Query (id=1f4d7a679a3e12d5:4223115700000000): Summary: Session ID: 91408890c21011a5:5e41b66c8838bc87 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2023-12-15 01:49:33.584643000 End Time: 2023-12-15 01:49:34.880213000 Duration: 1s295ms (1295570 us) Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.0.0.2023.0.19.0-22 RELEASE (build 1035747c39cde5575ba58410ee714b9ff8a5005e) User: csso_drorke Connected User: csso_drorke Delegated User: Network Address: 127.0.0.6:35057 Default Db: tpch_3000_parquet_external Sql Statement: select count(l_quantity) from lineitem Coordinator: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000 Query Options (set by configuration): RUNTIME_FILTER_WAIT_TIME_MS=10000,MAX_NUM_RUNTIME_FILTERS=50,MT_DOP=12,RUNTIME_FILTER_MIN_SIZE=8192,RUNTIME_FILTER_MAX_SIZE=2097152,TIMEZONE=Etc/UTC,CLIENT_IDENTIFIER=Impala Shell v4.1.0-RELEASE (b27a701) built on Tue Jun 7 21:31:56 PDT 2022,DEFAULT_FILE_FORMAT=PARQUET,DEFAULT_TRANSACTIONAL_TYPE=INSERT_ONLY,RETRY_FAILED_QUERIES=1,COMPUTE_PROCESSING_COST=1,MAX_FRAGMENT_INSTANCES_PER_NODE=12 Query Options (set by configuration and planner): RUNTIME_FILTER_WAIT_TIME_MS=10000,MAX_NUM_RUNTIME_FILTERS=50,MT_DOP=12,RUNTIME_FILTER_MIN_SIZE=8192,RUNTIME_FILTER_MAX_SIZE=2097152,TIMEZONE=Etc/UTC,CLIENT_IDENTIFIER=Impala Shell v4.1.0-RELEASE (b27a701) built on Tue Jun 7 21:31:56 PDT 2022,DEFAULT_FILE_FORMAT=PARQUET,SPOOL_QUERY_RESULTS=0,DEFAULT_TRANSACTIONAL_TYPE=INSERT_ONLY,RETRY_FAILED_QUERIES=1,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE,COMPUTE_PROCESSING_COST=1,MAX_FRAGMENT_INSTANCES_PER_NODE=12 Plan: ---------------- Max Per-Host Resource Reservation: Memory=48.00MB Threads=13 Per-Host Resource Estimates: Memory=192MB Dedicated Coordinator Resource Estimate: Memory=100MB Analyzed query: SELECT count(l_quantity) FROM tpch_3000_parquet_external.lineitem F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1 | max-parallelism=1 segment-costs=[2, 0] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))] PLAN-ROOT SINK | output exprs: count(l_quantity) | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0 | 03:AGGREGATE [FINALIZE] | output: count:merge(l_quantity) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 cost=1 | in pipelines: 03(GETNEXT), 01(OPEN) | 02:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 cost=1 | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Instance Resources: mem-estimate=16.02MB mem-reservation=4.00MB thread-reservation=1 max-parallelism=120 segment-costs=[18275573504, 1] 01:AGGREGATE | output: count(l_quantity) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 cost=18000048128 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN S3 [tpch_3000_parquet_external.lineitem, RANDOM] S3 partitions=1/1 files=2698 size=652.63GB stored statistics: table: rows=18.00G size=652.63GB columns: all extrapolated-rows=disabled max-scan-range-rows=6.83M mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=18.00G cost=275525376 in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 201555968 Request Pool: root.default Per Host Min Memory Reservation: impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(48.00 MB) coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(0) Per Host Number of Fragment Instances: impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(12) coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(1) Admission result: Admitted immediately Cluster Memory Admitted: 20.10 GB Executor Group: root.default-group-000 ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------------------- F01:ROOT 1 1 0.000ns 0.000ns 0 0 03:AGGREGATE 1 1 0.000ns 0.000ns 1 1 16.00 KB 16.00 KB FINALIZE 02:EXCHANGE 1 1 0.000ns 0.000ns 120 1 968.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 10 120 100.000us 4.000ms 16.03 KB 48.00 KB 01:AGGREGATE 10 120 334.802ms 424.003ms 120 1 25.00 KB 16.00 KB 00:SCAN S3 10 120 671.537ms 768.007ms 18.00B 18.00B 8.08 MB 16.00 MB tpch_3000_parquet_external.lineitem Errors: Query Compilation: 5.503ms - Metadata of all 1 tables cached: 1.077ms (1.077ms) - Analysis finished: 1.640ms (562.897us) - Authorization finished (ranger): 1.905ms (265.453us) - Value transfer graph computed: 2.136ms (230.533us) - Single node plan created: 3.909ms (1.773ms) - Runtime filters computed: 4.035ms (126.442us) - Distributed plan created: 4.060ms (24.286us) - Lineage info computed: 4.109ms (48.964us) - Parallel plans created: 4.119ms (10.248us) - Planning finished: 5.503ms (1.383ms) Query Timeline: 1s399ms - Query submitted: 0.000ns (0.000ns) - Planning finished: 7.999ms (7.999ms) - Submit for admission: 7.999ms (0.000ns) - Completed admission: 27.999ms (19.999ms) - Ready to start on 11 backends: 27.999ms (0.000ns) - All 11 execution backends (121 fragment instances) started: 31.999ms (3.999ms) - Rows available: 1s107ms (1s075ms) - First row fetched: 1s243ms (135.999ms) - Last row fetched: 1s295ms (51.999ms) - Released admission control resources: 1s295ms (0.000ns) - Unregister query: 1s399ms (103.999ms) - AdmissionControlTimeSinceLastUpdate: 15.000ms - ComputeScanRangeAssignmentTimer: 3.999ms Frontend: Referenced Tables: tpch_3000_parquet_external.lineitem - CatalogFetch.ColumnStats.Hits: 16 - CatalogFetch.ColumnStats.Misses: 0 - CatalogFetch.ColumnStats.Requests: 16 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 1 - CatalogFetch.PartitionLists.Misses: 0 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 2 - CatalogFetch.Partitions.Misses: 0 - CatalogFetch.Partitions.Requests: 2 - CatalogFetch.Partitions.Time: 0 - CatalogFetch.TableList.Hits: 1 - CatalogFetch.TableList.Misses: 0 - CatalogFetch.TableList.Requests: 1 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 1 - CatalogFetch.Tables.Misses: 0 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 0 - CpuCountDivisor: 1.00 - ExecutorGroupsConsidered: 1 (1) Executor group 1: Verdict: Match - CpuAsk: 120 (120) - CpuMax: 2.15B (2147483647) - EffectiveParallelism: 120 (120) - MemoryAsk: 1.88 GB (2015559680) - MemoryMax: 8589934592.00 GB (9223372036854775807) ImpalaServer: - ClientFetchWaitTimeStats: (Avg: 93.999ms ; Min: 51.999ms ; Max: 135.999ms ; Number of samples: 2) - ClientFetchWaitTimer: 187.999ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RPCCount: 13 (13) - RPCReadTimer: 21.000us - RPCWriteTimer: 493.000us - RowMaterializationRate: 0 - RowMaterializationTimer: 0.000ns Execution Profile 1f4d7a679a3e12d5:4223115700000000: Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 11, sum: 11ms, min / max: 0 / 2ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 2ms Slowest backend to start up: impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010 Per Node Peak Memory Usage: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(992.07 KB) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(97.38 MB) Per Node Bytes Read: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(0) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.28 GB) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.28 GB) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.28 GB) impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(1.29 GB) Per Node User Time: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(18.050ms) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s895ms) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s802ms) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s358ms) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s912ms) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s447ms) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s839ms) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s413ms) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s463ms) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s729ms) impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(11s524ms) Per Node System Time: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000(3.610ms) impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(43.638ms) impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(35.808ms) impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(31.854ms) impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(67.986ms) impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(51.837ms) impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(55.904ms) impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(56.082ms) impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(56.327ms) impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(40.224ms) impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010(59.759ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 11 (11) - NumCompletedBackends: 11 (11) - NumFragmentInstances: 121 (121) - NumFragments: 2 (2) - TotalBytesRead: 12.87 GB (13821333221) - TotalBytesSent: 1.41 KB (1440) - TotalCpuTime: 1m56s - TotalInnerBytesSent: 0 - TotalScanBytesSent: 1.41 KB (1440) Per Node Profiles: coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000: - AdmissionSlots: 1 (1) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F01: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 19.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 17.901ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - FunctionPruneTime: 3.999ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 3.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 1 (1) - NumInstructions: 14 (14) - NumOptimizedFunctions: 1 (1) - NumOptimizedInstructions: 6 (6) - OptimizationTime: 0.000ns - PeakMemoryUsage: 7.00 KB (7168) - PrepareTime: 15.999ms - TotalTime: 19.999ms impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.265ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.000ms - FunctionPruneTime: 4.000ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 12.000ms - TotalTime: 24.000ms impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.038ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - FunctionPruneTime: 4.000ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 3.697ms - CodegenUserTime: 22.185ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 8.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 3.729ms - CodegenUserTime: 22.375ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 8.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.533ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - FunctionPruneTime: 4.000ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.325ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 3.639ms - CodegenUserTime: 21.838ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 8.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 28.000ms impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.523ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 8.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 12.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 12.000ms - TotalTime: 24.000ms impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 3.565ms - CodegenUserTime: 21.395ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 3.999ms - FunctionPruneTime: 3.999ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 11.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 3.999ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 15.999ms - TotalTime: 27.999ms impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010: - AdmissionSlots: 12 (12) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 3.733ms - CodegenUserTime: 18.669ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.000ms - FunctionPruneTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 8.000ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 3.11 MB (3260124) - NumCachedFunctions: 0 (0) - NumFunctions: 8 (8) - NumInstructions: 170 (170) - NumOptimizedFunctions: 2 (2) - NumOptimizedInstructions: 108 (108) - OptimizationTime: 4.000ms - PeakMemoryUsage: 85.00 KB (87040) - PrepareTime: 16.000ms - TotalTime: 24.000ms Averaged Fragment F01:(Total: 1s215ms, non-child: 19.999ms, % non-child: 1.64%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1s223ms max:1s223ms mean: 1s223ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 1s223ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 992.00 KB (1015808) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 992.07 KB (1015877) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s059ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1s215ms - TotalThreadsSysTime: 3.610ms - TotalThreadsUserTime: 18.050ms - TotalThreadsVoluntaryContextSwitches: 120 (120) - TotalTime: 1s215ms Fragment Instance Lifecycle Timings: - ExecTime: 135.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s079ms - ExecTreeOpenTime: 1s059ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK:(Total: 135.999ms, non-child: 0.000ns, % non-child: 0.00%) - CreateResultSetTime: 0.000ns - InactiveTotalTime: 135.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 7.00 /sec - TotalTime: 135.999ms AGGREGATION_NODE (id=3):(Total: 1s059ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s059ms NonGroupingAggregator 0: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 1s059ms, non-child: 0.000ns, % non-child: 0.00%) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 1s059ms - PeakMemoryUsage: 968.00 KB (991232) - RowsReturned: 120 (120) - RowsReturnedRate: 113.00 /sec - TotalTime: 1s059ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 1.88 MB (1966080) - CumulativeAllocations: 240 (240) - EncryptionTime: 0.000ns - PeakReservation: 968.00 KB (991232) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 968.00 KB (991232) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 971.999ms - TotalBytesDequeued: 1.88 KB (1920) - TotalGetBatchTime: 1s059ms - DataWaitTime: 1s059ms Enqueue: - DispatchTime: (Avg: 15.216us ; Min: 10.451us ; Max: 57.979us ; Number of samples: 120) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 120 (120) - TotalBatchesReceived: 120 (120) - TotalBytesReceived: 1.41 KB (1440) - TotalEarlySenders: 0 (0) - TotalEosReceived: 120 (120) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) Coordinator Fragment F01: Instance 1f4d7a679a3e12d5:4223115700000000 (host=coordinator-0.coordinator-int.impala-1701977964-jz84.svc.cluster.local:27000): Last report received time: 2023-12-15 01:49:34.838 Fragment Instance Lifecycle Event Timeline: 1s215ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s079ms (1s079ms) - First Batch Produced: 1s079ms (0.000ns) - First Batch Sent: 1s215ms (135.999ms) - ExecInternal Finished: 1s215ms (0.000ns) - MemoryUsage (500.000ms): 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 1s223ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 992.00 KB (1015808) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 992.07 KB (1015877) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s059ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1s215ms - TotalThreadsSysTime: 3.610ms - TotalThreadsUserTime: 18.050ms - TotalThreadsVoluntaryContextSwitches: 120 (120) - TotalTime: 1s215ms Fragment Instance Lifecycle Timings: - ExecTime: 135.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s079ms - ExecTreeOpenTime: 1s059ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK: - CreateResultSetTime: 0.000ns - InactiveTotalTime: 135.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 7.00 /sec - TotalTime: 135.999ms AGGREGATION_NODE (id=3): Node Lifecycle Event Timeline: 1s215ms - Open Started: 19.999ms (19.999ms) - Open Finished: 1s079ms (1s059ms) - First Batch Requested: 1s079ms (0.000ns) - First Batch Returned: 1s079ms (0.000ns) - Last Batch Returned: 1s079ms (0.000ns) - Closed: 1s215ms (135.999ms) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s059ms NonGroupingAggregator 0: ExecOption: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2): Node Lifecycle Event Timeline: 1s079ms - Open Started: 19.999ms (19.999ms) - Open Finished: 991.999ms (971.999ms) - First Batch Requested: 991.999ms (0.000ns) - First Batch Returned: 1s079ms (87.999ms) - Last Batch Returned: 1s079ms (0.000ns) - Closed: 1s079ms (0.000ns) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 1s059ms - PeakMemoryUsage: 968.00 KB (991232) - RowsReturned: 120 (120) - RowsReturnedRate: 113.00 /sec - TotalTime: 1s059ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 1.88 MB (1966080) - CumulativeAllocations: 240 (240) - EncryptionTime: 0.000ns - PeakReservation: 968.00 KB (991232) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 968.00 KB (991232) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 971.999ms - TotalBytesDequeued: 1.88 KB (1920) - TotalGetBatchTime: 1s059ms - DataWaitTime: 1s059ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 15.216us ; Min: 10.451us ; Max: 57.979us ; Number of samples: 120) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 120 (120) - TotalBatchesReceived: 120 (120) - TotalBytesReceived: 1.41 KB (1440) - TotalEarlySenders: 0 (0) - TotalEosReceived: 120 (120) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) Averaged Fragment F00 [120 instances]:(Total: 1s033ms, non-child: 26.566ms, % non-child: 2.57%) split sizes: min: 4.96 GB, max: 5.70 GB, avg: 5.44 GB, stddev: 187.82 MB completion times: min:1s035ms max:1s091ms mean: 1s063ms stddev:19.610ms execution rates: min:4.57 GB/sec max:5.50 GB/sec mean:5.12 GB/sec stddev:200.60 MB/sec num instances: 120 - AverageThreadTokens: 1.00 - BytesAssigned: 5.44 GB (5839670100) - CompletionTime: 1s063ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.12 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508816) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105884) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 533.336us - TotalStorageWaitTime: 31.933ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s033ms - TotalThreadsSysTime: 4.161ms - TotalThreadsUserTime: 969.884ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s033ms Fragment Instance Lifecycle Timings [120 instances]: - ExecTime: 600.002us - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 1s006ms - PrepareTime: 133.334us - ExecTreePrepareTime: 66.667us KrpcDataStreamSender (dst_id=2) [120 instances]:(Total: 633.336us, non-child: 100.000us, % non-child: 15.79%) - NetworkThroughput: (Avg: 66.97 KB/sec ; Min: 20.85 KB/sec ; Max: 95.16 KB/sec ; Number of samples: 120) - RpcNetworkTime: (Avg: 191.565us ; Min: 107.705us ; Max: 562.116us ; Number of samples: 240) - RpcRecvrTime: (Avg: 18.304us ; Min: 10.615us ; Max: 76.858us ; Number of samples: 240) - EosSent: 1 (1) - InactiveTotalTime: 533.336us - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 33.333us - TotalBytesSent: 12.00 B (12) - TotalTime: 633.336us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1) [120 instances]:(Total: 1s006ms, non-child: 334.802ms, % non-child: 33.27%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s006ms NonGroupingAggregator 0 [120 instances]: - BuildTime: 264.734ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [120 instances]:(Total: 671.537ms, non-child: 671.537ms, % non-child: 100.00%) - ColumnarScannerActualReservation: (Avg: 8.00 MB (8383944) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 2698) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8189655) ; Min: 32.00 KB (32768) ; Max: 8.00 MB (8388608) ; Number of samples: 2698) - FooterProcessingTime: (Avg: 194.219us ; Min: 0.000ns ; Max: 8.000ms ; Number of samples: 2698) - InitialRangeActualReservation: (Avg: 7.82 MB (8197392) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 2698) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2698) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.60 MB (112829460) ; Min: 98.01 MB (102772999) ; Max: 126.61 MB (132759722) ; Number of samples: 120) - ParquetCompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 253.00 B (253) ; Max: 64.01 KB (65547) ; Number of samples: 208164) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.59 MB (112819051) ; Min: 98.00 MB (102763517) ; Max: 126.60 MB (132747474) ; Number of samples: 120) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65036) ; Min: 249.00 B (249) ; Max: 64.00 KB (65540) ; Number of samples: 208164) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.84 MB (115177776) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.84 MB (115177776) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 11.300ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.65 MB (112875483) - IoReadAsyncRequest: 3.51K (3514) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.65 MB (112875483) - IoReadTotalRequest: 3.51K (3514) - MaterializeTupleTime: 586.370ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.73K (1734) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467856) - PerReadThreadRawHdfsThroughput: 4.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.00M (150000402) - RowsReturned: 150.00M (150000402) - RowsReturnedRate: 224.31 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 31.933ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.133ms - TotalReadThroughput: 79.53 MB/sec - TotalTime: 671.537ms Buffer pool [120 instances]: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.41 MB (187077700) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: Instance 1f4d7a679a3e12d5:4223115700000026 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.40 GB Fragment Instance Lifecycle Event Timeline: 1s080ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s080ms (1s080ms) - First Batch Produced: 1s080ms (0.000ns) - First Batch Sent: 1s080ms (0.000ns) - ExecInternal Finished: 1s080ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.40 GB (5795746977) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.94 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s080ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 1s007ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s080ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s080ms - ExecTreeOpenTime: 1s052ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 78.52 KB/sec ; Min: 78.52 KB/sec ; Max: 78.52 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 128.472us ; Min: 107.705us ; Max: 149.240us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.730us ; Min: 15.688us ; Max: 25.773us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s080ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s080ms (1s052ms) - First Batch Requested: 1s080ms (0.000ns) - First Batch Returned: 1s080ms (0.000ns) - Last Batch Returned: 1s080ms (0.000ns) - Closed: 1s080ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s052ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s080ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s080ms (1s052ms) - Closed: 1s080ms (0.000ns) - BytesReadSeries (500.000ms): 30.83 MB, 80.84 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.70 MB (8069476) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.915us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.55 MB (113825148) ; Min: 108.55 MB (113825148) ; Max: 108.55 MB (113825148) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1750) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.54 MB (113814647) ; Min: 108.54 MB (113814647) ; Max: 108.54 MB (113814647) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65036) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1750) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.84 MB (116226865) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.84 MB (116226865) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.60 MB (113871665) - IoReadAsyncRequest: 3.55K (3546) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.60 MB (113871665) - IoReadTotalRequest: 3.55K (3546) - MaterializeTupleTime: 616.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.75K (1750) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.87 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 151.32M (151324108) - RowsReturned: 151.32M (151324108) - RowsReturnedRate: 214.95 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 80.84 MB/sec - TotalTime: 704.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.88 MB (188612608) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000030 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.22 GB Fragment Instance Lifecycle Event Timeline: 1s076ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s076ms (1s076ms) - First Batch Produced: 1s076ms (0.000ns) - First Batch Sent: 1s076ms (0.000ns) - ExecInternal Finished: 1s076ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.22 GB (5608840683) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.78 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s076ms - TotalThreadsSysTime: 3.975ms - TotalThreadsUserTime: 1s001ms - TotalThreadsVoluntaryContextSwitches: 67 (67) - TotalTime: 1s076ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s076ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 80.57 KB/sec ; Min: 80.57 KB/sec ; Max: 80.57 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 128.086us ; Min: 110.718us ; Max: 145.456us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.378us ; Min: 11.026us ; Max: 21.730us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s076ms (1s048ms) - First Batch Requested: 1s076ms (0.000ns) - First Batch Returned: 1s076ms (0.000ns) - Last Batch Returned: 1s076ms (0.000ns) - Closed: 1s076ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s048ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 316.004ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s076ms (1s048ms) - Closed: 1s076ms (0.000ns) - BytesReadSeries (500.000ms): 30.00 MB, 85.69 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.71 MB (8082773) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 113.30 MB (118806342) ; Min: 113.30 MB (118806342) ; Max: 113.30 MB (118806342) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65028) ; Min: 22.38 KB (22912) ; Max: 64.01 KB (65547) ; Number of samples: 1827) - ParquetUncompressedBytesReadPerColumn: (Avg: 113.29 MB (118795379) ; Min: 113.29 MB (118795379) ; Max: 113.29 MB (118795379) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65022) ; Min: 22.37 KB (22906) ; Max: 64.00 KB (65540) ; Number of samples: 1827) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.69 MB (121312502) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.69 MB (121312502) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 113.35 MB (118854902) - IoReadAsyncRequest: 3.70K (3702) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 113.35 MB (118854902) - IoReadTotalRequest: 3.70K (3702) - MaterializeTupleTime: 576.007ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.83K (1827) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.95M (157946331) - RowsReturned: 157.95M (157946331) - RowsReturnedRate: 243.74 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 85.69 MB/sec - TotalTime: 648.008ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 188.00 MB (197132288) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002c (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 1s076ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s076ms (1s076ms) - First Batch Produced: 1s076ms (0.000ns) - First Batch Sent: 1s076ms (0.000ns) - ExecInternal Finished: 1s076ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5864342109) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.00 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s076ms - TotalThreadsSysTime: 4.030ms - TotalThreadsUserTime: 991.585ms - TotalThreadsVoluntaryContextSwitches: 70 (70) - TotalTime: 1s076ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s076ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 71.15 KB/sec ; Min: 71.15 KB/sec ; Max: 71.15 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 172.330us ; Min: 164.700us ; Max: 179.960us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.940us ; Min: 11.234us ; Max: 22.647us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s076ms (1s048ms) - First Batch Requested: 1s076ms (0.000ns) - First Batch Returned: 1s076ms (0.000ns) - Last Batch Returned: 1s076ms (0.000ns) - Closed: 1s076ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s048ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s072ms (1s044ms) - Closed: 1s076ms (4.000ms) - BytesReadSeries (500.000ms): 25.01 MB, 80.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.820us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113061304) ; Min: 107.82 MB (113061304) ; Max: 107.82 MB (113061304) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65052) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113050876) ; Min: 107.81 MB (113050876) ; Max: 107.81 MB (113050876) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.02 MB (115360069) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.02 MB (115360069) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113107269) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113107269) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 596.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.84 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150308608) - RowsReturned: 150.31M (150308608) - RowsReturnedRate: 221.04 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 80.01 MB/sec - TotalTime: 680.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002b (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s076ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s076ms (1s076ms) - First Batch Produced: 1s076ms (0.000ns) - First Batch Sent: 1s076ms (0.000ns) - ExecInternal Finished: 1s076ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117399297) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 1s076ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1s010ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s076ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s076ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 95.16 KB/sec ; Min: 95.16 KB/sec ; Max: 95.16 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 144.894us ; Min: 123.153us ; Max: 166.635us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.388us ; Min: 11.175us ; Max: 17.602us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s076ms (1s048ms) - First Batch Requested: 1s076ms (0.000ns) - First Batch Returned: 1s076ms (0.000ns) - Last Batch Returned: 1s076ms (0.000ns) - Closed: 1s076ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s048ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 276.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s076ms (1s048ms) - Closed: 1s076ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 80.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.820us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113056336) ; Min: 107.82 MB (113056336) ; Max: 107.82 MB (113056336) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113045907) ; Min: 107.81 MB (113045907) ; Max: 107.81 MB (113045907) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115355103) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115355103) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113102303) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113102303) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 620.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150302013) - RowsReturned: 150.30M (150302013) - RowsReturnedRate: 205.33 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 80.01 MB/sec - TotalTime: 732.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000045 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s076ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s072ms (1s068ms) - First Batch Produced: 1s072ms (0.000ns) - First Batch Sent: 1s072ms (0.000ns) - ExecInternal Finished: 1s076ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851126850) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.99 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 1s072ms - TotalThreadsSysTime: 3.996ms - TotalThreadsUserTime: 999.025ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s072ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s068ms - ExecTreeOpenTime: 1s044ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 65.61 KB/sec ; Min: 65.61 KB/sec ; Max: 65.61 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 196.104us ; Min: 178.609us ; Max: 213.600us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.908us ; Min: 11.747us ; Max: 24.069us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s072ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s072ms (1s044ms) - First Batch Requested: 1s072ms (0.000ns) - First Batch Returned: 1s072ms (0.000ns) - Last Batch Returned: 1s072ms (0.000ns) - Closed: 1s072ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s044ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 264.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s072ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s072ms (1s040ms) - Closed: 1s072ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.914us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118197499) ; Min: 112.72 MB (118197499) ; Max: 112.72 MB (118197499) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118186595) ; Min: 112.71 MB (118186595) ; Max: 112.71 MB (118186595) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120600764) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120600764) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118245564) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118245564) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 596.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157136925) - RowsReturned: 157.14M (157136925) - RowsReturnedRate: 219.46 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 716.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000044 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 1s076ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s076ms (1s072ms) - First Batch Produced: 1s076ms (0.000ns) - First Batch Sent: 1s076ms (0.000ns) - ExecInternal Finished: 1s076ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5862450929) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.00 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s072ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1s005ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s072ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s072ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 66.79 KB/sec ; Min: 66.79 KB/sec ; Max: 66.79 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 189.903us ; Min: 175.464us ; Max: 204.342us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.129us ; Min: 11.038us ; Max: 19.221us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s076ms (1s048ms) - First Batch Requested: 1s076ms (0.000ns) - First Batch Returned: 1s076ms (0.000ns) - Last Batch Returned: 1s076ms (0.000ns) - Closed: 1s076ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s048ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 252.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s076ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s076ms (1s044ms) - Closed: 1s076ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.28 MB (117734581) ; Min: 112.28 MB (117734581) ; Max: 112.28 MB (117734581) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 21.82 KB (22340) ; Max: 64.00 KB (65534) ; Number of samples: 1810) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.27 MB (117723721) ; Min: 112.27 MB (117723721) ; Max: 112.27 MB (117723721) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65040) ; Min: 21.81 KB (22334) ; Max: 63.99 KB (65528) ; Number of samples: 1810) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.57 MB (120137682) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.57 MB (120137682) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.33 MB (117782482) - IoReadAsyncRequest: 3.67K (3666) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.33 MB (117782482) - IoReadTotalRequest: 3.67K (3666) - MaterializeTupleTime: 628.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1810) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 2.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.52M (156521507) - RowsReturned: 156.52M (156521507) - RowsReturnedRate: 218.60 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 44.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 716.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002d (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.24 GB Fragment Instance Lifecycle Event Timeline: 1s068ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s068ms (1s068ms) - First Batch Produced: 1s068ms (0.000ns) - First Batch Sent: 1s068ms (0.000ns) - ExecInternal Finished: 1s068ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.24 GB (5625436349) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.80 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s068ms - TotalThreadsSysTime: 3.997ms - TotalThreadsUserTime: 994.964ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s068ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s068ms - ExecTreeOpenTime: 1s040ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 76.19 KB/sec ; Min: 76.19 KB/sec ; Max: 76.19 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 139.520us ; Min: 125.235us ; Max: 153.806us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.588us ; Min: 11.331us ; Max: 19.846us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s068ms (1s040ms) - First Batch Requested: 1s068ms (0.000ns) - First Batch Returned: 1s068ms (0.000ns) - Last Batch Returned: 1s068ms (0.000ns) - Closed: 1s068ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s040ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s068ms (1s040ms) - Closed: 1s068ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 75.86 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.34 MB (7693356) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.915us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.57 MB (108604502) ; Min: 103.57 MB (108604502) ; Max: 103.57 MB (108604502) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65032) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1670) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.56 MB (108594481) ; Min: 103.56 MB (108594481) ; Max: 103.56 MB (108594481) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65026) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1670) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.86 MB (111004380) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.86 MB (111004380) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.62 MB (108649180) - IoReadAsyncRequest: 3.39K (3386) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.62 MB (108649180) - IoReadTotalRequest: 3.39K (3386) - MaterializeTupleTime: 656.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.67K (1670) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 144.38M (144383556) - RowsReturned: 144.38M (144383556) - RowsReturnedRate: 195.11 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 75.86 MB/sec - TotalTime: 740.010ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.62 MB (179961856) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000025 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s068ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s064ms (1s064ms) - First Batch Produced: 1s064ms (0.000ns) - First Batch Sent: 1s064ms (0.000ns) - ExecInternal Finished: 1s068ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117045499) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s068ms - TotalThreadsSysTime: 8.064ms - TotalThreadsUserTime: 1s020ms - TotalThreadsVoluntaryContextSwitches: 59 (59) - TotalTime: 1s068ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 64.81 KB/sec ; Min: 64.81 KB/sec ; Max: 64.81 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 170.058us ; Min: 159.314us ; Max: 180.803us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.254us ; Min: 15.489us ; Max: 37.020us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s064ms (1s036ms) - First Batch Requested: 1s064ms (0.000ns) - First Batch Returned: 1s064ms (0.000ns) - Last Batch Returned: 1s064ms (0.000ns) - Closed: 1s064ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 344.004ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s064ms (1s036ms) - Closed: 1s064ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.68 MB (8050005) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 333.337us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.96 MB (118442854) ; Min: 112.96 MB (118442854) ; Max: 112.96 MB (118442854) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.47 KB (28128) ; Max: 64.01 KB (65547) ; Number of samples: 1821) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.95 MB (118431927) ; Min: 112.95 MB (118431927) ; Max: 112.95 MB (118431927) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65036) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1821) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.35 MB (120948877) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.35 MB (120948877) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 113.00 MB (118491277) - IoReadAsyncRequest: 3.69K (3690) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 113.00 MB (118491277) - IoReadTotalRequest: 3.69K (3690) - MaterializeTupleTime: 540.007ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1821) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.46M (157463126) - RowsReturned: 157.46M (157463126) - RowsReturnedRate: 247.58 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 636.008ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.25 MB (196345856) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000041 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s068ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s068ms (1s064ms) - First Batch Produced: 1s068ms (0.000ns) - First Batch Sent: 1s068ms (0.000ns) - ExecInternal Finished: 1s068ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117077792) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 52.000ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 4.025ms - TotalThreadsUserTime: 990.072ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s068ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s040ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 67.43 KB/sec ; Min: 67.43 KB/sec ; Max: 67.43 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 193.687us ; Min: 173.781us ; Max: 213.594us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.126us ; Min: 17.280us ; Max: 22.973us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s068ms (1s040ms) - First Batch Requested: 1s068ms (0.000ns) - First Batch Returned: 1s068ms (0.000ns) - Last Batch Returned: 1s068ms (0.000ns) - Closed: 1s068ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s040ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 236.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s068ms (1s036ms) - Closed: 1s068ms (0.000ns) - BytesReadSeries (500.000ms): 39.86 MB, 95.16 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8035283) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.829us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.88 MB (113116384) ; Min: 107.88 MB (113116384) ; Max: 107.88 MB (113116384) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.49 KB (65009) ; Min: 10.34 KB (10590) ; Max: 64.00 KB (65540) ; Number of samples: 1740) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.87 MB (113105946) ; Min: 107.87 MB (113105946) ; Max: 107.87 MB (113105946) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.48 KB (65003) ; Min: 10.34 KB (10585) ; Max: 64.00 KB (65534) ; Number of samples: 1740) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.17 MB (115517863) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.17 MB (115517863) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.92 MB (113162663) - IoReadAsyncRequest: 3.53K (3526) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.92 MB (113162663) - IoReadTotalRequest: 3.53K (3526) - MaterializeTupleTime: 612.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1740) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.99 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.38M (150381839) - RowsReturned: 150.38M (150381839) - RowsReturnedRate: 195.81 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 52.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 95.16 MB/sec - TotalTime: 768.007ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.12 MB (187826176) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000040 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.22 GB Fragment Instance Lifecycle Event Timeline: 1s068ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s068ms (1s064ms) - First Batch Produced: 1s068ms (0.000ns) - First Batch Sent: 1s068ms (0.000ns) - ExecInternal Finished: 1s068ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.22 GB (5605511687) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.78 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 3.946ms - TotalThreadsUserTime: 990.065ms - TotalThreadsVoluntaryContextSwitches: 67 (67) - TotalTime: 1s068ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s040ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 78.40 KB/sec ; Min: 78.40 KB/sec ; Max: 78.40 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 181.063us ; Min: 149.473us ; Max: 212.653us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.473us ; Min: 11.181us ; Max: 17.765us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s068ms (1s040ms) - First Batch Requested: 1s068ms (0.000ns) - First Batch Returned: 1s068ms (0.000ns) - Last Batch Returned: 1s068ms (0.000ns) - Closed: 1s068ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s044ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 296.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s068ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s068ms (1s036ms) - Closed: 1s068ms (0.000ns) - BytesReadSeries (500.000ms): 50.00 MB, 104.85 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 320.003us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 122.36 MB (128305082) ; Min: 122.36 MB (128305082) ; Max: 122.36 MB (128305082) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65063) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1972) - ParquetUncompressedBytesReadPerColumn: (Avg: 122.35 MB (128293248) ; Min: 122.35 MB (128293248) ; Max: 122.35 MB (128293248) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65057) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1972) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 124.85 MB (130917243) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 124.85 MB (130917243) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 122.41 MB (128357243) - IoReadAsyncRequest: 3.99K (3994) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 122.41 MB (128357243) - IoReadTotalRequest: 3.99K (3994) - MaterializeTupleTime: 540.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.97K (1972) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 6.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 170.57M (170574382) - RowsReturned: 170.57M (170574382) - RowsReturnedRate: 268.20 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 104.85 MB/sec - TotalTime: 636.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 203.12 MB (212992000) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002f (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s064ms (1s064ms) - First Batch Produced: 1s064ms (0.000ns) - First Batch Sent: 1s064ms (0.000ns) - ExecInternal Finished: 1s064ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851238104) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.99 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 19.932ms - TotalThreadsUserTime: 972.690ms - TotalThreadsVoluntaryContextSwitches: 69 (69) - TotalTime: 1s064ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 75.18 KB/sec ; Min: 75.18 KB/sec ; Max: 75.18 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 144.188us ; Min: 132.504us ; Max: 155.872us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.616us ; Min: 11.572us ; Max: 21.661us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s064ms (1s036ms) - First Batch Requested: 1s064ms (0.000ns) - First Batch Returned: 1s064ms (0.000ns) - Last Batch Returned: 1s064ms (0.000ns) - Closed: 1s064ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 332.004ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s064ms (1s036ms) - Closed: 1s064ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 83.75 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 320.004us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 120.57 MB (126429044) ; Min: 120.57 MB (126429044) ; Max: 120.57 MB (126429044) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65035) ; Min: 13.63 KB (13953) ; Max: 64.01 KB (65547) ; Number of samples: 1944) - ParquetUncompressedBytesReadPerColumn: (Avg: 120.56 MB (126417379) ; Min: 120.56 MB (126417379) ; Max: 120.56 MB (126417379) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65029) ; Min: 13.62 KB (13948) ; Max: 64.00 KB (65540) ; Number of samples: 1944) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 123.06 MB (129040561) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 123.06 MB (129040561) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 120.62 MB (126480561) - IoReadAsyncRequest: 3.94K (3938) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 120.62 MB (126480561) - IoReadTotalRequest: 3.94K (3938) - MaterializeTupleTime: 556.007ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.94K (1944) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.76 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 168.08M (168080280) - RowsReturned: 168.08M (168080280) - RowsReturnedRate: 256.22 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 83.75 MB/sec - TotalTime: 656.008ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 199.12 MB (208797696) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003d (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.23 GB Fragment Instance Lifecycle Event Timeline: 1s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s064ms (1s064ms) - First Batch Produced: 1s064ms (0.000ns) - First Batch Sent: 1s064ms (0.000ns) - ExecInternal Finished: 1s064ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.23 GB (5615553456) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.79 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1s029ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s064ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 63.70 KB/sec ; Min: 63.70 KB/sec ; Max: 63.70 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 209.041us ; Min: 183.966us ; Max: 234.117us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.775us ; Min: 11.073us ; Max: 18.478us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s064ms (1s036ms) - First Batch Requested: 1s064ms (0.000ns) - First Batch Returned: 1s064ms (0.000ns) - Last Batch Returned: 1s064ms (0.000ns) - Closed: 1s064ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 264.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s064ms (1s032ms) - Closed: 1s064ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107916288) ; Min: 102.92 MB (107916288) ; Max: 102.92 MB (107916288) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107906334) ; Min: 102.91 MB (107906334) ; Max: 102.91 MB (107906334) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110110572) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110110572) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107960172) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107960172) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 624.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143468642) - RowsReturned: 143.47M (143468642) - RowsReturnedRate: 201.50 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 712.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000016 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.30 GB Fragment Instance Lifecycle Event Timeline: 1s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s064ms (1s064ms) - First Batch Produced: 1s064ms (0.000ns) - First Batch Sent: 1s064ms (0.000ns) - ExecInternal Finished: 1s064ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.30 GB (5690801842) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.91 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1s000ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s064ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 79.70 KB/sec ; Min: 79.70 KB/sec ; Max: 79.70 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 201.401us ; Min: 147.031us ; Max: 255.772us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.428us ; Min: 10.994us ; Max: 17.863us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s064ms (1s036ms) - First Batch Requested: 1s064ms (0.000ns) - First Batch Returned: 1s064ms (0.000ns) - Last Batch Returned: 1s064ms (0.000ns) - Closed: 1s064ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 276.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s064ms (1s032ms) - Closed: 1s064ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.00 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 761.911us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.38 MB (106299681) ; Min: 101.38 MB (106299681) ; Max: 101.38 MB (106299681) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65054) ; Min: 27.44 KB (28098) ; Max: 64.01 KB (65547) ; Number of samples: 1634) - ParquetUncompressedBytesReadPerColumn: (Avg: 101.37 MB (106289875) ; Min: 101.37 MB (106289875) ; Max: 101.37 MB (106289875) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.43 KB (28092) ; Max: 64.00 KB (65540) ; Number of samples: 1634) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 103.47 MB (108493381) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.47 MB (108493381) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 101.42 MB (106342981) - IoReadAsyncRequest: 3.31K (3310) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 101.42 MB (106342981) - IoReadTotalRequest: 3.31K (3310) - MaterializeTupleTime: 620.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.63K (1634) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 141.32M (141319407) - RowsReturned: 141.32M (141319407) - RowsReturnedRate: 207.82 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 65.00 MB/sec - TotalTime: 680.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.62 MB (174718976) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000f (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.43 GB Fragment Instance Lifecycle Event Timeline: 1s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s064ms (1s064ms) - First Batch Produced: 1s064ms (0.000ns) - First Batch Sent: 1s064ms (0.000ns) - ExecInternal Finished: 1s064ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.43 GB (5830683370) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.03 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 12.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 1s064ms - TotalThreadsSysTime: 3.920ms - TotalThreadsUserTime: 995.675ms - TotalThreadsVoluntaryContextSwitches: 69 (69) - TotalTime: 1s064ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s064ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 51.18 KB/sec ; Min: 51.18 KB/sec ; Max: 51.18 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 168.706us ; Min: 108.447us ; Max: 228.966us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.396us ; Min: 10.751us ; Max: 18.042us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s064ms (1s036ms) - First Batch Requested: 1s064ms (0.000ns) - First Batch Returned: 1s064ms (0.000ns) - Last Batch Returned: 1s064ms (0.000ns) - Closed: 1s064ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s064ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s064ms (1s032ms) - Closed: 1s064ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 70.74 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.08 MB (7426539) ; Min: 64.00 KB (65536) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.78 MB (113015253) ; Min: 107.78 MB (113015253) ; Max: 107.78 MB (113015253) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.46 KB (64988) ; Min: 11.62 KB (11902) ; Max: 64.01 KB (65547) ; Number of samples: 1739) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.77 MB (113004819) ; Min: 107.77 MB (113004819) ; Max: 107.77 MB (113004819) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.46 KB (64982) ; Min: 11.62 KB (11897) ; Max: 64.00 KB (65540) ; Number of samples: 1739) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.27 MB (115622060) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.27 MB (115622060) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.82 MB (113062060) - IoReadAsyncRequest: 3.53K (3528) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.82 MB (113062060) - IoReadTotalRequest: 3.53K (3528) - MaterializeTupleTime: 600.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1739) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 8.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.25M (150247355) - RowsReturned: 150.25M (150247355) - RowsReturnedRate: 223.58 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 12.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 70.74 MB/sec - TotalTime: 672.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 180.19 MB (188940288) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000069 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s063ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s059ms (1s059ms) - First Batch Produced: 1s059ms (0.000ns) - First Batch Sent: 1s059ms (0.000ns) - ExecInternal Finished: 1s063ms (3.999ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851410824) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.06 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 35.999ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s063ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1s001ms - TotalThreadsVoluntaryContextSwitches: 67 (67) - TotalTime: 1s063ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s059ms - ExecTreeOpenTime: 1s031ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 81.57 KB/sec ; Min: 81.57 KB/sec ; Max: 81.57 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 183.512us ; Min: 143.669us ; Max: 223.356us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.590us ; Min: 10.967us ; Max: 20.213us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 3.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s059ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s059ms (1s031ms) - First Batch Requested: 1s059ms (0.000ns) - First Batch Returned: 1s059ms (0.000ns) - Last Batch Returned: 1s059ms (0.000ns) - Closed: 1s059ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s031ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 267.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s059ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s059ms (1s027ms) - Closed: 1s059ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 64.56 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 380.951us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.47 MB (107445714) ; Min: 102.47 MB (107445714) ; Max: 102.47 MB (107445714) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65039) ; Min: 15.37 KB (15740) ; Max: 64.00 KB (65540) ; Number of samples: 1652) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.46 MB (107435803) ; Min: 102.46 MB (107435803) ; Max: 102.46 MB (107435803) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65033) ; Min: 15.37 KB (15735) ; Max: 64.00 KB (65534) ; Number of samples: 1652) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.56 MB (109639828) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.56 MB (109639828) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 15.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.51 MB (107489428) - IoReadAsyncRequest: 3.35K (3346) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.51 MB (107489428) - IoReadTotalRequest: 3.35K (3346) - MaterializeTupleTime: 627.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1652) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.84M (142843023) - RowsReturned: 142.84M (142843023) - RowsReturnedRate: 201.76 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 35.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.999ms - TotalReadThroughput: 64.56 MB/sec - TotalTime: 707.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002e (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/4.99 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s056ms (1s056ms) - First Batch Produced: 1s056ms (0.000ns) - First Batch Sent: 1s056ms (0.000ns) - ExecInternal Finished: 1s060ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 4.99 GB (5352662248) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.57 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 4.032ms - TotalThreadsUserTime: 992.024ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 80.43 KB/sec ; Min: 80.43 KB/sec ; Max: 80.43 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 150.118us ; Min: 145.692us ; Max: 154.544us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.008us ; Min: 14.189us ; Max: 17.828us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s056ms (1s028ms) - First Batch Requested: 1s056ms (0.000ns) - First Batch Returned: 1s056ms (0.000ns) - Last Batch Returned: 1s056ms (0.000ns) - Closed: 1s056ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s028ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s056ms (1s028ms) - Closed: 1s056ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 74.22 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.13 MB (107089296) ; Min: 102.13 MB (107089296) ; Max: 102.13 MB (107089296) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65060) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1646) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.12 MB (107079418) ; Min: 102.12 MB (107079418) ; Max: 102.12 MB (107079418) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65054) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1646) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.22 MB (109283275) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.22 MB (109283275) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 28.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.17 MB (107132875) - IoReadAsyncRequest: 3.33K (3334) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.17 MB (107132875) - IoReadTotalRequest: 3.33K (3334) - MaterializeTupleTime: 628.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1646) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.63 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.37M (142369189) - RowsReturned: 142.37M (142369189) - RowsReturnedRate: 194.49 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 74.22 MB/sec - TotalTime: 732.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000011 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5865700582) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.06 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508802) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 4.009ms - TotalThreadsUserTime: 990.230ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 81.78 KB/sec ; Min: 81.78 KB/sec ; Max: 81.78 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 129.074us ; Min: 114.852us ; Max: 143.298us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.761us ; Min: 11.220us ; Max: 18.303us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s060ms (1s032ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s032ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s060ms (1s028ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.668us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 117.62 MB (123334404) ; Min: 117.62 MB (123334404) ; Max: 117.62 MB (123334404) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.47 KB (28128) ; Max: 63.99 KB (65528) ; Number of samples: 1896) - ParquetUncompressedBytesReadPerColumn: (Avg: 117.61 MB (123323028) ; Min: 117.61 MB (123323028) ; Max: 117.61 MB (123323028) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.46 KB (28122) ; Max: 63.99 KB (65522) ; Number of samples: 1896) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 120.01 MB (125842149) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 120.01 MB (125842149) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 117.67 MB (123384549) - IoReadAsyncRequest: 3.84K (3840) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 117.67 MB (123384549) - IoReadTotalRequest: 3.84K (3840) - MaterializeTupleTime: 572.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.90K (1896) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467842) - PerReadThreadRawHdfsThroughput: 3.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 163.97M (163966135) - RowsReturned: 163.97M (163966135) - RowsReturnedRate: 244.00 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 672.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 195.00 MB (204472320) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000013 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851244072) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.05 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 996.142ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 90.63 KB/sec ; Min: 90.63 KB/sec ; Max: 90.63 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 121.965us ; Min: 114.623us ; Max: 129.308us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.401us ; Min: 11.095us ; Max: 17.708us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s060ms (1s032ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s032ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 304.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s060ms (1s028ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 75.87 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.40 MB (7764705) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 160.001us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 113.39 MB (118893294) ; Min: 113.39 MB (118893294) ; Max: 113.39 MB (118893294) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65040) ; Min: 27.45 KB (28104) ; Max: 64.01 KB (65547) ; Number of samples: 1828) - ParquetUncompressedBytesReadPerColumn: (Avg: 113.38 MB (118882324) ; Min: 113.38 MB (118882324) ; Max: 113.38 MB (118882324) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65034) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65540) ; Number of samples: 1828) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.87 MB (121502147) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.87 MB (121502147) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 113.43 MB (118942147) - IoReadAsyncRequest: 3.71K (3706) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 113.43 MB (118942147) - IoReadTotalRequest: 3.71K (3706) - MaterializeTupleTime: 588.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.83K (1828) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 158.06M (158061927) - RowsReturned: 158.06M (158061927) - RowsReturnedRate: 246.97 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 75.87 MB/sec - TotalTime: 640.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 188.25 MB (197394432) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000002 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117178928) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.33 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 3.982ms - TotalThreadsUserTime: 1s003ms - TotalThreadsVoluntaryContextSwitches: 54 (54) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 93.78 KB/sec ; Min: 93.78 KB/sec ; Max: 93.78 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 132.850us ; Min: 124.961us ; Max: 140.739us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.013us ; Min: 10.615us ; Max: 23.412us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s060ms (1s036ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s060ms (1s036ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113062375) ; Min: 107.82 MB (113062375) ; Max: 107.82 MB (113062375) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65053) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113051947) ; Min: 107.81 MB (113051947) ; Max: 107.81 MB (113051947) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.02 MB (115361144) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.02 MB (115361144) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113108344) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113108344) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 648.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 6.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150310064) - RowsReturned: 150.31M (150310064) - RowsReturnedRate: 213.51 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 704.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000009 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.21 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.21 GB (5598804279) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.88 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16.000ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 11.779ms - TotalThreadsUserTime: 989.249ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 77.72 KB/sec ; Min: 77.72 KB/sec ; Max: 77.72 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 131.416us ; Min: 112.053us ; Max: 150.780us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.129us ; Min: 11.012us ; Max: 19.246us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s060ms (1s036ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 300.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s060ms (1s036ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8035283) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.06 MB (113311597) ; Min: 108.06 MB (113311597) ; Max: 108.06 MB (113311597) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1742) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.05 MB (113301144) ; Min: 108.05 MB (113301144) ; Max: 108.05 MB (113301144) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65040) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1742) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.35 MB (115713127) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.35 MB (115713127) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.11 MB (113357927) - IoReadAsyncRequest: 3.53K (3530) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.11 MB (113357927) - IoReadTotalRequest: 3.53K (3530) - MaterializeTupleTime: 580.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1742) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 8.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.64M (150641381) - RowsReturned: 150.64M (150641381) - RowsReturnedRate: 229.64 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 16.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 656.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.12 MB (187826176) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000005 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.41 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.41 GB (5805092147) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.06 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 3.978ms - TotalThreadsUserTime: 1s002ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 88.38 KB/sec ; Min: 88.38 KB/sec ; Max: 88.38 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 134.064us ; Min: 132.591us ; Max: 135.537us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.846us ; Min: 13.688us ; Max: 18.005us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s060ms (1s036ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 272.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s060ms (1s036ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 75.13 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.65 MB (8025310) ; Min: 32.00 KB (32768) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.84 MB (113081805) ; Min: 107.84 MB (113081805) ; Max: 107.84 MB (113081805) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65026) ; Min: 25.18 KB (25789) ; Max: 64.01 KB (65547) ; Number of samples: 1739) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.83 MB (113071370) ; Min: 107.83 MB (113071370) ; Max: 107.83 MB (113071370) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65020) ; Min: 25.18 KB (25783) ; Max: 64.00 KB (65540) ; Number of samples: 1739) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.13 MB (115483272) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.13 MB (115483272) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.89 MB (113128072) - IoReadAsyncRequest: 3.52K (3524) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.89 MB (113128072) - IoReadTotalRequest: 3.52K (3524) - MaterializeTupleTime: 624.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1739) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.34M (150335872) - RowsReturned: 150.34M (150335872) - RowsReturnedRate: 217.25 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 75.13 MB/sec - TotalTime: 692.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.91 MB (187596800) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000004 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.51 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s060ms (1s060ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.51 GB (5917896131) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.16 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 999.287ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s060ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 1s036ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 91.88 KB/sec ; Min: 91.88 KB/sec ; Max: 91.88 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 128.360us ; Min: 127.540us ; Max: 129.181us ; Number of samples: 2) - RpcRecvrTime: (Avg: 13.923us ; Min: 10.789us ; Max: 17.057us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s060ms (1s036ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s036ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s060ms (1s036ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 79.54 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.26 MB (117709602) ; Min: 112.26 MB (117709602) ; Max: 112.26 MB (117709602) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65068) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1809) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.25 MB (117698748) ; Min: 112.25 MB (117698748) ; Max: 112.25 MB (117698748) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.54 KB (65062) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1809) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.55 MB (120112675) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.55 MB (120112675) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.30 MB (117757475) - IoReadAsyncRequest: 3.66K (3664) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.30 MB (117757475) - IoReadTotalRequest: 3.66K (3664) - MaterializeTupleTime: 580.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1809) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 9.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.49M (156488278) - RowsReturned: 156.49M (156488278) - RowsReturnedRate: 247.61 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 79.54 MB/sec - TotalTime: 632.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000066 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s059ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s059ms (1s059ms) - First Batch Produced: 1s059ms (0.000ns) - First Batch Sent: 1s059ms (0.000ns) - ExecInternal Finished: 1s059ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117517238) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.29 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 39.999ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s059ms - TotalThreadsSysTime: 4.014ms - TotalThreadsUserTime: 987.531ms - TotalThreadsVoluntaryContextSwitches: 69 (69) - TotalTime: 1s059ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s059ms - ExecTreeOpenTime: 1s031ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 81.83 KB/sec ; Min: 81.83 KB/sec ; Max: 81.83 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 172.752us ; Min: 143.212us ; Max: 202.292us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.171us ; Min: 19.551us ; Max: 20.791us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s059ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s059ms (1s031ms) - First Batch Requested: 1s059ms (0.000ns) - First Batch Returned: 1s059ms (0.000ns) - Last Batch Returned: 1s059ms (0.000ns) - Closed: 1s059ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s031ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 307.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s059ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s059ms (1s027ms) - Closed: 1s059ms (0.000ns) - BytesReadSeries (500.000ms): 13.79 MB, 78.79 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 120.53 MB (126388419) ; Min: 120.53 MB (126388419) ; Max: 120.53 MB (126388419) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.49 KB (65014) ; Min: 253.00 B (253) ; Max: 64.01 KB (65547) ; Number of samples: 1944) - ParquetUncompressedBytesReadPerColumn: (Avg: 120.52 MB (126376757) ; Min: 120.52 MB (126376757) ; Max: 120.52 MB (126376757) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.48 KB (65008) ; Min: 249.00 B (249) ; Max: 64.00 KB (65540) ; Number of samples: 1944) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 123.02 MB (128999934) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 123.02 MB (128999934) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 31.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 120.58 MB (126439934) - IoReadAsyncRequest: 3.94K (3938) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 120.58 MB (126439934) - IoReadTotalRequest: 3.94K (3938) - MaterializeTupleTime: 527.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.94K (1944) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.00 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 168.03M (168026253) - RowsReturned: 168.03M (168026253) - RowsReturnedRate: 265.86 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 39.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 39.999ms - TotalReadThroughput: 78.79 MB/sec - TotalTime: 631.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 199.12 MB (208797696) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000002a (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s056ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s056ms (1s056ms) - First Batch Produced: 1s056ms (0.000ns) - First Batch Sent: 1s056ms (0.000ns) - ExecInternal Finished: 1s056ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5856496231) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.99 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 48.000ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s056ms - TotalThreadsSysTime: 8.071ms - TotalThreadsUserTime: 980.714ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s056ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 70.63 KB/sec ; Min: 70.63 KB/sec ; Max: 70.63 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 143.741us ; Min: 121.572us ; Max: 165.911us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.288us ; Min: 14.018us ; Max: 20.559us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s056ms (1s028ms) - First Batch Requested: 1s056ms (0.000ns) - First Batch Returned: 1s056ms (0.000ns) - Last Batch Returned: 1s056ms (0.000ns) - Closed: 1s056ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s028ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 248.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s056ms (1s028ms) - Closed: 1s056ms (0.000ns) - BytesReadSeries (500.000ms): 25.00 MB, 75.51 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.68 MB (8054970) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.641us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.32 MB (108337986) ; Min: 103.32 MB (108337986) ; Max: 103.32 MB (108337986) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65028) ; Min: 13.51 KB (13839) ; Max: 64.00 KB (65540) ; Number of samples: 1666) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.31 MB (108327991) ; Min: 103.31 MB (108327991) ; Max: 103.31 MB (108327991) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65022) ; Min: 13.51 KB (13834) ; Max: 64.00 KB (65534) ; Number of samples: 1666) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.51 MB (110635098) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.51 MB (110635098) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.36 MB (108382298) - IoReadAsyncRequest: 3.38K (3376) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.36 MB (108382298) - IoReadTotalRequest: 3.38K (3376) - MaterializeTupleTime: 640.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.67K (1666) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 144.03M (144029238) - RowsReturned: 144.03M (144029238) - RowsReturnedRate: 197.84 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 48.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 44.000ms - TotalReadThroughput: 75.51 MB/sec - TotalTime: 728.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.75 MB (180092928) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000043 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.38 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s060ms (1s056ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.38 GB (5774025927) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.92 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 48.000ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 1s056ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 996.566ms - TotalThreadsVoluntaryContextSwitches: 54 (54) - TotalTime: 1s056ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 61.02 KB/sec ; Min: 61.02 KB/sec ; Max: 61.02 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 197.594us ; Min: 192.034us ; Max: 203.154us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.718us ; Min: 11.188us ; Max: 20.248us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s060ms (1s032ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s032ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s060ms (1s028ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.91 MB (107913172) ; Min: 102.91 MB (107913172) ; Max: 102.91 MB (107913172) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.90 MB (107903218) ; Min: 102.90 MB (107903218) ; Max: 102.90 MB (107903218) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.45 KB (28110) ; Max: 63.99 KB (65528) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110107447) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110107447) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107957047) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107957047) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 564.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 2.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.46M (143464482) - RowsReturned: 143.46M (143464482) - RowsReturnedRate: 220.04 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 48.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 40.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 652.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000047 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s060ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s060ms (1s056ms) - First Batch Produced: 1s060ms (0.000ns) - First Batch Sent: 1s060ms (0.000ns) - ExecInternal Finished: 1s060ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851084375) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.99 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s056ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 991.150ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s056ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 79.46 KB/sec ; Min: 79.46 KB/sec ; Max: 79.46 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 182.795us ; Min: 147.487us ; Max: 218.103us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.911us ; Min: 11.807us ; Max: 18.015us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s060ms (1s032ms) - First Batch Requested: 1s060ms (0.000ns) - First Batch Returned: 1s060ms (0.000ns) - Last Batch Returned: 1s060ms (0.000ns) - Closed: 1s060ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s032ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 204.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s060ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s060ms (1s028ms) - Closed: 1s060ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.819us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113057126) ; Min: 107.82 MB (113057126) ; Max: 107.82 MB (113057126) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113046695) ; Min: 107.81 MB (113046695) ; Max: 107.81 MB (113046695) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115355897) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115355897) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 32.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113103097) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113103097) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 612.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150303072) - RowsReturned: 150.30M (150303072) - RowsReturnedRate: 204.21 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 40.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 736.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000010 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.65 GB Fragment Instance Lifecycle Event Timeline: 1s056ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s056ms (1s056ms) - First Batch Produced: 1s056ms (0.000ns) - First Batch Sent: 1s056ms (0.000ns) - ExecInternal Finished: 1s056ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.65 GB (6065174469) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.23 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s056ms - TotalThreadsSysTime: 7.943ms - TotalThreadsUserTime: 988.881ms - TotalThreadsVoluntaryContextSwitches: 49 (49) - TotalTime: 1s056ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 79.48 KB/sec ; Min: 79.48 KB/sec ; Max: 79.48 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 131.346us ; Min: 115.252us ; Max: 147.441us ; Number of samples: 2) - RpcRecvrTime: (Avg: 19.406us ; Min: 12.811us ; Max: 26.001us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s056ms (1s028ms) - First Batch Requested: 1s056ms (0.000ns) - First Batch Returned: 1s056ms (0.000ns) - Last Batch Returned: 1s056ms (0.000ns) - Closed: 1s056ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s028ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 284.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s056ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s052ms (1s020ms) - Closed: 1s056ms (4.000ms) - BytesReadSeries (500.000ms): 15.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107918525) ; Min: 102.92 MB (107918525) ; Max: 102.92 MB (107918525) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107908571) ; Min: 102.91 MB (107908571) ; Max: 102.91 MB (107908571) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.46 KB (28116) ; Max: 63.99 KB (65528) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110112814) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110112814) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107962414) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107962414) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 608.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 5.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143471607) - RowsReturned: 143.47M (143471607) - RowsReturnedRate: 216.07 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 664.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000007 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s056ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s056ms (1s056ms) - First Batch Produced: 1s056ms (0.000ns) - First Batch Sent: 1s056ms (0.000ns) - ExecInternal Finished: 1s056ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851272341) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s056ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 996.144ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s056ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s056ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 76.71 KB/sec ; Min: 76.71 KB/sec ; Max: 76.71 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 133.114us ; Min: 113.453us ; Max: 152.775us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.559us ; Min: 10.851us ; Max: 18.268us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s056ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s056ms (1s032ms) - First Batch Requested: 1s056ms (0.000ns) - First Batch Returned: 1s056ms (0.000ns) - Last Batch Returned: 1s056ms (0.000ns) - Closed: 1s056ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s032ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 236.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s056ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s056ms (1s032ms) - Closed: 1s056ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113057952) ; Min: 107.82 MB (113057952) ; Max: 107.82 MB (113057952) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.47 KB (28128) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113047524) ; Min: 107.81 MB (113047524) ; Max: 107.81 MB (113047524) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115356719) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115356719) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113103919) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113103919) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 640.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.84 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150304203) - RowsReturned: 150.30M (150304203) - RowsReturnedRate: 204.22 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 736.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000064 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s055ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s055ms (1s055ms) - First Batch Produced: 1s055ms (0.000ns) - First Batch Sent: 1s055ms (0.000ns) - ExecInternal Finished: 1s055ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117198947) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.29 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 39.999ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 1s055ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 993.449ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s055ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s055ms - ExecTreeOpenTime: 1s027ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 86.24 KB/sec ; Min: 86.24 KB/sec ; Max: 86.24 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 189.381us ; Min: 135.883us ; Max: 242.879us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.560us ; Min: 12.987us ; Max: 20.133us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s055ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s055ms (1s027ms) - First Batch Requested: 1s055ms (0.000ns) - First Batch Returned: 1s055ms (0.000ns) - Last Batch Returned: 1s055ms (0.000ns) - Closed: 1s055ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s027ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 259.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s055ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 27.999ms (0.000ns) - Last Batch Returned: 1s055ms (1s027ms) - Closed: 1s055ms (0.000ns) - BytesReadSeries (500.000ms): 15.37 MB, 65.38 MB - ColumnarScannerActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.37 MB (7727549) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.825us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.65 MB (8023885) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 104.12 MB (109177871) ; Min: 104.12 MB (109177871) ; Max: 104.12 MB (109177871) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 21.63 KB (22154) ; Max: 64.01 KB (65547) ; Number of samples: 1679) - ParquetUncompressedBytesReadPerColumn: (Avg: 104.11 MB (109167793) ; Min: 104.11 MB (109167793) ; Max: 104.11 MB (109167793) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65019) ; Min: 21.63 KB (22148) ; Max: 64.00 KB (65540) ; Number of samples: 1679) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 106.41 MB (111577956) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 106.41 MB (111577956) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 7.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 104.16 MB (109222756) - IoReadAsyncRequest: 3.40K (3404) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 104.16 MB (109222756) - IoReadTotalRequest: 3.40K (3404) - MaterializeTupleTime: 575.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.68K (1679) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.89 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 145.15M (145145802) - RowsReturned: 145.15M (145145802) - RowsReturnedRate: 215.99 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 39.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 35.999ms - TotalReadThroughput: 65.38 MB/sec - TotalTime: 671.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 172.38 MB (180748288) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000029 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s052ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s052ms (1s052ms) - First Batch Produced: 1s052ms (0.000ns) - First Batch Sent: 1s052ms (0.000ns) - ExecInternal Finished: 1s052ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117245165) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 52.000ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s052ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 989.647ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s052ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s052ms - ExecTreeOpenTime: 1s024ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 59.31 KB/sec ; Min: 59.31 KB/sec ; Max: 59.31 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 160.721us ; Min: 123.865us ; Max: 197.578us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.612us ; Min: 11.222us ; Max: 22.002us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s052ms (1s024ms) - First Batch Requested: 1s052ms (0.000ns) - First Batch Returned: 1s052ms (0.000ns) - Last Batch Returned: 1s052ms (0.000ns) - Closed: 1s052ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s024ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 252.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s052ms (1s020ms) - Closed: 1s052ms (0.000ns) - BytesReadSeries (500.000ms): 25.01 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.478us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107921028) ; Min: 102.92 MB (107921028) ; Max: 102.92 MB (107921028) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107911074) ; Min: 102.91 MB (107911074) ; Max: 102.91 MB (107911074) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110115302) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110115302) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107964902) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107964902) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 664.009ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143474934) - RowsReturned: 143.47M (143474934) - RowsReturnedRate: 194.94 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 52.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 44.000ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 736.010ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000012 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.44 GB Fragment Instance Lifecycle Event Timeline: 1s052ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s052ms (1s052ms) - First Batch Produced: 1s052ms (0.000ns) - First Batch Sent: 1s052ms (0.000ns) - ExecInternal Finished: 1s052ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.44 GB (5844573514) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.04 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s052ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 988.191ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s052ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s052ms - ExecTreeOpenTime: 1s024ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 64.07 KB/sec ; Min: 64.07 KB/sec ; Max: 64.07 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 149.756us ; Min: 116.607us ; Max: 182.906us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.986us ; Min: 11.705us ; Max: 18.268us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s052ms (1s024ms) - First Batch Requested: 1s052ms (0.000ns) - First Batch Returned: 1s052ms (0.000ns) - Last Batch Returned: 1s052ms (0.000ns) - Closed: 1s052ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s024ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s052ms (1s020ms) - Closed: 1s052ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 64.00 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.91 MB (106859713) ; Min: 101.91 MB (106859713) ; Max: 101.91 MB (106859713) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65039) ; Min: 23.90 KB (24470) ; Max: 64.01 KB (65547) ; Number of samples: 1643) - ParquetUncompressedBytesReadPerColumn: (Avg: 101.90 MB (106849853) ; Min: 101.90 MB (106849853) ; Max: 101.90 MB (106849853) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65033) ; Min: 23.89 KB (24464) ; Max: 64.00 KB (65540) ; Number of samples: 1643) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.00 MB (109053627) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.00 MB (109053627) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 101.95 MB (106903227) - IoReadAsyncRequest: 3.33K (3328) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 101.95 MB (106903227) - IoReadTotalRequest: 3.33K (3328) - MaterializeTupleTime: 592.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.64K (1643) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.06M (142063965) - RowsReturned: 142.06M (142063965) - RowsReturnedRate: 204.11 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 64.00 MB/sec - TotalTime: 696.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.62 MB (174718976) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000006 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.21 GB Fragment Instance Lifecycle Event Timeline: 1s052ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s052ms (1s052ms) - First Batch Produced: 1s052ms (0.000ns) - First Batch Sent: 1s052ms (0.000ns) - ExecInternal Finished: 1s052ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.21 GB (5589476406) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.87 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 1s052ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 998.113ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s052ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s052ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 75.27 KB/sec ; Min: 75.27 KB/sec ; Max: 75.27 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 137.225us ; Min: 118.765us ; Max: 155.685us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.502us ; Min: 12.595us ; Max: 20.409us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s052ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s052ms (1s028ms) - First Batch Requested: 1s052ms (0.000ns) - First Batch Returned: 1s052ms (0.000ns) - Last Batch Returned: 1s052ms (0.000ns) - Closed: 1s052ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s028ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s052ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s052ms (1s028ms) - Closed: 1s052ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 78.74 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.827us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 111.46 MB (116872076) ; Min: 111.46 MB (116872076) ; Max: 111.46 MB (116872076) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.55 KB (65073) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1796) - ParquetUncompressedBytesReadPerColumn: (Avg: 111.45 MB (116861299) ; Min: 111.45 MB (116861299) ; Max: 111.45 MB (116861299) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.54 KB (65067) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1796) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 113.75 MB (119274863) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 113.75 MB (119274863) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 111.50 MB (116919663) - IoReadAsyncRequest: 3.64K (3638) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 111.50 MB (116919663) - IoReadTotalRequest: 3.64K (3638) - MaterializeTupleTime: 600.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.80K (1796) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 155.37M (155374860) - RowsReturned: 155.37M (155374860) - RowsReturnedRate: 225.83 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 78.74 MB/sec - TotalTime: 688.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000062 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.67 GB Fragment Instance Lifecycle Event Timeline: 1s051ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s051ms (1s051ms) - First Batch Produced: 1s051ms (0.000ns) - First Batch Sent: 1s051ms (0.000ns) - ExecInternal Finished: 1s051ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.67 GB (6092861067) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.27 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 19.999ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 1s051ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 994.359ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s051ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s051ms - ExecTreeOpenTime: 1s023ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 70.92 KB/sec ; Min: 70.92 KB/sec ; Max: 70.92 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 187.302us ; Min: 165.247us ; Max: 209.357us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.498us ; Min: 13.959us ; Max: 19.037us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s051ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s051ms (1s023ms) - First Batch Requested: 1s051ms (0.000ns) - First Batch Returned: 1s051ms (0.000ns) - Last Batch Returned: 1s051ms (0.000ns) - Closed: 1s051ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s023ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 251.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s051ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 27.999ms (0.000ns) - Last Batch Returned: 1s051ms (1s023ms) - Closed: 1s051ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.65 MB (8019223) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.635us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.16 MB (108175525) ; Min: 103.16 MB (108175525) ; Max: 103.16 MB (108175525) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.48 KB (28140) ; Max: 64.00 KB (65540) ; Number of samples: 1663) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.15 MB (108165547) ; Min: 103.15 MB (108165547) ; Max: 103.15 MB (108165547) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.47 KB (28134) ; Max: 64.00 KB (65534) ; Number of samples: 1663) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.35 MB (110472571) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.35 MB (110472571) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 23.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.21 MB (108219771) - IoReadAsyncRequest: 3.37K (3370) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.21 MB (108219771) - IoReadTotalRequest: 3.37K (3370) - MaterializeTupleTime: 643.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1663) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 5.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.81M (143813256) - RowsReturned: 143.81M (143813256) - RowsReturnedRate: 199.74 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 19.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 19.999ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 719.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.00 MB (179306496) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000027 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.66 GB Fragment Instance Lifecycle Event Timeline: 1s048ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s048ms (1s048ms) - First Batch Produced: 1s048ms (0.000ns) - First Batch Sent: 1s048ms (0.000ns) - ExecInternal Finished: 1s048ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.66 GB (6074342573) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s048ms - TotalThreadsSysTime: 7.914ms - TotalThreadsUserTime: 973.460ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s048ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s048ms - ExecTreeOpenTime: 1s020ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 60.24 KB/sec ; Min: 60.24 KB/sec ; Max: 60.24 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 171.956us ; Min: 149.370us ; Max: 194.543us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.369us ; Min: 12.482us ; Max: 22.257us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s048ms (1s020ms) - First Batch Requested: 1s048ms (0.000ns) - First Batch Returned: 1s048ms (0.000ns) - Last Batch Returned: 1s048ms (0.000ns) - Closed: 1s048ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s020ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 292.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s048ms (1s020ms) - Closed: 1s048ms (0.000ns) - BytesReadSeries (500.000ms): 25.01 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.64 MB (8013265) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.01 MB (108016559) ; Min: 103.01 MB (108016559) ; Max: 103.01 MB (108016559) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1661) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.00 MB (108006592) ; Min: 103.00 MB (108006592) ; Max: 103.00 MB (108006592) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1661) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.20 MB (110313557) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.20 MB (110313557) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.05 MB (108060757) - IoReadAsyncRequest: 3.37K (3366) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.05 MB (108060757) - IoReadTotalRequest: 3.37K (3366) - MaterializeTupleTime: 608.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1661) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 6.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.60M (143601926) - RowsReturned: 143.60M (143601926) - RowsReturnedRate: 211.18 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 680.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.88 MB (179175424) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003f (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s048ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s048ms (1s044ms) - First Batch Produced: 1s048ms (0.000ns) - First Batch Sent: 1s048ms (0.000ns) - ExecInternal Finished: 1s048ms (0.000ns) - MemoryUsage (500.000ms): 8.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117301632) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s044ms - TotalThreadsSysTime: 11.921ms - TotalThreadsUserTime: 969.392ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s048ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s044ms - ExecTreeOpenTime: 1s020ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 61.91 KB/sec ; Min: 61.91 KB/sec ; Max: 61.91 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 157.953us ; Min: 126.618us ; Max: 189.289us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.217us ; Min: 11.923us ; Max: 22.512us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s048ms (1s020ms) - First Batch Requested: 1s048ms (0.000ns) - First Batch Returned: 1s048ms (0.000ns) - Last Batch Returned: 1s048ms (0.000ns) - Closed: 1s048ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s020ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 248.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s048ms (1s016ms) - Closed: 1s048ms (0.000ns) - BytesReadSeries (500.000ms): 35.84 MB, 90.84 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.50 MB (7864320) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.639us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.62 MB (107608881) ; Min: 102.62 MB (107608881) ; Max: 102.62 MB (107608881) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65059) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1654) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.61 MB (107598955) ; Min: 102.61 MB (107598955) ; Max: 102.61 MB (107598955) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65053) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1654) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.81 MB (109905720) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.81 MB (109905720) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.67 MB (107652920) - IoReadAsyncRequest: 3.35K (3352) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.67 MB (107652920) - IoReadTotalRequest: 3.35K (3352) - MaterializeTupleTime: 644.006ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1654) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.06M (143059947) - RowsReturned: 143.06M (143059947) - RowsReturnedRate: 202.06 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 90.84 MB/sec - TotalTime: 708.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 167.75 MB (175898624) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000048 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.42 GB Fragment Instance Lifecycle Event Timeline: 1s052ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s052ms (1s048ms) - First Batch Produced: 1s052ms (0.000ns) - First Batch Sent: 1s052ms (0.000ns) - ExecInternal Finished: 1s052ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.42 GB (5820292942) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.96 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s048ms - TotalThreadsSysTime: 4.014ms - TotalThreadsUserTime: 975.595ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s048ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s048ms - ExecTreeOpenTime: 1s024ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 68.36 KB/sec ; Min: 68.36 KB/sec ; Max: 68.36 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 182.110us ; Min: 171.433us ; Max: 192.787us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.275us ; Min: 11.223us ; Max: 19.327us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s052ms (1s024ms) - First Batch Requested: 1s052ms (0.000ns) - First Batch Returned: 1s052ms (0.000ns) - Last Batch Returned: 1s052ms (0.000ns) - Closed: 1s052ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s024ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s052ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s052ms (1s020ms) - Closed: 1s052ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 98.17 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 110.88 MB (116265807) ; Min: 110.88 MB (116265807) ; Max: 110.88 MB (116265807) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65062) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1787) - ParquetUncompressedBytesReadPerColumn: (Avg: 110.87 MB (116255085) ; Min: 110.87 MB (116255085) ; Max: 110.87 MB (116255085) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65056) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65534) ; Number of samples: 1787) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 113.17 MB (118668372) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 113.17 MB (118668372) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 110.92 MB (116313172) - IoReadAsyncRequest: 3.62K (3620) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 110.92 MB (116313172) - IoReadTotalRequest: 3.62K (3620) - MaterializeTupleTime: 616.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.79K (1787) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 154.57M (154568856) - RowsReturned: 154.57M (154568856) - RowsReturnedRate: 219.56 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 98.17 MB/sec - TotalTime: 704.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 182.88 MB (191758336) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000003 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s048ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s048ms (1s048ms) - First Batch Produced: 1s048ms (0.000ns) - First Batch Sent: 1s048ms (0.000ns) - ExecInternal Finished: 1s048ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117195741) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.33 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16.000ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s048ms - TotalThreadsSysTime: 3.968ms - TotalThreadsUserTime: 988.227ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s048ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s048ms - ExecTreeOpenTime: 1s024ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 63.40 KB/sec ; Min: 63.40 KB/sec ; Max: 63.40 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 155.132us ; Min: 125.434us ; Max: 184.830us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.420us ; Min: 11.187us ; Max: 19.654us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s048ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s048ms (1s024ms) - First Batch Requested: 1s048ms (0.000ns) - First Batch Returned: 1s048ms (0.000ns) - Last Batch Returned: 1s048ms (0.000ns) - Closed: 1s048ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s024ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 304.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s048ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s048ms (1s024ms) - Closed: 1s048ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113059002) ; Min: 107.82 MB (113059002) ; Max: 107.82 MB (113059002) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113048574) ; Min: 107.81 MB (113048574) ; Max: 107.81 MB (113048574) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115357769) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115357769) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113104969) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113104969) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 572.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 8.95 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150305542) - RowsReturned: 150.31M (150305542) - RowsReturnedRate: 231.95 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 16.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 648.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000b (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s048ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s048ms (1s048ms) - First Batch Produced: 1s048ms (0.000ns) - First Batch Sent: 1s048ms (0.000ns) - ExecInternal Finished: 1s048ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851118985) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s048ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 995.566ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s048ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s048ms - ExecTreeOpenTime: 1s024ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 70.02 KB/sec ; Min: 70.02 KB/sec ; Max: 70.02 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 145.484us ; Min: 123.616us ; Max: 167.352us ; Number of samples: 2) - RpcRecvrTime: (Avg: 21.241us ; Min: 19.442us ; Max: 23.040us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s048ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s048ms (1s024ms) - First Batch Requested: 1s048ms (0.000ns) - First Batch Returned: 1s048ms (0.000ns) - Last Batch Returned: 1s048ms (0.000ns) - Closed: 1s048ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s024ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s048ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s048ms (1s024ms) - Closed: 1s048ms (0.000ns) - BytesReadSeries (500.000ms): 21.32 MB, 71.32 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.73 MB (8102632) ; Min: 2.00 MB (2097152) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 545.456us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 104.14 MB (109198454) ; Min: 104.14 MB (109198454) ; Max: 104.14 MB (109198454) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1679) - ParquetUncompressedBytesReadPerColumn: (Avg: 104.13 MB (109188379) ; Min: 104.13 MB (109188379) ; Max: 104.13 MB (109188379) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1679) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 106.33 MB (111495867) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 106.33 MB (111495867) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 104.18 MB (109243067) - IoReadAsyncRequest: 3.40K (3402) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 104.18 MB (109243067) - IoReadTotalRequest: 3.40K (3402) - MaterializeTupleTime: 620.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.68K (1679) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 145.17M (145173190) - RowsReturned: 145.17M (145173190) - RowsReturnedRate: 200.51 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 71.32 MB/sec - TotalTime: 724.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 172.75 MB (181141504) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000028 (host=impala-executor-000-7.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.706 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s044ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s044ms (1s044ms) - First Batch Produced: 1s044ms (0.000ns) - First Batch Sent: 1s044ms (0.000ns) - ExecInternal Finished: 1s044ms (0.000ns) - MemoryUsage (500.000ms): 8.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5857043641) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.00 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s044ms - TotalThreadsSysTime: 3.971ms - TotalThreadsUserTime: 976.725ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s044ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s044ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 42.14 KB/sec ; Min: 42.14 KB/sec ; Max: 42.14 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 206.880us ; Min: 135.668us ; Max: 278.093us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.481us ; Min: 11.710us ; Max: 19.252us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s044ms (1s016ms) - First Batch Requested: 1s044ms (0.000ns) - First Batch Returned: 1s044ms (0.000ns) - Last Batch Returned: 1s044ms (0.000ns) - Closed: 1s044ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.003ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s044ms (1s016ms) - Closed: 1s044ms (0.000ns) - BytesReadSeries (500.000ms): 25.10 MB, 80.50 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.70 MB (8069476) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.915us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.22 MB (113473578) ; Min: 108.22 MB (113473578) ; Max: 108.22 MB (113473578) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65027) ; Min: 24.48 KB (25066) ; Max: 64.00 KB (65534) ; Number of samples: 1745) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.21 MB (113463108) ; Min: 108.21 MB (113463108) ; Max: 108.21 MB (113463108) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65021) ; Min: 24.47 KB (25060) ; Max: 63.99 KB (65528) ; Number of samples: 1745) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 110.51 MB (115875179) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.51 MB (115875179) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.26 MB (113519979) - IoReadAsyncRequest: 3.54K (3536) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.26 MB (113519979) - IoReadTotalRequest: 3.54K (3536) - MaterializeTupleTime: 588.008ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.75K (1745) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 5.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.86M (150856720) - RowsReturned: 150.86M (150856720) - RowsReturnedRate: 223.16 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 80.50 MB/sec - TotalTime: 676.009ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.88 MB (188612608) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000042 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.39 GB Fragment Instance Lifecycle Event Timeline: 1s048ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s048ms (1s044ms) - First Batch Produced: 1s048ms (0.000ns) - First Batch Sent: 1s048ms (0.000ns) - ExecInternal Finished: 1s048ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.39 GB (5790214982) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.94 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 52.000ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s044ms - TotalThreadsSysTime: 7.925ms - TotalThreadsUserTime: 967.907ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s044ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s044ms - ExecTreeOpenTime: 1s020ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 74.06 KB/sec ; Min: 74.06 KB/sec ; Max: 74.06 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 146.576us ; Min: 134.919us ; Max: 158.234us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.868us ; Min: 11.403us ; Max: 20.333us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s048ms (1s020ms) - First Batch Requested: 1s048ms (0.000ns) - First Batch Returned: 1s048ms (0.000ns) - Last Batch Returned: 1s048ms (0.000ns) - Closed: 1s048ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s020ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s048ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s048ms (1s016ms) - Closed: 1s048ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 95.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 761.911us ; Min: 0.000ns ; Max: 8.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107918135) ; Min: 102.92 MB (107918135) ; Max: 102.92 MB (107918135) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107908181) ; Min: 102.91 MB (107908181) ; Max: 102.91 MB (107908181) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110112410) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110112410) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107962010) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107962010) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 592.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.85 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143471062) - RowsReturned: 143.47M (143471062) - RowsReturnedRate: 210.98 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 52.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 95.01 MB/sec - TotalTime: 680.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000e (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.43 GB Fragment Instance Lifecycle Event Timeline: 1s044ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s044ms (1s044ms) - First Batch Produced: 1s044ms (0.000ns) - First Batch Sent: 1s044ms (0.000ns) - ExecInternal Finished: 1s044ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.43 GB (5827107230) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.02 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s044ms - TotalThreadsSysTime: 4.010ms - TotalThreadsUserTime: 978.094ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s044ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s044ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 54.97 KB/sec ; Min: 54.97 KB/sec ; Max: 54.97 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 172.043us ; Min: 130.918us ; Max: 213.168us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.750us ; Min: 13.203us ; Max: 20.298us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s044ms (1s016ms) - First Batch Requested: 1s044ms (0.000ns) - First Batch Returned: 1s044ms (0.000ns) - Last Batch Returned: 1s044ms (0.000ns) - Closed: 1s044ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 364.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:26 ExecOption: Codegen enabled: 26 out of 26, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s044ms (1s012ms) - Closed: 1s044ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 79.20 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 26) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 26) - FooterProcessingTime: (Avg: 307.694us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 26) - InitialRangeActualReservation: (Avg: 7.85 MB (8227288) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 26) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 26) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 126.61 MB (132759722) ; Min: 126.61 MB (132759722) ; Max: 126.61 MB (132759722) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 2041) - ParquetUncompressedBytesReadPerColumn: (Avg: 126.60 MB (132747474) ; Min: 126.60 MB (132747474) ; Max: 126.60 MB (132747474) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65040) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 2041) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 129.20 MB (135476151) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 129.20 MB (135476151) - DataCacheHitCount: 52 (52) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 32.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 126.66 MB (132813751) - IoReadAsyncRequest: 4.13K (4134) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 126.66 MB (132813751) - IoReadTotalRequest: 4.13K (4134) - MaterializeTupleTime: 488.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 2.04K (2041) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 26 (26) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 26 (26) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 176.50M (176496569) - RowsReturned: 176.50M (176496569) - RowsReturnedRate: 298.13 M/sec - ScanRangesComplete: 26 (26) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 79.20 MB/sec - TotalTime: 592.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 211.25 MB (221511680) - CumulativeAllocations: 52 (52) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000046 (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s044ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s044ms (1s040ms) - First Batch Produced: 1s044ms (0.000ns) - First Batch Sent: 1s044ms (0.000ns) - ExecInternal Finished: 1s044ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851284354) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.99 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 12.106ms - TotalThreadsUserTime: 964.470ms - TotalThreadsVoluntaryContextSwitches: 65 (65) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 49.64 KB/sec ; Min: 49.64 KB/sec ; Max: 49.64 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 185.924us ; Min: 135.772us ; Max: 236.076us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.616us ; Min: 11.374us ; Max: 19.858us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s044ms (1s016ms) - First Batch Requested: 1s044ms (0.000ns) - First Batch Returned: 1s044ms (0.000ns) - Last Batch Returned: 1s044ms (0.000ns) - Closed: 1s044ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 292.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s044ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s044ms (1s012ms) - Closed: 1s044ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 90.48 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 6.99 MB (7325785) ; Min: 64.00 KB (65536) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 695.658us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.19 MB (102961601) ; Min: 98.19 MB (102961601) ; Max: 98.19 MB (102961601) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.48 KB (65001) ; Min: 15.08 KB (15439) ; Max: 64.00 KB (65540) ; Number of samples: 1584) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.18 MB (102952098) ; Min: 98.18 MB (102952098) ; Max: 98.18 MB (102952098) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.47 KB (64995) ; Min: 15.07 KB (15434) ; Max: 64.00 KB (65534) ; Number of samples: 1584) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.48 MB (105359505) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.48 MB (105359505) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.23 MB (103004305) - IoReadAsyncRequest: 3.21K (3214) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.23 MB (103004305) - IoReadTotalRequest: 3.21K (3214) - MaterializeTupleTime: 572.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1584) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.88M (136881608) - RowsReturned: 136.88M (136881608) - RowsReturnedRate: 198.95 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 90.48 MB/sec - TotalTime: 688.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 163.56 MB (171507712) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003e (host=impala-executor-000-2.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.704 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.48 GB Fragment Instance Lifecycle Event Timeline: 1s040ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s040ms (1s040ms) - First Batch Produced: 1s040ms (0.000ns) - First Batch Sent: 1s040ms (0.000ns) - ExecInternal Finished: 1s040ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.48 GB (5881814605) - CompletionTime: 1s091ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.02 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 7.971ms - TotalThreadsUserTime: 960.513ms - TotalThreadsVoluntaryContextSwitches: 68 (68) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s012ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 46.95 KB/sec ; Min: 46.95 KB/sec ; Max: 46.95 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 187.077us ; Min: 124.529us ; Max: 249.625us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.728us ; Min: 11.497us ; Max: 21.959us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s040ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s040ms (1s012ms) - First Batch Requested: 1s040ms (0.000ns) - First Batch Returned: 1s040ms (0.000ns) - Last Batch Returned: 1s040ms (0.000ns) - Closed: 1s040ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s012ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s040ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s040ms (1s008ms) - Closed: 1s040ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 95.67 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.10 MB (7447511) ; Min: 64.00 KB (65536) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.84 MB (114131784) ; Min: 108.84 MB (114131784) ; Max: 108.84 MB (114131784) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65032) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1755) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.83 MB (114121252) ; Min: 108.83 MB (114121252) ; Max: 108.83 MB (114121252) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65026) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1755) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 111.33 MB (116738957) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 111.33 MB (116738957) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.89 MB (114178957) - IoReadAsyncRequest: 3.56K (3560) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.89 MB (114178957) - IoReadTotalRequest: 3.56K (3560) - MaterializeTupleTime: 576.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.75K (1755) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.53 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 151.73M (151731748) - RowsReturned: 151.73M (151731748) - RowsReturnedRate: 234.15 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 95.67 MB/sec - TotalTime: 648.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 180.69 MB (189464576) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000074 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s040ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s040ms (1s040ms) - First Batch Produced: 1s040ms (0.000ns) - First Batch Sent: 1s040ms (0.000ns) - ExecInternal Finished: 1s040ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5850967507) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.20 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 60.000ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 970.319ms - TotalThreadsVoluntaryContextSwitches: 69 (69) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s012ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 42.32 KB/sec ; Min: 42.32 KB/sec ; Max: 42.32 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 299.507us ; Min: 276.904us ; Max: 322.111us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.492us ; Min: 11.578us ; Max: 17.406us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s040ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s040ms (1s012ms) - First Batch Requested: 1s040ms (0.000ns) - First Batch Returned: 1s040ms (0.000ns) - Last Batch Returned: 1s040ms (0.000ns) - Closed: 1s040ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s012ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 300.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s040ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s040ms (1s012ms) - Closed: 1s040ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 95.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 521.743us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118191920) ; Min: 112.72 MB (118191920) ; Max: 112.72 MB (118191920) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118181018) ; Min: 112.71 MB (118181018) ; Max: 112.71 MB (118181018) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65534) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120595177) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120595177) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.76 MB (118239977) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.76 MB (118239977) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 552.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.13M (157129496) - RowsReturned: 157.13M (157129496) - RowsReturnedRate: 243.99 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 60.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 56.000ms - TotalReadThroughput: 95.01 MB/sec - TotalTime: 644.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006d (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.38 GB Fragment Instance Lifecycle Event Timeline: 1s040ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s040ms (1s040ms) - First Batch Produced: 1s040ms (0.000ns) - First Batch Sent: 1s040ms (0.000ns) - ExecInternal Finished: 1s040ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.38 GB (5779726931) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.14 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 15.805ms - TotalThreadsUserTime: 987.852ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 74.75 KB/sec ; Min: 74.75 KB/sec ; Max: 74.75 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 212.924us ; Min: 156.767us ; Max: 269.081us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.822us ; Min: 12.574us ; Max: 17.071us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s040ms (1s016ms) - First Batch Requested: 1s040ms (0.000ns) - First Batch Returned: 1s040ms (0.000ns) - Last Batch Returned: 1s040ms (0.000ns) - Closed: 1s040ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 304.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 28.000ms (4.000ms) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s040ms (1s012ms) - Closed: 1s040ms (0.000ns) - BytesReadSeries (500.000ms): 35.00 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.828us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118192573) ; Min: 112.72 MB (118192573) ; Max: 112.72 MB (118192573) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118181669) ; Min: 112.71 MB (118181669) ; Max: 112.71 MB (118181669) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120595828) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120595828) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.76 MB (118240628) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.76 MB (118240628) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 560.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 7.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.13M (157130347) - RowsReturned: 157.13M (157130347) - RowsReturnedRate: 248.62 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 632.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000071 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.60 GB Fragment Instance Lifecycle Event Timeline: 1s040ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s040ms (1s040ms) - First Batch Produced: 1s040ms (0.000ns) - First Batch Sent: 1s040ms (0.000ns) - ExecInternal Finished: 1s040ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.60 GB (6009613953) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.34 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 973.926ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 83.70 KB/sec ; Min: 83.70 KB/sec ; Max: 83.70 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 207.469us ; Min: 140.010us ; Max: 274.929us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.014us ; Min: 11.265us ; Max: 18.764us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s040ms (1s016ms) - First Batch Requested: 1s040ms (0.000ns) - First Batch Returned: 1s040ms (0.000ns) - Last Batch Returned: 1s040ms (0.000ns) - Closed: 1s040ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 300.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 28.000ms (4.000ms) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s040ms (1s012ms) - Closed: 1s040ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 93.51 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 111.22 MB (116622807) ; Min: 111.22 MB (116622807) ; Max: 111.22 MB (116622807) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 22.63 KB (23177) ; Max: 64.00 KB (65540) ; Number of samples: 1793) - ParquetUncompressedBytesReadPerColumn: (Avg: 111.21 MB (116612049) ; Min: 111.21 MB (116612049) ; Max: 111.21 MB (116612049) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 22.63 KB (23171) ; Max: 64.00 KB (65534) ; Number of samples: 1793) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 113.51 MB (119025515) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 113.51 MB (119025515) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 111.27 MB (116670315) - IoReadAsyncRequest: 3.63K (3632) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 111.27 MB (116670315) - IoReadTotalRequest: 3.63K (3632) - MaterializeTupleTime: 552.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.79K (1793) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 6.93 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 155.04M (155043428) - RowsReturned: 155.04M (155043428) - RowsReturnedRate: 245.32 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 93.51 MB/sec - TotalTime: 632.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 182.88 MB (191758336) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000a (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.39 GB Fragment Instance Lifecycle Event Timeline: 1s040ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s040ms (1s040ms) - First Batch Produced: 1s040ms (0.000ns) - First Batch Sent: 1s040ms (0.000ns) - ExecInternal Finished: 1s040ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.39 GB (5786278690) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.05 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s040ms - TotalThreadsSysTime: 3.960ms - TotalThreadsUserTime: 982.103ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s040ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s040ms - ExecTreeOpenTime: 1s016ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 64.39 KB/sec ; Min: 64.39 KB/sec ; Max: 64.39 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 152.314us ; Min: 122.630us ; Max: 181.998us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.900us ; Min: 11.487us ; Max: 20.313us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s040ms (1s016ms) - First Batch Requested: 1s040ms (0.000ns) - First Batch Returned: 1s040ms (0.000ns) - Last Batch Returned: 1s040ms (0.000ns) - Closed: 1s040ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s016ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s040ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s040ms (1s016ms) - Closed: 1s040ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.476us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107919969) ; Min: 102.92 MB (107919969) ; Max: 102.92 MB (107919969) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107910015) ; Min: 102.91 MB (107910015) ; Max: 102.91 MB (107910015) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.45 KB (28110) ; Max: 63.99 KB (65528) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110114259) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110114259) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107963859) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107963859) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 632.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 6.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143473535) - RowsReturned: 143.47M (143473535) - RowsReturnedRate: 202.65 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 708.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000061 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.64 GB Fragment Instance Lifecycle Event Timeline: 1s039ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s039ms (1s039ms) - First Batch Produced: 1s039ms (0.000ns) - First Batch Sent: 1s039ms (0.000ns) - ExecInternal Finished: 1s039ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.64 GB (6051324905) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.24 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 31.999ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s039ms - TotalThreadsSysTime: 7.984ms - TotalThreadsUserTime: 998.102ms - TotalThreadsVoluntaryContextSwitches: 52 (52) - TotalTime: 1s039ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s039ms - ExecTreeOpenTime: 1s011ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 73.54 KB/sec ; Min: 73.54 KB/sec ; Max: 73.54 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 190.810us ; Min: 159.346us ; Max: 222.275us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.910us ; Min: 11.533us ; Max: 18.288us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s039ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s039ms (1s011ms) - First Batch Requested: 1s039ms (0.000ns) - First Batch Returned: 1s039ms (0.000ns) - Last Batch Returned: 1s039ms (0.000ns) - Closed: 1s039ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s011ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 271.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s039ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 27.999ms (0.000ns) - Last Batch Returned: 1s039ms (1s011ms) - Closed: 1s039ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.912us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118196130) ; Min: 112.72 MB (118196130) ; Max: 112.72 MB (118196130) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118185228) ; Min: 112.71 MB (118185228) ; Max: 112.71 MB (118185228) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120599390) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120599390) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 7.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118244190) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118244190) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 583.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157135090) - RowsReturned: 157.14M (157135090) - RowsReturnedRate: 241.01 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 31.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.999ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 651.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000067 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.19 GB Fragment Instance Lifecycle Event Timeline: 1s039ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s039ms (1s039ms) - First Batch Produced: 1s039ms (0.000ns) - First Batch Sent: 1s039ms (0.000ns) - ExecInternal Finished: 1s039ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.19 GB (5567680457) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.82 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 39.999ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s039ms - TotalThreadsSysTime: 4.041ms - TotalThreadsUserTime: 977.804ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s039ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s039ms - ExecTreeOpenTime: 1s011ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 86.85 KB/sec ; Min: 86.85 KB/sec ; Max: 86.85 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 181.639us ; Min: 134.927us ; Max: 228.351us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.255us ; Min: 10.943us ; Max: 17.567us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s039ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s039ms (1s011ms) - First Batch Requested: 1s039ms (0.000ns) - First Batch Returned: 1s039ms (0.000ns) - Last Batch Returned: 1s039ms (0.000ns) - Closed: 1s039ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s011ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 243.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s039ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s039ms (1s007ms) - Closed: 1s039ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.817us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113059706) ; Min: 107.82 MB (113059706) ; Max: 107.82 MB (113059706) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113049276) ; Min: 107.81 MB (113049276) ; Max: 107.81 MB (113049276) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115358467) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115358467) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 15.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113105667) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113105667) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 607.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150306509) - RowsReturned: 150.31M (150306509) - RowsReturnedRate: 212.30 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 39.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 39.999ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 707.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000017 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851114495) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.05 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 8.051ms - TotalThreadsUserTime: 966.143ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 76.98 KB/sec ; Min: 76.98 KB/sec ; Max: 76.98 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 137.250us ; Min: 122.277us ; Max: 152.224us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.480us ; Min: 10.935us ; Max: 18.026us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s036ms (1s008ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s036ms (1s004ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 64.36 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.15 MB (107116657) ; Min: 102.15 MB (107116657) ; Max: 102.15 MB (107116657) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 12.97 KB (13286) ; Max: 64.01 KB (65547) ; Number of samples: 1647) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.14 MB (107106774) ; Min: 102.14 MB (107106774) ; Max: 102.14 MB (107106774) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 12.97 KB (13281) ; Max: 64.00 KB (65540) ; Number of samples: 1647) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.25 MB (109310662) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.25 MB (109310662) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.20 MB (107160262) - IoReadAsyncRequest: 3.34K (3336) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.20 MB (107160262) - IoReadTotalRequest: 3.34K (3336) - MaterializeTupleTime: 576.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1647) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.41M (142405538) - RowsReturned: 142.41M (142405538) - RowsReturnedRate: 219.76 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 64.36 MB/sec - TotalTime: 648.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000018 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851213805) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.05 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16.000ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 7.875ms - TotalThreadsUserTime: 968.706ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 74.38 KB/sec ; Min: 74.38 KB/sec ; Max: 74.38 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 140.987us ; Min: 124.420us ; Max: 157.554us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.334us ; Min: 11.070us ; Max: 17.598us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s036ms (1s008ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 292.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s008ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107919854) ; Min: 102.92 MB (107919854) ; Max: 102.92 MB (107919854) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107909900) ; Min: 102.91 MB (107909900) ; Max: 102.91 MB (107909900) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110114129) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110114129) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107963729) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107963729) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 556.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 6.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143473367) - RowsReturned: 143.47M (143473367) - RowsReturnedRate: 222.78 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 16.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 644.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000075 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.11 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.11 GB (5489683968) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.88 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 4.030ms - TotalThreadsUserTime: 971.590ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 60.60 KB/sec ; Min: 60.60 KB/sec ; Max: 60.60 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 238.159us ; Min: 193.372us ; Max: 282.946us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.139us ; Min: 12.253us ; Max: 28.025us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s036ms (1s008ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 272.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s008ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 34.67 MB, 94.68 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.828us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 111.91 MB (117345239) ; Min: 111.91 MB (117345239) ; Max: 111.91 MB (117345239) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 12.56 KB (12864) ; Max: 64.01 KB (65547) ; Number of samples: 1804) - ParquetUncompressedBytesReadPerColumn: (Avg: 111.90 MB (117334415) ; Min: 111.90 MB (117334415) ; Max: 111.90 MB (117334415) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 12.56 KB (12859) ; Max: 64.00 KB (65540) ; Number of samples: 1804) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.20 MB (119748196) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.20 MB (119748196) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 111.95 MB (117392996) - IoReadAsyncRequest: 3.65K (3654) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 111.95 MB (117392996) - IoReadTotalRequest: 3.65K (3654) - MaterializeTupleTime: 540.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.80K (1804) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.00M (156003865) - RowsReturned: 156.00M (156003865) - RowsReturnedRate: 242.24 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 94.68 MB/sec - TotalTime: 644.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000070 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.40 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.40 GB (5797070873) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.15 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 3.980ms - TotalThreadsUserTime: 967.277ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s012ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 83.06 KB/sec ; Min: 83.06 KB/sec ; Max: 83.06 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 212.603us ; Min: 141.084us ; Max: 284.123us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.914us ; Min: 11.482us ; Max: 18.347us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s036ms (1s012ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s012ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 236.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 24.000ms (24.000ms) - Open Finished: 28.000ms (4.000ms) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s008ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 35.01 MB, 85.45 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8031138) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.26 MB (108279082) ; Min: 103.26 MB (108279082) ; Max: 103.26 MB (108279082) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65032) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1665) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.25 MB (108269091) ; Min: 103.25 MB (108269091) ; Max: 103.25 MB (108269091) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65026) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1665) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.45 MB (110576165) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.45 MB (110576165) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.31 MB (108323365) - IoReadAsyncRequest: 3.37K (3374) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.31 MB (108323365) - IoReadTotalRequest: 3.37K (3374) - MaterializeTupleTime: 604.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.67K (1665) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.95M (143950936) - RowsReturned: 143.95M (143950936) - RowsReturnedRate: 216.79 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 85.45 MB/sec - TotalTime: 664.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.25 MB (179568640) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000008 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851604322) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 4.035ms - TotalThreadsUserTime: 976.532ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s012ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 68.29 KB/sec ; Min: 68.29 KB/sec ; Max: 68.29 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 144.811us ; Min: 118.032us ; Max: 171.590us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.620us ; Min: 13.323us ; Max: 17.917us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s036ms (1s012ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s012ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s012ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 74.69 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.50 MB (112718714) ; Min: 107.50 MB (112718714) ; Max: 107.50 MB (112718714) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 21.09 KB (21594) ; Max: 64.00 KB (65540) ; Number of samples: 1733) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.49 MB (112708316) ; Min: 107.49 MB (112708316) ; Max: 107.49 MB (112708316) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65036) ; Min: 21.08 KB (21588) ; Max: 64.00 KB (65534) ; Number of samples: 1733) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.69 MB (115017367) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.69 MB (115017367) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.54 MB (112764567) - IoReadAsyncRequest: 3.51K (3510) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.54 MB (112764567) - IoReadTotalRequest: 3.51K (3510) - MaterializeTupleTime: 596.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.73K (1733) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 149.85M (149853202) - RowsReturned: 149.85M (149853202) - RowsReturnedRate: 217.81 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 74.69 MB/sec - TotalTime: 688.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000049 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.67 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.67 GB (6089369264) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.39 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 4.016ms - TotalThreadsUserTime: 996.019ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 62.40 KB/sec ; Min: 62.40 KB/sec ; Max: 62.40 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 174.546us ; Min: 161.308us ; Max: 187.785us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.091us ; Min: 14.245us ; Max: 17.940us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s036ms (1s008ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 232.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s008ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 95.02 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.476us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107923278) ; Min: 102.92 MB (107923278) ; Max: 102.92 MB (107923278) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65053) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107913323) ; Min: 102.91 MB (107913323) ; Max: 102.91 MB (107913323) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.02 MB (110117550) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.02 MB (110117550) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.97 MB (107967150) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.97 MB (107967150) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 628.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.48M (143477901) - RowsReturned: 143.48M (143477901) - RowsReturnedRate: 199.27 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 95.02 MB/sec - TotalTime: 720.001ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004a (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s036ms (1s036ms) - First Batch Produced: 1s036ms (0.000ns) - First Batch Sent: 1s036ms (0.000ns) - ExecInternal Finished: 1s036ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117167905) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.42 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 4.003ms - TotalThreadsUserTime: 972.797ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s036ms - ExecTreeOpenTime: 1s008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 73.92 KB/sec ; Min: 73.92 KB/sec ; Max: 73.92 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 169.410us ; Min: 158.533us ; Max: 180.287us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.024us ; Min: 11.678us ; Max: 18.370us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s036ms (1s008ms) - First Batch Requested: 1s036ms (0.000ns) - First Batch Returned: 1s036ms (0.000ns) - Last Batch Returned: 1s036ms (0.000ns) - Closed: 1s036ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 300.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s036ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s036ms (1s008ms) - Closed: 1s036ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.636us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113054055) ; Min: 107.82 MB (113054055) ; Max: 107.82 MB (113054055) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113043627) ; Min: 107.81 MB (113043627) ; Max: 107.81 MB (113043627) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115352815) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115352815) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113100015) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113100015) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 580.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 5.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150299007) - RowsReturned: 150.30M (150299007) - RowsReturnedRate: 236.32 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 636.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000051 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s036ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s032ms (1s032ms) - First Batch Produced: 1s032ms (0.000ns) - First Batch Sent: 1s032ms (0.000ns) - ExecInternal Finished: 1s036ms (4.000ms) - MemoryUsage (500.000ms): 8.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851412031) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s036ms - TotalThreadsSysTime: 8.069ms - TotalThreadsUserTime: 966.419ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 67.62 KB/sec ; Min: 67.62 KB/sec ; Max: 67.62 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 175.642us ; Min: 173.310us ; Max: 177.974us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.687us ; Min: 11.768us ; Max: 21.607us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s032ms (1s004ms) - First Batch Requested: 1s032ms (0.000ns) - First Batch Returned: 1s032ms (0.000ns) - Last Batch Returned: 1s032ms (0.000ns) - Closed: 1s032ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 252.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s032ms (1s004ms) - Closed: 1s032ms (0.000ns) - BytesReadSeries (500.000ms): 40.10 MB, 95.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 380.952us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107920204) ; Min: 102.92 MB (107920204) ; Max: 102.92 MB (107920204) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107910248) ; Min: 102.91 MB (107910248) ; Max: 102.91 MB (107910248) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 105.01 MB (110114489) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110114489) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107964089) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107964089) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 628.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143473820) - RowsReturned: 143.47M (143473820) - RowsReturnedRate: 203.80 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 95.01 MB/sec - TotalTime: 704.001ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006a (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/4.96 GB Fragment Instance Lifecycle Event Timeline: 1s035ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s035ms (1s035ms) - First Batch Produced: 1s035ms (0.000ns) - First Batch Sent: 1s035ms (0.000ns) - ExecInternal Finished: 1s035ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 4.96 GB (5328721607) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.61 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 39.999ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s035ms - TotalThreadsSysTime: 8.073ms - TotalThreadsUserTime: 964.734ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s035ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s035ms - ExecTreeOpenTime: 1s007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 66.33 KB/sec ; Min: 66.33 KB/sec ; Max: 66.33 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 195.276us ; Min: 176.671us ; Max: 213.882us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.136us ; Min: 11.399us ; Max: 20.874us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s035ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s035ms (1s007ms) - First Batch Requested: 1s035ms (0.000ns) - First Batch Returned: 1s035ms (0.000ns) - Last Batch Returned: 1s035ms (0.000ns) - Closed: 1s035ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 327.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s035ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s035ms (1s003ms) - Closed: 1s035ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 64.96 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.57 MB (7932705) ; Min: 2.00 MB (2097152) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.912us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.68 MB (112905537) ; Min: 107.68 MB (112905537) ; Max: 107.68 MB (112905537) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 17.01 KB (17419) ; Max: 64.01 KB (65547) ; Number of samples: 1736) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.67 MB (112895120) ; Min: 107.67 MB (112895120) ; Max: 107.67 MB (112895120) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 17.00 KB (17413) ; Max: 64.00 KB (65540) ; Number of samples: 1736) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.97 MB (115306920) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.97 MB (115306920) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 15.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.72 MB (112951720) - IoReadAsyncRequest: 3.52K (3518) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.72 MB (112951720) - IoReadTotalRequest: 3.52K (3518) - MaterializeTupleTime: 539.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1736) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.10M (150101524) - RowsReturned: 150.10M (150101524) - RowsReturnedRate: 234.53 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 39.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 35.999ms - TotalReadThroughput: 64.96 MB/sec - TotalTime: 639.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 176.88 MB (185466880) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000034 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.56 GB Fragment Instance Lifecycle Event Timeline: 1s032ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s032ms (1s032ms) - First Batch Produced: 1s032ms (0.000ns) - First Batch Sent: 1s032ms (0.000ns) - ExecInternal Finished: 1s032ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.56 GB (5967093029) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.32 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s032ms - TotalThreadsSysTime: 4.006ms - TotalThreadsUserTime: 965.595ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s032ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 40.79 KB/sec ; Min: 40.79 KB/sec ; Max: 40.79 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 256.827us ; Min: 226.339us ; Max: 287.318us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.605us ; Min: 11.333us ; Max: 17.877us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s032ms (1s004ms) - First Batch Requested: 1s032ms (0.000ns) - First Batch Returned: 1s032ms (0.000ns) - Last Batch Returned: 1s032ms (0.000ns) - Closed: 1s032ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s032ms (1s004ms) - Closed: 1s032ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.829us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.41 MB (117867909) ; Min: 112.41 MB (117867909) ; Max: 112.41 MB (117867909) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1812) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.40 MB (117857035) ; Min: 112.40 MB (117857035) ; Max: 112.40 MB (117857035) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1812) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.70 MB (120271056) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.70 MB (120271056) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.45 MB (117915856) - IoReadAsyncRequest: 3.67K (3670) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.45 MB (117915856) - IoReadTotalRequest: 3.67K (3670) - MaterializeTupleTime: 568.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1812) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.70M (156698729) - RowsReturned: 156.70M (156698729) - RowsReturnedRate: 244.84 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 640.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000015 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.22 GB Fragment Instance Lifecycle Event Timeline: 1s032ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s032ms (1s032ms) - First Batch Produced: 1s032ms (0.000ns) - First Batch Sent: 1s032ms (0.000ns) - ExecInternal Finished: 1s032ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.22 GB (5600826275) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.83 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 1s032ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 972.040ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s032ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 78.19 KB/sec ; Min: 78.19 KB/sec ; Max: 78.19 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 149.239us ; Min: 148.606us ; Max: 149.872us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.043us ; Min: 12.421us ; Max: 17.666us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s032ms (1s004ms) - First Batch Requested: 1s032ms (0.000ns) - First Batch Returned: 1s032ms (0.000ns) - Last Batch Returned: 1s032ms (0.000ns) - Closed: 1s032ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:20 ExecOption: Codegen enabled: 20 out of 20, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s032ms (1s004ms) - Closed: 1s032ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.00 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - FooterProcessingTime: (Avg: 200.001us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 20) - InitialRangeActualReservation: (Avg: 7.80 MB (8178892) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 20) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.01 MB (102772999) ; Min: 98.01 MB (102772999) ; Max: 98.01 MB (102772999) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1580) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.00 MB (102763517) ; Min: 98.00 MB (102763517) ; Max: 98.00 MB (102763517) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65040) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1580) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.00 MB (104862780) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.00 MB (104862780) - DataCacheHitCount: 40 (40) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.05 MB (102814780) - IoReadAsyncRequest: 3.20K (3200) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.05 MB (102814780) - IoReadTotalRequest: 3.20K (3200) - MaterializeTupleTime: 624.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1580) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 20 (20) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 20 (20) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.88 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.63M (136630894) - RowsReturned: 136.63M (136630894) - RowsReturnedRate: 188.72 M/sec - ScanRangesComplete: 20 (20) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 65.00 MB/sec - TotalTime: 724.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.50 MB (170393600) - CumulativeAllocations: 40 (40) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000d (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s032ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s032ms (1s032ms) - First Batch Produced: 1s032ms (0.000ns) - First Batch Sent: 1s032ms (0.000ns) - ExecInternal Finished: 1s032ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6116975505) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.27 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s032ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 993.498ms - TotalThreadsVoluntaryContextSwitches: 52 (52) - TotalTime: 1s032ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 55.20 KB/sec ; Min: 55.20 KB/sec ; Max: 55.20 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 173.906us ; Min: 135.506us ; Max: 212.307us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.001us ; Min: 11.983us ; Max: 20.019us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s032ms (1s004ms) - First Batch Requested: 1s032ms (0.000ns) - First Batch Returned: 1s032ms (0.000ns) - Last Batch Returned: 1s032ms (0.000ns) - Closed: 1s032ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s032ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s032ms (1s000ms) - Closed: 1s032ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.43 MB (107405142) ; Min: 102.43 MB (107405142) ; Max: 102.43 MB (107405142) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65054) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1651) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.42 MB (107395236) ; Min: 102.42 MB (107395236) ; Max: 102.42 MB (107395236) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1651) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.52 MB (109599230) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.52 MB (109599230) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.47 MB (107448830) - IoReadAsyncRequest: 3.34K (3344) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.47 MB (107448830) - IoReadTotalRequest: 3.34K (3344) - MaterializeTupleTime: 592.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1651) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.79M (142789077) - RowsReturned: 142.79M (142789077) - RowsReturnedRate: 217.66 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 70.01 MB/sec - TotalTime: 656.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006b (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.02 GB Fragment Instance Lifecycle Event Timeline: 1s031ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s027ms (1s027ms) - First Batch Produced: 1s027ms (0.000ns) - First Batch Sent: 1s027ms (0.000ns) - ExecInternal Finished: 1s031ms (3.999ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.02 GB (5385222319) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.66 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 39.999ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s031ms - TotalThreadsSysTime: 4.034ms - TotalThreadsUserTime: 960.172ms - TotalThreadsVoluntaryContextSwitches: 69 (69) - TotalTime: 1s031ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s027ms - ExecTreeOpenTime: 999.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 81.27 KB/sec ; Min: 81.27 KB/sec ; Max: 81.27 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 198.404us ; Min: 144.191us ; Max: 252.618us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.570us ; Min: 11.151us ; Max: 17.989us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 3.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s027ms (999.998ms) - First Batch Requested: 1s027ms (0.000ns) - First Batch Returned: 1s027ms (0.000ns) - Last Batch Returned: 1s027ms (0.000ns) - Closed: 1s027ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 999.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 295.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s027ms (995.998ms) - Closed: 1s027ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 75.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 521.738us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118199628) ; Min: 112.72 MB (118199628) ; Max: 112.72 MB (118199628) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65052) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118188724) ; Min: 112.71 MB (118188724) ; Max: 112.71 MB (118188724) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65046) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.02 MB (120602878) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.02 MB (120602878) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 7.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118247678) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118247678) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 567.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157139728) - RowsReturned: 157.14M (157139728) - RowsReturnedRate: 242.50 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 39.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.999ms - TotalReadThroughput: 75.01 MB/sec - TotalTime: 647.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000065 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.54 GB Fragment Instance Lifecycle Event Timeline: 1s031ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s027ms (1s027ms) - First Batch Produced: 1s027ms (0.000ns) - First Batch Sent: 1s027ms (0.000ns) - ExecInternal Finished: 1s031ms (3.999ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.54 GB (5947254143) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.15 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 27.999ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s031ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 971.116ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s031ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s027ms - ExecTreeOpenTime: 999.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 32.12 KB/sec ; Min: 32.12 KB/sec ; Max: 32.12 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 295.979us ; Min: 227.128us ; Max: 364.831us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.831us ; Min: 12.076us ; Max: 17.587us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 3.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s027ms (999.998ms) - First Batch Requested: 1s027ms (0.000ns) - First Batch Returned: 1s027ms (0.000ns) - Last Batch Returned: 1s027ms (0.000ns) - Closed: 1s027ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 999.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 235.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s027ms (995.998ms) - Closed: 1s027ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 70.55 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.67 MB (8046681) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.825us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.27 MB (113525162) ; Min: 108.27 MB (113525162) ; Max: 108.27 MB (113525162) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65020) ; Min: 7.28 KB (7450) ; Max: 64.01 KB (65547) ; Number of samples: 1746) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.26 MB (113514683) ; Min: 108.26 MB (113514683) ; Max: 108.26 MB (113514683) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.49 KB (65014) ; Min: 7.27 KB (7445) ; Max: 64.00 KB (65540) ; Number of samples: 1746) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.56 MB (115926773) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.56 MB (115926773) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 15.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.31 MB (113571573) - IoReadAsyncRequest: 3.54K (3538) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.31 MB (113571573) - IoReadTotalRequest: 3.54K (3538) - MaterializeTupleTime: 603.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.75K (1746) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.86 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.93M (150925280) - RowsReturned: 150.93M (150925280) - RowsReturnedRate: 218.10 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 27.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.999ms - TotalReadThroughput: 70.55 MB/sec - TotalTime: 691.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.38 MB (188088320) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003b (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.42 GB Fragment Instance Lifecycle Event Timeline: 1s032ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s028ms (1s024ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s032ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.42 GB (5818301344) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 8.055ms - TotalThreadsUserTime: 962.727ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 79.32 KB/sec ; Min: 79.32 KB/sec ; Max: 79.32 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 198.863us ; Min: 147.746us ; Max: 249.981us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.635us ; Min: 11.927us ; Max: 19.344us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s028ms (1s000ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s028ms (996.009ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 60.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.819us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113059820) ; Min: 107.82 MB (113059820) ; Max: 107.82 MB (113059820) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.45 KB (28104) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113049390) ; Min: 107.81 MB (113049390) ; Max: 107.81 MB (113049390) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115358589) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115358589) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113105789) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113105789) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 604.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150306642) - RowsReturned: 150.31M (150306642) - RowsReturnedRate: 218.47 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 60.01 MB/sec - TotalTime: 688.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000039 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.41 GB Fragment Instance Lifecycle Event Timeline: 1s032ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s028ms (1s024ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s032ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.41 GB (5808397935) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 3.992ms - TotalThreadsUserTime: 966.211ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 34.22 KB/sec ; Min: 34.22 KB/sec ; Max: 34.22 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 278.699us ; Min: 214.949us ; Max: 342.450us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.300us ; Min: 11.389us ; Max: 19.212us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s028ms (1s000ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s028ms (1s000ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 66.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.38 MB (7733248) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 333.336us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 108.63 MB (113906273) ; Min: 108.63 MB (113906273) ; Max: 108.63 MB (113906273) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.49 KB (65014) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1752) - ParquetUncompressedBytesReadPerColumn: (Avg: 108.62 MB (113895761) ; Min: 108.62 MB (113895761) ; Max: 108.62 MB (113895761) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.48 KB (65008) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1752) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 111.02 MB (116410715) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 111.02 MB (116410715) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 108.67 MB (113953115) - IoReadAsyncRequest: 3.55K (3552) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 108.67 MB (113953115) - IoReadTotalRequest: 3.55K (3552) - MaterializeTupleTime: 608.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.75K (1752) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.87 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 151.43M (151431930) - RowsReturned: 151.43M (151431930) - RowsReturnedRate: 216.33 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 66.01 MB/sec - TotalTime: 700.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 180.00 MB (188743680) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000014 (host=impala-executor-000-5.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.691 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.17 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s028ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.17 GB (5552904504) - CompletionTime: 1s079ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.79 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105892) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 964.328ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 996.008ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 35.41 KB/sec ; Min: 35.41 KB/sec ; Max: 35.41 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 243.043us ; Min: 155.101us ; Max: 330.986us ; Number of samples: 2) - RpcRecvrTime: (Avg: 21.068us ; Min: 16.393us ; Max: 25.744us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s024ms (996.008ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.008ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 264.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s024ms (996.008ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 19.54 MB, 74.05 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 111.76 MB (117188512) ; Min: 111.76 MB (117188512) ; Max: 111.76 MB (117188512) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65068) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1801) - ParquetUncompressedBytesReadPerColumn: (Avg: 111.75 MB (117177706) ; Min: 111.75 MB (117177706) ; Max: 111.75 MB (117177706) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.54 KB (65062) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65534) ; Number of samples: 1801) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.05 MB (119591393) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.05 MB (119591393) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 111.81 MB (117236193) - IoReadAsyncRequest: 3.65K (3648) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 111.81 MB (117236193) - IoReadTotalRequest: 3.65K (3648) - MaterializeTupleTime: 588.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.80K (1801) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.64 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 155.80M (155795545) - RowsReturned: 155.80M (155795545) - RowsReturnedRate: 237.49 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 74.05 MB/sec - TotalTime: 656.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006e (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.68 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s028ms (1s028ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s028ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.68 GB (6099350097) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.42 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 4.019ms - TotalThreadsUserTime: 960.792ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s028ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 63.38 KB/sec ; Min: 63.38 KB/sec ; Max: 63.38 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 231.094us ; Min: 184.889us ; Max: 277.299us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.769us ; Min: 11.661us ; Max: 19.878us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s028ms (1s004ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 240.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 28.000ms (4.000ms) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s028ms (996.007ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 35.00 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.639us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113055935) ; Min: 107.82 MB (113055935) ; Max: 107.82 MB (113055935) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.46 KB (28122) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113045506) ; Min: 107.81 MB (113045506) ; Max: 107.81 MB (113045506) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115354703) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115354703) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 28.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113101903) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113101903) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 584.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150301466) - RowsReturned: 150.30M (150301466) - RowsReturnedRate: 218.46 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 688.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005b (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.42 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s028ms (1s028ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s028ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.42 GB (5816519694) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.17 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 4.014ms - TotalThreadsUserTime: 967.832ms - TotalThreadsVoluntaryContextSwitches: 67 (67) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s028ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 81.50 KB/sec ; Min: 81.50 KB/sec ; Max: 81.50 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 187.287us ; Min: 143.780us ; Max: 230.794us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.506us ; Min: 11.448us ; Max: 19.564us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s028ms (1s004ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 252.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s028ms (1s004ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 40.17 MB, 95.17 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8029584) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.88 MB (113123844) ; Min: 107.88 MB (113123844) ; Max: 107.88 MB (113123844) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.49 KB (65013) ; Min: 2.55 KB (2612) ; Max: 64.00 KB (65540) ; Number of samples: 1740) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.87 MB (113113405) ; Min: 107.87 MB (113113405) ; Max: 107.87 MB (113113405) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.48 KB (65007) ; Min: 2.55 KB (2607) ; Max: 64.00 KB (65534) ; Number of samples: 1740) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.17 MB (115525323) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.17 MB (115525323) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 28.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.93 MB (113170123) - IoReadAsyncRequest: 3.53K (3526) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.93 MB (113170123) - IoReadTotalRequest: 3.53K (3526) - MaterializeTupleTime: 588.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1740) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.39M (150391774) - RowsReturned: 150.39M (150391774) - RowsReturnedRate: 212.42 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 95.17 MB/sec - TotalTime: 708.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.00 MB (187695104) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000060 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.44 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s028ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.44 GB (5845180436) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 12.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 3.972ms - TotalThreadsUserTime: 965.241ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 89.54 KB/sec ; Min: 89.54 KB/sec ; Max: 89.54 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 179.693us ; Min: 130.883us ; Max: 228.503us ; Number of samples: 2) - RpcRecvrTime: (Avg: 29.760us ; Min: 13.407us ; Max: 46.114us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s024ms (1s000ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 332.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s024ms (1s000ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 94.90 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.71 MB (112941072) ; Min: 107.71 MB (112941072) ; Max: 107.71 MB (112941072) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65058) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1736) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.70 MB (112930656) ; Min: 107.70 MB (112930656) ; Max: 107.70 MB (112930656) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65052) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1736) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.90 MB (115239788) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.90 MB (115239788) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.75 MB (112986988) - IoReadAsyncRequest: 3.52K (3516) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.75 MB (112986988) - IoReadTotalRequest: 3.52K (3516) - MaterializeTupleTime: 560.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1736) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 8.94 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.15M (150148777) - RowsReturned: 150.15M (150148777) - RowsReturnedRate: 239.09 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 12.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 94.90 MB/sec - TotalTime: 628.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000000c (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s028ms (1s028ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s028ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.04 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851148671) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 3.963ms - TotalThreadsUserTime: 967.090ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s028ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 38.02 KB/sec ; Min: 38.02 KB/sec ; Max: 38.02 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 250.248us ; Min: 192.309us ; Max: 308.187us ; Number of samples: 2) - RpcRecvrTime: (Avg: 19.467us ; Min: 16.678us ; Max: 22.256us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s028ms (1s004ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 284.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s028ms (1s004ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 75.11 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.827us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118198472) ; Min: 112.72 MB (118198472) ; Max: 112.72 MB (118198472) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.47 KB (28134) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118187568) ; Min: 112.71 MB (118187568) ; Max: 112.71 MB (118187568) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.47 KB (28128) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 115.01 MB (120601729) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120601729) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118246529) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118246529) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 568.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157138208) - RowsReturned: 157.14M (157138208) - RowsReturnedRate: 244.00 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 75.11 MB/sec - TotalTime: 644.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000001 (host=impala-executor-000-1.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.682 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s028ms (1s028ms) - First Batch Produced: 1s028ms (0.000ns) - First Batch Sent: 1s028ms (0.000ns) - ExecInternal Finished: 1s028ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5852930371) - CompletionTime: 1s067ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 3.973ms - TotalThreadsUserTime: 997.266ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s028ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 50.45 KB/sec ; Min: 50.45 KB/sec ; Max: 50.45 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 220.393us ; Min: 208.524us ; Max: 232.263us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.344us ; Min: 11.007us ; Max: 21.681us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s028ms (1s004ms) - First Batch Requested: 1s028ms (0.000ns) - First Batch Returned: 1s028ms (0.000ns) - Last Batch Returned: 1s028ms (0.000ns) - Closed: 1s028ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s028ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s028ms (1s004ms) - Closed: 1s028ms (0.000ns) - BytesReadSeries (500.000ms): 20.00 MB, 70.18 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.64 MB (8013265) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.99 MB (107991082) ; Min: 102.99 MB (107991082) ; Max: 102.99 MB (107991082) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.49 KB (65015) ; Min: 7.10 KB (7270) ; Max: 64.00 KB (65534) ; Number of samples: 1661) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.98 MB (107981117) ; Min: 102.98 MB (107981117) ; Max: 102.98 MB (107981117) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.49 KB (65009) ; Min: 7.09 KB (7265) ; Max: 63.99 KB (65528) ; Number of samples: 1661) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.18 MB (110288080) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.18 MB (110288080) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.03 MB (108035280) - IoReadAsyncRequest: 3.37K (3366) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.03 MB (108035280) - IoReadTotalRequest: 3.37K (3366) - MaterializeTupleTime: 620.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1661) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 4.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.57M (143568023) - RowsReturned: 143.57M (143568023) - RowsReturnedRate: 205.10 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 70.18 MB/sec - TotalTime: 700.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.88 MB (179175424) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004b (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 1s028ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s028ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5864699534) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 967.381ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s028ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 996.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 59.03 KB/sec ; Min: 59.03 KB/sec ; Max: 59.03 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 180.802us ; Min: 163.077us ; Max: 198.528us ; Number of samples: 2) - RpcRecvrTime: (Avg: 19.553us ; Min: 14.877us ; Max: 24.230us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s024ms (996.001ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 284.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s024ms (996.001ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 44.32 MB, 104.67 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.68 MB (8050005) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 333.333us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.28 MB (117730523) ; Min: 112.28 MB (117730523) ; Max: 112.28 MB (117730523) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.48 KB (28140) ; Max: 64.00 KB (65534) ; Number of samples: 1810) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.27 MB (117719663) ; Min: 112.27 MB (117719663) ; Max: 112.27 MB (117719663) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65038) ; Min: 27.47 KB (28134) ; Max: 63.99 KB (65528) ; Number of samples: 1810) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.67 MB (120236299) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.67 MB (120236299) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.32 MB (117778699) - IoReadAsyncRequest: 3.67K (3668) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.32 MB (117778699) - IoReadTotalRequest: 3.67K (3668) - MaterializeTupleTime: 592.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1810) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 4.00 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.52M (156516083) - RowsReturned: 156.52M (156516083) - RowsReturnedRate: 234.31 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 104.67 MB/sec - TotalTime: 668.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.25 MB (196345856) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000068 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.12 GB Fragment Instance Lifecycle Event Timeline: 1s027ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s027ms (1s027ms) - First Batch Produced: 1s027ms (0.000ns) - First Batch Sent: 1s027ms (0.000ns) - ExecInternal Finished: 1s027ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.12 GB (5495713531) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.76 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 43.999ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s027ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 965.001ms - TotalThreadsVoluntaryContextSwitches: 65 (65) - TotalTime: 1s027ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s027ms - ExecTreeOpenTime: 999.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 68.60 KB/sec ; Min: 68.60 KB/sec ; Max: 68.60 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 189.810us ; Min: 170.825us ; Max: 208.795us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.736us ; Min: 11.673us ; Max: 19.799us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s027ms (999.998ms) - First Batch Requested: 1s027ms (0.000ns) - First Batch Returned: 1s027ms (0.000ns) - Last Batch Returned: 1s027ms (0.000ns) - Closed: 1s027ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 999.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 215.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:20 ExecOption: Codegen enabled: 20 out of 20, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s027ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s027ms (995.998ms) - Closed: 1s027ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - FooterProcessingTime: (Avg: 199.999us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 20) - InitialRangeActualReservation: (Avg: 7.80 MB (8178892) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 20) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.01 MB (102776160) ; Min: 98.01 MB (102776160) ; Max: 98.01 MB (102776160) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1580) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.01 MB (102766680) ; Min: 98.01 MB (102766680) ; Max: 98.01 MB (102766680) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1580) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.01 MB (104865956) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.01 MB (104865956) - DataCacheHitCount: 40 (40) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.05 MB (102817956) - IoReadAsyncRequest: 3.20K (3200) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.05 MB (102817956) - IoReadTotalRequest: 3.20K (3200) - MaterializeTupleTime: 623.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1580) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 20 (20) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 20 (20) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 2.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.64M (136635106) - RowsReturned: 136.64M (136635106) - RowsReturnedRate: 196.32 M/sec - ScanRangesComplete: 20 (20) - ScannerIoWaitTime: 43.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 35.999ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 695.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.50 MB (170393600) - CumulativeAllocations: 40 (40) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000063 (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s027ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s023ms (1s023ms) - First Batch Produced: 1s023ms (0.000ns) - First Batch Sent: 1s023ms (0.000ns) - ExecInternal Finished: 1s027ms (3.999ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6116914900) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.29 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 31.999ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s027ms - TotalThreadsSysTime: 8.058ms - TotalThreadsUserTime: 954.903ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s027ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s023ms - ExecTreeOpenTime: 995.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 54.53 KB/sec ; Min: 54.53 KB/sec ; Max: 54.53 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 212.338us ; Min: 209.769us ; Max: 214.908us ; Number of samples: 2) - RpcRecvrTime: (Avg: 22.402us ; Min: 20.644us ; Max: 24.161us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 3.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s023ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s023ms (995.998ms) - First Batch Requested: 1s023ms (0.000ns) - First Batch Returned: 1s023ms (0.000ns) - Last Batch Returned: 1s023ms (0.000ns) - Closed: 1s023ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 995.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 247.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s023ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s023ms (991.998ms) - Closed: 1s023ms (0.000ns) - BytesReadSeries (500.000ms): 15.20 MB, 70.20 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.67 MB (8044544) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.666us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.82 MB (118303080) ; Min: 112.82 MB (118303080) ; Max: 112.82 MB (118303080) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 27.47 KB (28128) ; Max: 64.00 KB (65540) ; Number of samples: 1819) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.81 MB (118292166) ; Min: 112.81 MB (118292166) ; Max: 112.81 MB (118292166) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1819) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.21 MB (120809066) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.21 MB (120809066) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.87 MB (118351466) - IoReadAsyncRequest: 3.69K (3686) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.87 MB (118351466) - IoReadTotalRequest: 3.69K (3686) - MaterializeTupleTime: 587.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1819) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.28M (157277286) - RowsReturned: 157.28M (157277286) - RowsReturnedRate: 234.04 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 31.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 23.999ms - TotalReadThroughput: 70.20 MB/sec - TotalTime: 671.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.12 MB (196214784) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000032 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117131001) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.46 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s024ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 963.471ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s024ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 996.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 86.17 KB/sec ; Min: 86.17 KB/sec ; Max: 86.17 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 184.648us ; Min: 135.990us ; Max: 233.306us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.975us ; Min: 12.547us ; Max: 23.403us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s024ms (996.009ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 228.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s024ms (996.009ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 58.70 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.914us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 110.29 MB (115644194) ; Min: 110.29 MB (115644194) ; Max: 110.29 MB (115644194) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 16.16 KB (16547) ; Max: 64.00 KB (65540) ; Number of samples: 1778) - ParquetUncompressedBytesReadPerColumn: (Avg: 110.28 MB (115633526) ; Min: 110.28 MB (115633526) ; Max: 110.28 MB (115633526) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65035) ; Min: 16.15 KB (16541) ; Max: 64.00 KB (65534) ; Number of samples: 1778) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 112.58 MB (118046564) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 112.58 MB (118046564) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 110.33 MB (115691364) - IoReadAsyncRequest: 3.60K (3602) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 110.33 MB (115691364) - IoReadTotalRequest: 3.60K (3602) - MaterializeTupleTime: 600.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.78K (1778) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 153.74M (153742391) - RowsReturned: 153.74M (153742391) - RowsReturnedRate: 220.89 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 58.70 MB/sec - TotalTime: 696.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 182.88 MB (191758336) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000073 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.44 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.44 GB (5842985477) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s024ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 965.372ms - TotalThreadsVoluntaryContextSwitches: 59 (59) - TotalTime: 1s024ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 996.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 60.21 KB/sec ; Min: 60.21 KB/sec ; Max: 60.21 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 249.363us ; Min: 194.619us ; Max: 304.107us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.098us ; Min: 14.907us ; Max: 25.290us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s024ms (996.007ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 220.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s024ms (996.007ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 35.00 MB, 85.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107916469) ; Min: 102.92 MB (107916469) ; Max: 102.92 MB (107916469) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107906514) ; Min: 102.91 MB (107906514) ; Max: 102.91 MB (107906514) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110110757) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110110757) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107960357) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107960357) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 600.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143468875) - RowsReturned: 143.47M (143468875) - RowsReturnedRate: 214.77 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 85.01 MB/sec - TotalTime: 668.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000058 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.47 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.47 GB (5873715127) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s024ms - TotalThreadsSysTime: 4.002ms - TotalThreadsUserTime: 960.662ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s024ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 80.84 KB/sec ; Min: 80.84 KB/sec ; Max: 80.84 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 191.424us ; Min: 144.962us ; Max: 237.886us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.722us ; Min: 11.563us ; Max: 23.882us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s024ms (1s000ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 248.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s024ms (1s000ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 44.36 MB, 99.37 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.08 MB (117524597) ; Min: 112.08 MB (117524597) ; Max: 112.08 MB (117524597) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65038) ; Min: 15.32 KB (15692) ; Max: 64.01 KB (65547) ; Number of samples: 1807) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.07 MB (117513754) ; Min: 112.07 MB (117513754) ; Max: 112.07 MB (117513754) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65032) ; Min: 15.32 KB (15687) ; Max: 64.00 KB (65540) ; Number of samples: 1807) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.37 MB (119927626) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.37 MB (119927626) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.13 MB (117572426) - IoReadAsyncRequest: 3.66K (3660) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.13 MB (117572426) - IoReadTotalRequest: 3.66K (3660) - MaterializeTupleTime: 616.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1807) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.24M (156242299) - RowsReturned: 156.24M (156242299) - RowsReturnedRate: 220.68 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 99.37 MB/sec - TotalTime: 708.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000059 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851109100) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.20 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s024ms - TotalThreadsSysTime: 3.970ms - TotalThreadsUserTime: 960.776ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s024ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 37.48 KB/sec ; Min: 37.48 KB/sec ; Max: 37.48 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 262.508us ; Min: 212.373us ; Max: 312.644us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.783us ; Min: 11.676us ; Max: 17.891us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s024ms (1s000ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s024ms (1s000ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 94.37 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.27 MB (107242629) ; Min: 102.27 MB (107242629) ; Max: 102.27 MB (107242629) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65034) ; Min: 11.21 KB (11481) ; Max: 64.01 KB (65547) ; Number of samples: 1649) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.27 MB (107232735) ; Min: 102.27 MB (107232735) ; Max: 102.27 MB (107232735) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65028) ; Min: 11.21 KB (11476) ; Max: 64.00 KB (65540) ; Number of samples: 1649) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 104.37 MB (109436675) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 104.37 MB (109436675) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.32 MB (107286275) - IoReadAsyncRequest: 3.34K (3340) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.32 MB (107286275) - IoReadTotalRequest: 3.34K (3340) - MaterializeTupleTime: 612.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.65K (1649) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 142.57M (142573003) - RowsReturned: 142.57M (142573003) - RowsReturnedRate: 206.03 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 94.37 MB/sec - TotalTime: 692.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000056 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s024ms (1s024ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117119665) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.44 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s024ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 966.880ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s024ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s024ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 87.61 KB/sec ; Min: 87.61 KB/sec ; Max: 87.61 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 178.967us ; Min: 133.761us ; Max: 224.173us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.516us ; Min: 12.599us ; Max: 18.434us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s024ms (1s000ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 1s000ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 264.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s024ms (1s000ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.827us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118192019) ; Min: 112.72 MB (118192019) ; Max: 112.72 MB (118192019) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118181116) ; Min: 112.71 MB (118181116) ; Max: 112.71 MB (118181116) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120595276) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120595276) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 24.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.76 MB (118240076) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.76 MB (118240076) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 592.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.13M (157129629) - RowsReturned: 157.13M (157129629) - RowsReturnedRate: 229.72 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 684.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006c (host=impala-executor-000-4.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.690 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s023ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s023ms (1s023ms) - First Batch Produced: 1s023ms (0.000ns) - First Batch Sent: 1s023ms (0.000ns) - ExecInternal Finished: 1s023ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851239837) - CompletionTime: 1s075ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.06 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 23.999ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s023ms - TotalThreadsSysTime: 4.019ms - TotalThreadsUserTime: 961.009ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s023ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s023ms - ExecTreeOpenTime: 995.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 39.44 KB/sec ; Min: 39.44 KB/sec ; Max: 39.44 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 255.012us ; Min: 212.863us ; Max: 297.162us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.216us ; Min: 12.262us ; Max: 20.173us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s023ms - Open Started: 27.999ms (27.999ms) - Open Finished: 1s023ms (995.998ms) - First Batch Requested: 1s023ms (0.000ns) - First Batch Returned: 1s023ms (0.000ns) - Last Batch Returned: 1s023ms (0.000ns) - Closed: 1s023ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 995.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 235.999ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s023ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 1s023ms (991.998ms) - Closed: 1s023ms (0.000ns) - BytesReadSeries (500.000ms): 15.00 MB, 65.17 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.62 MB (7992271) ; Min: 64.00 KB (65536) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.475us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.08 MB (102844396) ; Min: 98.08 MB (102844396) ; Max: 98.08 MB (102844396) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1581) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.07 MB (102834910) ; Min: 98.07 MB (102834910) ; Max: 98.07 MB (102834910) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28104) ; Max: 63.99 KB (65528) ; Number of samples: 1581) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.17 MB (105036873) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.17 MB (105036873) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.999ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.12 MB (102886473) - IoReadAsyncRequest: 3.20K (3204) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.12 MB (102886473) - IoReadTotalRequest: 3.20K (3204) - MaterializeTupleTime: 611.998ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1581) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 3.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.73M (136725837) - RowsReturned: 136.73M (136725837) - RowsReturnedRate: 194.21 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 23.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 27.999ms - TotalReadThroughput: 65.17 MB/sec - TotalTime: 703.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.69 MB (170590208) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000033 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.26 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.26 GB (5644605297) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.04 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 4.005ms - TotalThreadsUserTime: 952.719ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 992.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 65.46 KB/sec ; Min: 65.46 KB/sec ; Max: 65.46 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 193.988us ; Min: 179.029us ; Max: 208.947us ; Number of samples: 2) - RpcRecvrTime: (Avg: 18.884us ; Min: 11.799us ; Max: 25.970us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s020ms (992.009ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 992.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 220.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s020ms (988.009ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 65.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.639us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113056042) ; Min: 107.82 MB (113056042) ; Max: 107.82 MB (113056042) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113045613) ; Min: 107.81 MB (113045613) ; Max: 107.81 MB (113045613) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115354806) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115354806) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113102006) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113102006) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 592.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 6.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150301639) - RowsReturned: 150.30M (150301639) - RowsReturnedRate: 223.66 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 16.000ms - TotalReadThroughput: 65.01 MB/sec - TotalTime: 672.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003a (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.01 GB Fragment Instance Lifecycle Event Timeline: 1s024ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s024ms (1s020ms) - First Batch Produced: 1s024ms (0.000ns) - First Batch Sent: 1s024ms (0.000ns) - ExecInternal Finished: 1s024ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.01 GB (5377113034) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.80 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 3.987ms - TotalThreadsUserTime: 957.049ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 996.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 56.75 KB/sec ; Min: 56.75 KB/sec ; Max: 56.75 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 175.840us ; Min: 145.181us ; Max: 206.500us ; Number of samples: 2) - RpcRecvrTime: (Avg: 51.136us ; Min: 25.415us ; Max: 76.858us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s024ms (996.009ms) - First Batch Requested: 1s024ms (0.000ns) - First Batch Returned: 1s024ms (0.000ns) - Last Batch Returned: 1s024ms (0.000ns) - Closed: 1s024ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s024ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s024ms (996.009ms) - Closed: 1s024ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 60.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.914us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.56 MB (118029788) ; Min: 112.56 MB (118029788) ; Max: 112.56 MB (118029788) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65066) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1814) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.55 MB (118018904) ; Min: 112.55 MB (118018904) ; Max: 112.55 MB (118018904) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.54 KB (65060) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65534) ; Number of samples: 1814) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.85 MB (120432968) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.85 MB (120432968) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.61 MB (118077768) - IoReadAsyncRequest: 3.67K (3674) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.61 MB (118077768) - IoReadTotalRequest: 3.67K (3674) - MaterializeTupleTime: 544.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1814) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.91M (156913937) - RowsReturned: 156.91M (156913937) - RowsReturnedRate: 246.72 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 60.01 MB/sec - TotalTime: 636.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000006f (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5857997860) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.21 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 8.055ms - TotalThreadsUserTime: 950.653ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 996.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 56.16 KB/sec ; Min: 56.16 KB/sec ; Max: 56.16 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 241.021us ; Min: 208.669us ; Max: 273.373us ; Number of samples: 2) - RpcRecvrTime: (Avg: 18.759us ; Min: 15.946us ; Max: 21.572us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s020ms (996.007ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 212.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 24.000ms (24.000ms) - Open Finished: 28.000ms (4.000ms) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s020ms (992.007ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 35.01 MB, 85.23 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.62 MB (7995392) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.14 MB (102904522) ; Min: 98.14 MB (102904522) ; Max: 98.14 MB (102904522) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.47 KB (28128) ; Max: 64.00 KB (65540) ; Number of samples: 1582) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.13 MB (102895030) ; Min: 98.13 MB (102895030) ; Max: 98.13 MB (102895030) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1582) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.23 MB (105097032) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.23 MB (105097032) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.18 MB (102946632) - IoReadAsyncRequest: 3.21K (3206) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.18 MB (102946632) - IoReadTotalRequest: 3.21K (3206) - MaterializeTupleTime: 652.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1582) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.81M (136805759) - RowsReturned: 136.81M (136805759) - RowsReturnedRate: 184.87 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 85.23 MB/sec - TotalTime: 740.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.75 MB (170655744) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000077 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851304779) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 7.942ms - TotalThreadsUserTime: 953.057ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 992.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 66.00 KB/sec ; Min: 66.00 KB/sec ; Max: 66.00 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 274.853us ; Min: 177.556us ; Max: 372.150us ; Number of samples: 2) - RpcRecvrTime: (Avg: 22.960us ; Min: 18.310us ; Max: 27.610us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s020ms (992.007ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 992.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 292.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s020ms (992.007ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 95.12 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.36 MB (7716864) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.74 MB (112970205) ; Min: 107.74 MB (112970205) ; Max: 107.74 MB (112970205) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.48 KB (65000) ; Min: 5.07 KB (5187) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.73 MB (112959777) ; Min: 107.73 MB (112959777) ; Max: 107.73 MB (112959777) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.47 KB (64994) ; Min: 5.06 KB (5182) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.12 MB (115474297) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.12 MB (115474297) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.78 MB (113016697) - IoReadAsyncRequest: 3.52K (3524) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.78 MB (113016697) - IoReadTotalRequest: 3.52K (3524) - MaterializeTupleTime: 564.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.19M (150187469) - RowsReturned: 150.19M (150187469) - RowsReturnedRate: 233.21 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 95.12 MB/sec - TotalTime: 644.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.62 MB (188350464) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000019 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.64 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.64 GB (6054722346) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.44 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 7.994ms - TotalThreadsUserTime: 979.371ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 992.005ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 60.22 KB/sec ; Min: 60.22 KB/sec ; Max: 60.22 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 191.127us ; Min: 187.644us ; Max: 194.611us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.573us ; Min: 20.050us ; Max: 33.097us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s020ms (992.005ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 992.005ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s020ms (992.005ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 55.00 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.819us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.81 MB (113052210) ; Min: 107.81 MB (113052210) ; Max: 107.81 MB (113052210) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113041781) ; Min: 107.81 MB (113041781) ; Max: 107.81 MB (113041781) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115350973) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115350973) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113098173) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113098173) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 608.003ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150296545) - RowsReturned: 150.30M (150296545) - RowsReturnedRate: 224.99 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 55.00 MB/sec - TotalTime: 668.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005d (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851077464) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.20 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 12.110ms - TotalThreadsUserTime: 956.744ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 996.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 53.14 KB/sec ; Min: 53.14 KB/sec ; Max: 53.14 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 208.900us ; Min: 197.296us ; Max: 220.504us ; Number of samples: 2) - RpcRecvrTime: (Avg: 44.417us ; Min: 16.315us ; Max: 72.519us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s020ms (996.004ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 996.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s020ms (996.004ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 94.76 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.57 MB (112796265) ; Min: 107.57 MB (112796265) ; Max: 107.57 MB (112796265) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1734) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.56 MB (112785859) ; Min: 107.56 MB (112785859) ; Max: 107.56 MB (112785859) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1734) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.76 MB (115094932) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.76 MB (115094932) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.61 MB (112842132) - IoReadAsyncRequest: 3.51K (3512) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.61 MB (112842132) - IoReadTotalRequest: 3.51K (3512) - MaterializeTupleTime: 568.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.73K (1734) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 149.96M (149956257) - RowsReturned: 149.96M (149956257) - RowsReturnedRate: 224.48 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 94.76 MB/sec - TotalTime: 668.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000050 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.37 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.37 GB (5764909895) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.10 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 8.018ms - TotalThreadsUserTime: 954.171ms - TotalThreadsVoluntaryContextSwitches: 54 (54) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 992.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 65.98 KB/sec ; Min: 65.98 KB/sec ; Max: 65.98 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 170.248us ; Min: 162.885us ; Max: 177.612us ; Number of samples: 2) - RpcRecvrTime: (Avg: 21.531us ; Min: 15.633us ; Max: 27.430us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s020ms (992.001ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 992.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s020ms (992.001ms) - Closed: 1s020ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 545.455us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113056504) ; Min: 107.82 MB (113056504) ; Max: 107.82 MB (113056504) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113046076) ; Min: 107.81 MB (113046076) ; Max: 107.81 MB (113046076) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65043) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115355273) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115355273) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113102473) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113102473) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 616.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150302223) - RowsReturned: 150.30M (150302223) - RowsReturnedRate: 217.20 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 692.001ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000053 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.42 GB Fragment Instance Lifecycle Event Timeline: 1s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s020ms (1s020ms) - First Batch Produced: 1s020ms (0.000ns) - First Batch Sent: 1s020ms (0.000ns) - ExecInternal Finished: 1s020ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.42 GB (5814488872) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.15 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 15.917ms - TotalThreadsUserTime: 942.790ms - TotalThreadsVoluntaryContextSwitches: 59 (59) - TotalTime: 1s020ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 992.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 59.43 KB/sec ; Min: 59.43 KB/sec ; Max: 59.43 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 179.265us ; Min: 161.363us ; Max: 197.168us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.722us ; Min: 15.368us ; Max: 26.076us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s020ms (992.001ms) - First Batch Requested: 1s020ms (0.000ns) - First Batch Returned: 1s020ms (0.000ns) - Last Batch Returned: 1s020ms (0.000ns) - Closed: 1s020ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 992.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 224.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s020ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s016ms (988.001ms) - Closed: 1s020ms (4.000ms) - BytesReadSeries (500.000ms): 50.01 MB, 105.02 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.73 MB (118201734) ; Min: 112.73 MB (118201734) ; Max: 112.73 MB (118201734) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65053) ; Min: 27.46 KB (28122) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.72 MB (118190830) ; Min: 112.72 MB (118190830) ; Max: 112.72 MB (118190830) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.02 MB (120604991) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.02 MB (120604991) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118249791) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118249791) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 572.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157142555) - RowsReturned: 157.14M (157142555) - RowsReturnedRate: 235.24 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 105.02 MB/sec - TotalTime: 668.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001d (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.49 GB Fragment Instance Lifecycle Event Timeline: 1s016ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s016ms (1s016ms) - First Batch Produced: 1s016ms (0.000ns) - First Batch Sent: 1s016ms (0.000ns) - ExecInternal Finished: 1s016ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.49 GB (5896013441) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.30 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s016ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 957.663ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s016ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s016ms - ExecTreeOpenTime: 988.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 64.82 KB/sec ; Min: 64.82 KB/sec ; Max: 64.82 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 178.876us ; Min: 176.970us ; Max: 180.783us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.059us ; Min: 20.981us ; Max: 31.137us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s016ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s016ms (988.004ms) - First Batch Requested: 1s016ms (0.000ns) - First Batch Returned: 1s016ms (0.000ns) - Last Batch Returned: 1s016ms (0.000ns) - Closed: 1s016ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 988.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 236.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s016ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s016ms (988.004ms) - Closed: 1s016ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 64.86 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.57 MB (118042984) ; Min: 112.57 MB (118042984) ; Max: 112.57 MB (118042984) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 7.12 KB (7288) ; Max: 64.01 KB (65547) ; Number of samples: 1815) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.56 MB (118032094) ; Min: 112.56 MB (118032094) ; Max: 112.56 MB (118032094) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 7.11 KB (7283) ; Max: 64.00 KB (65540) ; Number of samples: 1815) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.87 MB (120446188) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.87 MB (120446188) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.62 MB (118090988) - IoReadAsyncRequest: 3.68K (3676) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.62 MB (118090988) - IoReadTotalRequest: 3.68K (3676) - MaterializeTupleTime: 584.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1815) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.93M (156931483) - RowsReturned: 156.93M (156931483) - RowsReturnedRate: 232.15 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 64.86 MB/sec - TotalTime: 676.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001c (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s016ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s016ms (1s016ms) - First Batch Produced: 1s016ms (0.000ns) - First Batch Sent: 1s016ms (0.000ns) - ExecInternal Finished: 1s016ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117108374) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.50 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s016ms - TotalThreadsSysTime: 3.951ms - TotalThreadsUserTime: 952.198ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s016ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s016ms - ExecTreeOpenTime: 988.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 85.88 KB/sec ; Min: 85.88 KB/sec ; Max: 85.88 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 167.219us ; Min: 136.456us ; Max: 197.983us ; Number of samples: 2) - RpcRecvrTime: (Avg: 18.131us ; Min: 12.062us ; Max: 24.201us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s016ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s016ms (988.004ms) - First Batch Requested: 1s016ms (0.000ns) - First Batch Returned: 1s016ms (0.000ns) - Last Batch Returned: 1s016ms (0.000ns) - Closed: 1s016ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 988.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 240.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s016ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s016ms (988.004ms) - Closed: 1s016ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 55.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8031138) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.32 MB (108341500) ; Min: 103.32 MB (108341500) ; Max: 103.32 MB (108341500) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65030) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1666) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.31 MB (108331503) ; Min: 103.31 MB (108331503) ; Max: 103.31 MB (108331503) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65024) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1666) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.51 MB (110638617) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.51 MB (110638617) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.36 MB (108385817) - IoReadAsyncRequest: 3.38K (3376) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.36 MB (108385817) - IoReadTotalRequest: 3.38K (3376) - MaterializeTupleTime: 624.003ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.67K (1666) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 8.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 144.03M (144033920) - RowsReturned: 144.03M (144033920) - RowsReturnedRate: 205.76 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 16.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 55.01 MB/sec - TotalTime: 700.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.25 MB (179568640) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000037 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s012ms (1s008ms) - First Batch Produced: 1s012ms (0.000ns) - First Batch Sent: 1s012ms (0.000ns) - ExecInternal Finished: 1s012ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851414473) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 7.770ms - TotalThreadsUserTime: 947.834ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 984.009ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 88.99 KB/sec ; Min: 88.99 KB/sec ; Max: 88.99 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 176.658us ; Min: 131.683us ; Max: 221.633us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.401us ; Min: 11.177us ; Max: 17.626us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s012ms (984.009ms) - First Batch Requested: 1s012ms (0.000ns) - First Batch Returned: 1s012ms (0.000ns) - Last Batch Returned: 1s012ms (0.000ns) - Closed: 1s012ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 988.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s012ms (984.009ms) - Closed: 1s012ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 60.00 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107918128) ; Min: 102.92 MB (107918128) ; Max: 102.92 MB (107918128) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28104) ; Max: 64.01 KB (65547) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107908173) ; Min: 102.91 MB (107908173) ; Max: 102.91 MB (107908173) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.01 MB (110112405) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110112405) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107962005) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107962005) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 628.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143471071) - RowsReturned: 143.47M (143471071) - RowsReturnedRate: 202.64 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 60.00 MB/sec - TotalTime: 708.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000035 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.52 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s012ms (1s012ms) - First Batch Produced: 1s012ms (0.000ns) - First Batch Sent: 1s012ms (0.000ns) - ExecInternal Finished: 1s012ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.52 GB (5923368447) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.28 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s012ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 952.908ms - TotalThreadsVoluntaryContextSwitches: 56 (56) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s012ms - ExecTreeOpenTime: 984.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 61.49 KB/sec ; Min: 61.49 KB/sec ; Max: 61.49 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 206.135us ; Min: 190.589us ; Max: 221.681us ; Number of samples: 2) - RpcRecvrTime: (Avg: 22.112us ; Min: 12.541us ; Max: 31.684us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s012ms (984.009ms) - First Batch Requested: 1s012ms (0.000ns) - First Batch Returned: 1s012ms (0.000ns) - Last Batch Returned: 1s012ms (0.000ns) - Closed: 1s012ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 984.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 212.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 32.000ms (4.000ms) - Last Batch Returned: 1s012ms (980.009ms) - Closed: 1s012ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 57.86 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.46 MB (7822615) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.819us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 100.85 MB (105747052) ; Min: 100.85 MB (105747052) ; Max: 100.85 MB (105747052) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.47 KB (64995) ; Min: 1.46 KB (1499) ; Max: 64.00 KB (65534) ; Number of samples: 1627) - ParquetUncompressedBytesReadPerColumn: (Avg: 100.84 MB (105737292) ; Min: 100.84 MB (105737292) ; Max: 100.84 MB (105737292) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.47 KB (64989) ; Min: 1.46 KB (1494) ; Max: 63.99 KB (65528) ; Number of samples: 1627) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 103.04 MB (108043260) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.04 MB (108043260) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 100.89 MB (105790460) - IoReadAsyncRequest: 3.30K (3298) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 100.89 MB (105790460) - IoReadTotalRequest: 3.30K (3298) - MaterializeTupleTime: 584.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.63K (1627) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 4.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 140.58M (140584731) - RowsReturned: 140.58M (140584731) - RowsReturnedRate: 210.45 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 57.86 MB/sec - TotalTime: 668.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.88 MB (174981120) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000072 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.65 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s012ms (1s012ms) - First Batch Produced: 1s012ms (0.000ns) - First Batch Sent: 1s012ms (0.000ns) - ExecInternal Finished: 1s012ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.65 GB (6065572521) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.39 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s012ms - TotalThreadsSysTime: 4.051ms - TotalThreadsUserTime: 939.811ms - TotalThreadsVoluntaryContextSwitches: 72 (72) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s012ms - ExecTreeOpenTime: 984.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 51.91 KB/sec ; Min: 51.91 KB/sec ; Max: 51.91 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 260.584us ; Min: 225.771us ; Max: 295.398us ; Number of samples: 2) - RpcRecvrTime: (Avg: 20.969us ; Min: 17.621us ; Max: 24.318us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s012ms (984.007ms) - First Batch Requested: 1s012ms (0.000ns) - First Batch Returned: 1s012ms (0.000ns) - Last Batch Returned: 1s012ms (0.000ns) - Closed: 1s012ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 984.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 308.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s012ms (984.007ms) - Closed: 1s012ms (0.000ns) - BytesReadSeries (500.000ms): 40.35 MB, 100.35 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.68 MB (8050005) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.667us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.96 MB (118451986) ; Min: 112.96 MB (118451986) ; Max: 112.96 MB (118451986) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.46 KB (28116) ; Max: 64.01 KB (65547) ; Number of samples: 1821) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.95 MB (118441059) ; Min: 112.95 MB (118441059) ; Max: 112.95 MB (118441059) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1821) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.35 MB (120958004) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.35 MB (120958004) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 113.01 MB (118500404) - IoReadAsyncRequest: 3.69K (3690) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 113.01 MB (118500404) - IoReadTotalRequest: 3.69K (3690) - MaterializeTupleTime: 468.003ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1821) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.48M (157475246) - RowsReturned: 157.48M (157475246) - RowsReturnedRate: 279.21 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 44.000ms - TotalReadThroughput: 100.35 MB/sec - TotalTime: 564.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.25 MB (196345856) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000076 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s012ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851178692) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s012ms - TotalThreadsSysTime: 3.959ms - TotalThreadsUserTime: 942.277ms - TotalThreadsVoluntaryContextSwitches: 62 (62) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 60.89 KB/sec ; Min: 60.89 KB/sec ; Max: 60.89 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 251.844us ; Min: 192.468us ; Max: 311.220us ; Number of samples: 2) - RpcRecvrTime: (Avg: 22.723us ; Min: 17.992us ; Max: 27.455us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.007ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.007ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 39.05 MB, 92.64 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.64 MB (8007307) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 105.44 MB (110565957) ; Min: 105.44 MB (110565957) ; Max: 105.44 MB (110565957) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65038) ; Min: 12.64 KB (12943) ; Max: 64.01 KB (65547) ; Number of samples: 1700) - ParquetUncompressedBytesReadPerColumn: (Avg: 105.43 MB (110555756) ; Min: 105.43 MB (110555756) ; Max: 105.43 MB (110555756) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65032) ; Min: 12.63 KB (12938) ; Max: 64.00 KB (65540) ; Number of samples: 1700) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 107.64 MB (112863850) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.64 MB (112863850) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 105.49 MB (110611050) - IoReadAsyncRequest: 3.44K (3444) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 105.49 MB (110611050) - IoReadTotalRequest: 3.44K (3444) - MaterializeTupleTime: 556.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.70K (1700) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 146.99M (146991214) - RowsReturned: 146.99M (146991214) - RowsReturnedRate: 231.12 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 92.64 MB/sec - TotalTime: 636.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.75 MB (179044352) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001a (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s012ms (1s012ms) - First Batch Produced: 1s012ms (0.000ns) - First Batch Sent: 1s012ms (0.000ns) - ExecInternal Finished: 1s012ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117450535) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.50 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s012ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 949.021ms - TotalThreadsVoluntaryContextSwitches: 65 (65) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s012ms - ExecTreeOpenTime: 984.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 82.42 KB/sec ; Min: 82.42 KB/sec ; Max: 82.42 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 174.846us ; Min: 142.191us ; Max: 207.501us ; Number of samples: 2) - RpcRecvrTime: (Avg: 22.710us ; Min: 11.790us ; Max: 33.630us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s012ms (984.004ms) - First Batch Requested: 1s012ms (0.000ns) - First Batch Returned: 1s012ms (0.000ns) - Last Batch Returned: 1s012ms (0.000ns) - Closed: 1s012ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 984.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s012ms (984.004ms) - Closed: 1s012ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 63.51 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.56 MB (7927234) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 116.90 MB (122573465) ; Min: 116.90 MB (122573465) ; Max: 116.90 MB (122573465) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 19.56 KB (20030) ; Max: 64.01 KB (65547) ; Number of samples: 1885) - ParquetUncompressedBytesReadPerColumn: (Avg: 116.88 MB (122562154) ; Min: 116.88 MB (122562154) ; Max: 116.88 MB (122562154) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65019) ; Min: 19.55 KB (20024) ; Max: 64.00 KB (65540) ; Number of samples: 1885) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 119.38 MB (125183626) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 119.38 MB (125183626) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 116.94 MB (122623626) - IoReadAsyncRequest: 3.82K (3820) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 116.94 MB (122623626) - IoReadTotalRequest: 3.82K (3820) - MaterializeTupleTime: 568.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.89K (1885) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 162.95M (162954494) - RowsReturned: 162.95M (162954494) - RowsReturnedRate: 251.47 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 63.51 MB/sec - TotalTime: 648.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 192.12 MB (201457664) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001f (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.03 GB Fragment Instance Lifecycle Event Timeline: 1s012ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s012ms (1s012ms) - First Batch Produced: 1s012ms (0.000ns) - First Batch Sent: 1s012ms (0.000ns) - ExecInternal Finished: 1s012ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.03 GB (5400150831) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.85 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s012ms - TotalThreadsSysTime: 3.981ms - TotalThreadsUserTime: 947.659ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s012ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s012ms - ExecTreeOpenTime: 984.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 83.23 KB/sec ; Min: 83.23 KB/sec ; Max: 83.23 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 171.959us ; Min: 140.799us ; Max: 203.119us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.619us ; Min: 11.783us ; Max: 19.455us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s012ms (984.004ms) - First Batch Requested: 1s012ms (0.000ns) - First Batch Returned: 1s012ms (0.000ns) - Last Batch Returned: 1s012ms (0.000ns) - Closed: 1s012ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 984.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s012ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s012ms (984.004ms) - Closed: 1s012ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 60.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113057417) ; Min: 107.82 MB (113057417) ; Max: 107.82 MB (113057417) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.47 KB (28128) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113046989) ; Min: 107.81 MB (113046989) ; Max: 107.81 MB (113046989) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115356181) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115356181) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.86 MB (113103381) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.86 MB (113103381) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 556.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 5.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.30M (150303460) - RowsReturned: 150.30M (150303460) - RowsReturnedRate: 233.39 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 60.01 MB/sec - TotalTime: 644.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000078 (host=impala-executor-000-6.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.659 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.22 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.22 GB (5604247659) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.98 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105898) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 7.915ms - TotalThreadsUserTime: 941.906ms - TotalThreadsVoluntaryContextSwitches: 57 (57) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.007ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 20.85 KB/sec ; Min: 20.85 KB/sec ; Max: 20.85 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 404.783us ; Min: 247.450us ; Max: 562.116us ; Number of samples: 2) - RpcRecvrTime: (Avg: 23.714us ; Min: 19.228us ; Max: 28.201us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.007ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.007ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.007ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 37.01 MB, 87.10 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.50 MB (7864320) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 104.81 MB (109902972) ; Min: 104.81 MB (109902972) ; Max: 104.81 MB (109902972) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 19.70 KB (20175) ; Max: 64.01 KB (65547) ; Number of samples: 1690) - ParquetUncompressedBytesReadPerColumn: (Avg: 104.80 MB (109892830) ; Min: 104.80 MB (109892830) ; Max: 104.80 MB (109892830) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 19.70 KB (20169) ; Max: 64.00 KB (65540) ; Number of samples: 1690) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 107.10 MB (112303311) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.10 MB (112303311) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 104.85 MB (109948111) - IoReadAsyncRequest: 3.43K (3426) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 104.85 MB (109948111) - IoReadTotalRequest: 3.43K (3426) - MaterializeTupleTime: 564.004ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.69K (1690) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 146.11M (146109793) - RowsReturned: 146.11M (146109793) - RowsReturnedRate: 225.48 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 87.10 MB/sec - TotalTime: 648.004ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 175.38 MB (183894016) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000022 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.42 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.42 GB (5815313340) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.23 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 945.888ms - TotalThreadsVoluntaryContextSwitches: 64 (64) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 84.01 KB/sec ; Min: 84.01 KB/sec ; Max: 84.01 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 182.125us ; Min: 139.494us ; Max: 224.757us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.768us ; Min: 11.414us ; Max: 18.122us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.004ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.004ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 58.85 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.10 MB (106008497) ; Min: 101.10 MB (106008497) ; Max: 101.10 MB (106008497) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.55 KB (65075) ; Min: 27.45 KB (28104) ; Max: 64.01 KB (65547) ; Number of samples: 1629) - ParquetUncompressedBytesReadPerColumn: (Avg: 101.09 MB (105998721) ; Min: 101.09 MB (105998721) ; Max: 101.09 MB (105998721) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.54 KB (65069) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65540) ; Number of samples: 1629) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 103.19 MB (108202091) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.19 MB (108202091) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 101.14 MB (106051691) - IoReadAsyncRequest: 3.30K (3300) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 101.14 MB (106051691) - IoReadTotalRequest: 3.30K (3300) - MaterializeTupleTime: 604.003ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.63K (1629) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.80 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 140.93M (140932312) - RowsReturned: 140.93M (140932312) - RowsReturnedRate: 206.04 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 58.85 MB/sec - TotalTime: 684.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.62 MB (174718976) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000024 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 4.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851188375) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.26 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 943.749ms - TotalThreadsVoluntaryContextSwitches: 67 (67) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 66.41 KB/sec ; Min: 66.41 KB/sec ; Max: 66.41 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 165.534us ; Min: 154.619us ; Max: 176.450us ; Number of samples: 2) - RpcRecvrTime: (Avg: 27.956us ; Min: 17.417us ; Max: 38.496us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.004ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 252.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.004ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 1.17 MB, 62.09 MB - ColumnarScannerActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.46 MB (7820629) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.667us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.67 MB (8039082) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 109.71 MB (115038872) ; Min: 109.71 MB (115038872) ; Max: 109.71 MB (115038872) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.47 KB (64993) ; Min: 5.01 KB (5127) ; Max: 64.01 KB (65547) ; Number of samples: 1770) - ParquetUncompressedBytesReadPerColumn: (Avg: 109.70 MB (115028253) ; Min: 109.70 MB (115028253) ; Max: 109.70 MB (115028253) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.46 KB (64987) ; Min: 5.00 KB (5122) ; Max: 64.00 KB (65540) ; Number of samples: 1770) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 112.10 MB (117543721) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 112.10 MB (117543721) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 24.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 109.75 MB (115086121) - IoReadAsyncRequest: 3.59K (3588) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 109.75 MB (115086121) - IoReadTotalRequest: 3.59K (3588) - MaterializeTupleTime: 564.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.77K (1770) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 152.94M (152937670) - RowsReturned: 152.94M (152937670) - RowsReturnedRate: 228.95 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 62.09 MB/sec - TotalTime: 668.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 182.00 MB (190840832) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000020 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.44 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.44 GB (5843339395) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.25 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 4.013ms - TotalThreadsUserTime: 947.132ms - TotalThreadsVoluntaryContextSwitches: 55 (55) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 86.31 KB/sec ; Min: 86.31 KB/sec ; Max: 86.31 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 176.313us ; Min: 135.775us ; Max: 216.851us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.951us ; Min: 11.914us ; Max: 17.988us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.004ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.004ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 60.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118196699) ; Min: 112.72 MB (118196699) ; Max: 112.72 MB (118196699) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118185795) ; Min: 112.71 MB (118185795) ; Max: 112.71 MB (118185795) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120599946) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120599946) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.77 MB (118244746) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.77 MB (118244746) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 544.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.14M (157135849) - RowsReturned: 157.14M (157135849) - RowsReturnedRate: 256.76 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 60.01 MB/sec - TotalTime: 612.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000057 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117282699) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.44 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 8.135ms - TotalThreadsUserTime: 943.886ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 984.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 83.71 KB/sec ; Min: 83.71 KB/sec ; Max: 83.71 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 188.979us ; Min: 139.995us ; Max: 237.963us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.906us ; Min: 11.089us ; Max: 18.724us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s008ms (984.004ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 984.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s008ms (984.004ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 100.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113058745) ; Min: 107.82 MB (113058745) ; Max: 107.82 MB (113058745) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.45 KB (28104) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113048316) ; Min: 107.81 MB (113048316) ; Max: 107.81 MB (113048316) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.44 KB (28098) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115357518) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115357518) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113104718) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113104718) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 528.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150305224) - RowsReturned: 150.31M (150305224) - RowsReturnedRate: 239.34 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 100.01 MB/sec - TotalTime: 628.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005e (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.21 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s008ms (4.000ms) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.21 GB (5590875820) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.97 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 8.125ms - TotalThreadsUserTime: 941.835ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 61.02 KB/sec ; Min: 61.02 KB/sec ; Max: 61.02 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 195.238us ; Min: 192.045us ; Max: 198.432us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.736us ; Min: 12.779us ; Max: 22.694us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4.000ms - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s004ms (980.004ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s008ms (4.000ms) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s004ms (980.004ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 105.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.72 MB (118193712) ; Min: 112.72 MB (118193712) ; Max: 112.72 MB (118193712) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1817) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.71 MB (118182810) ; Min: 112.71 MB (118182810) ; Max: 112.71 MB (118182810) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1817) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.01 MB (120596971) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.01 MB (120596971) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 20.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.76 MB (118241771) - IoReadAsyncRequest: 3.68K (3680) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.76 MB (118241771) - IoReadTotalRequest: 3.68K (3680) - MaterializeTupleTime: 576.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1817) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.13M (157131896) - RowsReturned: 157.13M (157131896) - RowsReturnedRate: 238.08 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 105.01 MB/sec - TotalTime: 660.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004d (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851104273) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 940.780ms - TotalThreadsVoluntaryContextSwitches: 71 (71) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 36.44 KB/sec ; Min: 36.44 KB/sec ; Max: 36.44 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 275.422us ; Min: 229.249us ; Max: 321.595us ; Number of samples: 2) - RpcRecvrTime: (Avg: 23.375us ; Min: 14.859us ; Max: 31.892us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.001ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 284.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.001ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 45.22 MB, 105.22 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.67 MB (8044544) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.666us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.84 MB (118316727) ; Min: 112.84 MB (118316727) ; Max: 112.84 MB (118316727) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1819) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.83 MB (118305813) ; Min: 112.83 MB (118305813) ; Max: 112.83 MB (118305813) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65038) ; Min: 27.45 KB (28110) ; Max: 63.99 KB (65528) ; Number of samples: 1819) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.23 MB (120822702) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.23 MB (120822702) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.88 MB (118365102) - IoReadAsyncRequest: 3.69K (3686) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.88 MB (118365102) - IoReadTotalRequest: 3.69K (3686) - MaterializeTupleTime: 536.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1819) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 3.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.30M (157295399) - RowsReturned: 157.30M (157295399) - RowsReturnedRate: 252.08 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 105.22 MB/sec - TotalTime: 624.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.12 MB (196214784) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000052 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s008ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s008ms (1s008ms) - First Batch Produced: 1s008ms (0.000ns) - First Batch Sent: 1s008ms (0.000ns) - ExecInternal Finished: 1s008ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851269079) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 1s008ms - TotalThreadsSysTime: 4.041ms - TotalThreadsUserTime: 941.763ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s008ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s008ms - ExecTreeOpenTime: 980.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 55.64 KB/sec ; Min: 55.64 KB/sec ; Max: 55.64 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 217.235us ; Min: 210.615us ; Max: 223.855us ; Number of samples: 2) - RpcRecvrTime: (Avg: 18.430us ; Min: 14.599us ; Max: 22.262us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s008ms (980.001ms) - First Batch Requested: 1s008ms (0.000ns) - First Batch Returned: 1s008ms (0.000ns) - Last Batch Returned: 1s008ms (0.000ns) - Closed: 1s008ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s008ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s008ms (980.001ms) - Closed: 1s008ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 105.15 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.67 MB (8041813) ; Min: 64.00 KB (65536) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 166.666us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.76 MB (118238637) ; Min: 112.76 MB (118238637) ; Max: 112.76 MB (118238637) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65037) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1818) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.75 MB (118227729) ; Min: 112.75 MB (118227729) ; Max: 112.75 MB (118227729) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1818) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 115.15 MB (120744589) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.15 MB (120744589) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.81 MB (118286989) - IoReadAsyncRequest: 3.68K (3684) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.81 MB (118286989) - IoReadTotalRequest: 3.68K (3684) - MaterializeTupleTime: 540.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.82K (1818) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 157.19M (157191597) - RowsReturned: 157.19M (157191597) - RowsReturnedRate: 248.72 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 105.15 MB/sec - TotalTime: 632.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 187.06 MB (196149248) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000038 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s004ms (1s000ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851098514) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.22 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 24.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 1s000ms - TotalThreadsSysTime: 3.961ms - TotalThreadsUserTime: 938.756ms - TotalThreadsVoluntaryContextSwitches: 54 (54) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 976.009ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 71.34 KB/sec ; Min: 71.34 KB/sec ; Max: 71.34 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 190.757us ; Min: 164.258us ; Max: 217.257us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.813us ; Min: 13.880us ; Max: 19.747us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s004ms (976.009ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 976.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 260.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s004ms (976.009ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 58.64 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.478us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.55 MB (106487752) ; Min: 101.55 MB (106487752) ; Max: 101.55 MB (106487752) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65050) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1637) - ParquetUncompressedBytesReadPerColumn: (Avg: 101.55 MB (106477928) ; Min: 101.55 MB (106477928) ; Max: 101.55 MB (106477928) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65044) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1637) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 103.65 MB (108681520) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.65 MB (108681520) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 101.60 MB (106531120) - IoReadAsyncRequest: 3.32K (3316) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 101.60 MB (106531120) - IoReadTotalRequest: 3.32K (3316) - MaterializeTupleTime: 548.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.64K (1637) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 5.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 141.57M (141569431) - RowsReturned: 141.57M (141569431) - RowsReturnedRate: 231.32 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 24.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 20.000ms - TotalReadThroughput: 58.64 MB/sec - TotalTime: 612.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.62 MB (174718976) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000031 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.70 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s000ms (1s000ms) - First Batch Produced: 1s000ms (0.000ns) - First Batch Sent: 1s000ms (0.000ns) - ExecInternal Finished: 1s004ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.70 GB (6117128713) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.46 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 52.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 4.083ms - TotalThreadsUserTime: 963.651ms - TotalThreadsVoluntaryContextSwitches: 53 (53) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 972.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 36.86 KB/sec ; Min: 36.86 KB/sec ; Max: 36.86 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 247.380us ; Min: 176.817us ; Max: 317.944us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.898us ; Min: 15.033us ; Max: 38.764us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s000ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s000ms (972.009ms) - First Batch Requested: 1s000ms (0.000ns) - First Batch Returned: 1s000ms (0.000ns) - Last Batch Returned: 1s000ms (0.000ns) - Closed: 1s000ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 972.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 236.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s000ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s000ms (972.009ms) - Closed: 1s000ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 67.56 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.52 MB (7887115) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 347.829us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 106.35 MB (111512772) ; Min: 106.35 MB (111512772) ; Max: 106.35 MB (111512772) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65022) ; Min: 13.75 KB (14080) ; Max: 64.01 KB (65547) ; Number of samples: 1715) - ParquetUncompressedBytesReadPerColumn: (Avg: 106.34 MB (111502481) ; Min: 106.34 MB (111502481) ; Max: 106.34 MB (111502481) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.49 KB (65016) ; Min: 13.75 KB (14075) ; Max: 64.00 KB (65540) ; Number of samples: 1715) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 108.64 MB (113913684) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 108.64 MB (113913684) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 24.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 106.39 MB (111558484) - IoReadAsyncRequest: 3.48K (3476) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 106.39 MB (111558484) - IoReadTotalRequest: 3.48K (3476) - MaterializeTupleTime: 564.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.72K (1715) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 148.25M (148249958) - RowsReturned: 148.25M (148249958) - RowsReturnedRate: 225.99 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 52.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 44.000ms - TotalReadThroughput: 67.56 MB/sec - TotalTime: 656.006ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 175.88 MB (184418304) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000036 (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.47 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.47 GB (5873844394) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.24 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 4.024ms - TotalThreadsUserTime: 941.618ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 976.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 75.36 KB/sec ; Min: 75.36 KB/sec ; Max: 75.36 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 195.436us ; Min: 155.506us ; Max: 235.367us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.532us ; Min: 11.960us ; Max: 23.104us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s004ms (976.009ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 976.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s004ms (976.009ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 54.40 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.819us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.21 MB (112419795) ; Min: 107.21 MB (112419795) ; Max: 107.21 MB (112419795) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65057) ; Min: 27.48 KB (28140) ; Max: 64.00 KB (65540) ; Number of samples: 1728) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.20 MB (112409427) ; Min: 107.20 MB (112409427) ; Max: 107.20 MB (112409427) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.47 KB (28134) ; Max: 64.00 KB (65534) ; Number of samples: 1728) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.40 MB (114718326) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.40 MB (114718326) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.26 MB (112465526) - IoReadAsyncRequest: 3.50K (3500) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.26 MB (112465526) - IoReadTotalRequest: 3.50K (3500) - MaterializeTupleTime: 540.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.73K (1728) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.82 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 149.46M (149455793) - RowsReturned: 149.46M (149455793) - RowsReturnedRate: 242.62 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 54.40 MB/sec - TotalTime: 616.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000023 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.37 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.37 GB (5770018084) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 7.910ms - TotalThreadsUserTime: 937.017ms - TotalThreadsVoluntaryContextSwitches: 59 (59) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 976.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 70.54 KB/sec ; Min: 70.54 KB/sec ; Max: 70.54 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 191.196us ; Min: 166.121us ; Max: 216.271us ; Number of samples: 2) - RpcRecvrTime: (Avg: 16.584us ; Min: 14.628us ; Max: 18.541us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s004ms (976.004ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 976.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 320.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s004ms (976.004ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 55.34 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.65 MB (8019223) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.638us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 103.16 MB (108171369) ; Min: 103.16 MB (108171369) ; Max: 103.16 MB (108171369) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1663) - ParquetUncompressedBytesReadPerColumn: (Avg: 103.15 MB (108161391) ; Min: 103.15 MB (108161391) ; Max: 103.15 MB (108161391) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.51 KB (65039) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65534) ; Number of samples: 1663) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 105.35 MB (110468407) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.35 MB (110468407) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 103.20 MB (108215607) - IoReadAsyncRequest: 3.37K (3370) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 103.20 MB (108215607) - IoReadTotalRequest: 3.37K (3370) - MaterializeTupleTime: 528.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1663) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 8.57 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.81M (143807744) - RowsReturned: 143.81M (143807744) - RowsReturnedRate: 238.09 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 20.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 12.000ms - TotalReadThroughput: 55.34 MB/sec - TotalTime: 604.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 171.00 MB (179306496) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005f (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.00 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.00 GB (5367445761) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.77 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 11.996ms - TotalThreadsUserTime: 931.759ms - TotalThreadsVoluntaryContextSwitches: 65 (65) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 86.83 KB/sec ; Min: 86.83 KB/sec ; Max: 86.83 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 186.197us ; Min: 134.955us ; Max: 237.439us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.581us ; Min: 11.225us ; Max: 17.937us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s004ms (980.004ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 312.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:25 ExecOption: Codegen enabled: 25 out of 25, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s000ms (976.004ms) - Closed: 1s004ms (4.000ms) - BytesReadSeries (500.000ms): 40.88 MB, 101.40 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - ColumnarScannerIdealReservation: (Avg: 7.42 MB (7780433) ; Min: 512.00 KB (524288) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - FooterProcessingTime: (Avg: 160.000us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 25) - InitialRangeActualReservation: (Avg: 7.84 MB (8220835) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 25) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 25) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 113.91 MB (119444838) ; Min: 113.91 MB (119444838) ; Max: 113.91 MB (119444838) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65021) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65540) ; Number of samples: 1837) - ParquetUncompressedBytesReadPerColumn: (Avg: 113.90 MB (119433816) ; Min: 113.90 MB (119433816) ; Max: 113.90 MB (119433816) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.49 KB (65015) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65534) ; Number of samples: 1837) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 116.40 MB (122053906) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 116.40 MB (122053906) - DataCacheHitCount: 50 (50) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 24.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 113.96 MB (119493906) - IoReadAsyncRequest: 3.72K (3724) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 113.96 MB (119493906) - IoReadTotalRequest: 3.72K (3724) - MaterializeTupleTime: 492.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.84K (1837) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 25 (25) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 25 (25) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 158.80M (158795185) - RowsReturned: 158.80M (158795185) - RowsReturnedRate: 264.66 M/sec - ScanRangesComplete: 25 (25) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 36.000ms - TotalReadThroughput: 101.40 MB/sec - TotalTime: 600.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 188.62 MB (197787648) - CumulativeAllocations: 50 (50) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005c (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5851180197) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.20 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 949.735ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 80.06 KB/sec ; Min: 80.06 KB/sec ; Max: 80.06 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 188.077us ; Min: 146.377us ; Max: 229.777us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.019us ; Min: 11.391us ; Max: 18.648us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s004ms (980.004ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 244.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s004ms (980.004ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 90.20 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.62 MB (7995392) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.11 MB (102879497) ; Min: 98.11 MB (102879497) ; Max: 98.11 MB (102879497) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.51 KB (65031) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1582) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.10 MB (102870005) ; Min: 98.10 MB (102870005) ; Max: 98.10 MB (102870005) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1582) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.20 MB (105072007) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.20 MB (105072007) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.15 MB (102921607) - IoReadAsyncRequest: 3.21K (3206) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.15 MB (102921607) - IoReadTotalRequest: 3.21K (3206) - MaterializeTupleTime: 580.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1582) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.77M (136772506) - RowsReturned: 136.77M (136772506) - RowsReturnedRate: 204.75 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 90.20 MB/sec - TotalTime: 668.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.75 MB (170655744) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000055 (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.68 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s004ms (1s004ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.68 GB (6103594438) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.42 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 8.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 973.432ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s004ms - ExecTreeOpenTime: 980.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 91.23 KB/sec ; Min: 91.23 KB/sec ; Max: 91.23 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 174.504us ; Min: 128.455us ; Max: 220.553us ; Number of samples: 2) - RpcRecvrTime: (Avg: 18.405us ; Min: 17.278us ; Max: 19.533us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s004ms (980.004ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 980.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 280.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s004ms (980.004ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 100.20 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8029584) ; Min: 128.00 KB (131072) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.91 MB (113151044) ; Min: 107.91 MB (113151044) ; Max: 107.91 MB (113151044) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65029) ; Min: 22.71 KB (23255) ; Max: 64.01 KB (65547) ; Number of samples: 1740) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.90 MB (113140601) ; Min: 107.90 MB (113140601) ; Max: 107.90 MB (113140601) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65023) ; Min: 22.70 KB (23249) ; Max: 64.00 KB (65540) ; Number of samples: 1740) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.20 MB (115552532) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.20 MB (115552532) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.95 MB (113197332) - IoReadAsyncRequest: 3.53K (3526) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.95 MB (113197332) - IoReadTotalRequest: 3.53K (3526) - MaterializeTupleTime: 584.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1740) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 13.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.43M (150427920) - RowsReturned: 150.43M (150427920) - RowsReturnedRate: 235.04 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 8.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 8.000ms - TotalReadThroughput: 100.20 MB/sec - TotalTime: 640.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.00 MB (187695104) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004e (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.21 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s000ms (1s000ms) - First Batch Produced: 1s000ms (0.000ns) - First Batch Sent: 1s000ms (0.000ns) - ExecInternal Finished: 1s004ms (4.000ms) - MemoryUsage (500.000ms): 8.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.21 GB (5591738292) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.95 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 1s004ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 940.511ms - TotalThreadsVoluntaryContextSwitches: 60 (60) - TotalTime: 1s004ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 972.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 57.34 KB/sec ; Min: 57.34 KB/sec ; Max: 57.34 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 189.182us ; Min: 174.006us ; Max: 204.359us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.842us ; Min: 13.943us ; Max: 21.741us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s000ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s000ms (972.001ms) - First Batch Requested: 1s000ms (0.000ns) - First Batch Returned: 1s000ms (0.000ns) - Last Batch Returned: 1s000ms (0.000ns) - Closed: 1s000ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 972.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 268.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s000ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s000ms (972.001ms) - Closed: 1s000ms (0.000ns) - BytesReadSeries (500.000ms): 40.10 MB, 95.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 102.92 MB (107915248) ; Min: 102.92 MB (107915248) ; Max: 102.92 MB (107915248) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65048) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1659) - ParquetUncompressedBytesReadPerColumn: (Avg: 102.91 MB (107905294) ; Min: 102.91 MB (107905294) ; Max: 102.91 MB (107905294) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65042) ; Min: 27.45 KB (28110) ; Max: 64.00 KB (65534) ; Number of samples: 1659) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 105.01 MB (110109524) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 105.01 MB (110109524) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 102.96 MB (107959124) - IoReadAsyncRequest: 3.36K (3360) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 102.96 MB (107959124) - IoReadTotalRequest: 3.36K (3360) - MaterializeTupleTime: 592.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.66K (1659) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 3.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 143.47M (143467243) - RowsReturned: 143.47M (143467243) - RowsReturnedRate: 220.04 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 95.01 MB/sec - TotalTime: 652.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 170.62 MB (178913280) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000003c (host=impala-executor-000-9.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.657 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.30 GB Fragment Instance Lifecycle Event Timeline: 1s004ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 1s004ms (1s000ms) - First Batch Produced: 1s004ms (0.000ns) - First Batch Sent: 1s004ms (0.000ns) - ExecInternal Finished: 1s004ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.30 GB (5691789314) - CompletionTime: 1s043ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.08 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s000ms - TotalThreadsSysTime: 7.953ms - TotalThreadsUserTime: 934.544ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s000ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 976.009ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 62.10 KB/sec ; Min: 62.10 KB/sec ; Max: 62.10 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 210.277us ; Min: 188.718us ; Max: 231.837us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.342us ; Min: 14.109us ; Max: 38.576us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 1s004ms (976.009ms) - First Batch Requested: 1s004ms (0.000ns) - First Batch Returned: 1s004ms (0.000ns) - Last Batch Returned: 1s004ms (0.000ns) - Closed: 1s004ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 976.009ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 296.002ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:24 ExecOption: Codegen enabled: 24 out of 24, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s004ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s004ms (976.009ms) - Closed: 1s004ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 63.92 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - ColumnarScannerIdealReservation: (Avg: 7.58 MB (7951701) ; Min: 2.00 MB (2097152) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 24) - InitialRangeActualReservation: (Avg: 7.83 MB (8213845) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 24) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 24) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 112.18 MB (117631257) ; Min: 112.18 MB (117631257) ; Max: 112.18 MB (117631257) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65061) ; Min: 23.31 KB (23874) ; Max: 64.00 KB (65534) ; Number of samples: 1808) - ParquetUncompressedBytesReadPerColumn: (Avg: 112.17 MB (117620409) ; Min: 112.17 MB (117620409) ; Max: 112.17 MB (117620409) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65055) ; Min: 23.31 KB (23868) ; Max: 63.99 KB (65528) ; Number of samples: 1808) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 114.57 MB (120136988) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 114.57 MB (120136988) - DataCacheHitCount: 48 (48) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 112.23 MB (117679388) - IoReadAsyncRequest: 3.66K (3664) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 112.23 MB (117679388) - IoReadTotalRequest: 3.66K (3664) - MaterializeTupleTime: 528.005ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.81K (1808) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 24 (24) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 24 (24) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 4.00 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 156.38M (156384143) - RowsReturned: 156.38M (156384143) - RowsReturnedRate: 257.21 M/sec - ScanRangesComplete: 24 (24) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 63.92 MB/sec - TotalTime: 608.005ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 185.00 MB (193986560) - CumulativeAllocations: 48 (48) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000005a (host=impala-executor-000-3.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.661 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.17 GB Fragment Instance Lifecycle Event Timeline: 1s000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 1s000ms (1s000ms) - First Batch Produced: 1s000ms (0.000ns) - First Batch Sent: 1s000ms (0.000ns) - ExecInternal Finished: 1s000ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.17 GB (5554381044) - CompletionTime: 1s047ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.94 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508808) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105868) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 36.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 944.261ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 1s000ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 976.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 39.46 KB/sec ; Min: 39.46 KB/sec ; Max: 39.46 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 208.043us ; Min: 119.121us ; Max: 296.965us ; Number of samples: 2) - RpcRecvrTime: (Avg: 19.069us ; Min: 12.676us ; Max: 25.462us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 1s000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 1s000ms (976.004ms) - First Batch Requested: 1s000ms (0.000ns) - First Batch Returned: 1s000ms (0.000ns) - Last Batch Returned: 1s000ms (0.000ns) - Closed: 1s000ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 976.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 256.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:20 ExecOption: Codegen enabled: 20 out of 20, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 1s000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s000ms (976.004ms) - Closed: 1s000ms (0.000ns) - BytesReadSeries (500.000ms): 40.01 MB, 90.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 20) - InitialRangeActualReservation: (Avg: 7.80 MB (8178892) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 20) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 20) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.01 MB (102774844) ; Min: 98.01 MB (102774844) ; Max: 98.01 MB (102774844) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.52 KB (65047) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65534) ; Number of samples: 1580) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.00 MB (102765364) ; Min: 98.00 MB (102765364) ; Max: 98.00 MB (102765364) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65041) ; Min: 27.46 KB (28116) ; Max: 63.99 KB (65528) ; Number of samples: 1580) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 100.01 MB (104864625) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 100.01 MB (104864625) - DataCacheHitCount: 40 (40) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 98.05 MB (102816625) - IoReadAsyncRequest: 3.20K (3200) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 98.05 MB (102816625) - IoReadTotalRequest: 3.20K (3200) - MaterializeTupleTime: 572.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.58K (1580) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 20 (20) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 20 (20) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467848) - PerReadThreadRawHdfsThroughput: 3.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 136.63M (136633369) - RowsReturned: 136.63M (136633369) - RowsReturnedRate: 210.85 M/sec - ScanRangesComplete: 20 (20) - ScannerIoWaitTime: 36.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 90.01 MB/sec - TotalTime: 648.002ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 162.50 MB (170393600) - CumulativeAllocations: 40 (40) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001b (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.61 GB Fragment Instance Lifecycle Event Timeline: 996.005ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 996.005ms (996.005ms) - First Batch Produced: 996.005ms (0.000ns) - First Batch Sent: 996.005ms (0.000ns) - ExecInternal Finished: 996.005ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.61 GB (6020875779) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.41 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 44.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 996.005ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 933.511ms - TotalThreadsVoluntaryContextSwitches: 59 (59) - TotalTime: 996.005ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 996.005ms - ExecTreeOpenTime: 968.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 76.31 KB/sec ; Min: 76.31 KB/sec ; Max: 76.31 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 187.320us ; Min: 153.576us ; Max: 221.065us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.371us ; Min: 11.890us ; Max: 18.852us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 996.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 996.005ms (968.004ms) - First Batch Requested: 996.005ms (0.000ns) - First Batch Returned: 996.005ms (0.000ns) - Last Batch Returned: 996.005ms (0.000ns) - Closed: 996.005ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 968.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 996.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 996.005ms (968.004ms) - Closed: 996.005ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 59.04 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 363.638us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 106.85 MB (112040391) ; Min: 106.85 MB (112040391) ; Max: 106.85 MB (112040391) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65064) ; Min: 27.45 KB (28110) ; Max: 64.01 KB (65547) ; Number of samples: 1722) - ParquetUncompressedBytesReadPerColumn: (Avg: 106.84 MB (112030058) ; Min: 106.84 MB (112030058) ; Max: 106.84 MB (112030058) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65058) ; Min: 27.45 KB (28104) ; Max: 64.00 KB (65540) ; Number of samples: 1722) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.04 MB (114338797) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.04 MB (114338797) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 106.89 MB (112085997) - IoReadAsyncRequest: 3.49K (3488) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 106.89 MB (112085997) - IoReadTotalRequest: 3.49K (3488) - MaterializeTupleTime: 548.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.72K (1722) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 148.95M (148951403) - RowsReturned: 148.95M (148951403) - RowsReturnedRate: 221.65 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 44.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 32.000ms - TotalReadThroughput: 59.04 MB/sec - TotalTime: 672.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 174.75 MB (183238656) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000054 (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.45 GB Fragment Instance Lifecycle Event Timeline: 996.001ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 992.001ms (992.001ms) - First Batch Produced: 992.001ms (0.000ns) - First Batch Sent: 992.001ms (0.000ns) - ExecInternal Finished: 996.001ms (4.000ms) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.45 GB (5850895820) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.18 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508814) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 996.001ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 933.882ms - TotalThreadsVoluntaryContextSwitches: 58 (58) - TotalTime: 996.001ms Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 992.001ms - ExecTreeOpenTime: 964.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 34.21 KB/sec ; Min: 34.21 KB/sec ; Max: 34.21 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 282.347us ; Min: 222.136us ; Max: 342.559us ; Number of samples: 2) - RpcRecvrTime: (Avg: 34.244us ; Min: 18.975us ; Max: 49.513us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 4.000ms - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 4.000ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 992.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 992.001ms (964.001ms) - First Batch Requested: 992.001ms (0.000ns) - First Batch Returned: 992.001ms (0.000ns) - Last Batch Returned: 992.001ms (0.000ns) - Closed: 992.001ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 964.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 196.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 992.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 992.001ms (964.001ms) - Closed: 992.001ms (0.000ns) - BytesReadSeries (500.000ms): 40.00 MB, 98.41 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.476us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.32 MB (106244341) ; Min: 101.32 MB (106244341) ; Max: 101.32 MB (106244341) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.54 KB (65060) ; Min: 27.48 KB (28140) ; Max: 64.00 KB (65540) ; Number of samples: 1633) - ParquetUncompressedBytesReadPerColumn: (Avg: 101.31 MB (106234543) ; Min: 101.31 MB (106234543) ; Max: 101.31 MB (106234543) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.53 KB (65054) ; Min: 27.47 KB (28134) ; Max: 64.00 KB (65534) ; Number of samples: 1633) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 103.41 MB (108438023) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.41 MB (108438023) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 101.36 MB (106287623) - IoReadAsyncRequest: 3.31K (3308) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 101.36 MB (106287623) - IoReadTotalRequest: 3.31K (3308) - MaterializeTupleTime: 592.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.63K (1633) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467854) - PerReadThreadRawHdfsThroughput: 4.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 141.25M (141245875) - RowsReturned: 141.25M (141245875) - RowsReturnedRate: 207.71 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 98.41 MB/sec - TotalTime: 680.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 166.62 MB (174718976) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004f (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.20 GB Fragment Instance Lifecycle Event Timeline: 996.001ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 996.001ms (996.001ms) - First Batch Produced: 996.001ms (0.000ns) - First Batch Sent: 996.001ms (0.000ns) - ExecInternal Finished: 996.001ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.20 GB (5588007344) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 4.95 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 996.001ms - TotalThreadsSysTime: 12.018ms - TotalThreadsUserTime: 921.290ms - TotalThreadsVoluntaryContextSwitches: 66 (66) - TotalTime: 996.001ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 996.001ms - ExecTreeOpenTime: 968.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 39.87 KB/sec ; Min: 39.87 KB/sec ; Max: 39.87 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 231.510us ; Min: 169.125us ; Max: 293.896us ; Number of samples: 2) - RpcRecvrTime: (Avg: 15.873us ; Min: 11.536us ; Max: 20.211us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 996.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 996.001ms (968.001ms) - First Batch Requested: 996.001ms (0.000ns) - First Batch Returned: 996.001ms (0.000ns) - Last Batch Returned: 996.001ms (0.000ns) - Closed: 996.001ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 968.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 216.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:22 ExecOption: Codegen enabled: 22 out of 22, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 996.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 996.001ms (968.001ms) - Closed: 996.001ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 105.01 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - FooterProcessingTime: (Avg: 181.818us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 22) - InitialRangeActualReservation: (Avg: 7.82 MB (8197957) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 22) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 22) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.82 MB (113059140) ; Min: 107.82 MB (113059140) ; Max: 107.82 MB (113059140) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65051) ; Min: 27.47 KB (28128) ; Max: 64.01 KB (65547) ; Number of samples: 1738) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.81 MB (113048711) ; Min: 107.81 MB (113048711) ; Max: 107.81 MB (113048711) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65045) ; Min: 27.46 KB (28122) ; Max: 64.00 KB (65540) ; Number of samples: 1738) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 110.01 MB (115357906) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 110.01 MB (115357906) - DataCacheHitCount: 44 (44) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.87 MB (113105106) - IoReadAsyncRequest: 3.52K (3520) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.87 MB (113105106) - IoReadTotalRequest: 3.52K (3520) - MaterializeTupleTime: 624.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.74K (1738) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 22 (22) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 22 (22) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 4.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 150.31M (150305750) - RowsReturned: 150.31M (150305750) - RowsReturnedRate: 208.76 M/sec - ScanRangesComplete: 22 (22) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 24.000ms - TotalReadThroughput: 105.01 MB/sec - TotalTime: 720.001ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 178.75 MB (187432960) - CumulativeAllocations: 44 (44) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000004c (host=impala-executor-000-8.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.664 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.46 GB Fragment Instance Lifecycle Event Timeline: 996.001ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 996.001ms (996.001ms) - First Batch Produced: 996.001ms (0.000ns) - First Batch Sent: 996.001ms (0.000ns) - ExecInternal Finished: 996.001ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.46 GB (5859919478) - CompletionTime: 1s051ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.19 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105886) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 996.001ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 936.067ms - TotalThreadsVoluntaryContextSwitches: 63 (63) - TotalTime: 996.001ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 996.001ms - ExecTreeOpenTime: 968.001ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 58.39 KB/sec ; Min: 58.39 KB/sec ; Max: 58.39 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 165.158us ; Min: 129.618us ; Max: 200.698us ; Number of samples: 2) - RpcRecvrTime: (Avg: 14.141us ; Min: 11.118us ; Max: 17.165us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 996.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 996.001ms (968.001ms) - First Batch Requested: 996.001ms (0.000ns) - First Batch Returned: 996.001ms (0.000ns) - Last Batch Returned: 996.001ms (0.000ns) - Closed: 996.001ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 968.001ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 272.000ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 996.001ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 996.001ms (968.001ms) - Closed: 996.001ms (0.000ns) - BytesReadSeries (500.000ms): 45.00 MB, 100.26 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 7.66 MB (8035283) ; Min: 256.00 KB (262144) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 173.913us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 107.46 MB (112680672) ; Min: 107.46 MB (112680672) ; Max: 107.46 MB (112680672) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65020) ; Min: 17.67 KB (18099) ; Max: 64.01 KB (65547) ; Number of samples: 1733) - ParquetUncompressedBytesReadPerColumn: (Avg: 107.45 MB (112670273) ; Min: 107.45 MB (112670273) ; Max: 107.45 MB (112670273) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.49 KB (65014) ; Min: 17.67 KB (18093) ; Max: 64.00 KB (65540) ; Number of samples: 1733) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 109.75 MB (115081995) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.75 MB (115081995) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 107.50 MB (112726795) - IoReadAsyncRequest: 3.51K (3512) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 107.50 MB (112726795) - IoReadTotalRequest: 3.51K (3512) - MaterializeTupleTime: 548.000ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.73K (1733) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 149.80M (149802574) - RowsReturned: 149.80M (149802574) - RowsReturnedRate: 238.54 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 32.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 100.26 MB/sec - TotalTime: 628.000ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 179.12 MB (187826176) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:422311570000001e (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:23/5.24 GB Fragment Instance Lifecycle Event Timeline: 992.005ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 992.005ms (992.005ms) - First Batch Produced: 992.005ms (0.000ns) - First Batch Sent: 992.005ms (0.000ns) - ExecInternal Finished: 992.005ms (0.000ns) - MemoryUsage (500.000ms): 8.04 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.24 GB (5624506062) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.06 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 40.000ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 992.005ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 935.767ms - TotalThreadsVoluntaryContextSwitches: 54 (54) - TotalTime: 992.005ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 992.005ms - ExecTreeOpenTime: 964.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 32.45 KB/sec ; Min: 32.45 KB/sec ; Max: 32.45 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 354.691us ; Min: 348.198us ; Max: 361.184us ; Number of samples: 2) - RpcRecvrTime: (Avg: 39.169us ; Min: 15.094us ; Max: 63.244us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 992.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 992.005ms (964.004ms) - First Batch Requested: 992.005ms (0.000ns) - First Batch Returned: 992.005ms (0.000ns) - Last Batch Returned: 992.005ms (0.000ns) - Closed: 992.005ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 964.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 224.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 21 out of 21, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 992.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 992.005ms (964.004ms) - Closed: 992.005ms (0.000ns) - BytesReadSeries (500.000ms): 1.15 MB, 56.06 MB - ColumnarScannerActualReservation: (Avg: 7.81 MB (8188879) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - ColumnarScannerIdealReservation: (Avg: 7.67 MB (8039082) ; Min: 1.00 MB (1048576) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - FooterProcessingTime: (Avg: 190.477us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 21) - InitialRangeActualReservation: (Avg: 7.62 MB (7989150) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 21) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 21) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 98.97 MB (103780356) ; Min: 98.97 MB (103780356) ; Max: 98.97 MB (103780356) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.50 KB (65025) ; Min: 15.74 KB (16113) ; Max: 64.01 KB (65547) ; Number of samples: 1596) - ParquetUncompressedBytesReadPerColumn: (Avg: 98.96 MB (103770780) ; Min: 98.96 MB (103770780) ; Max: 98.96 MB (103770780) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.50 KB (65019) ; Min: 15.73 KB (16108) ; Max: 64.00 KB (65540) ; Number of samples: 1596) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 101.06 MB (105973181) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 101.06 MB (105973181) - DataCacheHitCount: 42 (42) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 99.01 MB (103822781) - IoReadAsyncRequest: 3.23K (3234) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 99.01 MB (103822781) - IoReadTotalRequest: 3.23K (3234) - MaterializeTupleTime: 588.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.60K (1596) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 21 (21) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 21 (21) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 2.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 137.97M (137970089) - RowsReturned: 137.97M (137970089) - RowsReturnedRate: 204.10 M/sec - ScanRangesComplete: 21 (21) - ScannerIoWaitTime: 40.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 40.000ms - TotalReadThroughput: 56.06 MB/sec - TotalTime: 676.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 163.62 MB (171573248) - CumulativeAllocations: 42 (42) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 1f4d7a679a3e12d5:4223115700000021 (host=impala-executor-000-0.impala-executor.impala-1701977964-jz84.svc.cluster.local:27010): Last report received time: 2023-12-15 01:49:34.648 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:22/5.25 GB Fragment Instance Lifecycle Event Timeline: 992.005ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 992.005ms (992.005ms) - First Batch Produced: 992.005ms (0.000ns) - First Batch Sent: 992.005ms (0.000ns) - ExecInternal Finished: 992.005ms (0.000ns) - MemoryUsage (500.000ms): 8.11 MB, 8.11 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 5.25 GB (5637321655) - CompletionTime: 1s035ms - ExchangeScanRatio: 0.00 - ExecutionRate: 5.07 GB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.11 MB (8508820) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 97.38 MB (102105880) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28.000ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 992.005ms - TotalThreadsSysTime: 4.005ms - TotalThreadsUserTime: 929.322ms - TotalThreadsVoluntaryContextSwitches: 61 (61) - TotalTime: 992.005ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 992.005ms - ExecTreeOpenTime: 964.004ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 77.10 KB/sec ; Min: 77.10 KB/sec ; Max: 77.10 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 179.158us ; Min: 151.993us ; Max: 206.324us ; Number of samples: 2) - RpcRecvrTime: (Avg: 17.392us ; Min: 12.894us ; Max: 21.890us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.03 KB (16415) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 992.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 992.005ms (964.004ms) - First Batch Requested: 992.005ms (0.000ns) - First Batch Returned: 992.005ms (0.000ns) - Last Batch Returned: 992.005ms (0.000ns) - Closed: 992.005ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - TotalTime: 964.004ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 248.001ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: tpch_3000_parquet_external.lineitem Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/SNAPPY:23 ExecOption: Codegen enabled: 23 out of 23, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 992.005ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 992.005ms (964.004ms) - Closed: 992.005ms (0.000ns) - BytesReadSeries (500.000ms): 5.00 MB, 64.19 MB - ColumnarScannerActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - ColumnarScannerIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 23) - InitialRangeActualReservation: (Avg: 7.83 MB (8206246) ; Min: 4.00 MB (4194304) ; Max: 8.00 MB (8388608) ; Number of samples: 23) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 23) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 111.61 MB (117034398) ; Min: 111.61 MB (117034398) ; Max: 111.61 MB (117034398) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 63.53 KB (65055) ; Min: 27.46 KB (28122) ; Max: 64.01 KB (65547) ; Number of samples: 1799) - ParquetUncompressedBytesReadPerColumn: (Avg: 111.60 MB (117023603) ; Min: 111.60 MB (117023603) ; Max: 111.60 MB (117023603) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.52 KB (65049) ; Min: 27.46 KB (28116) ; Max: 64.00 KB (65540) ; Number of samples: 1799) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 113.90 MB (119437236) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 113.90 MB (119437236) - DataCacheHitCount: 46 (46) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 111.66 MB (117082036) - IoReadAsyncRequest: 3.64K (3644) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 0 - IoReadSyncRequest: 0 (0) - IoReadTotalBytes: 111.66 MB (117082036) - IoReadTotalRequest: 3.64K (3644) - MaterializeTupleTime: 576.002ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 1.80K (1799) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 23 (23) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 23 (23) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.08 MB (8467860) - PerReadThreadRawHdfsThroughput: 3.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 155.59M (155590645) - RowsReturned: 155.59M (155590645) - RowsReturnedRate: 238.63 M/sec - ScanRangesComplete: 23 (23) - ScannerIoWaitTime: 28.000ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 28.000ms - TotalReadThroughput: 64.19 MB/sec - TotalTime: 652.003ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 186.88 MB (195952640) - CumulativeAllocations: 46 (46) - EncryptionTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns