Query (id=d04d0645dcd4ee6f:dc3ba79f00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Summary: Session ID: 9140015f2810ba4c:69150cdfd543249f Session Type: BEESWAX Start Time: 2022-05-16 22:44:28.012973000 End Time: 2022-05-16 22:44:28.589515000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.1.0-SNAPSHOT DEBUG (build 0a3f428ead4c7bdadb6f8e27a6ab5b1b5d332ffc) User: ubuntu Connected User: ubuntu Delegated User: Network Address: 192.168.124.1:58984 Default Db: default Sql Statement: select count(l_orderkey) from functional_parquet.lineitem_sixblocks Coordinator: 192.168.124.4:27000 Query Options (set by configuration): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestParquet::()::test_multiple_blocks_mt_dop[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'debug_action':'-1:OPEN:SET_ Query Options (set by configuration and planner): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestParquet::()::test_multiple_blocks_mt_dop[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'debug_action':'-1:OPEN:SET_,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE Plan: ---------------- Max Per-Host Resource Reservation: Memory=6.00MB Threads=3 Per-Host Resource Estimates: Memory=36MB WARNING: The following tables are missing relevant table and/or column statistics. functional_parquet.lineitem_sixblocks Analyzed query: SELECT count(l_orderkey) FROM functional_parquet.lineitem_sixblocks F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1 PLAN-ROOT SINK | output exprs: count(l_orderkey) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 | 03:AGGREGATE [FINALIZE] | output: count:merge(l_orderkey) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 | in pipelines: 03(GETNEXT), 01(OPEN) | 02:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=6 Per-Instance Resources: mem-estimate=16.02MB mem-reservation=1.00MB thread-reservation=1 01:AGGREGATE | output: count(l_orderkey) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN HDFS [functional_parquet.lineitem_sixblocks, RANDOM] HDFS partitions=1/1 files=1 size=5.28MB stored statistics: table: rows=unavailable size=unavailable columns: unavailable extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=176.47K in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 37797888 Tables Missing Stats: functional_parquet.lineitem_sixblocks Request Pool: root.default Per Host Min Memory Reservation: 192.168.124.6:27000(2.00 MB) 192.168.124.4:27000(6.00 MB) 192.168.124.5:27000(2.00 MB) Per Host Number of Fragment Instances: 192.168.124.6:27000(2) 192.168.124.4:27000(3) 192.168.124.5:27000(2) Admission result: Admitted immediately Cluster Memory Admitted: 900.00 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------------------------- F01:ROOT 1 1 0.000ns 0.000ns 4.01 MB 4.00 MB 03:AGGREGATE 1 1 0.000ns 0.000ns 1 1 16.00 KB 16.00 KB FINALIZE 02:EXCHANGE 1 1 0.000ns 0.000ns 6 1 56.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 3 6 0.000ns 0.000ns 16.00 KB 0 01:AGGREGATE 3 6 3.999ms 15.999ms 6 1 25.00 KB 16.00 KB 00:SCAN HDFS 3 6 48.666ms 91.998ms 40.00K 176.47K 1.42 MB 16.00 MB functional_parquet.lineitem_sixblocks Errors: Query Compilation: 2.207ms - Metadata of all 1 tables cached: 701.133us (701.133us) - Analysis finished: 919.158us (218.025us) - Authorization finished (noop): 933.439us (14.281us) - Value transfer graph computed: 1.043ms (110.391us) - Single node plan created: 1.338ms (294.858us) - Runtime filters computed: 1.385ms (46.632us) - Distributed plan created: 1.399ms (14.537us) - Parallel plans created: 1.406ms (6.387us) - Planning finished: 2.207ms (801.017us) Query Timeline: 583.993ms - Query submitted: 0.000ns (0.000ns) - Planning finished: 3.999ms (3.999ms) - Submit for admission: 31.999ms (27.999ms) - Completed admission: 91.998ms (59.999ms) - Ready to start on 3 backends: 91.998ms (0.000ns) - All 3 execution backends (7 fragment instances) started: 107.998ms (15.999ms) - Rows available: 539.993ms (431.995ms) - First row fetched: 547.993ms (7.999ms) - Last row fetched: 547.993ms (0.000ns) - Released admission control resources: 575.993ms (27.999ms) - Unregister query: 583.993ms (7.999ms) - AdmissionControlTimeSinceLastUpdate: 40.000ms - ComputeScanRangeAssignmentTimer: 0.000ns - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Frontend: - CatalogFetch.ColumnStats.Hits: 16 - CatalogFetch.ColumnStats.Misses: 0 - CatalogFetch.ColumnStats.Requests: 16 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 1 - CatalogFetch.PartitionLists.Misses: 0 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 2 - CatalogFetch.Partitions.Misses: 0 - CatalogFetch.Partitions.Requests: 2 - CatalogFetch.Partitions.Time: 0 - CatalogFetch.TableList.Hits: 2 - CatalogFetch.TableList.Misses: 0 - CatalogFetch.TableList.Requests: 2 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 1 - CatalogFetch.Tables.Misses: 0 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns ImpalaServer: - ClientFetchWaitTimer: 15.999ms - InactiveTotalTime: 0.000ns - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 35.00 /sec - RowMaterializationTimer: 27.999ms - TotalTime: 0.000ns Execution Profile d04d0645dcd4ee6f:dc3ba79f00000000: Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 11ms / 15ms, 25th %-ile: 11ms, 50th %-ile: 15ms, 75th %-ile: 15ms, 90th %-ile: 15ms, 95th %-ile: 15ms, 99.9th %-ile: 15ms Slowest backend to start up: 192.168.124.4:27000 Per Node Peak Memory Usage: 192.168.124.4:27000(6.55 MB) 192.168.124.5:27000(2.51 MB) 192.168.124.6:27000(2.92 MB) Per Node Bytes Read: 192.168.124.4:27000(1.09 MB) 192.168.124.5:27000(1.06 MB) 192.168.124.6:27000(1.09 MB) Per Node User Time: 192.168.124.4:27000(127.033ms) 192.168.124.5:27000(82.296ms) 192.168.124.6:27000(68.858ms) Per Node System Time: 192.168.124.4:27000(3.933ms) 192.168.124.5:27000(0.000ns) 192.168.124.6:27000(18.278ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InactiveTotalTime: 0.000ns - InnerNodeSelectivityRatio: 0.20 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 7 (7) - NumFragments: 2 (2) - TotalBytesRead: 3.24 MB (3400772) - TotalBytesSent: 72.00 B (72) - TotalCpuTime: 300.398ms - TotalInnerBytesSent: 12.00 B (12) - TotalScanBytesSent: 60.00 B (60) - TotalTime: 475.994ms Per Node Profiles: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns 192.168.124.4:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 16 (16) - CodegenTotalWallClockTime: 251.997ms - CodegenSysTime: 0.000ns - CodegenUserTime: 43.328ms - CodegenVoluntaryContextSwitches: 9 (9) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 43.999ms - ModuleBitcodeSize: 4.19 MB (4397044) - NumFunctions: 1 (1) - NumInstructions: 13 (13) - OptimizationTime: 43.999ms - PeakMemoryUsage: 6.50 KB (6656) - PrepareTime: 207.997ms - TotalTime: 251.997ms Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 26 (26) - CodegenTotalWallClockTime: 343.996ms - CodegenSysTime: 0.000ns - CodegenUserTime: 58.378ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 23.999ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 115.998ms - ModuleBitcodeSize: 4.19 MB (4397044) - NumFunctions: 12 (12) - NumInstructions: 211 (211) - OptimizationTime: 91.998ms - PeakMemoryUsage: 105.50 KB (108032) - PrepareTime: 227.997ms - TotalTime: 343.996ms 192.168.124.5:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 24 (24) - CodegenTotalWallClockTime: 347.996ms - CodegenSysTime: 0.000ns - CodegenUserTime: 60.348ms - CodegenVoluntaryContextSwitches: 8 (8) - CompileTime: 23.999ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 19.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 147.998ms - ModuleBitcodeSize: 4.19 MB (4397044) - NumFunctions: 12 (12) - NumInstructions: 211 (211) - OptimizationTime: 83.999ms - PeakMemoryUsage: 105.50 KB (108032) - PrepareTime: 199.997ms - TotalTime: 347.996ms 192.168.124.6:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 20 (20) - CodegenTotalWallClockTime: 247.997ms - CodegenSysTime: 16.718ms - CodegenUserTime: 44.582ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 23.999ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - MainThreadCodegenTime: 115.998ms - ModuleBitcodeSize: 4.19 MB (4397044) - NumFunctions: 12 (12) - NumInstructions: 211 (211) - OptimizationTime: 83.999ms - PeakMemoryUsage: 105.50 KB (108032) - PrepareTime: 131.998ms - TotalTime: 247.997ms Averaged Fragment F01:(Total: 415.995ms, non-child: 251.997ms, % non-child: 60.58%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:467.994ms max:467.994ms mean: 467.994ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 467.994ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 4.02 MB (4218880) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.55 MB (6865568) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 151.998ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 415.995ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 46.982ms - TotalThreadsVoluntaryContextSwitches: 17 (17) - TotalTime: 415.995ms Fragment Instance Lifecycle Timings: - ExecTime: 11.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 403.995ms - ExecTreeOpenTime: 151.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 11.999ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 11.999ms - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 83.00 /sec - TotalTime: 11.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=3):(Total: 151.998ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 6.00 /sec - TotalTime: 151.998ms NonGroupingAggregator 0: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 151.998ms, non-child: 0.000ns, % non-child: 0.00%) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 151.998ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 39.00 /sec - TotalTime: 151.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 19.999ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 96.00 B (96) - TotalGetBatchTime: 151.998ms - DataWaitTime: 151.998ms - TotalTime: 0.000ns Enqueue: - DispatchTime: (Avg: 33.437us ; Min: 18.855us ; Max: 60.638us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 72.00 B (72) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Coordinator Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000000 (host=192.168.124.4:27000): Last report received time: 2022-05-16 22:44:28.588 Fragment Instance Lifecycle Event Timeline: 447.995ms - Prepare Finished: 31.999ms (31.999ms) - Open Finished: 435.995ms (403.995ms) - First Batch Produced: 435.995ms (0.000ns) - First Batch Sent: 435.995ms (0.000ns) - ExecInternal Finished: 447.995ms (11.999ms) - MemoryUsage (500.000ms): 12.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 467.994ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 4.02 MB (4218880) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.55 MB (6865568) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 151.998ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 415.995ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 46.982ms - TotalThreadsVoluntaryContextSwitches: 17 (17) - TotalTime: 415.995ms Fragment Instance Lifecycle Timings: - ExecTime: 11.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 403.995ms - ExecTreeOpenTime: 151.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK: - InactiveTotalTime: 11.999ms - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 83.00 /sec - TotalTime: 11.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=3): Node Lifecycle Event Timeline: 435.995ms - Open Started: 283.996ms (283.996ms) - Open Finished: 435.995ms (151.998ms) - First Batch Requested: 435.995ms (0.000ns) - First Batch Returned: 435.995ms (0.000ns) - Last Batch Returned: 435.995ms (0.000ns) - Closed: 435.995ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 6.00 /sec - TotalTime: 151.998ms NonGroupingAggregator 0: ExecOption: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2): Node Lifecycle Event Timeline: 435.995ms - Open Started: 283.996ms (283.996ms) - Open Finished: 303.996ms (19.999ms) - First Batch Requested: 303.996ms (0.000ns) - First Batch Returned: 435.995ms (131.998ms) - Last Batch Returned: 435.995ms (0.000ns) - Closed: 435.995ms (0.000ns) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 151.998ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 39.00 /sec - TotalTime: 151.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 19.999ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 96.00 B (96) - TotalGetBatchTime: 151.998ms - DataWaitTime: 151.998ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 33.437us ; Min: 18.855us ; Max: 60.638us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 72.00 B (72) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [6 instances]:(Total: 375.995ms, non-child: 305.996ms, % non-child: 81.38%) split sizes: min: 289.20 KB, max: 1.00 MB, avg: 901.53 KB, stddev: 273.84 KB completion times: min:375.995ms max:467.994ms mean: 425.328ms stddev:37.853ms execution rates: min:669.46 KB/sec max:2.66 MB/sec mean:2.09 MB/sec stddev:695.33 KB/sec num instances: 6 - AverageThreadTokens: 1.00 - BytesAssigned: 901.53 KB (923170) - CompletionTime: 425.328ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.09 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.39 MB (1457791) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.99 MB (4188410) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17.333ms - TotalStorageWaitTime: 10.666ms - TotalThreadsInvoluntaryContextSwitches: 148 (148) - TotalThreadsTotalWallClockTime: 375.329ms - TotalThreadsSysTime: 3.701ms - TotalThreadsUserTime: 38.534ms - TotalThreadsVoluntaryContextSwitches: 9 (9) - TotalTime: 375.995ms Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: 17.333ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 357.996ms - ExecTreeOpenTime: 51.999ms - PrepareTime: 666.659us - ExecTreePrepareTime: 666.659us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2) [6 instances]:(Total: 17.333ms, non-child: 0.000ns, % non-child: 0.00%) - NetworkThroughput: (Avg: 22.08 KB/sec ; Min: 1.29 KB/sec ; Max: 94.79 KB/sec ; Number of samples: 6) - RpcNetworkTime: (Avg: 5.137ms ; Min: 47.113us ; Max: 16.067ms ; Number of samples: 12) - RpcRecvrTime: (Avg: 489.962us ; Min: 17.811us ; Max: 5.241ms ; Number of samples: 12) - EosSent: 1 (1) - InactiveTotalTime: 17.333ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 17.333ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1) [6 instances]:(Total: 52.666ms, non-child: 3.999ms, % non-child: 7.59%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 22.00 KB (22528) - RowsReturned: 1 (1) - RowsReturnedRate: 25.00 /sec - TotalTime: 52.666ms NonGroupingAggregator 0 [6 instances]: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 48.666ms, non-child: 48.666ms, % non-child: 100.00%) - ColumnarScannerActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 400) - ColumnarScannerIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 400) - FooterProcessingTime: (Avg: 17.999ms ; Min: 3.999ms ; Max: 39.999ms ; Number of samples: 6) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 6) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 6) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: (Avg: 7.23 KB (7400) ; Min: 5.13 KB (5254) ; Max: 11.85 KB (12136) ; Number of samples: 4) - ParquetUncompressedPageSize: (Avg: 74.00 B (74) ; Min: 74.00 B (74) ; Max: 74.00 B (74) ; Number of samples: 400) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 553.51 KB (566795) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 553.51 KB (566795) - DataCacheHitCount: 68 (68) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 26.35 KB (26987) - IoReadAsyncRequest: 320 (320) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 517.86 KB (530287) - IoReadSyncRequest: 1 (1) - IoReadTotalBytes: 544.21 KB (557274) - IoReadTotalRequest: 321 (321) - MaterializeTupleTime: 666.659us - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumFileMetadataRead: 0 (0) - NumPages: 80 (80) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 80 (80) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.35 MB (1416831) - PerReadThreadRawHdfsThroughput: 22.73 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 6.67K (6666) - RowsReturned: 6.67K (6666) - RowsReturnedRate: 169.25 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 10.666ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 666.659us - TotalReadThroughput: 0.00 /sec - TotalTime: 48.666ms Buffer pool [6 instances]: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 661.33 KB (677205) - CumulativeAllocations: 67 (67) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 106.67 KB (109226) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000001 (host=192.168.124.5:27000): Last report received time: 2022-05-16 22:44:28.551 Hdfs split stats (:<# splits>/): -1:1/1.00 MB Fragment Instance Lifecycle Event Timeline: 431.995ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 411.995ms (407.995ms) - First Batch Produced: 411.995ms (0.000ns) - First Batch Sent: 411.995ms (0.000ns) - ExecInternal Finished: 431.995ms (19.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 1.00 MB (1048576) - CompletionTime: 431.995ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.31 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.46 MB (1531442) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 MB (2635662) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.999ms - TotalStorageWaitTime: 11.999ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 427.995ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 70.105ms - TotalThreadsVoluntaryContextSwitches: 13 (13) - TotalTime: 427.995ms Fragment Instance Lifecycle Timings: - ExecTime: 19.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 407.995ms - ExecTreeOpenTime: 59.999ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 2.20 KB/sec ; Min: 2.20 KB/sec ; Max: 2.20 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 5.683ms ; Min: 5.330ms ; Max: 6.037ms ; Number of samples: 2) - RpcRecvrTime: (Avg: 2.648ms ; Min: 56.405us ; Max: 5.241ms ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 19.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 19.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 411.995ms - Open Started: 351.996ms (351.996ms) - Open Finished: 411.995ms (59.999ms) - First Batch Requested: 411.995ms (0.000ns) - First Batch Returned: 411.995ms (0.000ns) - Last Batch Returned: 411.995ms (0.000ns) - Closed: 411.995ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 16.00 /sec - TotalTime: 59.999ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:1 ExecOption: Codegen enabled: 1 out of 1, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 411.995ms - Open Started: 351.996ms (351.996ms) - Open Finished: 351.996ms (0.000ns) - First Batch Requested: 351.996ms (0.000ns) - First Batch Returned: 395.995ms (43.999ms) - Last Batch Returned: 395.995ms (0.000ns) - Closed: 411.995ms (15.999ms) - BytesReadSeries (500.000ms): 0 - ColumnarScannerActualReservation: 0 (Number of samples: 0) - ColumnarScannerIdealReservation: 0 (Number of samples: 0) - FooterProcessingTime: (Avg: 39.999ms ; Min: 39.999ms ; Max: 39.999ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedPageSize: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 531.55 KB (544306) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 531.55 KB (544306) - DataCacheHitCount: 2 (2) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 0 - IoReadAsyncRequest: 0 (0) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 431.55 KB (441906) - IoReadSyncRequest: 1 (1) - IoReadTotalBytes: 431.55 KB (441906) - IoReadTotalRequest: 1 (1) - MaterializeTupleTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 0 (0) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 0 (0) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.42 MB (1490482) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 11.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 0.000ns - TotalReadThroughput: 0.00 /sec - TotalTime: 43.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000006 (host=192.168.124.4:27000): Last report received time: 2022-05-16 22:44:28.588 Hdfs split stats (:<# splits>/): -1:1/1.00 MB Fragment Instance Lifecycle Event Timeline: 435.995ms - Prepare Finished: 31.999ms (31.999ms) - Open Finished: 423.995ms (391.995ms) - First Batch Produced: 423.995ms (0.000ns) - First Batch Sent: 423.995ms (0.000ns) - ExecInternal Finished: 435.995ms (11.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 1.00 MB (1048576) - CompletionTime: 467.994ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.14 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.46 MB (1531442) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.55 MB (6865568) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.999ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 341 (341) - TotalThreadsTotalWallClockTime: 403.995ms - TotalThreadsSysTime: 3.933ms - TotalThreadsUserTime: 19.424ms - TotalThreadsVoluntaryContextSwitches: 7 (7) - TotalTime: 407.995ms Fragment Instance Lifecycle Timings: - ExecTime: 11.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 391.995ms - ExecTreeOpenTime: 79.999ms - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 94.79 KB/sec ; Min: 94.79 KB/sec ; Max: 94.79 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 207.626us ; Min: 123.626us ; Max: 291.626us ; Number of samples: 2) - RpcRecvrTime: (Avg: 35.799us ; Min: 22.144us ; Max: 49.455us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 11.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 11.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 423.995ms - Open Started: 343.996ms (343.996ms) - Open Finished: 423.995ms (79.999ms) - First Batch Requested: 423.995ms (0.000ns) - First Batch Returned: 423.995ms (0.000ns) - Last Batch Returned: 423.995ms (0.000ns) - Closed: 423.995ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 11.00 /sec - TotalTime: 83.999ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:2 ExecOption: Codegen enabled: 2 out of 2, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 423.995ms - Open Started: 343.996ms (343.996ms) - Open Finished: 343.996ms (0.000ns) - First Batch Requested: 343.996ms (0.000ns) - First Batch Returned: 367.995ms (23.999ms) - Last Batch Returned: 423.995ms (55.999ms) - Closed: 423.995ms (0.000ns) - BytesReadSeries (500.000ms): 0 - ColumnarScannerActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 164) - ColumnarScannerIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 164) - FooterProcessingTime: (Avg: 7.999ms ; Min: 3.999ms ; Max: 11.999ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: (Avg: 11.85 KB (12136) ; Min: 11.85 KB (12136) ; Max: 11.85 KB (12136) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 74.00 B (74) ; Min: 74.00 B (74) ; Max: 74.00 B (74) ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 1.09 MB (1143992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.09 MB (1143992) - DataCacheHitCount: 168 (168) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 54.08 KB (55380) - IoReadAsyncRequest: 656 (656) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 863.10 KB (883812) - IoReadSyncRequest: 2 (2) - IoReadTotalBytes: 917.18 KB (939192) - IoReadTotalRequest: 658 (658) - MaterializeTupleTime: 3.999ms - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 164 (164) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 164 (164) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.42 MB (1490482) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowsRead: 16.40K (16400) - RowsReturned: 16.40K (16400) - RowsReturnedRate: 195.24 K/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 0.000ns - TotalReadThroughput: 0.00 /sec - TotalTime: 83.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 1.53 MB (1605632) - CumulativeAllocations: 166 (166) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000005 (host=192.168.124.4:27000): Last report received time: 2022-05-16 22:44:28.588 Hdfs split stats (:<# splits>/): -1:1/1.00 MB Fragment Instance Lifecycle Event Timeline: 387.995ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 383.995ms (383.995ms) - First Batch Produced: 383.995ms (0.000ns) - First Batch Sent: 383.995ms (0.000ns) - ExecInternal Finished: 387.995ms (3.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 1.00 MB (1048576) - CompletionTime: 467.994ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.14 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.04 MB (1089536) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.55 MB (6865568) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 387.995ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.627ms - TotalThreadsVoluntaryContextSwitches: 12 (12) - TotalTime: 387.995ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 383.995ms - ExecTreeOpenTime: 19.999ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 31.35 KB/sec ; Min: 31.35 KB/sec ; Max: 31.35 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 210.429us ; Min: 47.113us ; Max: 373.745us ; Number of samples: 2) - RpcRecvrTime: (Avg: 28.028us ; Min: 17.811us ; Max: 38.245us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 3.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 383.995ms - Open Started: 363.995ms (363.995ms) - Open Finished: 383.995ms (19.999ms) - First Batch Requested: 383.995ms (0.000ns) - First Batch Returned: 383.995ms (0.000ns) - Last Batch Returned: 383.995ms (0.000ns) - Closed: 383.995ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 50.00 /sec - TotalTime: 19.999ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% ExecOption: Codegen enabled: 0 out of 0, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 383.995ms - Open Started: 363.995ms (363.995ms) - Open Finished: 383.995ms (19.999ms) - First Batch Requested: 383.995ms (0.000ns) - First Batch Returned: 383.995ms (0.000ns) - Last Batch Returned: 383.995ms (0.000ns) - Closed: 383.995ms (0.000ns) - BytesReadSeries (500.000ms): 0 - InitialRangeActualReservation: 0 (Number of samples: 0) - InitialRangeIdealReservation: 0 (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - PeakMemoryUsage: 1.00 MB (1048576) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerIoWaitTime: 0.000ns - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 0.000ns - TotalReadThroughput: 0.00 /sec - TotalTime: 19.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000002 (host=192.168.124.5:27000): Last report received time: 2022-05-16 22:44:28.551 Hdfs split stats (:<# splits>/): -1:1/289.20 KB Fragment Instance Lifecycle Event Timeline: 407.995ms - Prepare Finished: 31.999ms (31.999ms) - Open Finished: 375.995ms (343.996ms) - First Batch Produced: 375.995ms (0.000ns) - First Batch Sent: 375.995ms (0.000ns) - ExecInternal Finished: 407.995ms (31.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 289.20 KB (296144) - CompletionTime: 431.995ms - ExchangeScanRatio: 0.00 - ExecutionRate: 669.46 KB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.46 MB (1531442) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 MB (2635662) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31.999ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 166 (166) - TotalThreadsTotalWallClockTime: 375.995ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 12.191ms - TotalThreadsVoluntaryContextSwitches: 5 (5) - TotalTime: 375.995ms Fragment Instance Lifecycle Timings: - ExecTime: 31.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 343.996ms - ExecTreeOpenTime: 23.999ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 1.53 KB/sec ; Min: 1.53 KB/sec ; Max: 1.53 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 11.853ms ; Min: 7.639ms ; Max: 16.067ms ; Number of samples: 2) - RpcRecvrTime: (Avg: 37.777us ; Min: 31.023us ; Max: 44.532us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 31.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 31.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 375.995ms - Open Started: 351.996ms (351.996ms) - Open Finished: 375.995ms (23.999ms) - First Batch Requested: 375.995ms (0.000ns) - First Batch Returned: 375.995ms (0.000ns) - Last Batch Returned: 375.995ms (0.000ns) - Closed: 375.995ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 41.00 /sec - TotalTime: 23.999ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:1 ExecOption: Codegen enabled: 1 out of 1, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 375.995ms - Open Started: 351.996ms (351.996ms) - Open Finished: 351.996ms (0.000ns) - First Batch Requested: 351.996ms (0.000ns) - First Batch Returned: 359.995ms (7.999ms) - Last Batch Returned: 367.995ms (7.999ms) - Closed: 375.995ms (7.999ms) - BytesReadSeries (500.000ms): 0 - ColumnarScannerActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 82) - ColumnarScannerIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 82) - FooterProcessingTime: (Avg: 7.999ms ; Min: 7.999ms ; Max: 7.999ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: (Avg: 5.93 KB (6068) ; Min: 5.93 KB (6068) ; Max: 5.93 KB (6068) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 74.00 B (74) ; Min: 74.00 B (74) ; Max: 74.00 B (74) ; Number of samples: 82) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 558.66 KB (572068) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 558.66 KB (572068) - DataCacheHitCount: 84 (84) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 27.11 KB (27762) - IoReadAsyncRequest: 328 (328) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 431.55 KB (441906) - IoReadSyncRequest: 1 (1) - IoReadTotalBytes: 458.66 KB (469668) - IoReadTotalRequest: 329 (329) - MaterializeTupleTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 82 (82) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 82 (82) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.42 MB (1490482) - PerReadThreadRawHdfsThroughput: 136.39 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 8.20K (8200) - RowsReturned: 8.20K (8200) - RowsReturnedRate: 512.50 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3.999ms - TotalReadThroughput: 0.00 /sec - TotalTime: 15.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 784.00 KB (802816) - CumulativeAllocations: 83 (83) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000004 (host=192.168.124.6:27000): Last report received time: 2022-05-16 22:44:28.494 Hdfs split stats (:<# splits>/): -1:1/1.00 MB Fragment Instance Lifecycle Event Timeline: 367.995ms - Prepare Finished: 15.999ms (15.999ms) - Open Finished: 351.996ms (335.996ms) - First Batch Produced: 351.996ms (0.000ns) - First Batch Sent: 351.996ms (0.000ns) - ExecInternal Finished: 367.995ms (15.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 1.00 MB (1048576) - CompletionTime: 375.995ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.66 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.46 MB (1531442) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.92 MB (3064000) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.999ms - TotalStorageWaitTime: 51.999ms - TotalThreadsInvoluntaryContextSwitches: 136 (136) - TotalThreadsTotalWallClockTime: 351.996ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 14.024ms - TotalThreadsVoluntaryContextSwitches: 11 (11) - TotalTime: 351.996ms Fragment Instance Lifecycle Timings: - ExecTime: 15.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 335.996ms - ExecTreeOpenTime: 91.998ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 1.29 KB/sec ; Min: 1.29 KB/sec ; Max: 1.29 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 6.491ms ; Min: 3.869ms ; Max: 9.113ms ; Number of samples: 2) - RpcRecvrTime: (Avg: 48.639us ; Min: 21.089us ; Max: 76.190us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 15.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 15.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 351.996ms - Open Started: 259.997ms (259.997ms) - Open Finished: 351.996ms (91.998ms) - First Batch Requested: 351.996ms (0.000ns) - First Batch Returned: 351.996ms (0.000ns) - Last Batch Returned: 351.996ms (0.000ns) - Closed: 351.996ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 10.00 /sec - TotalTime: 91.998ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:1 ExecOption: Codegen enabled: 1 out of 1, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 351.996ms - Open Started: 259.997ms (259.997ms) - Open Finished: 259.997ms (0.000ns) - First Batch Requested: 259.997ms (0.000ns) - First Batch Returned: 287.996ms (27.999ms) - Last Batch Returned: 351.996ms (63.999ms) - Closed: 351.996ms (0.000ns) - BytesReadSeries (500.000ms): 0 - ColumnarScannerActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 71) - ColumnarScannerIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 71) - FooterProcessingTime: (Avg: 27.999ms ; Min: 27.999ms ; Max: 27.999ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: (Avg: 5.13 KB (5254) ; Min: 5.13 KB (5254) ; Max: 5.13 KB (5254) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 74.00 B (74) ; Min: 74.00 B (74) ; Max: 74.00 B (74) ; Number of samples: 71) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 554.93 KB (568245) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 554.93 KB (568245) - DataCacheHitCount: 73 (73) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 23.38 KB (23939) - IoReadAsyncRequest: 284 (284) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 431.55 KB (441906) - IoReadSyncRequest: 1 (1) - IoReadTotalBytes: 454.93 KB (465845) - IoReadTotalRequest: 285 (285) - MaterializeTupleTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 71 (71) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 71 (71) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.42 MB (1490482) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowsRead: 7.10K (7100) - RowsReturned: 7.10K (7100) - RowsReturnedRate: 77.17 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 51.999ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 0.000ns - TotalReadThroughput: 0.00 /sec - TotalTime: 91.998ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 696.00 KB (712704) - CumulativeAllocations: 72 (72) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance d04d0645dcd4ee6f:dc3ba79f00000003 (host=192.168.124.6:27000): Last report received time: 2022-05-16 22:44:28.494 Hdfs split stats (:<# splits>/): -1:1/1.00 MB Fragment Instance Lifecycle Event Timeline: 311.996ms - Prepare Finished: 7.999ms (7.999ms) - Open Finished: 291.996ms (283.996ms) - First Batch Produced: 291.996ms (0.000ns) - First Batch Sent: 291.996ms (0.000ns) - ExecInternal Finished: 311.996ms (19.999ms) - MemoryUsage (500.000ms): 28.00 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 1.00 MB (1048576) - CompletionTime: 375.995ms - ExchangeScanRatio: 0.00 - ExecutionRate: 2.66 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.46 MB (1531442) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.92 MB (3064000) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.999ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 195 (195) - TotalThreadsTotalWallClockTime: 303.996ms - TotalThreadsSysTime: 18.278ms - TotalThreadsUserTime: 54.834ms - TotalThreadsVoluntaryContextSwitches: 8 (8) - TotalTime: 303.996ms Fragment Instance Lifecycle Timings: - ExecTime: 19.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 283.996ms - ExecTreeOpenTime: 35.999ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 1.29 KB/sec ; Min: 1.29 KB/sec ; Max: 1.29 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 6.379ms ; Min: 3.687ms ; Max: 9.071ms ; Number of samples: 2) - RpcRecvrTime: (Avg: 140.717us ; Min: 45.408us ; Max: 236.027us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 19.999ms - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 12.00 B (12) - TotalTime: 19.999ms - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1): Node Lifecycle Event Timeline: 291.996ms - Open Started: 255.997ms (255.997ms) - Open Finished: 291.996ms (35.999ms) - First Batch Requested: 291.996ms (0.000ns) - First Batch Returned: 291.996ms (0.000ns) - Last Batch Returned: 291.996ms (0.000ns) - Closed: 291.996ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 25.00 KB (25600) - RowsReturned: 1 (1) - RowsReturnedRate: 27.00 /sec - TotalTime: 35.999ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0): Table Name: functional_parquet.lineitem_sixblocks Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:1 ExecOption: Codegen enabled: 1 out of 1, PARQUET Codegen Enabled Node Lifecycle Event Timeline: 291.996ms - Open Started: 255.997ms (255.997ms) - Open Finished: 255.997ms (0.000ns) - First Batch Requested: 255.997ms (0.000ns) - First Batch Returned: 271.996ms (15.999ms) - Last Batch Returned: 291.996ms (19.999ms) - Closed: 291.996ms (0.000ns) - BytesReadSeries (500.000ms): 0 - ColumnarScannerActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 83) - ColumnarScannerIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 83) - FooterProcessingTime: (Avg: 15.999ms ; Min: 15.999ms ; Max: 15.999ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: (Avg: 6.00 KB (6142) ; Min: 6.00 KB (6142) ; Max: 6.00 KB (6142) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 74.00 B (74) ; Min: 74.00 B (74) ; Max: 74.00 B (74) ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 558.75 KB (572161) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 558.75 KB (572161) - DataCacheHitCount: 85 (85) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 27.20 KB (27855) - IoReadAsyncRequest: 332 (332) - IoReadSkippedBytes: 0 - IoReadSyncBytes: 431.55 KB (441906) - IoReadSyncRequest: 1 (1) - IoReadTotalBytes: 458.75 KB (469761) - IoReadTotalRequest: 333 (333) - MaterializeTupleTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumBloomFilteredRowGroups: 0 (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumPages: 83 (83) - NumPagesSkippedByLateMaterialization: 0 (0) - NumRowGroups: 83 (83) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.42 MB (1490482) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowsRead: 8.30K (8300) - RowsReturned: 8.30K (8300) - RowsReturnedRate: 230.56 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 0.000ns - TotalReadThroughput: 0.00 /sec - TotalTime: 35.999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 792.00 KB (811008) - CumulativeAllocations: 84 (84) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns