Intra-node bytes read ratio: 0.980290221812 Intra-node bytes read ratio: 0.933418695451 Intra-node bytes read ratio: 0.889849262238 Intra-node bytes read ratio: 0.800085220062 Profile of skewed execution: Query (id=424a091e5dad2365:4b3d45b400000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Summary: Session ID: 55462dabfc34bbb3:4d363788821d96a5 Session Type: BEESWAX Start Time: 2022-12-12 20:02:02.164266000 End Time: 2022-12-12 20:02:06.509996000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.3.0-SNAPSHOT DEBUG (build 93e15e9dce1dd7b64b4ec39c6dd13362531d23f2) User: ubuntu Connected User: ubuntu Delegated User: Network Address: 192.168.124.1:54548 Default Db: default Sql Statement: select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Coordinator: 192.168.124.4:27000 Query Options (set by configuration): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre Query Options (set by configuration and planner): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre,SPOOL_QUERY_RESULTS=0,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE Plan: ---------------- Max Per-Host Resource Reservation: Memory=16.00MB Threads=3 Per-Host Resource Estimates: Memory=64MB WARNING: The following tables are missing relevant table and/or column statistics. test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Analyzed query: SELECT min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) FROM test_mt_dop_skew_lpt_95cba3d6.lineitem_skew F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 03:AGGREGATE [FINALIZE] | output: min:merge(l_orderkey), min:merge(l_partkey), min:merge(l_suppkey), min:merge(l_linenumber), min:merge(l_quantity), min:merge(l_extendedprice), min:merge(l_discount), min:merge(l_tax), min:merge(l_returnflag), min:merge(l_linestatus), min:merge(l_shipdate), min:merge(l_commitdate), min:merge(l_receiptdate), min:merge(l_shipinstruct), min:merge(l_shipmode), min:merge(l_comment) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 03(GETNEXT), 01(OPEN) | 02:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=6 Per-Instance Resources: mem-estimate=32.02MB mem-reservation=8.00MB thread-reservation=1 01:AGGREGATE | output: min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN HDFS [test_mt_dop_skew_lpt_95cba3d6.lineitem_skew, RANDOM] HDFS partitions=1/1 files=66 size=1.37GB stored statistics: table: rows=unavailable size=718.94MB columns: unavailable extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=32.00MB mem-reservation=8.00MB thread-reservation=0 tuple-ids=0 row-size=156B cardinality=9.44M in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 67174400 Tables Missing Stats: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Request Pool: root.default Per Host Min Memory Reservation: 192.168.124.5:27000(16.00 MB) 192.168.124.6:27000(16.00 MB) 192.168.124.4:27000(16.00 MB) Per Host Number of Fragment Instances: 192.168.124.5:27000(2) 192.168.124.6:27000(2) 192.168.124.4:27000(3) Admission result: Admitted immediately Cluster Memory Admitted: 900.00 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------------------------------- F01:ROOT 1 1 0.000ns 0.000ns 0 0 03:AGGREGATE 1 1 0.000ns 0.000ns 1 1 16.00 KB 16.00 KB FINALIZE 02:EXCHANGE 1 1 0.000ns 0.000ns 6 1 56.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 3 6 0.000ns 0.000ns 1.26 KB 640.00 KB 01:AGGREGATE 3 6 320.662ms 391.994ms 6 1 490.00 KB 16.00 KB 00:SCAN HDFS 3 6 3s575ms 3s975ms 11.45M 9.44M 24.00 MB 32.00 MB test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Errors: Query Compilation: 3.709ms - Metadata of all 1 tables cached: 1.229ms (1.229ms) - Analysis finished: 1.702ms (473.793us) - Authorization finished (noop): 1.786ms (83.947us) - Value transfer graph computed: 1.844ms (57.595us) - Single node plan created: 2.647ms (803.062us) - Runtime filters computed: 2.782ms (135.245us) - Distributed plan created: 2.795ms (13.193us) - Parallel plans created: 2.800ms (4.418us) - Planning finished: 3.709ms (908.715us) Query Timeline: 4s347ms - Query submitted: 0.000ns (0.000ns) - Planning finished: 3.999ms (3.999ms) - Submit for admission: 3.999ms (0.000ns) - Completed admission: 15.999ms (11.999ms) - Ready to start on 3 backends: 15.999ms (0.000ns) - All 3 execution backends (7 fragment instances) started: 15.999ms (0.000ns) - Rows available: 4s287ms (4s271ms) - First row fetched: 4s335ms (47.999ms) - Last row fetched: 4s335ms (0.000ns) - Released admission control resources: 4s347ms (11.999ms) - AdmissionControlTimeSinceLastUpdate: 76.000ms - ComputeScanRangeAssignmentTimer: 0.000ns - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Frontend: - CatalogFetch.ColumnStats.Hits: 16 - CatalogFetch.ColumnStats.Misses: 0 - CatalogFetch.ColumnStats.Requests: 16 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 1 - CatalogFetch.PartitionLists.Misses: 0 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 2 - CatalogFetch.Partitions.Misses: 0 - CatalogFetch.Partitions.Requests: 2 - CatalogFetch.Partitions.Time: 0 - CatalogFetch.RPCs.Bytes: 2.00 KB (2044) - CatalogFetch.RPCs.Requests: 1 - CatalogFetch.RPCs.Time: 0 - CatalogFetch.StorageLoad.Time: 0 - CatalogFetch.TableList.Hits: 2 - CatalogFetch.TableList.Misses: 0 - CatalogFetch.TableList.Requests: 2 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 0 - CatalogFetch.Tables.Misses: 1 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns ImpalaServer: - ClientFetchWaitTimer: 47.999ms - InactiveTotalTime: 0.000ns - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 83.00 /sec - RowMaterializationTimer: 11.999ms - TotalTime: 0.000ns Execution Profile 424a091e5dad2365:4b3d45b400000000:(Total: 4s283ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Slowest backend to start up: 192.168.124.4:27000 Per Node Peak Memory Usage: 192.168.124.4:27000(48.99 MB) 192.168.124.6:27000(48.98 MB) 192.168.124.5:27000(48.98 MB) Per Node Bytes Read: 192.168.124.4:27000(461.42 MB) 192.168.124.6:27000(471.53 MB) 192.168.124.5:27000(471.40 MB) Per Node User Time: 192.168.124.4:27000(3s315ms) 192.168.124.6:27000(3s253ms) 192.168.124.5:27000(3s184ms) Per Node System Time: 192.168.124.4:27000(408.232ms) 192.168.124.6:27000(414.184ms) 192.168.124.5:27000(465.694ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InactiveTotalTime: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 7 (7) - NumFragments: 2 (2) - TotalBytesRead: 1.37 GB (1472568887) - TotalBytesSent: 841.00 B (841) - TotalCpuTime: 11s041ms - TotalInnerBytesSent: 0 - TotalScanBytesSent: 841.00 B (841) - TotalTime: 4s283ms Per Node Profiles: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns 192.168.124.4:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.257ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 7.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 4.27 MB (4480736) - NumCachedFunctions: 20 (20) - NumFunctions: 20 (20) - NumInstructions: 404 (404) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 27.999ms Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 31.999ms, non-child: 31.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 3.999ms - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 31.999ms - CodegenSysTime: 7.376ms - CodegenUserTime: 22.128ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 11.999ms - ModuleBitcodeGenTime: 3.999ms - ModuleBitcodeSize: 4.27 MB (4480736) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 31.999ms 192.168.124.6:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.525ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 7.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 4.27 MB (4480736) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 27.999ms 192.168.124.5:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 3.634ms - CodegenUserTime: 21.809ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 7.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 4.27 MB (4480736) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 27.999ms Averaged Fragment F01:(Total: 4s319ms, non-child: 27.999ms, % non-child: 0.65%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4s331ms max:4s331ms mean: 4s331ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 4s331ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 80.00 KB (81920) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51373680) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4s243ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 4s319ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.747ms - TotalThreadsVoluntaryContextSwitches: 9 (9) - TotalTime: 4s319ms Fragment Instance Lifecycle Timings: - ExecTime: 47.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s271ms - ExecTreeOpenTime: 4s243ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 47.999ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 47.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 20.00 /sec - TotalTime: 47.999ms AGGREGATION_NODE (id=3):(Total: 4s243ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s243ms NonGroupingAggregator 0: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 4s243ms, non-child: 0.000ns, % non-child: 0.00%) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 4s243ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 1.00 /sec - TotalTime: 4s243ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 3s479ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s243ms - DataWaitTime: 4s243ms - TotalTime: 0.000ns Enqueue: - DispatchTime: (Avg: 49.611us ; Min: 42.033us ; Max: 60.239us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 841.00 B (841) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Coordinator Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 424a091e5dad2365:4b3d45b400000000 (host=192.168.124.4:27000):(Total: 4s319ms, non-child: 27.999ms, % non-child: 0.65%) Last report received time: 2022-12-12 20:02:06.509 Fragment Instance Lifecycle Event Timeline: 4s319ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s271ms (4s271ms) - First Batch Produced: 4s271ms (0.000ns) - First Batch Sent: 4s319ms (47.999ms) - ExecInternal Finished: 4s319ms (0.000ns) - MemoryUsage (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 48.00 KB, 72.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 4s331ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 80.00 KB (81920) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51373680) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4s243ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 4s319ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.747ms - TotalThreadsVoluntaryContextSwitches: 9 (9) - TotalTime: 4s319ms Fragment Instance Lifecycle Timings: - ExecTime: 47.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s271ms - ExecTreeOpenTime: 4s243ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 47.999ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 47.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 20.00 /sec - TotalTime: 47.999ms AGGREGATION_NODE (id=3):(Total: 4s243ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 4s319ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s271ms (4s243ms) - First Batch Requested: 4s271ms (0.000ns) - First Batch Returned: 4s271ms (0.000ns) - Last Batch Returned: 4s271ms (0.000ns) - Closed: 4s319ms (47.999ms) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s243ms NonGroupingAggregator 0: ExecOption: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 4s243ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 4s271ms - Open Started: 27.999ms (27.999ms) - Open Finished: 3s507ms (3s479ms) - First Batch Requested: 3s507ms (0.000ns) - First Batch Returned: 4s271ms (763.989ms) - Last Batch Returned: 4s271ms (0.000ns) - Closed: 4s271ms (0.000ns) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 4s243ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 1.00 /sec - TotalTime: 4s243ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 456.00 B, 1.10 KB - FirstBatchWaitTime: 3s479ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s243ms - DataWaitTime: 4s243ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 291.00 B, 701.00 B - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 49.611us ; Min: 42.033us ; Max: 60.239us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 841.00 B (841) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [6 instances]:(Total: 3s926ms, non-child: 29.999ms, % non-child: 0.76%) split sizes: min: 112.78 MB, max: 358.50 MB, avg: 234.01 MB, stddev: 98.36 MB completion times: min:4s039ms max:4s331ms mean: 4s217ms stddev:127.176ms execution rates: min:26.35 MB/sec max:86.50 MB/sec mean:55.55 MB/sec stddev:23.68 MB/sec num instances: 6 - AverageThreadTokens: 1.00 - BytesAssigned: 234.01 MB (245373534) - CompletionTime: 4s217ms - ExchangeScanRatio: 0.00 - ExecutionRate: 55.55 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51365488) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s074ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 3s926ms - TotalThreadsSysTime: 214.685ms - TotalThreadsUserTime: 1s621ms - TotalThreadsVoluntaryContextSwitches: 36 (36) - TotalTime: 3s926ms Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s926ms - ExecTreeOpenTime: 3s896ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2) [6 instances]: - NetworkThroughput: (Avg: 830.41 KB/sec ; Min: 639.20 KB/sec ; Max: 992.61 KB/sec ; Number of samples: 6) - RpcNetworkTime: (Avg: 115.100us ; Min: 52.746us ; Max: 204.724us ; Number of samples: 12) - RpcRecvrTime: (Avg: 45.660us ; Min: 14.763us ; Max: 89.408us ; Number of samples: 12) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1274) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 140.00 B (140) - TotalTime: 0.000ns - UncompressedRowBatchSize: 224.00 B (224) AGGREGATION_NODE (id=1) [6 instances]:(Total: 3s896ms, non-child: 320.662ms, % non-child: 8.23%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s896ms NonGroupingAggregator 0 [6 instances]: - BuildTime: 291.995ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 3s575ms, non-child: 3s575ms, % non-child: 100.00%) - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - InitialRangeIdealReservation: (Avg: 14.70 MB (15418497) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 234.06 MB (245428147) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 89.76 MB (94122770) - DataCacheHitCount: 13 (13) - DataCacheMissBytes: 144.30 MB (151305377) - DataCacheMissCount: 21 (21) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 532.659ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 961.320ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 80.37 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 1.91M (1907845) - RowsReturned: 1.91M (1907845) - RowsReturnedRate: 537.96 K/sec - ScanRangesComplete: 11 (11) - ScannerIoWaitTime: 2s074ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s015ms - TotalReadThroughput: 54.75 MB/sec - TotalTime: 3s575ms Buffer pool [6 instances]: - AllocTime: 666.657us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 140.72 MB (147554304) - CumulativeAllocations: 23 (23) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 666.657us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 424a091e5dad2365:4b3d45b400000006 (host=192.168.124.5:27000):(Total: 4s271ms, non-child: 27.999ms, % non-child: 0.66%) Last report received time: 2022-12-12 20:02:06.459 Hdfs split stats (:<# splits>/): -1:11/112.78 MB Fragment Instance Lifecycle Event Timeline: 4s271ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s271ms (4s271ms) - First Batch Produced: 4s271ms (0.000ns) - First Batch Sent: 4s271ms (0.000ns) - ExecInternal Finished: 4s271ms (0.000ns) - MemoryUsage (500.000ms): 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 112.78 MB (118256790) - CompletionTime: 4s279ms - ExchangeScanRatio: 0.00 - ExecutionRate: 26.35 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s603ms - TotalThreadsInvoluntaryContextSwitches: 52 (52) - TotalThreadsTotalWallClockTime: 4s271ms - TotalThreadsSysTime: 198.618ms - TotalThreadsUserTime: 1s430ms - TotalThreadsVoluntaryContextSwitches: 39 (39) - TotalTime: 4s271ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s271ms - ExecTreeOpenTime: 4s243ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 892.80 KB/sec ; Min: 892.80 KB/sec ; Max: 892.80 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 102.940us ; Min: 52.746us ; Max: 153.135us ; Number of samples: 2) - RpcRecvrTime: (Avg: 45.642us ; Min: 18.397us ; Max: 72.887us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 140.00 B (140) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s243ms, non-child: 267.996ms, % non-child: 6.31%) Node Lifecycle Event Timeline: 4s271ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s271ms (4s243ms) - First Batch Requested: 4s271ms (0.000ns) - First Batch Returned: 4s271ms (0.000ns) - Last Batch Returned: 4s271ms (0.000ns) - Closed: 4s271ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s243ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 235.996ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s975ms, non-child: 3s975ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:87.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:9 ExecOption: Codegen enabled: 9 out of 9, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s271ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 231.996ms (203.997ms) - Last Batch Returned: 4s271ms (4s039ms) - Closed: 4s271ms (0.000ns) - BytesReadSeries (500.000ms): 24.00 MB, 40.00 MB, 64.00 MB, 88.00 MB, 112.00 MB, 140.00 MB, 155.88 MB, 179.60 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 9) - InitialRangeIdealReservation: (Avg: 14.22 MB (14913080) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 9) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.88 - BytesRead: 209.52 MB (219701250) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 26.78 MB (28085288) - DataCacheHitCount: 5 (5) - DataCacheMissBytes: 182.74 MB (191615962) - DataCacheMissCount: 25 (25) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 511.992ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 847.988ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 57.25 MB/sec - RemoteScanRanges: 21 (21) - RowsRead: 1.71M (1705375) - RowsReturned: 1.71M (1705375) - RowsReturnedRate: 428.92 K/sec - ScanRangesComplete: 9 (9) - ScannerIoWaitTime: 2s603ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s659ms - TotalReadThroughput: 44.90 MB/sec - TotalTime: 3s975ms Buffer pool: - AllocTime: 3.999ms - CompressionTime: 0.000ns - CumulativeAllocationBytes: 108.06 MB (113311744) - CumulativeAllocations: 17 (17) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 424a091e5dad2365:4b3d45b400000005 (host=192.168.124.5:27000):(Total: 4s163ms, non-child: 27.999ms, % non-child: 0.67%) Last report received time: 2022-12-12 20:02:06.459 Hdfs split stats (:<# splits>/): -1:11/358.50 MB Fragment Instance Lifecycle Event Timeline: 4s163ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s163ms (4s163ms) - First Batch Produced: 4s163ms (0.000ns) - First Batch Sent: 4s163ms (0.000ns) - ExecInternal Finished: 4s163ms (0.000ns) - MemoryUsage (500.000ms): 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.18 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 358.50 MB (375910699) - CompletionTime: 4s279ms - ExchangeScanRatio: 0.00 - ExecutionRate: 83.76 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s131ms - TotalThreadsInvoluntaryContextSwitches: 60 (60) - TotalThreadsTotalWallClockTime: 4s163ms - TotalThreadsSysTime: 267.076ms - TotalThreadsUserTime: 1s753ms - TotalThreadsVoluntaryContextSwitches: 47 (47) - TotalTime: 4s163ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s163ms - ExecTreeOpenTime: 4s135ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 801.13 KB/sec ; Min: 801.13 KB/sec ; Max: 801.13 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 114.210us ; Min: 60.201us ; Max: 168.220us ; Number of samples: 2) - RpcRecvrTime: (Avg: 46.878us ; Min: 15.647us ; Max: 78.110us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s135ms, non-child: 367.994ms, % non-child: 8.90%) Node Lifecycle Event Timeline: 4s163ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s163ms (4s135ms) - First Batch Requested: 4s163ms (0.000ns) - First Batch Returned: 4s163ms (0.000ns) - Last Batch Returned: 4s163ms (0.000ns) - Closed: 4s163ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s135ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 327.995ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s767ms, non-child: 3s767ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:13 ExecOption: Codegen enabled: 13 out of 13, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s163ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 4s163ms (4s131ms) - Closed: 4s163ms (0.000ns) - BytesReadSeries (500.000ms): 24.00 MB, 48.00 MB, 72.00 MB, 104.00 MB, 140.00 MB, 179.77 MB, 211.43 MB, 246.98 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - InitialRangeIdealReservation: (Avg: 15.69 MB (16454577) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.75 - BytesRead: 261.88 MB (274597311) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 23 (23) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 94.83 MB (99431892) - DataCacheHitCount: 17 (17) - DataCacheMissBytes: 167.05 MB (175165419) - DataCacheMissCount: 23 (23) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 623.991ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s003ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 81.84 MB/sec - RemoteScanRanges: 30 (30) - RowsRead: 2.13M (213 ...[truncated 457951 chars]... - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 456.00 B - FirstBatchWaitTime: 3s811ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s451ms - DataWaitTime: 4s451ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 289.00 B - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 43.982us ; Min: 22.763us ; Max: 51.378us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 837.00 B (837) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [6 instances]:(Total: 4s173ms, non-child: 29.332ms, % non-child: 0.70%) split sizes: min: 112.78 MB, max: 358.50 MB, avg: 234.01 MB, stddev: 98.36 MB completion times: min:4s215ms max:4s527ms mean: 4s410ms stddev:138.613ms execution rates: min:25.13 MB/sec max:82.89 MB/sec mean:53.12 MB/sec stddev:22.64 MB/sec num instances: 6 - AverageThreadTokens: 1.00 - BytesAssigned: 234.01 MB (245373534) - CompletionTime: 4s410ms - ExchangeScanRatio: 0.00 - ExecutionRate: 53.12 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51365488) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 666.657us - TotalStorageWaitTime: 2s335ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 4s173ms - TotalThreadsSysTime: 225.961ms - TotalThreadsUserTime: 1s596ms - TotalThreadsVoluntaryContextSwitches: 31 (31) - TotalTime: 4s173ms Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: 666.657us - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s173ms - ExecTreeOpenTime: 4s143ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2) [6 instances]:(Total: 666.657us, non-child: 0.000ns, % non-child: 0.00%) - NetworkThroughput: (Avg: 1.02 MB/sec ; Min: 542.74 KB/sec ; Max: 1.61 MB/sec ; Number of samples: 6) - RpcNetworkTime: (Avg: 100.621us ; Min: 47.295us ; Max: 248.306us ; Number of samples: 12) - RpcRecvrTime: (Avg: 43.413us ; Min: 15.047us ; Max: 99.230us ; Number of samples: 12) - EosSent: 1 (1) - InactiveTotalTime: 666.657us - PeakMemoryUsage: 1.24 KB (1274) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 139.00 B (139) - TotalTime: 666.657us - UncompressedRowBatchSize: 224.00 B (224) AGGREGATION_NODE (id=1) [6 instances]:(Total: 4s143ms, non-child: 297.329ms, % non-child: 7.18%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s143ms NonGroupingAggregator 0 [6 instances]: - BuildTime: 275.996ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 3s846ms, non-child: 3s846ms, % non-child: 100.00%) - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - InitialRangeIdealReservation: (Avg: 14.70 MB (15418497) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.33 - BytesRead: 234.06 MB (245428147) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 92.40 MB (96887137) - DataCacheHitCount: 14 (14) - DataCacheMissBytes: 141.66 MB (148541010) - DataCacheMissCount: 21 (21) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 587.991ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 915.320ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 74.12 MB/sec - RemoteScanRanges: 28 (28) - RowsRead: 1.91M (1907845) - RowsReturned: 1.91M (1907845) - RowsReturnedRate: 498.51 K/sec - ScanRangesComplete: 11 (11) - ScannerIoWaitTime: 2s335ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s243ms - TotalReadThroughput: 49.23 MB/sec - TotalTime: 3s846ms Buffer pool [6 instances]: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 140.72 MB (147554304) - CumulativeAllocations: 23 (23) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000006 (host=192.168.124.5:27000):(Total: 4s479ms, non-child: 27.999ms, % non-child: 0.62%) Last report received time: 2022-12-12 20:02:19.848 Hdfs split stats (:<# splits>/): -1:11/112.78 MB Fragment Instance Lifecycle Event Timeline: 4s479ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s479ms (4s479ms) - First Batch Produced: 4s479ms (0.000ns) - First Batch Sent: 4s479ms (0.000ns) - ExecInternal Finished: 4s479ms (0.000ns) - MemoryUsage (500.000ms): 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 112.78 MB (118256790) - CompletionTime: 4s487ms - ExchangeScanRatio: 0.00 - ExecutionRate: 25.13 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s295ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 4s479ms - TotalThreadsSysTime: 271.331ms - TotalThreadsUserTime: 1s879ms - TotalThreadsVoluntaryContextSwitches: 37 (37) - TotalTime: 4s479ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s479ms - ExecTreeOpenTime: 4s451ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.61 MB/sec ; Min: 1.61 MB/sec ; Max: 1.61 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 67.707us ; Min: 53.883us ; Max: 81.531us ; Number of samples: 2) - RpcRecvrTime: (Avg: 26.726us ; Min: 17.827us ; Max: 35.626us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s451ms, non-child: 367.994ms, % non-child: 8.27%) Node Lifecycle Event Timeline: 4s479ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s479ms (4s451ms) - First Batch Requested: 4s479ms (0.000ns) - First Batch Returned: 4s479ms (0.000ns) - Last Batch Returned: 4s479ms (0.000ns) - Closed: 4s479ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s451ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 347.995ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 4s083ms, non-child: 4s083ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:44.44% 1:55.56% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:14 ExecOption: Codegen enabled: 14 out of 14, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s479ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 31.999ms (3.999ms) - Last Batch Returned: 4s479ms (4s447ms) - Closed: 4s479ms (0.000ns) - BytesReadSeries (500.000ms): 8.00 MB, 32.00 MB, 56.00 MB, 88.00 MB, 132.06 MB, 163.87 MB, 187.70 MB, 223.33 MB, 258.86 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 14) - InitialRangeIdealReservation: (Avg: 15.43 MB (16178029) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 14) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.56 - BytesRead: 273.58 MB (286867085) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 103.01 MB (108010360) - DataCacheHitCount: 17 (17) - DataCacheMissBytes: 170.57 MB (178856725) - DataCacheMissCount: 24 (24) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 699.990ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s067ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 80.94 MB/sec - RemoteScanRanges: 33 (33) - RowsRead: 2.23M (2227691) - RowsReturned: 2.23M (2227691) - RowsReturnedRate: 545.48 K/sec - ScanRangesComplete: 14 (14) - ScannerIoWaitTime: 2s295ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s379ms - TotalReadThroughput: 57.52 MB/sec - TotalTime: 4s083ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 172.06 MB (180420608) - CumulativeAllocations: 28 (28) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000005 (host=192.168.124.5:27000):(Total: 4s467ms, non-child: 27.999ms, % non-child: 0.63%) Last report received time: 2022-12-12 20:02:19.848 Hdfs split stats (:<# splits>/): -1:11/358.50 MB Fragment Instance Lifecycle Event Timeline: 4s467ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s463ms (4s463ms) - First Batch Produced: 4s463ms (0.000ns) - First Batch Sent: 4s463ms (0.000ns) - ExecInternal Finished: 4s467ms (3.999ms) - MemoryUsage (500.000ms): 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 358.50 MB (375910699) - CompletionTime: 4s487ms - ExchangeScanRatio: 0.00 - ExecutionRate: 79.88 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 2s907ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 4s467ms - TotalThreadsSysTime: 199.054ms - TotalThreadsUserTime: 1s349ms - TotalThreadsVoluntaryContextSwitches: 31 (31) - TotalTime: 4s467ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s463ms - ExecTreeOpenTime: 4s435ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2):(Total: 3.999ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 542.74 KB/sec ; Min: 542.74 KB/sec ; Max: 542.74 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 160.595us ; Min: 72.885us ; Max: 248.306us ; Number of samples: 2) - RpcRecvrTime: (Avg: 58.516us ; Min: 17.803us ; Max: 99.230us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 3.999ms - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s435ms, non-child: 251.996ms, % non-child: 5.68%) Node Lifecycle Event Timeline: 4s463ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s463ms (4s435ms) - First Batch Requested: 4s463ms (0.000ns) - First Batch Returned: 4s463ms (0.000ns) - Last Batch Returned: 4s463ms (0.000ns) - Closed: 4s463ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s435ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 239.996ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 4s183ms, non-child: 4s183ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:8 ExecOption: Codegen enabled: 8 out of 8, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s463ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 275.996ms (247.996ms) - Last Batch Returned: 4s463ms (4s187ms) - Closed: 4s463ms (0.000ns) - BytesReadSeries (500.000ms): 0, 24.00 MB, 40.00 MB, 56.00 MB, 72.00 MB, 104.00 MB, 132.06 MB, 155.84 MB, 179.57 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 14.50 MB (15204352) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 8) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 1.00 - BytesRead: 197.82 MB (207431476) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 22.48 MB (23567854) - DataCacheHitCount: 5 (5) - DataCacheMissBytes: 175.35 MB (183863622) - DataCacheMissCount: 24 (24) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 499.993ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 767.989ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 49.41 MB/sec - RemoteScanRanges: 18 (18) - RowsRead: 1.61M (1610860) - RowsReturned: 1.61M (1610860) - RowsReturnedRate: 385.01 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 2s907ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 4s003ms - TotalReadThroughput: 39.90 MB/sec - TotalTime: 4s183ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.06 MB (100728832) - CumulativeAllocations: 16 (16) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000001 (host=192.168.124.6:27000):(Total: 4s203ms, non-child: 27.999ms, % non-child: 0.67%) Last report received time: 2022-12-12 20:02:19.574 Hdfs split stats (:<# splits>/): -1:11/349.47 MB Fragment Instance Lifecycle Event Timeline: 4s203ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s203ms (4s203ms) - First Batch Produced: 4s203ms (0.000ns) - First Batch Sent: 4s203ms (0.000ns) - ExecInternal Finished: 4s203ms (0.000ns) - MemoryUsage (500.000ms): 12.80 KB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 349.47 MB (366445577) - CompletionTime: 4s215ms - ExchangeScanRatio: 0.00 - ExecutionRate: 82.89 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s059ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 4s203ms - TotalThreadsSysTime: 283.735ms - TotalThreadsUserTime: 1s829ms - TotalThreadsVoluntaryContextSwitches: 33 (33) - TotalTime: 4s203ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s203ms - ExecTreeOpenTime: 4s175ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 984.40 KB/sec ; Min: 984.40 KB/sec ; Max: 984.40 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 93.691us ; Min: 50.481us ; Max: 136.901us ; Number of samples: 2) - RpcRecvrTime: (Avg: 47.471us ; Min: 15.239us ; Max: 79.703us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s175ms, non-child: 379.994ms, % non-child: 9.10%) Node Lifecycle Event Timeline: 4s203ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s203ms (4s175ms) - First Batch Requested: 4s203ms (0.000ns) - First Batch Returned: 4s203ms (0.000ns) - Last Batch Returned: 4s203ms (0.000ns) - Closed: 4s203ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s175ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 331.995ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s795ms, non-child: 3s795ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:37.5% 1:62.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:15 ExecOption: Codegen enabled: 15 out of 15, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s203ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 263.996ms (235.996ms) - Last Batch Returned: 4s203ms (3s939ms) - Closed: 4s203ms (0.000ns) - BytesReadSeries (500.000ms): 0, 32.00 MB, 72.00 MB, 112.00 MB, 132.06 MB, 155.93 MB, 191.67 MB, 223.33 MB, 266.31 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 15) - InitialRangeIdealReservation: (Avg: 14.93 MB (15658734) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 15) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.62 - BytesRead: 281.04 MB (294687774) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 22 (22) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 142.09 MB (148996894) - DataCacheHitCount: 20 (20) - DataCacheMissBytes: 138.94 MB (145690880) - DataCacheMissCount: 22 (22) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 671.990ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s059ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 96.25 MB/sec - RemoteScanRanges: 38 (38) - RowsRead: 2.29M (2289717) - RowsReturned: 2.29M (2289717) - RowsReturnedRate: 603.20 K/sec - ScanRangesComplete: 15 (15) - ScannerIoWaitTime: 2s059ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s919ms - TotalReadThroughput: 59.18 MB/sec - TotalTime: 3s795ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 180.06 MB (188809216) - CumulativeAllocations: 29 (29) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000002 (host=192.168.124.6:27000):(Total: 4s143ms, non-child: 27.999ms, % non-child: 0.68%) Last report received time: 2022-12-12 20:02:19.574 Hdfs split stats (:<# splits>/): -1:11/121.93 MB Fragment Instance Lifecycle Event Timeline: 4s143ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s143ms (4s143ms) - First Batch Produced: 4s143ms (0.000ns) - First Batch Sent: 4s143ms (0.000ns) - ExecInternal Finished: 4s143ms (0.000ns) - MemoryUsage (500.000ms): 12.80 KB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 121.93 MB (127856861) - CompletionTime: 4s215ms - ExchangeScanRatio: 0.00 - ExecutionRate: 28.92 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s667ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 4s143ms - TotalThreadsSysTime: 197.344ms - TotalThreadsUserTime: 1s288ms - TotalThreadsVoluntaryContextSwitches: 26 (26) - TotalTime: 4s143ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s143ms - ExecTreeOpenTime: 4s115ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 912.96 KB/sec ; Min: 912.96 KB/sec ; Max: 912.96 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 97.714us ; Min: 52.092us ; Max: 143.336us ; Number of samples: 2) - RpcRecvrTime: (Avg: 44.304us ; Min: 15.228us ; Max: 73.381us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 134.00 B (134) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s115ms, non-child: 171.997ms, % non-child: 4.18%) Node Lifecycle Event Timeline: 4s143ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s143ms (4s115ms) - First Batch Requested: 4s143ms (0.000ns) - First Batch Returned: 4s143ms (0.000ns) - Last Batch Returned: 4s143ms (0.000ns) - Closed: 4s143ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s115ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 163.997ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s943ms, non-child: 3s943ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:87.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:7 ExecOption: Codegen enabled: 7 out of 7, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s143ms - Open Started: 27.999ms (27.999ms) - Open Finished: 27.999ms (0.000ns) - First Batch Requested: 27.999ms (0.000ns) - First Batch Returned: 259.996ms (231.996ms) - Last Batch Returned: 4s143ms (3s883ms) - Closed: 4s143ms (0.000ns) - BytesReadSeries (500.000ms): 0, 16.00 MB, 40.00 MB, 56.00 MB, 96.00 MB, 112.00 MB, 132.06 MB, 155.84 MB, 175.60 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 7) - InitialRangeIdealReservation: (Avg: 15.43 MB (16178029) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 7) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.88 - BytesRead: 190.49 MB (199745736) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 22 (22) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 47.72 MB (50039839) - DataCacheHitCount: 6 (6) - DataCacheMissBytes: 142.77 MB (149705897) - DataCacheMissCount: 22 (22) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 479.993ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 791.989ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 53.57 MB/sec - RemoteScanRanges: 23 (23) - RowsRead: 1.56M (1559545) - RowsReturned: 1.56M (1559545) - RowsReturnedRate: 395.43 K/sec - ScanRangesComplete: 7 (7) - ScannerIoWaitTime: 2s667ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s555ms - TotalReadThroughput: 39.02 MB/sec - TotalTime: 3s943ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 88.06 MB (92340224) - CumulativeAllocations: 15 (15) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000003 (host=192.168.124.4:27000):(Total: 3s911ms, non-child: 31.999ms, % non-child: 0.82%) Last report received time: 2022-12-12 20:02:19.886 Hdfs split stats (:<# splits>/): -1:14/199.50 MB Fragment Instance Lifecycle Event Timeline: 3s911ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 3s911ms (3s911ms) - First Batch Produced: 3s911ms (0.000ns) - First Batch Sent: 3s911ms (0.000ns) - ExecInternal Finished: 3s911ms (0.000ns) - MemoryUsage (500.000ms): 12.80 KB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 199.50 MB (209196004) - CompletionTime: 4s527ms - ExchangeScanRatio: 0.00 - ExecutionRate: 44.06 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51373680) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s987ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 3s911ms - TotalThreadsSysTime: 191.616ms - TotalThreadsUserTime: 1s728ms - TotalThreadsVoluntaryContextSwitches: 30 (30) - TotalTime: 3s911ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s911ms - ExecTreeOpenTime: 3s879ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.14 MB/sec ; Min: 1.14 MB/sec ; Max: 1.14 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 81.476us ; Min: 47.295us ; Max: 115.657us ; Number of samples: 2) - RpcRecvrTime: (Avg: 41.199us ; Min: 15.047us ; Max: 67.352us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 3s879ms, non-child: 283.996ms, % non-child: 7.32%) Node Lifecycle Event Timeline: 3s911ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s911ms (3s879ms) - First Batch Requested: 3s911ms (0.000ns) - First Batch Returned: 3s911ms (0.000ns) - Last Batch Returned: 3s911ms (0.000ns) - Closed: 3s911ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s879ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 259.996ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s595ms, non-child: 3s595ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:28.57% 1:71.43% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:12 ExecOption: Codegen enabled: 12 out of 12, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s911ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 35.999ms (3.999ms) - Last Batch Returned: 3s911ms (3s875ms) - Closed: 3s911ms (0.000ns) - BytesReadSeries (500.000ms): 0, 24.00 MB, 88.00 MB, 96.00 MB, 132.06 MB, 155.90 MB, 175.68 MB, 223.11 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - InitialRangeIdealReservation: (Avg: 15.33 MB (16078165) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.71 - BytesRead: 249.68 MB (261803773) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 19 (19) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 126.76 MB (132912698) - DataCacheHitCount: 18 (18) - DataCacheMissBytes: 122.92 MB (128891075) - DataCacheMissCount: 19 (19) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 607.991ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 995.986ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 88.29 MB/sec - RemoteScanRanges: 30 (30) - RowsRead: 2.03M (2033760) - RowsReturned: 2.03M (2033760) - RowsReturnedRate: 565.57 K/sec - ScanRangesComplete: 12 (12) - ScannerIoWaitTime: 1s987ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s827ms - TotalReadThroughput: 55.78 MB/sec - TotalTime: 3s595ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 148.06 MB (155254784) - CumulativeAllocations: 24 (24) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 0a4b68440741f53d:d401c30200000004 (host=192.168.124.4:27000):(Total: 3s835ms, non-child: 31.999ms, % non-child: 0.83%) Last report received time: 2022-12-12 20:02:19.886 Hdfs split stats (:<# splits>/): -1:13/261.86 MB Fragment Instance Lifecycle Event Timeline: 3s835ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 3s835ms (3s835ms) - First Batch Produced: 3s835ms (0.000ns) - First Batch Sent: 3s835ms (0.000ns) - ExecInternal Finished: 3s835ms (0.000ns) - MemoryUsage (500.000ms): 12.80 KB, 24.18 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.18 MB, 24.49 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 261.86 MB (274575276) - CompletionTime: 4s527ms - ExchangeScanRatio: 0.00 - ExecutionRate: 57.83 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.99 MB (51373680) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s091ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 3s835ms - TotalThreadsSysTime: 212.688ms - TotalThreadsUserTime: 1s504ms - TotalThreadsVoluntaryContextSwitches: 29 (29) - TotalTime: 3s835ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s835ms - ExecTreeOpenTime: 3s803ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1019.76 KB/sec ; Min: 1019.76 KB/sec ; Max: 1019.76 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 102.547us ; Min: 60.491us ; Max: 144.604us ; Number of samples: 2) - RpcRecvrTime: (Avg: 42.264us ; Min: 17.059us ; Max: 67.470us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.26 KB (1294) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 151.00 B (151) - TotalTime: 0.000ns - UncompressedRowBatchSize: 234.00 B (234) AGGREGATION_NODE (id=1):(Total: 3s803ms, non-child: 327.995ms, % non-child: 8.62%) Node Lifecycle Event Timeline: 3s835ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s835ms (3s803ms) - First Batch Requested: 3s835ms (0.000ns) - First Batch Returned: 3s835ms (0.000ns) - Last Batch Returned: 3s835ms (0.000ns) - Closed: 3s835ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s803ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 311.995ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s475ms, non-child: 3s475ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:15 ExecOption: Codegen enabled: 15 out of 15, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s835ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 283.996ms (251.996ms) - Last Batch Returned: 3s835ms (3s551ms) - Closed: 3s835ms (0.000ns) - BytesReadSeries (500.000ms): 0, 24.00 MB, 40.00 MB, 64.00 MB, 104.69 MB, 128.50 MB, 144.38 MB, 176.00 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 15) - InitialRangeIdealReservation: (Avg: 13.07 MB (13701393) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 15) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 1.00 - BytesRead: 211.75 MB (222033043) - BytesReadDataNodeCache: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 112.34 MB (117795181) - DataCacheHitCount: 18 (18) - DataCacheMissBytes: 99.41 MB (104237862) - DataCacheMissCount: 16 (16) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 567.992ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 807.988ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 76.28 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 1.73M (1725502) - RowsReturned: 1.73M (1725502) - RowsReturnedRate: 496.41 K/sec - ScanRangesComplete: 15 (15) - ScannerIoWaitTime: 2s091ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s775ms - TotalReadThroughput: 44.00 MB/sec - TotalTime: 3s475ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 26 (26) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns