Intra-node bytes read ratio: 0.879926272721 Intra-node bytes read ratio: 0.934411630805 Intra-node bytes read ratio: 0.961263756569 Intra-node bytes read ratio: 0.838286681816 Profile of skewed execution: Query (id=bd419d19da91e401:14357bf700000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Summary: Session ID: 4d49f23e7ed7fd5b:0a04a5b728f59296 Session Type: BEESWAX Start Time: 2023-03-01 01:30:27.293578000 End Time: 2023-03-01 01:30:31.432769000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.3.0-SNAPSHOT DEBUG (build d14cd65a43fa1773f0326dc8dd7a82da6c2ccaf8) User: ubuntu Connected User: ubuntu Delegated User: Network Address: 192.168.124.1:34582 Default Db: default Sql Statement: select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Coordinator: 192.168.124.4:27000 Query Options (set by configuration): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre Query Options (set by configuration and planner): MT_DOP=2,TIMEZONE=UTC,CLIENT_IDENTIFIER=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre,SPOOL_QUERY_RESULTS=0,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE Plan: ---------------- Max Per-Host Resource Reservation: Memory=16.00MB Threads=3 Per-Host Resource Estimates: Memory=64MB WARNING: The following tables are missing relevant table and/or column statistics. test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Analyzed query: SELECT min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) FROM test_mt_dop_skew_lpt_95cba3d6.lineitem_skew F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 03:AGGREGATE [FINALIZE] | output: min:merge(l_orderkey), min:merge(l_partkey), min:merge(l_suppkey), min:merge(l_linenumber), min:merge(l_quantity), min:merge(l_extendedprice), min:merge(l_discount), min:merge(l_tax), min:merge(l_returnflag), min:merge(l_linestatus), min:merge(l_shipdate), min:merge(l_commitdate), min:merge(l_receiptdate), min:merge(l_shipinstruct), min:merge(l_shipmode), min:merge(l_comment) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 03(GETNEXT), 01(OPEN) | 02:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=6 Per-Instance Resources: mem-estimate=32.02MB mem-reservation=8.00MB thread-reservation=1 01:AGGREGATE | output: min(l_orderkey), min(l_partkey), min(l_suppkey), min(l_linenumber), min(l_quantity), min(l_extendedprice), min(l_discount), min(l_tax), min(l_returnflag), min(l_linestatus), min(l_shipdate), min(l_commitdate), min(l_receiptdate), min(l_shipinstruct), min(l_shipmode), min(l_comment) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=156B cardinality=1 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN HDFS [test_mt_dop_skew_lpt_95cba3d6.lineitem_skew, RANDOM] HDFS partitions=1/1 files=66 size=1.37GB stored statistics: table: rows=unavailable size=718.94MB columns: unavailable extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=32.00MB mem-reservation=8.00MB thread-reservation=0 tuple-ids=0 row-size=156B cardinality=9.44M in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 67174400 Tables Missing Stats: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Request Pool: root.default Per Host Min Memory Reservation: 192.168.124.6:27000(16.00 MB) 192.168.124.5:27000(16.00 MB) 192.168.124.4:27000(16.00 MB) Per Host Number of Fragment Instances: 192.168.124.6:27000(2) 192.168.124.5:27000(2) 192.168.124.4:27000(3) Admission result: Admitted immediately Cluster Memory Admitted: 900.00 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------------------------------- F01:ROOT 1 1 0.000ns 0.000ns 0 0 03:AGGREGATE 1 1 0.000ns 0.000ns 1 1 16.00 KB 16.00 KB FINALIZE 02:EXCHANGE 1 1 0.000ns 0.000ns 6 1 56.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 3 6 1.333ms 7.999ms 1.26 KB 640.00 KB 01:AGGREGATE 3 6 325.331ms 351.998ms 6 1 490.00 KB 16.00 KB 00:SCAN HDFS 3 6 3s231ms 3s747ms 11.45M 9.44M 24.00 MB 32.00 MB test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Errors: Query Compilation: 3.849ms - Metadata of all 1 tables cached: 1.326ms (1.326ms) - Analysis finished: 1.783ms (456.337us) - Authorization finished (noop): 1.871ms (88.682us) - Value transfer graph computed: 1.939ms (67.641us) - Single node plan created: 2.761ms (822.374us) - Runtime filters computed: 2.902ms (140.199us) - Distributed plan created: 2.915ms (13.239us) - Parallel plans created: 2.920ms (5.360us) - Planning finished: 3.849ms (928.655us) Query Timeline: 4s143ms - Query submitted: 0.000ns (0.000ns) - Planning finished: 3.999ms (3.999ms) - Submit for admission: 3.999ms (0.000ns) - Completed admission: 11.999ms (7.999ms) - Ready to start on 3 backends: 11.999ms (0.000ns) - All 3 execution backends (7 fragment instances) started: 11.999ms (0.000ns) - Rows available: 4s127ms (4s115ms) - First row fetched: 4s131ms (3.999ms) - Last row fetched: 4s131ms (0.000ns) - Released admission control resources: 4s139ms (7.999ms) - AdmissionControlTimeSinceLastUpdate: 75.000ms - ComputeScanRangeAssignmentTimer: 0.000ns - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Frontend: Referenced Tables: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew - CatalogFetch.ColumnStats.Hits: 16 - CatalogFetch.ColumnStats.Misses: 0 - CatalogFetch.ColumnStats.Requests: 16 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 1 - CatalogFetch.PartitionLists.Misses: 0 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 2 - CatalogFetch.Partitions.Misses: 0 - CatalogFetch.Partitions.Requests: 2 - CatalogFetch.Partitions.Time: 0 - CatalogFetch.RPCs.Bytes: 2.00 KB (2044) - CatalogFetch.RPCs.Requests: 1 - CatalogFetch.RPCs.Time: 0 - CatalogFetch.StorageLoad.Time: 0 - CatalogFetch.TableList.Hits: 2 - CatalogFetch.TableList.Misses: 0 - CatalogFetch.TableList.Requests: 2 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 0 - CatalogFetch.Tables.Misses: 1 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns ImpalaServer: - ClientFetchWaitTimer: 3.999ms - InactiveTotalTime: 0.000ns - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 83.00 /sec - RowMaterializationTimer: 11.999ms - TotalTime: 0.000ns Execution Profile bd419d19da91e401:14357bf700000000:(Total: 4s123ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Slowest backend to start up: 192.168.124.4:27000 Per Node Peak Memory Usage: 192.168.124.4:27000(49.03 MB) 192.168.124.5:27000(48.98 MB) 192.168.124.6:27000(48.98 MB) Per Node Bytes Read: 192.168.124.4:27000(483.17 MB) 192.168.124.5:27000(489.48 MB) 192.168.124.6:27000(431.70 MB) Per Node User Time: 192.168.124.4:27000(3s277ms) 192.168.124.5:27000(3s319ms) 192.168.124.6:27000(2s981ms) Per Node System Time: 192.168.124.4:27000(454.994ms) 192.168.124.5:27000(462.138ms) 192.168.124.6:27000(441.927ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InactiveTotalTime: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 7 (7) - NumFragments: 2 (2) - TotalBytesRead: 1.37 GB (1472568887) - TotalBytesSent: 839.00 B (839) - TotalCpuTime: 10s937ms - TotalInnerBytesSent: 0 - TotalScanBytesSent: 839.00 B (839) - TotalTime: 4s123ms Per Node Profiles: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns 192.168.124.4:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 0.000ns - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 3.479ms - CodegenUserTime: 20.879ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 7.999ms - ModuleBitcodeGenTime: 0.000ns - ModuleBitcodeSize: 4.28 MB (4487672) - NumCachedFunctions: 20 (20) - NumFunctions: 20 (20) - NumInstructions: 404 (404) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 27.999ms Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 31.999ms, non-child: 31.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 3.999ms - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 31.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 28.525ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 11.999ms - ModuleBitcodeGenTime: 3.999ms - ModuleBitcodeSize: 4.28 MB (4487672) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 31.999ms 192.168.124.5:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 31.999ms, non-child: 31.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 3.999ms - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 31.999ms - CodegenSysTime: 3.544ms - CodegenUserTime: 24.813ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 11.999ms - ModuleBitcodeGenTime: 3.999ms - ModuleBitcodeSize: 4.28 MB (4487672) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 19.999ms - TotalTime: 31.999ms 192.168.124.6:27000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen:(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) - CodegenCacheLookupTime: 3.999ms - CodegenCacheSaveTime: 0.000ns - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 27.999ms - CodegenSysTime: 3.536ms - CodegenUserTime: 24.454ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - InactiveTotalTime: 0.000ns - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - MainThreadCodegenTime: 11.999ms - ModuleBitcodeGenTime: 3.999ms - ModuleBitcodeSize: 4.28 MB (4487672) - NumCachedFunctions: 99 (99) - NumFunctions: 99 (99) - NumInstructions: 2.86K (2864) - OptimizationTime: 3.999ms - PeakMemoryUsage: 0 - PrepareTime: 15.999ms - TotalTime: 27.999ms Averaged Fragment F01:(Total: 4s119ms, non-child: 27.999ms, % non-child: 0.68%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4s127ms max:4s127ms mean: 4s127ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 4s127ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 80.00 KB (81920) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.03 MB (51410544) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4s087ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4s119ms - TotalThreadsSysTime: 3.662ms - TotalThreadsUserTime: 21.972ms - TotalThreadsVoluntaryContextSwitches: 8 (8) - TotalTime: 4s119ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s115ms - ExecTreeOpenTime: 4s087ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 3.999ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 250.00 /sec - TotalTime: 3.999ms AGGREGATION_NODE (id=3):(Total: 4s087ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s087ms NonGroupingAggregator 0: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 4s087ms, non-child: 0.000ns, % non-child: 0.00%) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 4s087ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 1.00 /sec - TotalTime: 4s087ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 3s119ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s087ms - DataWaitTime: 4s087ms - TotalTime: 0.000ns Enqueue: - DispatchTime: (Avg: 43.941us ; Min: 25.377us ; Max: 52.855us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 839.00 B (839) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Coordinator Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance bd419d19da91e401:14357bf700000000 (host=192.168.124.4:27000):(Total: 4s119ms, non-child: 27.999ms, % non-child: 0.68%) Last report received time: 2023-03-01 01:30:31.432 Fragment Instance Lifecycle Event Timeline: 4s119ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s115ms (4s115ms) - First Batch Produced: 4s115ms (0.000ns) - First Batch Sent: 4s119ms (3.999ms) - ExecInternal Finished: 4s119ms (0.000ns) - MemoryUsage (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 64.00 KB, 72.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 4s127ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 80.00 KB (81920) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.03 MB (51410544) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4s087ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4s119ms - TotalThreadsSysTime: 3.662ms - TotalThreadsUserTime: 21.972ms - TotalThreadsVoluntaryContextSwitches: 8 (8) - TotalTime: 4s119ms Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s115ms - ExecTreeOpenTime: 4s087ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 3.999ms, non-child: 0.000ns, % non-child: 0.00%) - InactiveTotalTime: 3.999ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 250.00 /sec - TotalTime: 3.999ms AGGREGATION_NODE (id=3):(Total: 4s087ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 4s119ms - Open Started: 27.999ms (27.999ms) - Open Finished: 4s115ms (4s087ms) - First Batch Requested: 4s115ms (0.000ns) - First Batch Returned: 4s115ms (0.000ns) - Last Batch Returned: 4s115ms (0.000ns) - Closed: 4s119ms (3.999ms) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s087ms NonGroupingAggregator 0: ExecOption: - BuildTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 4s087ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 4s115ms - Open Started: 27.999ms (27.999ms) - Open Finished: 3s147ms (3s119ms) - First Batch Requested: 3s147ms (0.000ns) - First Batch Returned: 4s115ms (967.994ms) - Last Batch Returned: 4s115ms (0.000ns) - Closed: 4s115ms (0.000ns) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 4s087ms - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 6 (6) - RowsReturnedRate: 1.00 /sec - TotalTime: 4s087ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 56.00 KB (57344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 56.00 KB (57344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 900.00 B, 1.10 KB - FirstBatchWaitTime: 3s119ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s087ms - DataWaitTime: 4s087ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 561.00 B, 701.00 B - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 43.941us ; Min: 25.377us ; Max: 52.855us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 839.00 B (839) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [6 instances]:(Total: 3s589ms, non-child: 31.333ms, % non-child: 0.87%) split sizes: min: 115.80 MB, max: 364.24 MB, avg: 234.01 MB, stddev: 91.47 MB completion times: min:3s179ms max:4s127ms mean: 3s811ms stddev:446.889ms execution rates: min:30.31 MB/sec max:99.32 MB/sec mean:61.88 MB/sec stddev:25.16 MB/sec num instances: 6 - AverageThreadTokens: 1.00 - BytesAssigned: 234.01 MB (245373534) - CompletionTime: 3s811ms - ExchangeScanRatio: 0.00 - ExecutionRate: 61.88 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.00 MB (51377776) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s757ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 3s589ms - TotalThreadsSysTime: 225.899ms - TotalThreadsUserTime: 1s592ms - TotalThreadsVoluntaryContextSwitches: 30 (30) - TotalTime: 3s589ms Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: 666.663us - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s588ms - ExecTreeOpenTime: 3s557ms - PrepareTime: 666.663us - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2) [6 instances]:(Total: 1.333ms, non-child: 1.333ms, % non-child: 100.00%) - NetworkThroughput: (Avg: 1.05 MB/sec ; Min: 920.32 KB/sec ; Max: 1.35 MB/sec ; Number of samples: 6) - RpcNetworkTime: (Avg: 94.265us ; Min: 51.951us ; Max: 160.227us ; Number of samples: 12) - RpcRecvrTime: (Avg: 41.076us ; Min: 15.278us ; Max: 77.621us ; Number of samples: 12) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1274) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 139.00 B (139) - TotalTime: 1.333ms - UncompressedRowBatchSize: 224.00 B (224) AGGREGATION_NODE (id=1) [6 instances]:(Total: 3s557ms, non-child: 325.331ms, % non-child: 9.15%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s557ms NonGroupingAggregator 0 [6 instances]: - BuildTime: 295.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 3s231ms, non-child: 3s231ms, % non-child: 100.00%) - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - InitialRangeIdealReservation: (Avg: 14.70 MB (15418497) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 234.06 MB (245428147) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 111.67 MB (117094256) - DataCacheHitCount: 17 (17) - DataCacheMissBytes: 122.39 MB (128333891) - DataCacheMissCount: 17 (17) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 537.330ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 931.994ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 96.24 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 1.91M (1907845) - RowsReturned: 1.91M (1907845) - RowsReturnedRate: 595.10 K/sec - ScanRangesComplete: 11 (11) - ScannerIoWaitTime: 1s757ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s547ms - TotalReadThroughput: 58.48 MB/sec - TotalTime: 3s231ms Buffer pool [6 instances]: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 140.72 MB (147554304) - CumulativeAllocations: 23 (23) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance bd419d19da91e401:14357bf700000002 (host=192.168.124.5:27000):(Total: 4s115ms, non-child: 31.999ms, % non-child: 0.78%) Last report received time: 2023-03-01 01:30:31.429 Hdfs split stats (:<# splits>/): -1:12/125.11 MB Fragment Instance Lifecycle Event Timeline: 4s115ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s115ms (4s115ms) - First Batch Produced: 4s115ms (0.000ns) - First Batch Sent: 4s115ms (0.000ns) - ExecInternal Finished: 4s115ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 125.11 MB (131192002) - CompletionTime: 4s127ms - ExchangeScanRatio: 0.00 - ExecutionRate: 30.31 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s035ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 4s115ms - TotalThreadsSysTime: 265.041ms - TotalThreadsUserTime: 1s795ms - TotalThreadsVoluntaryContextSwitches: 34 (34) - TotalTime: 4s115ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s115ms - ExecTreeOpenTime: 4s083ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.35 MB/sec ; Min: 1.35 MB/sec ; Max: 1.35 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 76.151us ; Min: 54.743us ; Max: 97.560us ; Number of samples: 2) - RpcRecvrTime: (Avg: 28.456us ; Min: 16.600us ; Max: 40.312us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s083ms, non-child: 343.998ms, % non-child: 8.42%) Node Lifecycle Event Timeline: 4s115ms - Open Started: 31.999ms (31.999ms) - Open Finished: 4s115ms (4s083ms) - First Batch Requested: 4s115ms (0.000ns) - First Batch Returned: 4s115ms (0.000ns) - Last Batch Returned: 4s115ms (0.000ns) - Closed: 4s115ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s083ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 323.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s739ms, non-child: 3s739ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:37.5% 1:62.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:13 ExecOption: Codegen enabled: 13 out of 13, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s115ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 239.998ms (207.998ms) - Last Batch Returned: 4s115ms (3s875ms) - Closed: 4s115ms (0.000ns) - BytesReadSeries (500.000ms): 0, 56.00 MB, 104.00 MB, 140.00 MB, 163.87 MB, 187.70 MB, 215.48 MB, 247.07 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - InitialRangeIdealReservation: (Avg: 16.00 MB (16777216) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.62 - BytesRead: 266.27 MB (279205068) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 22 (22) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 115.84 MB (121464464) - DataCacheHitCount: 18 (18) - DataCacheMissBytes: 150.43 MB (157740604) - DataCacheMissCount: 22 (22) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 615.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s079ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 90.08 MB/sec - RemoteScanRanges: 38 (38) - RowsRead: 2.17M (2169045) - RowsReturned: 2.17M (2169045) - RowsReturnedRate: 579.96 K/sec - ScanRangesComplete: 13 (13) - ScannerIoWaitTime: 2s035ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s955ms - TotalReadThroughput: 61.77 MB/sec - TotalTime: 3s739ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 164.06 MB (172032000) - CumulativeAllocations: 27 (27) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance bd419d19da91e401:14357bf700000001 (host=192.168.124.5:27000):(Total: 4s083ms, non-child: 31.999ms, % non-child: 0.78%) Last report received time: 2023-03-01 01:30:31.429 Hdfs split stats (:<# splits>/): -1:13/364.24 MB Fragment Instance Lifecycle Event Timeline: 4s083ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 4s083ms (4s083ms) - First Batch Produced: 4s083ms (0.000ns) - First Batch Sent: 4s083ms (0.000ns) - ExecInternal Finished: 4s083ms (0.000ns) - MemoryUsage (500.000ms): 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 364.24 MB (381935884) - CompletionTime: 4s127ms - ExchangeScanRatio: 0.00 - ExecutionRate: 88.24 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s371ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 4s083ms - TotalThreadsSysTime: 197.097ms - TotalThreadsUserTime: 1s524ms - TotalThreadsVoluntaryContextSwitches: 33 (33) - TotalTime: 4s083ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s083ms - ExecTreeOpenTime: 4s051ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 928.90 KB/sec ; Min: 928.90 KB/sec ; Max: 928.90 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 107.177us ; Min: 67.172us ; Max: 147.183us ; Number of samples: 2) - RpcRecvrTime: (Avg: 48.069us ; Min: 18.518us ; Max: 77.621us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 140.00 B (140) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s051ms, non-child: 303.998ms, % non-child: 7.50%) Node Lifecycle Event Timeline: 4s083ms - Open Started: 31.999ms (31.999ms) - Open Finished: 4s083ms (4s051ms) - First Batch Requested: 4s083ms (0.000ns) - First Batch Returned: 4s083ms (0.000ns) - Last Batch Returned: 4s083ms (0.000ns) - Closed: 4s083ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s051ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 279.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s747ms, non-child: 3s747ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:87.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:12 ExecOption: Codegen enabled: 12 out of 12, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s083ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 51.999ms (19.999ms) - Last Batch Returned: 4s083ms (4s031ms) - Closed: 4s083ms (0.000ns) - BytesReadSeries (500.000ms): 8.00 MB, 24.00 MB, 48.00 MB, 80.00 MB, 112.00 MB, 140.00 MB, 155.88 MB, 191.46 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - InitialRangeIdealReservation: (Avg: 12.33 MB (12932437) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.88 - BytesRead: 223.21 MB (234053890) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 50.99 MB (53464590) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 172.22 MB (180589300) - DataCacheMissCount: 24 (24) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 543.997ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 827.995ms - MaxCompressedTextF ...[truncated 539143 chars]... - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 456.00 B, 1.10 KB - FirstBatchWaitTime: 3s251ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 1.31 KB (1344) - TotalGetBatchTime: 4s087ms - DataWaitTime: 4s087ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 289.00 B, 699.00 B - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 38.312us ; Min: 24.871us ; Max: 49.834us ; Number of samples: 6) - DeserializeRowBatchTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 837.00 B (837) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [6 instances]:(Total: 3s661ms, non-child: 29.999ms, % non-child: 0.82%) split sizes: min: 115.80 MB, max: 364.24 MB, avg: 234.01 MB, stddev: 91.47 MB completion times: min:3s299ms max:4s167ms mean: 3s861ms stddev:397.487ms execution rates: min:30.40 MB/sec max:95.71 MB/sec mean:60.93 MB/sec stddev:24.57 MB/sec num instances: 6 - AverageThreadTokens: 1.00 - BytesAssigned: 234.01 MB (245373534) - CompletionTime: 3s861ms - ExchangeScanRatio: 0.00 - ExecutionRate: 60.93 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.00 MB (51377776) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s803ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 3s661ms - TotalThreadsSysTime: 227.037ms - TotalThreadsUserTime: 1s621ms - TotalThreadsVoluntaryContextSwitches: 30 (30) - TotalTime: 3s661ms Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s661ms - ExecTreeOpenTime: 3s631ms - PrepareTime: 666.663us - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2) [6 instances]: - NetworkThroughput: (Avg: 1.21 MB/sec ; Min: 1.01 MB/sec ; Max: 1.51 MB/sec ; Number of samples: 6) - RpcNetworkTime: (Avg: 83.682us ; Min: 48.716us ; Max: 142.771us ; Number of samples: 12) - RpcRecvrTime: (Avg: 37.763us ; Min: 13.146us ; Max: 73.345us ; Number of samples: 12) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1274) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 139.00 B (139) - TotalTime: 0.000ns - UncompressedRowBatchSize: 224.00 B (224) AGGREGATION_NODE (id=1) [6 instances]:(Total: 3s631ms, non-child: 319.998ms, % non-child: 8.81%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s631ms NonGroupingAggregator 0 [6 instances]: - BuildTime: 291.331ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 3s311ms, non-child: 3s311ms, % non-child: 100.00%) - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - InitialRangeIdealReservation: (Avg: 14.70 MB (15418497) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 71) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - BytesRead: 234.06 MB (245428147) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 109.68 MB (115008473) - DataCacheHitCount: 17 (17) - DataCacheMissBytes: 124.38 MB (130419674) - DataCacheMissCount: 17 (17) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 562.663ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 940.661ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 94.17 MB/sec - RemoteScanRanges: 28 (28) - RowsRead: 1.91M (1907845) - RowsReturned: 1.91M (1907845) - RowsReturnedRate: 579.42 K/sec - ScanRangesComplete: 11 (11) - ScannerIoWaitTime: 1s803ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s587ms - TotalReadThroughput: 57.39 MB/sec - TotalTime: 3s311ms Buffer pool [6 instances]: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 140.72 MB (147554304) - CumulativeAllocations: 23 (23) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000002 (host=192.168.124.5:27000):(Total: 4s111ms, non-child: 27.999ms, % non-child: 0.68%) Last report received time: 2023-03-01 01:30:43.951 Hdfs split stats (:<# splits>/): -1:12/125.11 MB Fragment Instance Lifecycle Event Timeline: 4s115ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 4s115ms (4s111ms) - First Batch Produced: 4s115ms (0.000ns) - First Batch Sent: 4s115ms (0.000ns) - ExecInternal Finished: 4s115ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.18 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 125.11 MB (131192002) - CompletionTime: 4s115ms - ExchangeScanRatio: 0.00 - ExecutionRate: 30.40 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s167ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 4s111ms - TotalThreadsSysTime: 211.098ms - TotalThreadsUserTime: 1s700ms - TotalThreadsVoluntaryContextSwitches: 36 (36) - TotalTime: 4s111ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s111ms - ExecTreeOpenTime: 4s083ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.08 MB/sec ; Min: 1.08 MB/sec ; Max: 1.08 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 90.858us ; Min: 60.289us ; Max: 121.428us ; Number of samples: 2) - RpcRecvrTime: (Avg: 40.508us ; Min: 25.819us ; Max: 55.197us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s083ms, non-child: 331.998ms, % non-child: 8.13%) Node Lifecycle Event Timeline: 4s115ms - Open Started: 31.999ms (31.999ms) - Open Finished: 4s115ms (4s083ms) - First Batch Requested: 4s115ms (0.000ns) - First Batch Returned: 4s115ms (0.000ns) - Last Batch Returned: 4s115ms (0.000ns) - Closed: 4s115ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s083ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 311.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s751ms, non-child: 3s751ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:12 ExecOption: Codegen enabled: 12 out of 12, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s115ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 283.998ms (251.998ms) - Last Batch Returned: 4s115ms (3s831ms) - Closed: 4s115ms (0.000ns) - BytesReadSeries (500.000ms): 0, 56.00 MB, 72.00 MB, 120.00 MB, 140.00 MB, 163.87 MB, 187.65 MB, 227.24 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - InitialRangeIdealReservation: (Avg: 15.33 MB (16078165) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 12) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.75 - BytesRead: 249.80 MB (261935328) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 84.00 MB (88080384) - DataCacheHitCount: 13 (13) - DataCacheMissBytes: 165.80 MB (173854944) - DataCacheMissCount: 24 (24) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 631.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 947.994ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 81.32 MB/sec - RemoteScanRanges: 38 (38) - RowsRead: 2.03M (2034096) - RowsReturned: 2.03M (2034096) - RowsReturnedRate: 542.14 K/sec - ScanRangesComplete: 12 (12) - ScannerIoWaitTime: 2s167ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s071ms - TotalReadThroughput: 56.81 MB/sec - TotalTime: 3s751ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 148.06 MB (155254784) - CumulativeAllocations: 24 (24) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000001 (host=192.168.124.5:27000):(Total: 4s067ms, non-child: 31.999ms, % non-child: 0.79%) Last report received time: 2023-03-01 01:30:43.951 Hdfs split stats (:<# splits>/): -1:13/364.24 MB Fragment Instance Lifecycle Event Timeline: 4s067ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 4s067ms (4s063ms) - First Batch Produced: 4s067ms (0.000ns) - First Batch Sent: 4s067ms (0.000ns) - ExecInternal Finished: 4s067ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 364.24 MB (381935884) - CompletionTime: 4s115ms - ExchangeScanRatio: 0.00 - ExecutionRate: 88.49 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s171ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 4s063ms - TotalThreadsSysTime: 192.142ms - TotalThreadsUserTime: 1s705ms - TotalThreadsVoluntaryContextSwitches: 37 (37) - TotalTime: 4s067ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 4s063ms - ExecTreeOpenTime: 4s035ms - PrepareTime: 3.999ms - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.04 MB/sec ; Min: 1.04 MB/sec ; Max: 1.04 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 90.714us ; Min: 54.367us ; Max: 127.061us ; Number of samples: 2) - RpcRecvrTime: (Avg: 44.961us ; Min: 16.577us ; Max: 73.345us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 4s035ms, non-child: 327.998ms, % non-child: 8.13%) Node Lifecycle Event Timeline: 4s067ms - Open Started: 31.999ms (31.999ms) - Open Finished: 4s067ms (4s035ms) - First Batch Requested: 4s067ms (0.000ns) - First Batch Returned: 4s067ms (0.000ns) - Last Batch Returned: 4s067ms (0.000ns) - Closed: 4s067ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 4s035ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 307.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s707ms, non-child: 3s707ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:13 ExecOption: Codegen enabled: 13 out of 13, TEXT Codegen Enabled Node Lifecycle Event Timeline: 4s067ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 255.998ms (223.998ms) - Last Batch Returned: 4s067ms (3s811ms) - Closed: 4s067ms (0.000ns) - BytesReadSeries (500.000ms): 0, 24.00 MB, 48.00 MB, 80.00 MB, 128.00 MB, 151.93 MB, 187.58 MB, 215.30 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - InitialRangeIdealReservation: (Avg: 13.23 MB (13873467) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.75 - BytesRead: 239.68 MB (251323630) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 70.89 MB (74333974) - DataCacheHitCount: 13 (13) - DataCacheMissBytes: 168.79 MB (176989656) - DataCacheMissCount: 24 (24) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 555.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 975.994ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 76.33 MB/sec - RemoteScanRanges: 33 (33) - RowsRead: 1.95M (1951418) - RowsReturned: 1.95M (1951418) - RowsReturnedRate: 526.27 K/sec - ScanRangesComplete: 13 (13) - ScannerIoWaitTime: 2s171ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 3s139ms - TotalReadThroughput: 53.82 MB/sec - TotalTime: 3s707ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 140.06 MB (146866176) - CumulativeAllocations: 24 (24) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000005 (host=192.168.124.4:27000):(Total: 3s619ms, non-child: 31.999ms, % non-child: 0.88%) Last report received time: 2023-03-01 01:30:44.002 Hdfs split stats (:<# splits>/): -1:12/258.78 MB Fragment Instance Lifecycle Event Timeline: 3s619ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 3s619ms (3s619ms) - First Batch Produced: 3s619ms (0.000ns) - First Batch Sent: 3s619ms (0.000ns) - ExecInternal Finished: 3s619ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.18 MB, 24.18 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 258.78 MB (271355619) - CompletionTime: 4s167ms - ExchangeScanRatio: 0.00 - ExecutionRate: 62.09 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.03 MB (51410544) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s575ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 3s619ms - TotalThreadsSysTime: 231.750ms - TotalThreadsUserTime: 1s810ms - TotalThreadsVoluntaryContextSwitches: 28 (28) - TotalTime: 3s619ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s619ms - ExecTreeOpenTime: 3s587ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.51 MB/sec ; Min: 1.51 MB/sec ; Max: 1.51 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 69.133us ; Min: 53.409us ; Max: 84.857us ; Number of samples: 2) - RpcRecvrTime: (Avg: 25.255us ; Min: 13.212us ; Max: 37.299us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 134.00 B (134) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 3s587ms, non-child: 351.998ms, % non-child: 9.81%) Node Lifecycle Event Timeline: 3s619ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s619ms (3s587ms) - First Batch Requested: 3s619ms (0.000ns) - First Batch Returned: 3s619ms (0.000ns) - Last Batch Returned: 3s619ms (0.000ns) - Closed: 3s619ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s587ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 327.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s235ms, non-child: 3s235ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:13 ExecOption: Codegen enabled: 13 out of 13, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s619ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 279.998ms (247.998ms) - Last Batch Returned: 3s619ms (3s339ms) - Closed: 3s619ms (0.000ns) - BytesReadSeries (500.000ms): 0, 40.00 MB, 80.00 MB, 128.00 MB, 175.77 MB, 203.58 MB, 223.33 MB, 257.25 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - InitialRangeIdealReservation: (Avg: 14.77 MB (15486660) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 13) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.50 - BytesRead: 257.25 MB (269748597) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 14 (14) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 157.82 MB (165486428) - DataCacheHitCount: 24 (24) - DataCacheMissBytes: 99.43 MB (104262169) - DataCacheMissCount: 14 (14) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 595.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s051ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 111.85 MB/sec - RemoteScanRanges: 24 (24) - RowsRead: 2.10M (2104898) - RowsReturned: 2.10M (2104898) - RowsReturnedRate: 650.47 K/sec - ScanRangesComplete: 13 (13) - ScannerIoWaitTime: 1s575ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s299ms - TotalReadThroughput: 64.31 MB/sec - TotalTime: 3s235ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 156.06 MB (163643392) - CumulativeAllocations: 25 (25) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000006 (host=192.168.124.4:27000):(Total: 3s607ms, non-child: 31.999ms, % non-child: 0.89%) Last report received time: 2023-03-01 01:30:44.002 Hdfs split stats (:<# splits>/): -1:11/224.26 MB Fragment Instance Lifecycle Event Timeline: 3s607ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 3s607ms (3s607ms) - First Batch Produced: 3s607ms (0.000ns) - First Batch Sent: 3s607ms (0.000ns) - ExecInternal Finished: 3s607ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 224.26 MB (235149993) - CompletionTime: 4s167ms - ExchangeScanRatio: 0.00 - ExecutionRate: 53.80 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 49.03 MB (51410544) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s819ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 3s607ms - TotalThreadsSysTime: 231.226ms - TotalThreadsUserTime: 1s549ms - TotalThreadsVoluntaryContextSwitches: 30 (30) - TotalTime: 3s607ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s607ms - ExecTreeOpenTime: 3s575ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.14 MB/sec ; Min: 1.14 MB/sec ; Max: 1.14 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 83.173us ; Min: 51.139us ; Max: 115.208us ; Number of samples: 2) - RpcRecvrTime: (Avg: 43.591us ; Min: 16.552us ; Max: 70.631us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 3s575ms, non-child: 307.998ms, % non-child: 8.61%) Node Lifecycle Event Timeline: 3s607ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s607ms (3s575ms) - First Batch Requested: 3s607ms (0.000ns) - First Batch Returned: 3s607ms (0.000ns) - Last Batch Returned: 3s607ms (0.000ns) - Closed: 3s607ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s575ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 279.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 3s267ms, non-child: 3s267ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:10 ExecOption: Codegen enabled: 10 out of 10, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s607ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 283.998ms (251.998ms) - Last Batch Returned: 3s607ms (3s323ms) - Closed: 3s607ms (0.000ns) - BytesReadSeries (500.000ms): 0, 32.00 MB, 48.00 MB, 88.00 MB, 120.00 MB, 163.72 MB, 187.48 MB, 225.91 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 10) - InitialRangeIdealReservation: (Avg: 15.20 MB (15938355) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 10) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.75 - BytesRead: 225.91 MB (236888087) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 95.60 MB (100241510) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 130.32 MB (136646577) - DataCacheMissCount: 18 (18) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 559.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 879.995ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 83.30 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 1.84M (1839465) - RowsReturned: 1.84M (1839465) - RowsReturnedRate: 562.87 K/sec - ScanRangesComplete: 10 (10) - ScannerIoWaitTime: 1s819ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s711ms - TotalReadThroughput: 56.48 MB/sec - TotalTime: 3s267ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 124.06 MB (130088960) - CumulativeAllocations: 20 (20) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000003 (host=192.168.124.6:27000):(Total: 3s287ms, non-child: 27.999ms, % non-child: 0.85%) Last report received time: 2023-03-01 01:30:43.135 Hdfs split stats (:<# splits>/): -1:12/115.80 MB Fragment Instance Lifecycle Event Timeline: 3s291ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 3s291ms (3s287ms) - First Batch Produced: 3s291ms (0.000ns) - First Batch Sent: 3s291ms (0.000ns) - ExecInternal Finished: 3s291ms (0.000ns) - MemoryUsage (500.000ms): 24.18 MB, 24.18 MB, 24.18 MB, 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 115.80 MB (121429243) - CompletionTime: 3s299ms - ExchangeScanRatio: 0.00 - ExecutionRate: 35.09 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s275ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 3s287ms - TotalThreadsSysTime: 276.874ms - TotalThreadsUserTime: 1s745ms - TotalThreadsVoluntaryContextSwitches: 26 (26) - TotalTime: 3s287ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s287ms - ExecTreeOpenTime: 3s259ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.51 MB/sec ; Min: 1.51 MB/sec ; Max: 1.51 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 68.054us ; Min: 48.716us ; Max: 87.392us ; Number of samples: 2) - RpcRecvrTime: (Avg: 27.004us ; Min: 13.146us ; Max: 40.863us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.24 KB (1270) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 138.00 B (138) - TotalTime: 0.000ns - UncompressedRowBatchSize: 222.00 B (222) AGGREGATION_NODE (id=1):(Total: 3s259ms, non-child: 351.998ms, % non-child: 10.80%) Node Lifecycle Event Timeline: 3s291ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s291ms (3s259ms) - First Batch Requested: 3s291ms (0.000ns) - First Batch Returned: 3s291ms (0.000ns) - Last Batch Returned: 3s291ms (0.000ns) - Closed: 3s291ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s259ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 303.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 2s907ms, non-child: 2s907ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:28.57% 1:71.43% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:14 ExecOption: Codegen enabled: 14 out of 14, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s291ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 35.999ms (3.999ms) - Last Batch Returned: 3s291ms (3s255ms) - Closed: 3s291ms (0.000ns) - BytesReadSeries (500.000ms): 8.00 MB, 32.00 MB, 80.00 MB, 128.00 MB, 175.68 MB, 203.44 MB, 239.03 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 14) - InitialRangeIdealReservation: (Avg: 14.29 MB (14979657) ; Min: 4.00 MB (4194304) ; Max: 24.00 MB (25165824) ; Number of samples: 14) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.71 - BytesRead: 260.34 MB (272983255) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 181.79 MB (190618625) - DataCacheHitCount: 28 (28) - DataCacheMissBytes: 78.55 MB (82364630) - DataCacheMissCount: 12 (12) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 619.996ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1s011ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 143.36 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 2.12M (2120475) - RowsReturned: 2.12M (2120475) - RowsReturnedRate: 729.19 K/sec - ScanRangesComplete: 14 (14) - ScannerIoWaitTime: 1s275ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 1s815ms - TotalReadThroughput: 68.29 MB/sec - TotalTime: 2s907ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 160.06 MB (167837696) - CumulativeAllocations: 27 (27) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9d4e0925e0f961b0:2d21694d00000004 (host=192.168.124.6:27000):(Total: 3s275ms, non-child: 27.999ms, % non-child: 0.85%) Last report received time: 2023-03-01 01:30:43.135 Hdfs split stats (:<# splits>/): -1:11/315.84 MB Fragment Instance Lifecycle Event Timeline: 3s279ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 3s279ms (3s275ms) - First Batch Produced: 3s279ms (0.000ns) - First Batch Sent: 3s279ms (0.000ns) - ExecInternal Finished: 3s279ms (0.000ns) - MemoryUsage (500.000ms): 24.49 MB, 24.49 MB, 24.18 MB, 24.49 MB, 24.49 MB, 24.49 MB, 24.49 MB - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BytesAssigned: 315.84 MB (331178466) - CompletionTime: 3s299ms - ExchangeScanRatio: 0.00 - ExecutionRate: 95.71 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 24.49 MB (25680696) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 48.98 MB (51361392) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1s807ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 3s275ms - TotalThreadsSysTime: 219.134ms - TotalThreadsUserTime: 1s215ms - TotalThreadsVoluntaryContextSwitches: 24 (24) - TotalTime: 3s275ms Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - InactiveTotalTime: 0.000ns - OpenTime: 3s275ms - ExecTreeOpenTime: 3s247ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=2): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 1.01 MB/sec ; Min: 1.01 MB/sec ; Max: 1.01 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 100.164us ; Min: 57.557us ; Max: 142.771us ; Number of samples: 2) - RpcRecvrTime: (Avg: 45.262us ; Min: 18.631us ; Max: 71.894us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.26 KB (1294) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 151.00 B (151) - TotalTime: 0.000ns - UncompressedRowBatchSize: 234.00 B (234) AGGREGATION_NODE (id=1):(Total: 3s247ms, non-child: 247.998ms, % non-child: 7.64%) Node Lifecycle Event Timeline: 3s279ms - Open Started: 31.999ms (31.999ms) - Open Finished: 3s279ms (3s247ms) - First Batch Requested: 3s279ms (0.000ns) - First Batch Returned: 3s279ms (0.000ns) - Last Batch Returned: 3s279ms (0.000ns) - Closed: 3s279ms (0.000ns) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 490.00 KB (501760) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - TotalTime: 3s247ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 215.998ms - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 2s999ms, non-child: 2s999ms, % non-child: 100.00%) Table Name: test_mt_dop_skew_lpt_95cba3d6.lineitem_skew Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:85.71% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: TEXT/NONE:9 ExecOption: Codegen enabled: 9 out of 9, TEXT Codegen Enabled Node Lifecycle Event Timeline: 3s279ms - Open Started: 31.999ms (31.999ms) - Open Finished: 31.999ms (0.000ns) - First Batch Requested: 31.999ms (0.000ns) - First Batch Returned: 35.999ms (3.999ms) - Last Batch Returned: 3s279ms (3s243ms) - Closed: 3s279ms (0.000ns) - BytesReadSeries (500.000ms): 8.00 MB, 24.00 MB, 64.00 MB, 84.82 MB, 116.56 MB, 132.44 MB, 156.16 MB - InitialRangeActualReservation: (Avg: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 9) - InitialRangeIdealReservation: (Avg: 16.00 MB (16777216) ; Min: 8.00 MB (8388608) ; Max: 24.00 MB (25165824) ; Number of samples: 9) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.86 - BytesRead: 171.37 MB (179689990) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 67.99 MB (71289920) - DataCacheHitCount: 11 (11) - DataCacheMissBytes: 103.38 MB (108400070) - DataCacheMissCount: 15 (15) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - DelimiterParseTime: 411.997ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 775.995ms - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - PeakMemoryUsage: 24.00 MB (25169920) - PerReadThreadRawHdfsThroughput: 68.88 MB/sec - RemoteScanRanges: 21 (21) - RowsRead: 1.40M (1396723) - RowsReturned: 1.40M (1396723) - RowsReturnedRate: 465.58 K/sec - ScanRangesComplete: 9 (9) - ScannerIoWaitTime: 1s807ms - TotalRawHdfsOpenFileTime: 0.000ns - TotalRawHdfsReadTime: 2s487ms - TotalReadThroughput: 44.62 MB/sec - TotalTime: 2s999ms Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 116.00 MB (121634816) - CumulativeAllocations: 18 (18) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 MB (25165824) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Standard Error SET client_identifier=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre; -- connecting to: localhost:21000 -- connecting to localhost:21050 with impyla -- 2023-03-01 01:30:11,814 INFO MainThread: Closing active operation -- connecting to localhost:28000 with impyla -- 2023-03-01 01:30:11,829 INFO MainThread: Closing active operation SET client_identifier=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre; SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_mt_dop_skew_lpt_95cba3d6` CASCADE; -- 2023-03-01 01:30:11,840 INFO MainThread: Started query ff421f6f1949ecc9:01f20b8f00000000 SET client_identifier=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_mt_dop_skew_lpt_95cba3d6`; -- 2023-03-01 01:30:11,897 INFO MainThread: Started query 77427b3a03b39e1b:60c39c7c00000000 -- 2023-03-01 01:30:11,948 INFO MainThread: Created database "test_mt_dop_skew_lpt_95cba3d6" for test ID "query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]" SET client_identifier=query_test/test_scanners.py::TestHdfsScannerSkew::()::test_mt_dop_skew_lpt[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thre; -- connecting to: localhost:21000 SET mt_dop=2; -- executing against localhost:21000 create table test_mt_dop_skew_lpt_95cba3d6.lineitem_skew like tpch.lineitem; -- 2023-03-01 01:30:11,960 INFO MainThread: Started query 80475132ccdadc36:90bc6ff500000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:12,033 INFO MainThread: Started query 3044c7ebe20ac8e1:b782f82800000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:12,998 INFO MainThread: Started query 6f43080827839933:d4b69aed00000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:13,811 INFO MainThread: Started query 6a408613c37ee912:5395414300000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:14,675 INFO MainThread: Started query bf43b44632736f1f:b3f028f300000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:15,490 INFO MainThread: Started query 934e702aaef472a7:76d1371200000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:16,303 INFO MainThread: Started query c445648d543c3827:6634a79b00000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:17,117 INFO MainThread: Started query 6c48c8428fd918b6:6b2365c200000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:17,931 INFO MainThread: Started query 6443948bb8d08a05:07730c1600000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:18,745 INFO MainThread: Started query a64733b3fa3d96aa:60cd1f4900000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem where l_orderkey % 11 = 0; -- 2023-03-01 01:30:19,560 INFO MainThread: Started query d940f5dcb3f17897:004d4f1600000000 -- executing against localhost:21000 insert into test_mt_dop_skew_lpt_95cba3d6.lineitem_skew select * from tpch.lineitem; -- 2023-03-01 01:30:20,373 INFO MainThread: Started query e9418aeb1cf5820d:c6ea01b500000000 -- executing against localhost:21000 select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew; -- 2023-03-01 01:30:24,459 INFO MainThread: Started query a1447298f8dc1342:c956fecc00000000 -- executing against localhost:21000 select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew; -- 2023-03-01 01:30:27,298 INFO MainThread: Started query bd419d19da91e401:14357bf700000000 -- executing against localhost:21000 select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew; -- 2023-03-01 01:30:31,441 INFO MainThread: Started query fd4d07afb3cff4d0:dc3392aa00000000 -- executing against localhost:21000 select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew; -- 2023-03-01 01:30:35,683 INFO MainThread: Started query e64214cb95a1f702:7473fd6200000000 -- executing against localhost:21000 select min(l_orderkey),min(l_partkey),min(l_suppkey),min(l_linenumber), min(l_quantity),min(l_extendedprice),min(l_discount),min(l_tax), min(l_returnflag),min(l_linestatus),min(l_shipdate),min(l_commitdate), min(l_receiptdate),min(l_shipinstruct),min(l_shipmode),min(l_comment) from test_mt_dop_skew_lpt_95cba3d6.lineitem_skew; -- 2023-03-01 01:30:39,826 INFO MainThread: Started query 9d4e0925e0f961b0:2d21694d00000000 -- closing connection to: localhost:21000