Query (id=9342fd18312bc8b0:6249452a00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Summary: Session ID: 5e425b495a98ab3e:c3592833d77c9eae Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2021-04-12 17:55:19.144806000 End Time: 2021-04-12 17:55:24.035886000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build 34a183d3d6632c70c19af939d8034af2b5c42f11) User: quanlong Connected User: quanlong Delegated User: Network Address: ::ffff:127.0.0.1:44554 Default Db: default Sql Statement: select straight_join a.l_orderkey from tpch_ec.lineitem_orderkey_only a join [SHUFFLE] tpch_parquet.orders b where a.l_orderkey = b.o_orderkey and b.o_custkey = 5 order by l_orderkey Coordinator: quanlong-OptiPlex-BJ:27000 Query Options (set by configuration): RUNTIME_FILTER_WAIT_TIME_MS=60000,ALLOW_ERASURE_CODED_FILES=1,TIMEZONE=PRC,CLIENT_IDENTIFIER=impala shell build version not available,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=2 Query Options (set by configuration and planner): RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=0,ALLOW_ERASURE_CODED_FILES=1,TIMEZONE=PRC,CLIENT_IDENTIFIER=impala shell build version not available,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=2 Plan: ---------------- Max Per-Host Resource Reservation: Memory=25.94MB Threads=6 Per-Host Resource Estimates: Memory=199MB WARNING: The following tables are missing relevant table and/or column statistics. tpch_ec.lineitem_orderkey_only Analyzed query: SELECT /* +straight_join */ a.l_orderkey FROM tpch_ec.lineitem_orderkey_only a INNER JOIN /* +SHUFFLE */ tpch_parquet.orders b WHERE a.l_orderkey = b.o_orderkey AND b.o_custkey = CAST(5 AS BIGINT) ORDER BY l_orderkey ASC F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=65.86MB mem-reservation=4.00MB thread-reservation=1 PLAN-ROOT SINK | output exprs: l_orderkey | mem-estimate=45.83MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 | 06:MERGING-EXCHANGE [UNPARTITIONED] | order by: l_orderkey ASC | mem-estimate=20.02MB mem-reservation=0B thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=6.01M | in pipelines: 03(GETNEXT) | F02:PLAN FRAGMENT [HASH(a.l_orderkey)] hosts=2 instances=2 Per-Host Resources: mem-estimate=35.88MB mem-reservation=8.94MB thread-reservation=1 runtime-filters-memory=1.00MB 03:SORT | order by: l_orderkey ASC | mem-estimate=22.92MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=6.01M | in pipelines: 03(GETNEXT), 00(OPEN) | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: a.l_orderkey = b.o_orderkey | fk/pk conjuncts: assumed fk/pk | runtime filters: RF000[bloom] <- b.o_orderkey, RF001[min_max] <- b.o_orderkey | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,1 row-size=24B cardinality=6.01M | in pipelines: 00(GETNEXT), 01(OPEN) | |--05:EXCHANGE [HASH(b.o_orderkey)] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=1 row-size=16B cardinality=15 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 | Per-Host Resources: mem-estimate=80.00MB mem-reservation=8.00MB thread-reservation=2 | 01:SCAN HDFS [tpch_parquet.orders b, RANDOM] | HDFS partitions=1/1 files=2 size=54.21MB | predicates: b.o_custkey = CAST(5 AS BIGINT) | stored statistics: | table: rows=1.50M size=54.21MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=1.18M | parquet statistics predicates: b.o_custkey = CAST(5 AS BIGINT) | parquet dictionary predicates: b.o_custkey = CAST(5 AS BIGINT) | mem-estimate=80.00MB mem-reservation=8.00MB thread-reservation=1 | tuple-ids=1 row-size=16B cardinality=15 | in pipelines: 01(GETNEXT) | 04:EXCHANGE [HASH(a.l_orderkey)] | mem-estimate=10.02MB mem-reservation=0B thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=6.01M | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 Per-Host Resources: mem-estimate=17.00MB mem-reservation=5.00MB thread-reservation=2 runtime-filters-memory=1.00MB 00:SCAN HDFS [tpch_ec.lineitem_orderkey_only a, RANDOM] HDFS partitions=1/1 files=2 size=9.22MB erasure coded: files=2 size=9.22MB runtime filters: RF001[min_max] -> a.l_orderkey, RF000[bloom] -> a.l_orderkey stored statistics: table: rows=unavailable size=unavailable columns: unavailable extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=1 tuple-ids=0 row-size=8B cardinality=6.01M in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 208386120 Tables Missing Stats: tpch_ec.lineitem_orderkey_only Request Pool: default-pool Per Host Min Memory Reservation: quanlong-OptiPlex-BJ:27001(21.94 MB) quanlong-OptiPlex-BJ:27000(25.94 MB) Per Host Number of Fragment Instances: quanlong-OptiPlex-BJ:27001(3) quanlong-OptiPlex-BJ:27000(4) Admission result: Admitted immediately Cluster Memory Admitted: 397.46 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------------------- F03:ROOT 1 1 123.491us 123.491us 4.01 MB 45.83 MB 06:MERGING-EXCHANGE 1 1 79.152us 79.152us 19 6.01M 32.00 KB 20.02 MB UNPARTITIONED F02:EXCHANGE SENDER 2 2 82.063us 88.114us 14.22 KB 0 03:SORT 2 2 0.000ns 0.000ns 19 6.01M 6.02 MB 22.92 MB 02:HASH JOIN 2 2 807.874us 913.504us 19 6.01M 1.99 MB 1.94 MB INNER JOIN, PARTITIONED |--05:EXCHANGE 2 2 22.356us 24.523us 4 15 16.00 KB 16.00 KB HASH(b.o_orderkey) | F01:EXCHANGE SENDER 2 2 136.554us 180.059us 23.05 KB 0 | 01:SCAN HDFS 2 2 41.824ms 60.895ms 4 15 8.94 MB 80.00 MB tpch_parquet.orders b 04:EXCHANGE 2 2 31.844us 36.240us 19 6.01M 16.00 KB 10.02 MB HASH(a.l_orderkey) F00:EXCHANGE SENDER 2 2 121.485us 160.497us 36.44 KB 0 00:SCAN HDFS 2 2 251.041ms 314.902ms 19 6.01M 8.62 MB 16.00 MB tpch_ec.lineitem_orderkey_only a Errors: Query Compilation: 4s372ms - Metadata load started: 11.916ms (11.916ms) - Metadata load finished. loaded-tables=1/2 load-requests=1 catalog-updates=5 storage-load-time=12ms: 4s308ms (4s296ms) - Analysis finished: 4s317ms (8.275ms) - Authorization finished (noop): 4s317ms (181.451us) - Value transfer graph computed: 4s319ms (1.867ms) - Single node plan created: 4s353ms (34.021ms) - Runtime filters computed: 4s357ms (4.312ms) - Distributed plan created: 4s357ms (312.639us) - Planning finished: 4s372ms (14.494ms) Query Timeline: 4s894ms - Query submitted: 168.591us (168.591us) - Planning finished: 4s376ms (4s376ms) - Submit for admission: 4s376ms (186.818us) - Completed admission: 4s377ms (396.097us) - Ready to start on 2 backends: 4s377ms (425.196us) - All 2 execution backends (7 fragment instances) started: 4s379ms (1.683ms) - First dynamic filter received: 4s637ms (258.294ms) - First dynamic filter received: 4s637ms (55.000ns) - Rows available: 4s802ms (164.392ms) - First row fetched: 4s879ms (77.650ms) - Last row fetched: 4s879ms (33.022us) - Released admission control resources: 4s891ms (11.291ms) - Unregister query: 4s894ms (3.426ms) - AdmissionControlTimeSinceLastUpdate: 63.000ms - ComputeScanRangeAssignmentTimer: 149.021us - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Frontend: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns ImpalaServer: - ClientFetchWaitTimer: 80.272ms - InactiveTotalTime: 0.000ns - NumRowsFetched: 19 (19) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 1.57 K/sec - RowMaterializationTimer: 12.083ms - TotalTime: 0.000ns Execution Profile 9342fd18312bc8b0:6249452a00000000: Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value --------------------------------------------------------------------------------------------------------------------------------------------------------------- 1 2 0 REMOTE false 2 (2) N/A N/A true MIN_MAX 0 2 0 REMOTE false 2 (2) N/A N/A true 1.00 MB 1.75e-39 Backend startup latencies: Count: 2, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Slowest backend to start up: quanlong-OptiPlex-BJ:27000 Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value --------------------------------------------------------------------------------------------------------------------------------------------------------------- 1 2 0 REMOTE false 0 (2) 4s637ms 4s640ms true MIN_MAX 0 2 0 REMOTE false 0 (2) 4s637ms 4s640ms true 1.00 MB 1.75e-39 Per Node Peak Memory Usage: quanlong-OptiPlex-BJ:27000(29.40 MB) quanlong-OptiPlex-BJ:27001(25.73 MB) Per Node Bytes Read: quanlong-OptiPlex-BJ:27000(1.09 MB) quanlong-OptiPlex-BJ:27001(8.22 MB) Per Node User Time: quanlong-OptiPlex-BJ:27000(442.936ms) quanlong-OptiPlex-BJ:27001(582.665ms) Per Node System Time: quanlong-OptiPlex-BJ:27000(4.334ms) quanlong-OptiPlex-BJ:27001(12.363ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 4 (4) - FinalizationTimer: 0.000ns - InactiveTotalTime: 0.000ns - InnerNodeSelectivityRatio: 0.65 - NumBackends: 2 (2) - NumCompletedBackends: 2 (2) - NumFragmentInstances: 7 (7) - NumFragments: 4 (4) - TotalBytesRead: 9.31 MB (9760191) - TotalBytesSent: 320.00 B (320) - TotalCpuTime: 1s042ms - TotalInnerBytesSent: 126.00 B (126) - TotalScanBytesSent: 194.00 B (194) - TotalTime: 436.768ms Per Node Profiles: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns quanlong-OptiPlex-BJ:27000: Filter 1 arrival: 262ms Filter 0 arrival: 263ms - AdmissionSlots: 1 (1) - BloomFilterBytes: 2.00 MB (2097152) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 8.483us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - SystemAllocTime: 4.510us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F03: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 25.295ms - CodegenSysTime: 3.985ms - CodegenUserTime: 19.929ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 2.034ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 908.237us - LoadTime: 0.000ns - MainThreadCodegenTime: 11.230ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 19 (19) - NumInstructions: 704 (704) - OptimizationTime: 7.447ms - PeakMemoryUsage: 352.00 KB (360448) - PrepareTime: 14.074ms - TotalTime: 25.304ms Fragment F02: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 255.904ms - CodegenSysTime: 0.000ns - CodegenUserTime: 255.813ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 19.998ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 13.307ms - LoadTime: 0.000ns - MainThreadCodegenTime: 241.061ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 97 (97) - NumInstructions: 4.90K (4899) - OptimizationTime: 206.541ms - PeakMemoryUsage: 2.39 MB (2508288) - PrepareTime: 14.852ms - TotalTime: 255.912ms Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 78.240ms - CodegenSysTime: 0.000ns - CodegenUserTime: 75.961ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.644ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 1.744ms - LoadTime: 0.000ns - MainThreadCodegenTime: 63.761ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 32 (32) - NumInstructions: 697 (697) - OptimizationTime: 56.423ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 14.487ms - TotalTime: 78.247ms Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 78.730ms - CodegenSysTime: 0.000ns - CodegenUserTime: 75.999ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.947ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 2.917ms - LoadTime: 0.000ns - MainThreadCodegenTime: 56.492ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 35 (35) - NumInstructions: 711 (711) - OptimizationTime: 47.254ms - PeakMemoryUsage: 355.50 KB (364032) - PrepareTime: 22.247ms - TotalTime: 78.739ms quanlong-OptiPlex-BJ:27001: Filter 1 arrival: 262ms Filter 0 arrival: 263ms - AdmissionSlots: 1 (1) - BloomFilterBytes: 2.00 MB (2097152) - InactiveTotalTime: 0.000ns - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - TotalTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 7.449us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - SystemAllocTime: 3.740us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Fragment F02: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 258.805ms - CodegenSysTime: 4.207ms - CodegenUserTime: 251.339ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 19.787ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 12.748ms - LoadTime: 0.000ns - MainThreadCodegenTime: 244.907ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 97 (97) - NumInstructions: 4.90K (4899) - OptimizationTime: 211.080ms - PeakMemoryUsage: 2.39 MB (2508288) - PrepareTime: 13.908ms - TotalTime: 258.813ms Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 106.254ms - CodegenSysTime: 0.000ns - CodegenUserTime: 103.540ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.521ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 2.393ms - LoadTime: 0.000ns - MainThreadCodegenTime: 84.376ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 32 (32) - NumInstructions: 697 (697) - OptimizationTime: 76.128ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 21.889ms - TotalTime: 106.263ms Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns CodeGen: - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 53.852ms - CodegenSysTime: 3.939ms - CodegenUserTime: 47.268ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 3.458ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 2.186ms - LoadTime: 0.000ns - MainThreadCodegenTime: 39.990ms - ModuleBitcodeSize: 3.23 MB (3387284) - NumFunctions: 35 (35) - NumInstructions: 711 (711) - OptimizationTime: 33.383ms - PeakMemoryUsage: 355.50 KB (364032) - PrepareTime: 13.870ms - TotalTime: 53.860ms Averaged Fragment F03:(Total: 500.416ms, non-child: 25.631ms, % non-child: 5.12%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:506.479ms max:506.479ms mean: 506.479ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 506.479ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 4.05 MB (4243456) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.40 MB (30828203) - RowsProduced: 19 (19) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 500.206ms - TotalThreadsSysTime: 4.334ms - TotalThreadsUserTime: 21.672ms - TotalThreadsVoluntaryContextSwitches: 3 (3) - TotalTime: 500.416ms Fragment Instance Lifecycle Timings: - ExecTime: 77.700ms - ExecTreeExecTime: 161.886us - InactiveTotalTime: 0.000ns - OpenTime: 422.514ms - ExecTreeOpenTime: 397.032ms - PrepareTime: 161.484us - ExecTreePrepareTime: 96.945us - TotalTime: 0.000ns PLAN_ROOT_SINK:(Total: 77.591ms, non-child: 123.491us, % non-child: 0.16%) - InactiveTotalTime: 77.468ms - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 19 (19) - RowsSentRate: 244.00 /sec - TotalTime: 77.591ms Buffer pool: - AllocTime: 1.250us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6):(Total: 397.193ms, non-child: 79.152us, % non-child: 0.02%) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 397.113ms - MergeGetNext: 153.366us - MergeGetNextBatch: 144.853us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 19 (19) - RowsReturnedRate: 47.00 /sec - TotalTime: 397.193ms Buffer pool: - AllocTime: 4.098us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 396.976ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 323.00 B (323) - TotalGetBatchTime: 397.127ms - DataWaitTime: 397.113ms - TotalTime: 0.000ns Enqueue: - DispatchTime: (Avg: 47.635us ; Min: 31.810us ; Max: 63.460us ; Number of samples: 2) - DeserializeRowBatchTime: 25.626us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 126.00 B (126) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Coordinator Fragment F03: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000000 (host=quanlong-OptiPlex-BJ:27000): Last report received time: 2021-04-12 17:55:24.030 Fragment Instance Lifecycle Event Timeline: 500.795ms - Prepare Finished: 448.447us (448.447us) - Open Finished: 422.972ms (422.524ms) - First Batch Produced: 423.136ms (164.247us) - First Batch Sent: 423.157ms (20.122us) - ExecInternal Finished: 500.795ms (77.638ms) - MemoryUsage (500.000ms): 8.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 506.479ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 4.05 MB (4243456) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.40 MB (30828203) - RowsProduced: 19 (19) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 500.206ms - TotalThreadsSysTime: 4.334ms - TotalThreadsUserTime: 21.672ms - TotalThreadsVoluntaryContextSwitches: 3 (3) - TotalTime: 500.416ms Fragment Instance Lifecycle Timings: - ExecTime: 77.700ms - ExecTreeExecTime: 161.886us - InactiveTotalTime: 0.000ns - OpenTime: 422.514ms - ExecTreeOpenTime: 397.032ms - PrepareTime: 161.484us - ExecTreePrepareTime: 96.945us - TotalTime: 0.000ns PLAN_ROOT_SINK: - InactiveTotalTime: 77.468ms - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 19 (19) - RowsSentRate: 244.00 /sec - TotalTime: 77.591ms Buffer pool: - AllocTime: 1.250us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6): ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 423.188ms - Open Started: 25.844ms (25.844ms) - Open Finished: 422.873ms (397.029ms) - First Batch Requested: 422.975ms (101.360us) - First Batch Returned: 423.135ms (159.991us) - Last Batch Returned: 423.135ms (475.000ns) - Closed: 423.188ms (53.084us) - ConvertRowBatchTime: 0.000ns - InactiveTotalTime: 397.113ms - MergeGetNext: 153.366us - MergeGetNextBatch: 144.853us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 19 (19) - RowsReturnedRate: 47.00 /sec - TotalTime: 397.193ms Buffer pool: - AllocTime: 4.098us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 396.976ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 323.00 B (323) - TotalGetBatchTime: 397.127ms - DataWaitTime: 397.113ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 47.635us ; Min: 31.810us ; Max: 63.460us ; Number of samples: 2) - DeserializeRowBatchTime: 25.626us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 126.00 B (126) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F02 [2 instances]:(Total: 422.691ms, non-child: 257.222ms, % non-child: 60.85%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:425.412ms max:506.994ms mean: 466.203ms stddev:40.791ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 2 - AverageThreadTokens: 1.00 - BytesAssigned: 0 - CompletionTime: 466.203ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.02 MB (8413664) - PeakReservation: 7.94 MB (8323072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 27.56 MB (28903219) - RowsProduced: 9 (9) - TotalNetworkReceiveTime: 163.796ms - TotalNetworkSendTime: 376.707us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 423.402ms - TotalThreadsSysTime: 2.103ms - TotalThreadsUserTime: 256.498ms - TotalThreadsVoluntaryContextSwitches: 5 (5) - TotalTime: 422.691ms Fragment Instance Lifecycle Timings [2 instances]: - ExecTime: 469.672us - ExecTreeExecTime: 12.788us - InactiveTotalTime: 0.000ns - OpenTime: 421.681ms - ExecTreeOpenTime: 164.231ms - PrepareTime: 496.017us - ExecTreePrepareTime: 370.105us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=6) [2 instances]:(Total: 458.770us, non-child: 82.063us, % non-child: 17.89%) - NetworkThroughput: (Avg: 364.11 KB/sec ; Min: 197.52 KB/sec ; Max: 530.70 KB/sec ; Number of samples: 2) - RpcNetworkTime: (Avg: 145.086us ; Min: 85.579us ; Max: 171.134us ; Number of samples: 4) - RpcRecvrTime: (Avg: 54.095us ; Min: 27.639us ; Max: 80.536us ; Number of samples: 4) - EosSent: 1 (1) - InactiveTotalTime: 376.707us - PeakMemoryUsage: 14.22 KB (14560) - RowsSent: 9 (9) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 7.297us - TotalBytesSent: 63.00 B (63) - TotalTime: 458.770us - UncompressedRowBatchSize: 161.00 B (161) SORT_NODE (id=3) [2 instances]:(Total: 164.612ms, non-child: 0.000ns, % non-child: 0.00%) - AddBatchTime: (Avg: 4.629us ; Min: 524.000ns ; Max: 8.914us ; Number of samples: 4) - NumRowsPerRun: (Avg: 9 (9) ; Min: 4 (4) ; Max: 15 (15) ; Number of samples: 2) - InMemorySortTime: 1.746us - InactiveTotalTime: 0.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 6.02 MB (6316032) - RowsReturned: 9 (9) - RowsReturnedRate: 57.00 /sec - SortDataSize: 85.00 B (85) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) - TotalTime: 164.612ms Buffer pool [2 instances]: - AllocTime: 13.122us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.707us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2) [2 instances]:(Total: 164.615ms, non-child: 807.874us, % non-child: 0.49%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.99 MB (2083072) - ProbeRows: 9 (9) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.310us - RowsReturned: 9 (9) - RowsReturnedRate: 57.00 /sec - TotalTime: 164.615ms Buffer pool [2 instances]: - AllocTime: 9.255us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 6.985us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2) [2 instances]:(Total: 1.178ms, non-child: 1.178ms, % non-child: 100.00%) - BuildRows: 2 (2) - BuildRowsPartitionTime: 23.962us - HashTablesBuildTime: 39.260us - InactiveTotalTime: 0.000ns - LargestPartitionPercent: 66 (66) - MaxPartitionLevel: 0 (0) - NumHashTableBuildsSkipped: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - TotalTime: 1.178ms Hash Table [2 instances]: - HashBuckets: 2 (2) - HashCollisions: 0 (0) - InactiveTotalTime: 0.000ns - Probes: 11 (11) - Resizes: 0 (0) - TotalTime: 0.000ns - Travel: 0 (0) EXCHANGE_NODE (id=5) [2 instances]:(Total: 22.356us, non-child: 22.356us, % non-child: 100.00%) - ConvertRowBatchTime: 2.607us - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 2 (2) - RowsReturnedRate: 85.93 K/sec - TotalTime: 22.356us Buffer pool [2 instances]: - AllocTime: 6.227us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.361us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue [2 instances]: - FirstBatchWaitTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 50.00 B (50) - TotalGetBatchTime: 7.936us - DataWaitTime: 0.000ns - TotalTime: 0.000ns Enqueue [2 instances]: - DispatchTime: (Avg: 58.205us ; Min: 35.085us ; Max: 81.325us ; Number of samples: 2) - DeserializeRowBatchTime: 25.139us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 34.00 B (34) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns EXCHANGE_NODE (id=4) [2 instances]:(Total: 163.808ms, non-child: 31.845us, % non-child: 0.02%) - ConvertRowBatchTime: 8.013us - InactiveTotalTime: 163.776ms - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 9 (9) - RowsReturnedRate: 57.00 /sec - TotalTime: 163.808ms Buffer pool [2 instances]: - AllocTime: 3.317us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.400us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue [2 instances]: - FirstBatchWaitTime: 163.552ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 161.00 B (161) - TotalGetBatchTime: 163.785ms - DataWaitTime: 163.776ms - TotalTime: 0.000ns Enqueue [2 instances]: - DispatchTime: (Avg: 74.836us ; Min: 65.444us ; Max: 84.228us ; Number of samples: 2) - DeserializeRowBatchTime: 19.178us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 63.00 B (63) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Fragment F02: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000006 (host=quanlong-OptiPlex-BJ:27000): Last report received time: 2021-04-12 17:55:24.030 Fragment Instance Lifecycle Event Timeline: 423.205ms - Prepare Finished: 920.000us (920.000us) - Open Finished: 422.677ms (421.757ms) - First Batch Produced: 422.685ms (7.536us) - First Batch Sent: 422.711ms (25.908us) - ExecInternal Finished: 423.205ms (494.499us) - MemoryUsage (500.000ms): 1.99 MB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 0 - CompletionTime: 506.994ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.02 MB (8413664) - PeakReservation: 7.94 MB (8323072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.40 MB (30828203) - RowsProduced: 15 (15) - TotalNetworkReceiveTime: 165.296ms - TotalNetworkSendTime: 429.693us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 423.521ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 257.189ms - TotalThreadsVoluntaryContextSwitches: 6 (6) - TotalTime: 422.868ms Fragment Instance Lifecycle Timings: - ExecTime: 514.763us - ExecTreeExecTime: 10.950us - InactiveTotalTime: 0.000ns - OpenTime: 421.750ms - ExecTreeOpenTime: 165.737ms - PrepareTime: 555.606us - ExecTreePrepareTime: 423.791us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=6): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 530.70 KB/sec ; Min: 530.70 KB/sec ; Max: 530.70 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 165.805us ; Min: 160.476us ; Max: 171.134us ; Number of samples: 2) - RpcRecvrTime: (Avg: 69.218us ; Min: 57.900us ; Max: 80.536us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 429.693us - PeakMemoryUsage: 14.22 KB (14560) - RowsSent: 15 (15) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 6.811us - TotalBytesSent: 93.00 B (93) - TotalTime: 505.705us - UncompressedRowBatchSize: 255.00 B (255) SORT_NODE (id=3): SortType: Total ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 422.742ms - Open Started: 256.928ms (256.928ms) - Open Finished: 422.663ms (165.735ms) - First Batch Requested: 422.679ms (15.787us) - First Batch Returned: 422.684ms (5.392us) - Last Batch Returned: 422.719ms (34.750us) - Closed: 422.742ms (22.693us) - AddBatchTime: (Avg: 4.540us ; Min: 544.000ns ; Max: 8.536us ; Number of samples: 2) - NumRowsPerRun: (Avg: 15 (15) ; Min: 15 (15) ; Max: 15 (15) ; Number of samples: 1) - InMemorySortTime: 1.094us - InactiveTotalTime: 0.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 6.02 MB (6316032) - RowsReturned: 15 (15) - RowsReturnedRate: 90.00 /sec - SortDataSize: 135.00 B (135) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) - TotalTime: 166.170ms Buffer pool: - AllocTime: 12.841us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.424us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2): ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 422.657ms - Open Started: 256.936ms (256.936ms) - Open Finished: 422.418ms (165.481ms) - First Batch Requested: 422.500ms (82.131us) - First Batch Returned: 422.575ms (75.500us) - Last Batch Returned: 422.595ms (19.246us) - Closed: 422.657ms (62.907us) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.99 MB (2083072) - ProbeRows: 15 (15) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.002us - RowsReturned: 15 (15) - RowsReturnedRate: 90.00 /sec - TotalTime: 166.222ms Buffer pool: - AllocTime: 11.693us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 4 (4) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.921us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRows: 3 (3) - BuildRowsPartitionTime: 32.875us - HashTablesBuildTime: 48.234us - InactiveTotalTime: 0.000ns - LargestPartitionPercent: 33 (33) - MaxPartitionLevel: 0 (0) - NumHashTableBuildsSkipped: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - TotalTime: 1.189ms Hash Table: - HashBuckets: 3 (3) - HashCollisions: 0 (0) - InactiveTotalTime: 0.000ns - Probes: 18 (18) - Resizes: 0 (0) - TotalTime: 0.000ns - Travel: 0 (0) EXCHANGE_NODE (id=5): Node Lifecycle Event Timeline: 258.318ms - Open Started: 257.060ms (257.060ms) - Open Finished: 257.067ms (6.880us) - First Batch Requested: 257.848ms (781.513us) - First Batch Returned: 257.864ms (15.206us) - Last Batch Returned: 257.864ms (264.000ns) - Closed: 258.318ms (454.095us) - ConvertRowBatchTime: 3.088us - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 3 (3) - RowsReturnedRate: 122.33 K/sec - TotalTime: 24.523us Buffer pool: - AllocTime: 4.454us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.744us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 75.00 B (75) - TotalGetBatchTime: 8.538us - DataWaitTime: 0.000ns - TotalTime: 0.000ns Enqueue: - DispatchTime: (Avg: 81.325us ; Min: 81.325us ; Max: 81.325us ; Number of samples: 1) - DeserializeRowBatchTime: 24.991us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 47.00 B (47) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns EXCHANGE_NODE (id=4): Node Lifecycle Event Timeline: 422.647ms - Open Started: 257.091ms (257.091ms) - Open Finished: 422.135ms (165.043ms) - First Batch Requested: 422.151ms (15.798us) - First Batch Returned: 422.414ms (262.808us) - Last Batch Returned: 422.415ms (564.000ns) - Closed: 422.647ms (232.257us) - ConvertRowBatchTime: 10.824us - InactiveTotalTime: 165.274ms - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 15 (15) - RowsReturnedRate: 90.00 /sec - TotalTime: 165.310ms Buffer pool: - AllocTime: 3.770us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.651us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 165.036ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 255.00 B (255) - TotalGetBatchTime: 165.284ms - DataWaitTime: 165.274ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 84.228us ; Min: 84.228us ; Max: 84.228us ; Number of samples: 1) - DeserializeRowBatchTime: 23.477us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 93.00 B (93) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000005 (host=quanlong-OptiPlex-BJ:27001): Last report received time: 2021-04-12 17:55:23.949 Fragment Instance Lifecycle Event Timeline: 422.706ms - Prepare Finished: 647.886us (647.886us) - Open Finished: 422.273ms (421.626ms) - First Batch Produced: 422.288ms (14.069us) - First Batch Sent: 422.322ms (34.744us) - ExecInternal Finished: 422.706ms (384.196us) - MemoryUsage (500.000ms): 80.47 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BytesAssigned: 0 - CompletionTime: 425.412ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.02 MB (8413664) - PeakReservation: 7.94 MB (8323072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 25.73 MB (26978236) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 162.297ms - TotalNetworkSendTime: 323.722us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 423.284ms - TotalThreadsSysTime: 4.207ms - TotalThreadsUserTime: 255.807ms - TotalThreadsVoluntaryContextSwitches: 5 (5) - TotalTime: 422.513ms Fragment Instance Lifecycle Timings: - ExecTime: 424.581us - ExecTreeExecTime: 14.626us - InactiveTotalTime: 0.000ns - OpenTime: 421.612ms - ExecTreeOpenTime: 162.726ms - PrepareTime: 436.429us - ExecTreePrepareTime: 316.420us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=6): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 197.52 KB/sec ; Min: 197.52 KB/sec ; Max: 197.52 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 124.368us ; Min: 85.579us ; Max: 163.157us ; Number of samples: 2) - RpcRecvrTime: (Avg: 38.972us ; Min: 27.639us ; Max: 50.306us ; Number of samples: 2) - EosSent: 1 (1) - InactiveTotalTime: 323.722us - PeakMemoryUsage: 14.22 KB (14560) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 7.783us - TotalBytesSent: 33.00 B (33) - TotalTime: 411.836us - UncompressedRowBatchSize: 68.00 B (68) SORT_NODE (id=3): SortType: Total ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 422.348ms - Open Started: 259.526ms (259.526ms) - Open Finished: 422.251ms (162.724ms) - First Batch Requested: 422.278ms (26.867us) - First Batch Returned: 422.287ms (9.508us) - Last Batch Returned: 422.330ms (42.479us) - Closed: 422.348ms (18.346us) - AddBatchTime: (Avg: 4.719us ; Min: 524.000ns ; Max: 8.914us ; Number of samples: 2) - NumRowsPerRun: (Avg: 4 (4) ; Min: 4 (4) ; Max: 4 (4) ; Number of samples: 1) - InMemorySortTime: 2.398us - InactiveTotalTime: 0.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 6.02 MB (6316032) - RowsReturned: 4 (4) - RowsReturnedRate: 24.00 /sec - SortDataSize: 36.00 B (36) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) - TotalTime: 163.055ms Buffer pool: - AllocTime: 13.404us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.991us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2): ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 422.242ms - Open Started: 259.531ms (259.531ms) - Open Finished: 422.007ms (162.475ms) - First Batch Requested: 422.103ms (96.318us) - First Batch Returned: 422.152ms (49.228us) - Last Batch Returned: 422.169ms (16.856us) - Closed: 422.242ms (73.127us) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 1.99 MB (2083072) - ProbeRows: 4 (4) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.618us - RowsReturned: 4 (4) - RowsReturnedRate: 24.00 /sec - TotalTime: 163.007ms Buffer pool: - AllocTime: 6.817us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.050us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRows: 1 (1) - BuildRowsPartitionTime: 15.050us - HashTablesBuildTime: 30.287us - InactiveTotalTime: 0.000ns - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumHashTableBuildsSkipped: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - TotalTime: 1.168ms Hash Table: - HashBuckets: 1 (1) - HashCollisions: 0 (0) - InactiveTotalTime: 0.000ns - Probes: 5 (5) - Resizes: 0 (0) - TotalTime: 0.000ns - Travel: 0 (0) EXCHANGE_NODE (id=5): Node Lifecycle Event Timeline: 260.905ms - Open Started: 259.650ms (259.650ms) - Open Finished: 259.656ms (5.544us) - First Batch Requested: 260.406ms (749.971us) - First Batch Returned: 260.418ms (12.406us) - Last Batch Returned: 260.419ms (244.000ns) - Closed: 260.905ms (486.412us) - ConvertRowBatchTime: 2.126us - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 49.53 K/sec - TotalTime: 20.189us Buffer pool: - AllocTime: 8.000us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.978us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 25.00 B (25) - TotalGetBatchTime: 7.335us - DataWaitTime: 0.000ns - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 21.00 B - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 35.085us ; Min: 35.085us ; Max: 35.085us ; Number of samples: 1) - DeserializeRowBatchTime: 25.287us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 21.00 B (21) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns EXCHANGE_NODE (id=4): Node Lifecycle Event Timeline: 422.230ms - Open Started: 259.685ms (259.685ms) - Open Finished: 421.760ms (162.075ms) - First Batch Requested: 421.776ms (15.211us) - First Batch Returned: 422.003ms (227.152us) - Last Batch Returned: 422.003ms (618.000ns) - Closed: 422.230ms (226.702us) - ConvertRowBatchTime: 5.202us - InactiveTotalTime: 162.279ms - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 4 (4) - RowsReturnedRate: 24.00 /sec - TotalTime: 162.306ms Buffer pool: - AllocTime: 2.864us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.150us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 162.068ms - InactiveTotalTime: 0.000ns - TotalBytesDequeued: 68.00 B (68) - TotalGetBatchTime: 162.287ms - DataWaitTime: 162.279ms - TotalTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 65.444us ; Min: 65.444us ; Max: 65.444us ; Number of samples: 1) - DeserializeRowBatchTime: 14.879us - InactiveTotalTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 33.00 B (33) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) - TotalTime: 0.000ns Averaged Fragment F00 [2 instances]:(Total: 343.836ms, non-child: 92.288ms, % non-child: 26.84%) split sizes: min: 4.30 MB, max: 4.92 MB, avg: 4.61 MB, stddev: 318.08 KB completion times: min:424.869ms max:508.701ms mean: 466.785ms stddev:41.916ms execution rates: min:8.45 MB/sec max:11.58 MB/sec mean:10.02 MB/sec stddev:1.57 MB/sec num instances: 2 - AverageThreadTokens: 1.00 - BytesAssigned: 4.61 MB (4834851) - CompletionTime: 466.785ms - ExchangeScanRatio: 0.00 - ExecutionRate: 10.02 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 6.36 MB (6665152) - PeakReservation: 6.00 MB (6291456) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 27.56 MB (28903219) - RowsProduced: 9 (9) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 385.339us - TotalStorageWaitTime: 4.901ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 577.492ms - TotalThreadsSysTime: 1.983ms - TotalThreadsUserTime: 166.755ms - TotalThreadsVoluntaryContextSwitches: 17 (17) - TotalTime: 343.836ms Fragment Instance Lifecycle Timings [2 instances]: - ExecTime: 251.016ms - ExecTreeExecTime: 250.500ms - InactiveTotalTime: 0.000ns - OpenTime: 92.489ms - ExecTreeOpenTime: 142.926us - PrepareTime: 288.093us - ExecTreePrepareTime: 166.246us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=4) [2 instances]:(Total: 506.824us, non-child: 121.485us, % non-child: 23.97%) - NetworkThroughput: (Avg: 328.86 KB/sec ; Min: 134.36 KB/sec ; Max: 523.37 KB/sec ; Number of samples: 2) - RpcNetworkTime: (Avg: 175.748us ; Min: 145.490us ; Max: 239.856us ; Number of samples: 6) - RpcRecvrTime: (Avg: 71.586us ; Min: 48.438us ; Max: 115.780us ; Number of samples: 6) - EosSent: 2 (2) - InactiveTotalTime: 385.339us - PeakMemoryUsage: 32.44 KB (33216) - RowsSent: 9 (9) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 6.300us - TotalBytesSent: 63.00 B (63) - TotalTime: 506.824us - UncompressedRowBatchSize: 161.00 B (161) HDFS_SCAN_NODE (id=0) [2 instances]:(Total: 251.041ms, non-child: 251.041ms, % non-child: 100.00%) - FooterProcessingTime: (Avg: 2.760ms ; Min: 2.646ms ; Max: 2.874ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 4.75 MB (4978878) ; Min: 4.75 MB (4978878) ; Max: 4.75 MB (4978878) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 12.86 KB (13171) ; Min: 2.07 KB (2117) ; Max: 59.61 KB (61041) ; Number of samples: 378) - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 23.55 MB (24696378) ; Min: 23.55 MB (24696378) ; Max: 23.55 MB (24696378) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.80 KB (65334) ; Min: 10.26 KB (10503) ; Max: 64.01 KB (65544) ; Number of samples: 378) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 2.55 MB (2675952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.56 MB (2682679) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.56 MB (2682679) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 5.481ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 68.490ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 189 (189) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.32 MB (6627840) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 507.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.50 KB (6656) - RowBatchQueueGetWaitTime: 81.147ms - RowBatchQueuePeakMemoryUsage: 20.50 KB (20992) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 2 (2) - RowsRead: 1.60M (1604666) - RowsReturned: 9 (9) - RowsReturnedRate: 30.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 4.901ms - ScannerThreadWorklessLoops: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 233.996ms - ScannerThreadsSysTime: 1.983ms - ScannerThreadsUserTime: 73.534ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsOpenFileTime: 1.595ms - TotalRawHdfsReadTime: 3.287ms - TotalReadThroughput: 0.00 /sec - TotalTime: 251.041ms Buffer pool [2 instances]: - AllocTime: 29.423us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 4.12 MB (4325376) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.06 MB (4259840) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 26.911us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 1 (0) [2 instances]: - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 1 (1) - RowGroups rejected: 0 (0) - RowGroups total: 1 (1) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 1.60M (1604666) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Filter 0 (1.00 MB) [2 instances]: - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.60M (1604666) - Rows rejected: 1.60M (1604656) - Rows total: 1.60M (1604666) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Fragment F00: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000001 (host=quanlong-OptiPlex-BJ:27001): Last report received time: 2021-04-12 17:55:23.949 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/4.92 MB Fragment Instance Lifecycle Event Timeline: 422.134ms - Prepare Finished: 594.605us (594.605us) - Open Finished: 107.106ms (106.511ms) - First Batch Produced: 421.289ms (314.183ms) - First Batch Sent: 421.313ms (23.418us) - ExecInternal Finished: 422.134ms (820.738us) - MemoryUsage (500.000ms): 4.04 MB - ThreadUsage (500.000ms): 2 - AverageThreadTokens: 2.00 - BytesAssigned: 4.92 MB (5160563) - CompletionTime: 424.869ms - ExchangeScanRatio: 0.00 - ExecutionRate: 11.58 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.66 MB (9078208) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 25.73 MB (26978236) - RowsProduced: 19 (19) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 521.140us - TotalStorageWaitTime: 6.977ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 726.600ms - TotalThreadsSysTime: 3.966ms - TotalThreadsUserTime: 254.089ms - TotalThreadsVoluntaryContextSwitches: 20 (20) - TotalTime: 421.880ms Fragment Instance Lifecycle Timings: - ExecTime: 315.009ms - ExecTreeExecTime: 314.315ms - InactiveTotalTime: 0.000ns - OpenTime: 106.506ms - ExecTreeOpenTime: 143.612us - PrepareTime: 318.731us - ExecTreePrepareTime: 185.378us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=4): ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 328.86 KB/sec ; Min: 134.36 KB/sec ; Max: 523.37 KB/sec ; Number of samples: 2) - RpcNetworkTime: (Avg: 176.286us ; Min: 145.490us ; Max: 239.856us ; Number of samples: 4) - RpcRecvrTime: (Avg: 81.190us ; Min: 56.176us ; Max: 115.780us ; Number of samples: 4) - EosSent: 2 (2) - InactiveTotalTime: 521.140us - PeakMemoryUsage: 36.44 KB (37312) - RowsSent: 19 (19) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 12.600us - TotalBytesSent: 126.00 B (126) - TotalTime: 681.638us - UncompressedRowBatchSize: 323.00 B (323) HDFS_SCAN_NODE (id=0): Table Name: tpch_ec.lineitem_orderkey_only Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/4.92 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 155ms. Maximum arrival delay: 263ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 421.509ms - Open Started: 106.951ms (106.951ms) - Open Finished: 107.093ms (141.142us) - First Batch Requested: 107.108ms (15.466us) - First Batch Returned: 421.287ms (314.179ms) - Last Batch Returned: 421.448ms (160.671us) - Closed: 421.509ms (61.267us) - BytesReadSeries (500.000ms): 0 - FooterProcessingTime: (Avg: 2.646ms ; Min: 2.646ms ; Max: 2.646ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 4.75 MB (4978878) ; Min: 4.75 MB (4978878) ; Max: 4.75 MB (4978878) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 12.86 KB (13171) ; Min: 2.07 KB (2117) ; Max: 59.61 KB (61041) ; Number of samples: 378) - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 23.55 MB (24696378) ; Min: 23.55 MB (24696378) ; Max: 23.55 MB (24696378) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 63.80 KB (65334) ; Min: 10.26 KB (10503) ; Max: 64.01 KB (65544) ; Number of samples: 378) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 5.01 MB (5249504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.02 MB (5262959) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.02 MB (5262959) - CachedFileHandlesHitCount: 1 (1) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 10.962ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 136.980ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 378 (378) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.62 MB (9040896) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 934.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 13.00 KB (13312) - RowBatchQueueGetWaitTime: 159.191ms - RowBatchQueuePeakMemoryUsage: 25.00 KB (25600) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 3.21M (3209332) - RowsReturned: 19 (19) - RowsReturnedRate: 60.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 6.977ms - ScannerThreadWorklessLoops: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 305.094ms - ScannerThreadsSysTime: 3.966ms - ScannerThreadsUserTime: 146.776ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsOpenFileTime: 1.592ms - TotalRawHdfsReadTime: 5.359ms - TotalReadThroughput: 0.00 /sec - TotalTime: 314.902ms Buffer pool: - AllocTime: 20.964us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 8.12 MB (8519680) - CumulativeAllocations: 2 (2) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 8.00 MB (8388608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 17.828us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 1 (0): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 1 (1) - RowGroups rejected: 0 (0) - RowGroups total: 1 (1) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 3.21M (3209332) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 3.21M (3209332) - Rows rejected: 3.21M (3209313) - Rows total: 3.21M (3209332) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000002 (host=quanlong-OptiPlex-BJ:27000): Last report received time: 2021-04-12 17:55:24.030 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/4.30 MB Fragment Instance Lifecycle Event Timeline: 266.010ms - Prepare Finished: 487.723us (487.723us) - Open Finished: 78.966ms (78.478ms) - First Batch Produced: 265.598ms (186.632ms) - First Batch Sent: 265.601ms (3.067us) - ExecInternal Finished: 266.010ms (409.284us) - AverageThreadTokens: 0.00 - BytesAssigned: 4.30 MB (4509139) - CompletionTime: 508.701ms - ExchangeScanRatio: 0.00 - ExecutionRate: 8.45 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 4.06 MB (4252096) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.40 MB (30828203) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 249.537us - TotalStorageWaitTime: 2.824ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 428.383ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 79.422ms - TotalThreadsVoluntaryContextSwitches: 15 (15) - TotalTime: 265.792ms Fragment Instance Lifecycle Timings: - ExecTime: 187.022ms - ExecTreeExecTime: 186.685ms - InactiveTotalTime: 0.000ns - OpenTime: 78.472ms - ExecTreeOpenTime: 142.240us - PrepareTime: 257.456us - ExecTreePrepareTime: 147.114us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=4): ExecOption: Hash Partitioned Sender Codegen Enabled - NetworkThroughput: 0.00 /sec (Number of samples: 0) - RpcNetworkTime: (Avg: 174.672us ; Min: 161.072us ; Max: 188.273us ; Number of samples: 2) - RpcRecvrTime: (Avg: 52.378us ; Min: 48.438us ; Max: 56.319us ; Number of samples: 2) - EosSent: 2 (2) - InactiveTotalTime: 249.537us - PeakMemoryUsage: 28.44 KB (29120) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - TotalTime: 332.011us - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0): Table Name: tpch_ec.lineitem_orderkey_only Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/4.30 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 184ms. Maximum arrival delay: 263ms. Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/NONE:1 Node Lifecycle Event Timeline: 265.700ms - Open Started: 78.813ms (78.813ms) - Open Finished: 78.952ms (139.601us) - First Batch Requested: 78.970ms (17.210us) - First Batch Returned: 265.596ms (186.626ms) - Last Batch Returned: 265.659ms (63.121us) - Closed: 265.700ms (40.742us) - FooterProcessingTime: (Avg: 2.874ms ; Min: 2.874ms ; Max: 2.874ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: 0 (Number of samples: 0) - ParquetRowGroupIdealReservation: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedPageSize: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 100.00 KB (102400) - BytesReadDataNodeCache: 0 - BytesReadLocal: 100.00 KB (102400) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 100.00 KB (102400) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 383.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 0 (0) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 4.02 MB (4214784) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 80.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 0 - RowBatchQueueGetWaitTime: 3.104ms - RowBatchQueuePeakMemoryUsage: 16.00 KB (16384) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 2 (2) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 2.824ms - ScannerThreadWorklessLoops: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 162.898ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 292.000us - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsOpenFileTime: 1.597ms - TotalRawHdfsReadTime: 1.215ms - TotalReadThroughput: 0.00 /sec - TotalTime: 187.180ms Buffer pool: - AllocTime: 37.882us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 1 (1) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 35.995us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 1 (0): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 1 (1) - RowGroups rejected: 1 (1) - RowGroups total: 1 (1) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0.000ns - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0.000ns Averaged Fragment F01 [2 instances]:(Total: 109.323ms, non-child: 66.462ms, % non-child: 60.79%) split sizes: min: 11.67 MB, max: 42.55 MB, avg: 27.11 MB, stddev: 15.44 MB completion times: min:425.178ms max:508.039ms mean: 466.608ms stddev:41.430ms execution rates: min:22.96 MB/sec max:100.07 MB/sec mean:61.52 MB/sec stddev:38.55 MB/sec num instances: 2 - AverageThreadTokens: 0.00 - BytesAssigned: 27.11 MB (28422999) - CompletionTime: 466.608ms - ExchangeScanRatio: 0.00 - ExecutionRate: 61.52 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.96 MB (9392688) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 27.56 MB (28903219) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 900.646us - TotalStorageWaitTime: 24.705ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 150.301ms - TotalThreadsSysTime: 2.095ms - TotalThreadsUserTime: 78.711ms - TotalThreadsVoluntaryContextSwitches: 13 (13) - TotalTime: 109.323ms Fragment Instance Lifecycle Timings [2 instances]: - ExecTime: 42.509ms - ExecTreeExecTime: 41.456ms - InactiveTotalTime: 0.000ns - OpenTime: 66.558ms - ExecTreeOpenTime: 176.403us - PrepareTime: 221.455us - ExecTreePrepareTime: 101.068us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=5) [2 instances]:(Total: 1.037ms, non-child: 136.555us, % non-child: 13.17%) - NetworkThroughput: (Avg: 45.08 KB/sec ; Min: 26.87 KB/sec ; Max: 63.29 KB/sec ; Number of samples: 2) - RpcNetworkTime: (Avg: 534.196us ; Min: 116.086us ; Max: 763.147us ; Number of samples: 6) - RpcRecvrTime: (Avg: 62.712us ; Min: 32.383us ; Max: 113.876us ; Number of samples: 6) - EosSent: 2 (2) - InactiveTotalTime: 900.646us - PeakMemoryUsage: 19.05 KB (19504) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 5.195us - TotalBytesSent: 34.00 B (34) - TotalTime: 1.037ms - UncompressedRowBatchSize: 50.00 B (50) HDFS_SCAN_NODE (id=1) [2 instances]:(Total: 41.824ms, non-child: 41.824ms, % non-child: 100.00%) - FooterProcessingTime: (Avg: 5.906ms ; Min: 5.901ms ; Max: 5.910ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 3.015ms ; Min: 730.654us ; Max: 5.299ms ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 821.06 KB (840765) ; Min: 211.31 KB (216382) ; Max: 1.63 MB (1713761) ; Number of samples: 4) - ParquetCompressedPageSize: (Avg: 33.86 KB (34670) ; Min: 14.09 KB (14428) ; Max: 64.14 KB (65683) ; Number of samples: 97) - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 2.50 MB (2621440) ; Min: 1.00 MB (1048576) ; Max: 4.00 MB (4194304) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.48 MB (1556354) ; Min: 320.02 KB (327700) ; Max: 3.26 MB (3422711) ; Number of samples: 4) - ParquetUncompressedPageSize: (Avg: 62.67 KB (64179) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 97) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.10 MB (2204143) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.10 MB (2204143) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.10 MB (2204143) - CachedFileHandlesHitCount: 28 (28) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.671ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 5.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 176 (176) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 128 (128) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.94 MB (9369088) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 91.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 19.00 KB (19456) - RowBatchQueueGetWaitTime: 41.077ms - RowBatchQueuePeakMemoryUsage: 29.00 KB (29696) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 157.34K (157342) - RowsReturned: 2 (2) - RowsReturnedRate: 32.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 24.705ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 41.243ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.740ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsOpenFileTime: 3.128ms - TotalRawHdfsReadTime: 21.786ms - TotalReadThroughput: 0.00 /sec - TotalTime: 41.824ms Buffer pool [2 instances]: - AllocTime: 29.070us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 2.62 MB (2752512) - CumulativeAllocations: 3 (3) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.50 MB (2621440) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 19.898us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F01: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000003 (host=quanlong-OptiPlex-BJ:27001): Last report received time: 2021-04-12 17:55:23.949 Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/42.55 MB Fragment Instance Lifecycle Event Timeline: 116.310ms - Prepare Finished: 377.569us (377.569us) - Open Finished: 54.495ms (54.118ms) - First Batch Produced: 114.818ms (60.323ms) - First Batch Sent: 114.828ms (10.041us) - ExecInternal Finished: 116.310ms (1.481ms) - AverageThreadTokens: 0.00 - BytesAssigned: 42.55 MB (44612613) - CompletionTime: 425.178ms - ExchangeScanRatio: 0.00 - ExecutionRate: 100.07 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.96 MB (9392688) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 25.73 MB (26978236) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.021ms - TotalStorageWaitTime: 33.976ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 176.167ms - TotalThreadsSysTime: 4.190ms - TotalThreadsUserTime: 72.769ms - TotalThreadsVoluntaryContextSwitches: 15 (15) - TotalTime: 116.108ms Fragment Instance Lifecycle Timings: - ExecTime: 61.732ms - ExecTreeExecTime: 60.528ms - InactiveTotalTime: 0.000ns - OpenTime: 54.110ms - ExecTreeOpenTime: 165.458us - PrepareTime: 229.119us - ExecTreePrepareTime: 105.057us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=5): ExecOption: Hash Partitioned Sender Codegen Enabled - NetworkThroughput: (Avg: 45.08 KB/sec ; Min: 26.87 KB/sec ; Max: 63.29 KB/sec ; Number of samples: 2) - RpcNetworkTime: (Avg: 438.694us ; Min: 116.086us ; Max: 763.147us ; Number of samples: 4) - RpcRecvrTime: (Avg: 68.367us ; Min: 32.383us ; Max: 113.876us ; Number of samples: 4) - EosSent: 2 (2) - InactiveTotalTime: 1.021ms - PeakMemoryUsage: 23.05 KB (23600) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 10.390us - TotalBytesSent: 68.00 B (68) - TotalTime: 1.201ms - UncompressedRowBatchSize: 100.00 B (100) HDFS_SCAN_NODE (id=1): Table Name: tpch_parquet.orders Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/42.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 115.085ms - Open Started: 54.318ms (54.318ms) - Open Finished: 54.480ms (162.515us) - First Batch Requested: 54.498ms (17.450us) - First Batch Returned: 114.817ms (60.318ms) - Last Batch Returned: 115.038ms (221.294us) - Closed: 115.085ms (46.610us) - FooterProcessingTime: (Avg: 5.910ms ; Min: 5.910ms ; Max: 5.910ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 5.299ms ; Min: 5.299ms ; Max: 5.299ms ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 1.34 MB (1402574) ; Min: 1.04 MB (1091387) ; Max: 1.63 MB (1713761) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 33.41 KB (34209) ; Min: 14.09 KB (14428) ; Max: 36.90 KB (37789) ; Number of samples: 82) - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.52 MB (2646633) ; Min: 1.78 MB (1870556) ; Max: 3.26 MB (3422711) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 63.04 KB (64552) ; Min: 14.08 KB (14423) ; Max: 64.01 KB (65544) ; Number of samples: 82) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.22 MB (3372857) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.22 MB (3372857) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.22 MB (3372857) - CachedFileHandlesHitCount: 46 (46) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 6.654ms - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 8.623ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 282 (282) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 200 (200) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.94 MB (9369088) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 103.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 21.00 KB (21504) - RowBatchQueueGetWaitTime: 60.156ms - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 247.02K (247016) - RowsReturned: 4 (4) - RowsReturnedRate: 65.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 33.976ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 60.332ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 22.482ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsOpenFileTime: 3.334ms - TotalRawHdfsReadTime: 30.930ms - TotalReadThroughput: 0.00 /sec - TotalTime: 60.895ms Buffer pool: - AllocTime: 39.929us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 4.12 MB (4325376) - CumulativeAllocations: 3 (3) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 31.021us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 9342fd18312bc8b0:6249452a00000004 (host=quanlong-OptiPlex-BJ:27000): Last report received time: 2021-04-12 17:55:24.030 Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/11.67 MB Fragment Instance Lifecycle Event Timeline: 102.742ms - Prepare Finished: 348.331us (348.331us) - Open Finished: 79.362ms (79.014ms) - First Batch Produced: 101.557ms (22.195ms) - First Batch Sent: 101.561ms (3.623us) - ExecInternal Finished: 102.742ms (1.181ms) - AverageThreadTokens: 0.00 - BytesAssigned: 11.67 MB (12233386) - CompletionTime: 508.039ms - ExchangeScanRatio: 0.00 - ExecutionRate: 22.96 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.96 MB (9392688) - PeakReservation: 8.00 MB (8388608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.40 MB (30828203) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 779.369us - TotalStorageWaitTime: 15.434ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 124.436ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 84.653ms - TotalThreadsVoluntaryContextSwitches: 11 (11) - TotalTime: 102.539ms Fragment Instance Lifecycle Timings: - ExecTime: 23.286ms - ExecTreeExecTime: 22.384ms - InactiveTotalTime: 0.000ns - OpenTime: 79.006ms - ExecTreeOpenTime: 187.348us - PrepareTime: 213.792us - ExecTreePrepareTime: 97.079us - TotalTime: 0.000ns KrpcDataStreamSender (dst_id=5): ExecOption: Hash Partitioned Sender Codegen Enabled - NetworkThroughput: 0.00 /sec (Number of samples: 0) - RpcNetworkTime: (Avg: 725.201us ; Min: 703.482us ; Max: 746.920us ; Number of samples: 2) - RpcRecvrTime: (Avg: 51.402us ; Min: 50.163us ; Max: 52.642us ; Number of samples: 2) - EosSent: 2 (2) - InactiveTotalTime: 779.369us - PeakMemoryUsage: 15.05 KB (15408) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - TotalTime: 872.419us - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1): Table Name: tpch_parquet.orders Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/11.67 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 101.819ms - Open Started: 79.160ms (79.160ms) - Open Finished: 79.345ms (184.993us) - First Batch Requested: 79.369ms (23.413us) - First Batch Returned: 101.555ms (22.185ms) - Last Batch Returned: 101.760ms (205.305us) - Closed: 101.819ms (59.058us) - FooterProcessingTime: (Avg: 5.901ms ; Min: 5.901ms ; Max: 5.901ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 730.654us ; Min: 730.654us ; Max: 730.654us ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 272.42 KB (278957) ; Min: 211.31 KB (216382) ; Max: 333.53 KB (341532) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 36.32 KB (37194) ; Min: 14.09 KB (14428) ; Max: 64.14 KB (65683) ; Number of samples: 15) - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 455.15 KB (466075) ; Min: 320.02 KB (327700) ; Max: 590.28 KB (604450) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 60.69 KB (62143) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 15) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1011.16 KB (1035430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1011.16 KB (1035430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1011.16 KB (1035430) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 688.889us - InactiveTotalTime: 0.000ns - MaterializeTupleTime: 1.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 71 (71) - NumRowGroups: 1 (1) - NumRowGroupsSkippedByUnusefulFilters: 0 (0) - NumRowGroupsWithPageIndex: 1 (1) - NumRuntimeFilteredPages: 0 (0) - NumRuntimeFilteredRowGroups: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 56 (56) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.94 MB (9369088) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 78.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 17.00 KB (17408) - RowBatchQueueGetWaitTime: 21.997ms - RowBatchQueuePeakMemoryUsage: 25.00 KB (25600) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 67.67K (67668) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 15.434ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 22.154ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsOpenFileTime: 2.922ms - TotalRawHdfsReadTime: 12.643ms - TotalReadThroughput: 0.00 /sec - TotalTime: 22.752ms Buffer pool: - AllocTime: 18.212us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 1.12 MB (1179648) - CumulativeAllocations: 3 (3) - EncryptionTime: 0.000ns - InactiveTotalTime: 0.000ns - PeakReservation: 8.00 MB (8388608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.776us - TotalTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns