Query (id=94da567a47606a7:70ad12d88de1989): Summary: Session ID: 3540fd633dfc6ecd:1676868b1772b49f Session Type: BEESWAX Start Time: 2014-11-14 23:20:48.341896000 End Time: 2014-11-14 23:20:58.001655000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 1.3.0-cdh5 DEBUG (build f88ed4283afa3c2dc3a1438e6c1d557b20b51291) User: abehm Connected User: abehm Delegated User: Network Address: 127.0.0.1:58266 Default Db: default Sql Statement: select s_name, count(*) as numwait from tpch.supplier, tpch.lineitem l1, tpch.orders, tpch.nation where s_suppkey = l1.l_suppkey and o_orderkey = l1.l_orderkey and o_orderstatus = 'F' and l1.l_receiptdate > l1.l_commitdate and exists ( select * from tpch.lineitem l2 where l2.l_orderkey = l1.l_orderkey and l2.l_suppkey <> l1.l_suppkey ) and not exists ( select * from tpch.lineitem l3 where l3.l_orderkey = l1.l_orderkey and l3.l_suppkey <> l1.l_suppkey and l3.l_receiptdate > l3.l_commitdate ) and s_nationkey = n_nationkey and n_name = 'SAUDI ARABIA' group by s_name order by numwait desc, s_name limit 100 Coordinator: desk:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=575.85MB VCores=4 F08:PLAN FRAGMENT [UNPARTITIONED] 21:MERGING-EXCHANGE [UNPARTITIONED] order by: count(*) DESC, s_name ASC limit: 100 hosts=3 per-host-mem=unavailable tuple-ids=9 row-size=42B cardinality=100 F07:PLAN FRAGMENT [HASH(s_name)] DATASTREAM SINK [FRAGMENT=F08, EXCHANGE=21, UNPARTITIONED] 12:TOP-N [LIMIT=100] | order by: count(*) DESC, s_name ASC | hosts=3 per-host-mem=4.10KB | tuple-ids=9 row-size=42B cardinality=100 | 20:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: s_name | hosts=3 per-host-mem=10.00MB | tuple-ids=8 row-size=42B cardinality=10388 | 19:EXCHANGE [HASH(s_name)] hosts=3 per-host-mem=0B tuple-ids=8 row-size=42B cardinality=10388 F05:PLAN FRAGMENT [HASH(l1.l_orderkey)] DATASTREAM SINK [FRAGMENT=F07, EXCHANGE=19, HASH(s_name)] 11:AGGREGATE | output: count(*) | group by: s_name | hosts=3 per-host-mem=10.00MB | tuple-ids=8 row-size=42B cardinality=10388 | 10:HASH JOIN [LEFT ANTI JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l3.l_orderkey | other join predicates: l3.l_suppkey != l1.l_suppkey | hosts=3 per-host-mem=14.27MB | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--18:EXCHANGE [HASH(l3.l_orderkey)] | hosts=3 per-host-mem=0B | tuple-ids=6 row-size=68B cardinality=600122 | 09:HASH JOIN [LEFT SEMI JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | other join predicates: l2.l_suppkey != l1.l_suppkey | hosts=3 per-host-mem=33.58MB | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--17:EXCHANGE [HASH(l2.l_orderkey)] | hosts=3 per-host-mem=0B | tuple-ids=4 row-size=16B cardinality=6001215 | 16:EXCHANGE [HASH(l1.l_orderkey)] hosts=3 per-host-mem=0B tuple-ids=1,0,2,3 row-size=162B cardinality=600122 F06:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=18, HASH(l3.l_orderkey)] 05:SCAN HDFS [tpch.lineitem l3, RANDOM] partitions=1/1 files=1 size=718.94MB predicates: l3.l_receiptdate > l3.l_commitdate table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=264.00MB tuple-ids=6 row-size=68B cardinality=600122 F04:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=17, HASH(l2.l_orderkey)] 04:SCAN HDFS [tpch.lineitem l2, RANDOM] partitions=1/1 files=1 size=718.94MB table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=264.00MB tuple-ids=4 row-size=16B cardinality=6001215 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=16, HASH(l1.l_orderkey)] 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: s_nationkey = n_nationkey | hosts=3 per-host-mem=28B | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--15:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=3 row-size=25B cardinality=1 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_orderkey = o_orderkey | hosts=3 per-host-mem=13.11MB | tuple-ids=1,0,2 row-size=137B cardinality=600122 | |--14:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=2 row-size=25B cardinality=500000 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_suppkey = s_suppkey | hosts=3 per-host-mem=472.66KB | tuple-ids=1,0 row-size=112B cardinality=600122 | |--13:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=0 row-size=44B cardinality=10000 | 01:SCAN HDFS [tpch.lineitem l1, RANDOM] partitions=1/1 files=1 size=718.94MB predicates: l1.l_receiptdate > l1.l_commitdate table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=264.00MB tuple-ids=1 row-size=68B cardinality=600122 F03:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=15, BROADCAST] 03:SCAN HDFS [tpch.nation, RANDOM] partitions=1/1 files=1 size=2.15KB predicates: n_name = 'SAUDI ARABIA' table stats: 25 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=3 row-size=25B cardinality=1 F02:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=14, BROADCAST] 02:SCAN HDFS [tpch.orders, RANDOM] partitions=1/1 files=1 size=162.56MB predicates: o_orderstatus = 'F' table stats: 1500000 rows total column stats: all hosts=3 per-host-mem=176.00MB tuple-ids=2 row-size=25B cardinality=500000 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=13, BROADCAST] 00:SCAN HDFS [tpch.supplier, RANDOM] partitions=1/1 files=1 size=1.33MB table stats: 10000 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=0 row-size=44B cardinality=10000 ---------------- Estimated Per-Host Mem: 603818298 Estimated Per-Host VCores: 4 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------- 21:MERGING-EXCHANGE 1 341.969us 341.969us 300 100 0 -1.00 B UNPARTITIONED 12:TOP-N 3 1.738ms 1.928ms 300 100 20.00 KB 4.10 KB 20:AGGREGATE 3 141.305ms 141.559ms 411 10.39K 6.29 MB 10.00 MB FINALIZE 19:EXCHANGE 3 163.412us 178.198us 1.20K 10.39K 0 0 HASH(s_name) 11:AGGREGATE 3 159.478ms 212.594ms 1.20K 10.39K 11.47 MB 10.00 MB 10:HASH JOIN 3 1s485ms 1s575ms 4.14K 600.12K 838.05 MB 14.27 MB LEFT ANTI JOIN, PARTITIONED |--18:EXCHANGE 3 293.828ms 308.780ms 3.79M 600.12K 0 0 HASH(l3.l_orderkey) | 05:SCAN HDFS 3 2s787ms 3s233ms 3.79M 600.12K 65.66 MB 264.00 MB tpch.lineitem l3 09:HASH JOIN 3 4s791ms 4s880ms 73.09K 600.12K 838.05 MB 33.58 MB LEFT SEMI JOIN, PARTITIONED |--17:EXCHANGE 3 380.799ms 406.256ms 6.00M 6.00M 0 0 HASH(l2.l_orderkey) | 04:SCAN HDFS 3 2s745ms 3s046ms 6.00M 6.00M 64.73 MB 264.00 MB tpch.lineitem l2 16:EXCHANGE 3 3.863ms 3.915ms 75.87K 600.12K 0 0 HASH(l1.l_orderkey) 08:HASH JOIN 3 387.206ms 400.723ms 75.87K 600.12K 8.59 MB 28.00 B INNER JOIN, BROADCAST |--15:EXCHANGE 3 15.843us 19.148us 1 1 0 0 BROADCAST | 03:SCAN HDFS 1 443.178ms 443.178ms 1 1 41.00 KB 32.00 MB tpch.nation 07:HASH JOIN 3 3s889ms 4s269ms 1.83M 600.12K 566.03 MB 13.11 MB INNER JOIN, BROADCAST |--14:EXCHANGE 3 141.48ms 144.758ms 729.41K 500.00K 0 0 BROADCAST | 02:SCAN HDFS 2 1s744ms 2s386ms 729.41K 500.00K 32.16 MB 176.00 MB tpch.orders 06:HASH JOIN 3 1s763ms 1s879ms 3.79M 600.12K 12.43 MB 472.66 KB INNER JOIN, BROADCAST |--13:EXCHANGE 3 3.112ms 5.549ms 10.00K 10.00K 0 0 BROADCAST | 00:SCAN HDFS 1 508.179ms 508.179ms 10.00K 10.00K 2.24 MB 32.00 MB tpch.supplier 01:SCAN HDFS 3 1s854ms 1s895ms 3.79M 600.12K 65.38 MB 264.00 MB tpch.lineitem l1 Query Timeline: 9s669ms - Start execution: 66.242us (66.242us) - Planning finished: 274.144ms (274.78ms) - Ready to start remote fragments: 275.415ms (1.270ms) - Remote fragments started: 2s901ms (2s626ms) - Rows available: 9s588ms (6s686ms) - First row fetched: 9s649ms (61.251ms) - Unregister query: 9s659ms (10.52ms) ImpalaServer: - ClientFetchWaitTimer: 68.557ms - RowMaterializationTimer: 141.110us Execution Profile 94da567a47606a7:70ad12d88de1989:(Total: 9s298ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 19, last: 0.505064, min: 0.141253, max: 0.505064, mean: 0.262667, stddev: 0.11594 Per Node Peak Memory Usage: desk:22000(1.79 GB) desk:22002(1.78 GB) desk:22001(1.74 GB) - FinalizationTimer: 0ns Coordinator Fragment F08:(Total: 6s669ms, non-child: 452.950us, % non-child: 0.01%) MemoryUsage(500.0ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB ThreadUsage(500.0ms): 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 48.00 KB (49152) - PerHostPeakMemUsage: 0 - PrepareTime: 55.119us - RowsProduced: 100 - TotalCpuTime: 9s375ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 802 - BlocksRecycled: 287 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.08 GB (21564157952) - PeakMemoryUsage: 1.56 GB (1678245888) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns EXCHANGE_NODE (id=21):(Total: 6s668ms, non-child: 341.969us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 5.82 KB (5957) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 85.995us - FirstBatchArrivalWaitTime: 6s668ms - MergeGetNext: 283.349us - MergeGetNextBatch: 15.635us - PeakMemoryUsage: 0 - RowsReturned: 300 - RowsReturnedRate: 44.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F07:(Total: 9s030ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:9s170ms max:9s172ms mean: 9s171ms stddev:606.289us execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.31 MB (6619136) - PerHostPeakMemUsage: 1.77 GB (1900795994) - PrepareTime: 139.648ms - RowsProduced: 100 - TotalCpuTime: 424.94ms - TotalNetworkReceiveTime: 8s886ms - TotalNetworkSendTime: 165.43us - TotalStorageWaitTime: 0ns CodeGen:(Total: 415.46ms, non-child: 415.46ms, % non-child: 100.00%) - CodegenTime: 3.732ms - CompileTime: 13.992ms - LoadTime: 40.952us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 265.823ms - PrepareTime: 134.142ms DataStreamSender (dst_id=21):(Total: 88.625us, non-child: 88.625us, % non-child: 100.00%) - BytesSent: 1.94 KB (1985) - NetworkThroughput(*): 15.68 MB/sec - OverallThroughput: 21.72 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 48.712us - ThriftTransmitTime(*): 121.742us - UncompressedRowBatchSize: 5.28 KB (5404) SORT_NODE (id=12):(Total: 9s030ms, non-child: 1.738ms, % non-child: 0.02%) - PeakMemoryUsage: 20.00 KB (20480) - RowsReturned: 100 - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=20):(Total: 9s028ms, non-child: 141.305ms, % non-child: 1.57%) - BuildTime: 132.963us - GetNewBlockTime: 179.346us - GetResultsTime: 148.947us - HashBuckets: 32.43K (32426) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.29 MB (6598656) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 137 - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 - UnpinTime: 7.638us EXCHANGE_NODE (id=19):(Total: 8s887ms, non-child: 8s887ms, % non-child: 100.00%) - BytesReceived: 7.11 KB (7284) - ConvertRowBatchTime: 56.93us - DeserializeRowBatchTimer: 112.264us - FirstBatchArrivalWaitTime: 8s744ms - PeakMemoryUsage: 0 - RowsReturned: 398 - RowsReturnedRate: 44.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 802 - BlocksRecycled: 287 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.08 GB (21564157952) - PeakMemoryUsage: 1.56 GB (1678245888) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns Averaged Fragment F05:(Total: 8s752ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8s878ms max:8s974ms mean: 8s928ms stddev:39.127ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 2.83 - PeakMemoryUsage: 1.47 GB (1576086493) - PerHostPeakMemUsage: 1.77 GB (1900795994) - PrepareTime: 174.312ms - RowsProduced: 398 - TotalCpuTime: 16s780ms - TotalNetworkReceiveTime: 18s494ms - TotalNetworkSendTime: 658.321us - TotalStorageWaitTime: 0ns CodeGen:(Total: 504.723ms, non-child: 504.723ms, % non-child: 100.00%) - CodegenTime: 3.570ms - CompileTime: 30.266ms - LoadTime: 24.563us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 316.734ms - PrepareTime: 156.922ms DataStreamSender (dst_id=19):(Total: 243.126us, non-child: 243.126us, % non-child: 100.00%) - BytesSent: 7.11 KB (7284) - NetworkThroughput(*): 14.33 MB/sec - OverallThroughput: 28.61 MB/sec - PeakMemoryUsage: 36.00 KB (36864) - SerializeBatchTime: 154.237us - ThriftTransmitTime(*): 484.813us - UncompressedRowBatchSize: 21.04 KB (21540) AGGREGATION_NODE (id=11):(Total: 8s751ms, non-child: 159.478ms, % non-child: 1.82%) - BuildTime: 2.138ms - GetNewBlockTime: 214.755us - GetResultsTime: 158.60us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 11.27 MB (11816965) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 398 - RowsReturnedRate: 45.00 /sec - SpilledPartitions: 0 - UnpinTime: 9.399us HASH_JOIN_NODE (id=10):(Total: 8s592ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 534.874ms - BuildRows: 1.26M (1264432) - BuildRowsPartitioned: 1.26M (1264432) - BuildTime: 384.114ms - GetNewBlockTime: 1.305ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 24.36K (24363) - ProbeRowsPartitioned: 0 - ProbeTime: 8.283ms - RowsReturned: 1.38K (1380) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 - UnpinTime: 10.840us EXCHANGE_NODE (id=18):(Total: 7s405ms, non-child: 7s405ms, % non-child: 100.00%) - BytesReceived: 42.52 MB (44583495) - ConvertRowBatchTime: 208.883ms - DeserializeRowBatchTimer: 562.925ms - FirstBatchArrivalWaitTime: 238.828ms - PeakMemoryUsage: 0 - RowsReturned: 1.26M (1264432) - RowsReturnedRate: 170.75 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 8s251ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 365.108ms - BuildRows: 2.00M (2000405) - BuildRowsPartitioned: 2.00M (2000405) - BuildTime: 987.405ms - GetNewBlockTime: 1.964ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 25.29K (25290) - ProbeRowsPartitioned: 0 - ProbeTime: 8.971ms - RowsReturned: 24.36K (24363) - RowsReturnedRate: 2.95 K/sec - SpilledPartitions: 0 - UnpinTime: 10.771us EXCHANGE_NODE (id=17):(Total: 6s635ms, non-child: 6s635ms, % non-child: 100.00%) - BytesReceived: 29.26 MB (30680657) - ConvertRowBatchTime: 337.99ms - DeserializeRowBatchTimer: 163.907ms - FirstBatchArrivalWaitTime: 435.210ms - PeakMemoryUsage: 0 - RowsReturned: 2.00M (2000405) - RowsReturnedRate: 301.49 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns EXCHANGE_NODE (id=16):(Total: 5s055ms, non-child: 5s055ms, % non-child: 100.00%) - BytesReceived: 2.32 MB (2432830) - ConvertRowBatchTime: 2.593ms - DeserializeRowBatchTimer: 31.920ms - FirstBatchArrivalWaitTime: 5s051ms - PeakMemoryUsage: 0 - RowsReturned: 25.29K (25290) - RowsReturnedRate: 5.00 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F06:(Total: 7s236ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 206.94 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 23.13 MB completion times: min:6s179ms max:7s980ms mean: 7s252ms stddev:774.430ms execution rates: min:32.08 MB/sec max:33.70 MB/sec mean:33.09 MB/sec stddev:735.01 KB/sec num instances: 3 - AverageThreadTokens: 2.79 - PeakMemoryUsage: 65.64 MB (68833280) - PerHostPeakMemUsage: 1.77 GB (1900795994) - PrepareTime: 233.235ms - RowsProduced: 1.26M (1264432) - TotalCpuTime: 20s552ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 77.395ms - TotalStorageWaitTime: 318.497ms CodeGen:(Total: 421.188ms, non-child: 421.188ms, % non-child: 100.00%) - CodegenTime: 2.763ms - CompileTime: 5.700ms - LoadTime: 53.121us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 204.913ms - PrepareTime: 209.543ms DataStreamSender (dst_id=18):(Total: 4s443ms, non-child: 4s443ms, % non-child: 100.00%) - BytesSent: 42.52 MB (44583495) - NetworkThroughput(*): 28.23 MB/sec - OverallThroughput: 9.57 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 1s300ms - ThriftTransmitTime(*): 1s506ms - UncompressedRowBatchSize: 96.49 MB (101171886) HDFS_SCAN_NODE (id=5):(Total: 2s787ms, non-child: 2s787ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 239.65 MB (251289064) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.65 MB (251289064) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.65 MB (251289064) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.55 MB (68739072) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.00M (2000405) - RowsReturned: 1.26M (1264432) - RowsReturnedRate: 457.12 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 189 - ScannerThreadsTotalWallClockTime: 13s462ms - DelimiterParseTime: 2s010ms - MaterializeTupleTime(*): 302.928ms - ScannerThreadsSysTime: 9.333ms - ScannerThreadsUserTime: 2s257ms - ScannerThreadsVoluntaryContextSwitches: 2.29K (2289) - TotalRawHdfsReadTime(*): 131.885ms - TotalReadThroughput: 31.31 MB/sec Averaged Fragment F04:(Total: 6s229ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 206.94 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 23.13 MB completion times: min:5s286ms max:6s901ms mean: 6s332ms stddev:740.381ms execution rates: min:37.09 MB/sec max:39.14 MB/sec mean:37.94 MB/sec stddev:892.88 KB/sec num instances: 3 - AverageThreadTokens: 2.78 - PeakMemoryUsage: 64.84 MB (67993488) - PerHostPeakMemUsage: 1.77 GB (1900795994) - PrepareTime: 173.411ms - RowsProduced: 2.00M (2000405) - TotalCpuTime: 18s049ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 42.502ms - TotalStorageWaitTime: 97.427ms CodeGen:(Total: 418.990ms, non-child: 418.990ms, % non-child: 100.00%) - CodegenTime: 1.170ms - CompileTime: 5.959ms - LoadTime: 54.417us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 240.805ms - PrepareTime: 171.346ms DataStreamSender (dst_id=17):(Total: 3s472ms, non-child: 3s472ms, % non-child: 100.00%) - BytesSent: 29.26 MB (30680657) - NetworkThroughput(*): 30.72 MB/sec - OverallThroughput: 8.44 MB/sec - PeakMemoryUsage: 111.89 KB (114576) - SerializeBatchTime: 984.120ms - ThriftTransmitTime(*): 952.557ms - UncompressedRowBatchSize: 53.43 MB (56023080) HDFS_SCAN_NODE (id=4):(Total: 2s745ms, non-child: 2s745ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.93 - BytesRead: 239.65 MB (251289064) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.65 MB (251289064) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.65 MB (251289064) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 64.73 MB (67870720) - PerReadThreadRawHdfsThroughput: 1.81 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.00M (2000405) - RowsReturned: 2.00M (2000405) - RowsReturnedRate: 733.25 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 215 - ScannerThreadsTotalWallClockTime: 11s686ms - DelimiterParseTime: 2s039ms - MaterializeTupleTime(*): 263.489ms - ScannerThreadsSysTime: 14.667ms - ScannerThreadsUserTime: 2s165ms - ScannerThreadsVoluntaryContextSwitches: 3.55K (3548) - TotalRawHdfsReadTime(*): 129.817ms - TotalReadThroughput: 36.92 MB/sec Averaged Fragment F00:(Total: 6s810ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 206.94 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 23.13 MB completion times: min:6s960ms max:7s356ms mean: 7s181ms stddev:164.820ms execution rates: min:29.73 MB/sec max:35.42 MB/sec mean:33.32 MB/sec stddev:2.55 MB/sec num instances: 3 - AverageThreadTokens: 3.19 - PeakMemoryUsage: 635.93 MB (666816528) - PerHostPeakMemUsage: 1.77 GB (1900795994) - PrepareTime: 333.128ms - RowsProduced: 25.29K (25290) - TotalCpuTime: 19s688ms - TotalNetworkReceiveTime: 4s108ms - TotalNetworkSendTime: 15.278ms - TotalStorageWaitTime: 153.148ms CodeGen:(Total: 968.428ms, non-child: 968.428ms, % non-child: 100.00%) - CodegenTime: 7.216ms - CompileTime: 62.506ms - LoadTime: 62.540us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 649.363ms - PrepareTime: 255.412ms DataStreamSender (dst_id=16):(Total: 138.700ms, non-child: 138.700ms, % non-child: 100.00%) - BytesSent: 2.32 MB (2432830) - NetworkThroughput(*): 28.33 MB/sec - OverallThroughput: 16.70 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 56.692ms - ThriftTransmitTime(*): 81.913ms - UncompressedRowBatchSize: 5.09 MB (5339865) HASH_JOIN_NODE (id=8):(Total: 6s707ms, non-child: 206.901ms, % non-child: 3.08%) - BuildPartitionTime: 5.399us - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 6.601us - GetNewBlockTime: 501.986us - HashBuckets: 2 - LargestPartitionPercent: 100 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 8.59 MB (9003024) - PinTime: 0ns - ProbeRows: 609.64K (609637) - ProbeRowsPartitioned: 0 - ProbeTime: 44.563ms - RowsReturned: 25.29K (25290) - RowsReturnedRate: 3.77 K/sec - SpilledPartitions: 0 - UnpinTime: 10.562us EXCHANGE_NODE (id=15):(Total: 176.4ms, non-child: 176.4ms, % non-child: 100.00%) - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 1.453us - DeserializeRowBatchTimer: 9.698us - FirstBatchArrivalWaitTime: 175.947ms - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 25.85 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 6s324ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 228.622ms - BuildRows: 729.41K (729413) - BuildRowsPartitioned: 729.41K (729413) - BuildTime: 658.833ms - GetNewBlockTime: 2.730ms - HashBuckets: 2.10M (2097152) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 566.03 MB (593526784) - PinTime: 0ns - ProbeRows: 1.26M (1264432) - ProbeRowsPartitioned: 0 - ProbeTime: 162.811ms - RowsReturned: 609.64K (609637) - RowsReturnedRate: 96.34 K/sec - SpilledPartitions: 0 - UnpinTime: 10.175us EXCHANGE_NODE (id=14):(Total: 2s722ms, non-child: 2s722ms, % non-child: 100.00%) - BytesReceived: 11.04 MB (11577831) - ConvertRowBatchTime: 122.637ms - DeserializeRowBatchTimer: 228.196ms - FirstBatchArrivalWaitTime: 629.513ms - PeakMemoryUsage: 0 - RowsReturned: 729.41K (729413) - RowsReturnedRate: 268.57 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 3s605ms, non-child: 412.575ms, % non-child: 11.44%) - BuildPartitionTime: 2.979ms - BuildRows: 10.00K (10000) - BuildRowsPartitioned: 10.00K (10000) - BuildTime: 4.603ms - GetNewBlockTime: 246.259us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 12.43 MB (13033472) - PinTime: 0ns - ProbeRows: 1.26M (1264432) - ProbeRowsPartitioned: 0 - ProbeTime: 345.427ms - RowsReturned: 1.26M (1264432) - RowsReturnedRate: 351.73 K/sec - SpilledPartitions: 0 - UnpinTime: 10.372us EXCHANGE_NODE (id=13):(Total: 1s339ms, non-child: 1s339ms, % non-child: 100.00%) - BytesReceived: 207.55 KB (212530) - ConvertRowBatchTime: 1.625ms - DeserializeRowBatchTimer: 3.507ms - FirstBatchArrivalWaitTime: 1s299ms - PeakMemoryUsage: 0 - RowsReturned: 10.00K (10000) - RowsReturnedRate: 7.55 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1s854ms, non-child: 1s854ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.72 - BytesRead: 239.65 MB (251289064) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.65 MB (251288040) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.65 MB (251288040) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.38 MB (68558848) - PerReadThreadRawHdfsThroughput: 1.73 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.00M (2000405) - RowsReturned: 1.26M (1264432) - RowsReturnedRate: 683.25 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 2.70K (2698) - ScannerThreadsTotalWallClockTime: 10s990ms - DelimiterParseTime: 3s054ms - MaterializeTupleTime(*): 552.345ms - ScannerThreadsSysTime: 4.0ms - ScannerThreadsUserTime: 2s820ms - ScannerThreadsVoluntaryContextSwitches: 135 - TotalRawHdfsReadTime(*): 135.354ms - TotalReadThroughput: 33.04 MB/sec Averaged Fragment F03:(Total: 472.466ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 2.15 KB, max: 2.15 KB, avg: 2.15 KB, stddev: 0 completion times: min:926.467ms max:926.467ms mean: 926.467ms stddev:0ns execution rates: min:2.32 KB/sec max:2.32 KB/sec mean:2.32 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 64.98 KB (66544) - PerHostPeakMemUsage: 183.26 MB (192163744) - PrepareTime: 421.219ms - RowsProduced: 1 - TotalCpuTime: 876.346ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 379.731us - TotalStorageWaitTime: 16.665ms CodeGen:(Total: 786.643ms, non-child: 786.643ms, % non-child: 100.00%) - CodegenTime: 3.355ms - CompileTime: 6.238ms - LoadTime: 76.167us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 362.567ms - PrepareTime: 416.756ms DataStreamSender (dst_id=15):(Total: 78.671us, non-child: 78.671us, % non-child: 100.00%) - BytesSent: 135.00 B (135) - NetworkThroughput(*): 162.62 KB/sec - OverallThroughput: 1.64 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 10.404us - ThriftTransmitTime(*): 810.682us - UncompressedRowBatchSize: 144.00 B (144) HDFS_SCAN_NODE (id=3):(Total: 443.178ms, non-child: 443.178ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.15 KB (2199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.15 KB (2199) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.15 KB (2199) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 41.00 KB (41984) - PerReadThreadRawHdfsThroughput: 17.01 MB/sec - RemoteScanRanges: 0 - RowsRead: 25 - RowsReturned: 1 - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 21.519ms - DelimiterParseTime: 9.881us - MaterializeTupleTime(*): 2.485us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 123.270us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 1s991ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 34.56 MB, max: 128.00 MB, avg: 81.28 MB, stddev: 46.72 MB completion times: min:1s428ms max:2s794ms mean: 2s111ms stddev:682.771ms execution rates: min:24.19 MB/sec max:45.81 MB/sec mean:35.00 MB/sec stddev:10.81 MB/sec num instances: 2 - AverageThreadTokens: 1.58 - PeakMemoryUsage: 32.16 MB (33722368) - PerHostPeakMemUsage: 1.26 GB (1353909168) - PrepareTime: 318.570ms - RowsProduced: 364.71K (364706) - TotalCpuTime: 4s019ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 14.602ms - TotalStorageWaitTime: 73.991ms CodeGen:(Total: 765.568ms, non-child: 765.568ms, % non-child: 100.00%) - CodegenTime: 2.572ms - CompileTime: 20.181ms - LoadTime: 69.986us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 429.413ms - PrepareTime: 314.652ms DataStreamSender (dst_id=14):(Total: 217.898ms, non-child: 217.898ms, % non-child: 100.00%) - BytesSent: 16.56 MB (17366758) - NetworkThroughput(*): 18.45 MB/sec - OverallThroughput: 78.76 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 199.344ms - ThriftTransmitTime(*): 867.234ms - UncompressedRowBatchSize: 38.61 MB (40486735) HDFS_SCAN_NODE (id=2):(Total: 1s744ms, non-child: 1s744ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 81.28 MB (85226592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.28 MB (85226592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.28 MB (85226592) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 32.12 MB (33681408) - PerReadThreadRawHdfsThroughput: 1.97 GB/sec - RemoteScanRanges: 0 - RowsRead: 750.00K (750000) - RowsReturned: 364.71K (364706) - RowsReturnedRate: 190.72 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1095) - ScannerThreadsTotalWallClockTime: 1s631ms - DelimiterParseTime: 700.236ms - MaterializeTupleTime(*): 87.472ms - ScannerThreadsSysTime: 2.0ms - ScannerThreadsUserTime: 520.32ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 37.176ms - TotalReadThroughput: 28.63 MB/sec Averaged Fragment F01:(Total: 580.468ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 1.33 MB, max: 1.33 MB, avg: 1.33 MB, stddev: 0 completion times: min:696.700ms max:696.700ms mean: 696.700ms stddev:0ns execution rates: min:1.92 MB/sec max:1.92 MB/sec mean:1.92 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 2.30 MB (2408448) - PerHostPeakMemUsage: 705.85 MB (740140992) - PrepareTime: 427.73ms - RowsProduced: 10.00K (10000) - TotalCpuTime: 1s200ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.125ms - TotalStorageWaitTime: 61.116ms CodeGen:(Total: 996.881ms, non-child: 996.881ms, % non-child: 100.00%) - CodegenTime: 2.792ms - CompileTime: 18.999ms - LoadTime: 73.770us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 553.258ms - PrepareTime: 423.495ms DataStreamSender (dst_id=13):(Total: 16.839ms, non-child: 16.839ms, % non-child: 100.00%) - BytesSent: 622.66 KB (637602) - NetworkThroughput(*): 32.54 MB/sec - OverallThroughput: 36.11 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 6.575ms - ThriftTransmitTime(*): 18.684ms - UncompressedRowBatchSize: 1.55 MB (1620132) HDFS_SCAN_NODE (id=0):(Total: 508.179ms, non-child: 508.179ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.33 MB (1399184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.33 MB (1399184) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.33 MB (1399184) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.24 MB (2347008) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 - RowsRead: 10.00K (10000) - RowsReturned: 10.00K (10000) - RowsReturnedRate: 19.68 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 69.6ms - DelimiterParseTime: 5.300ms - MaterializeTupleTime(*): 1.36ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 4.0ms - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 906.712us - TotalReadThroughput: 0.00 /sec Fragment F07: Instance 94da567a47606a7:70ad12d88de198d (host=desk:22001):(Total: 9s034ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.31 MB (6619136) - PerHostPeakMemUsage: 1.74 GB (1871861984) - PrepareTime: 139.603ms - RowsProduced: 100 - TotalCpuTime: 421.91ms - TotalNetworkReceiveTime: 8s890ms - TotalNetworkSendTime: 144.457us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 802 - BlocksRecycled: 287 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.08 GB (21564157952) - PeakMemoryUsage: 1.56 GB (1678245888) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 411.555ms, non-child: 411.555ms, % non-child: 100.00%) - CodegenTime: 3.743ms - CompileTime: 10.978ms - LoadTime: 53.114us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 265.432ms - PrepareTime: 134.82ms DataStreamSender (dst_id=21):(Total: 76.171us, non-child: 76.171us, % non-child: 100.00%) - BytesSent: 1.95 KB (1996) - NetworkThroughput(*): 16.86 MB/sec - OverallThroughput: 24.99 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 39.549us - ThriftTransmitTime(*): 112.930us - UncompressedRowBatchSize: 5.28 KB (5404) SORT_NODE (id=12):(Total: 9s034ms, non-child: 1.874ms, % non-child: 0.02%) - PeakMemoryUsage: 20.00 KB (20480) - RowsReturned: 100 - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=20):(Total: 9s032ms, non-child: 141.559ms, % non-child: 1.57%) ExecOption: Codegen Enabled - BuildTime: 161.147us - GetNewBlockTime: 175.395us - GetResultsTime: 173.457us - HashBuckets: 31.74K (31744) - LargestPartitionPercent: 2 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.29 MB (6598656) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 135 - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 - UnpinTime: 7.452us EXCHANGE_NODE (id=19):(Total: 8s890ms, non-child: 161.758us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 7.05 KB (7224) - ConvertRowBatchTime: 63.92us - DeserializeRowBatchTimer: 104.95us - FirstBatchArrivalWaitTime: 8s748ms - PeakMemoryUsage: 0 - RowsReturned: 395 - RowsReturnedRate: 44.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 94da567a47606a7:70ad12d88de198b (host=desk:22002):(Total: 9s031ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.31 MB (6619136) - PerHostPeakMemUsage: 1.78 GB (1909530384) - PrepareTime: 139.616ms - RowsProduced: 100 - TotalCpuTime: 423.460ms - TotalNetworkReceiveTime: 8s887ms - TotalNetworkSendTime: 155.287us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 802 - BlocksRecycled: 287 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.08 GB (21564157952) - PeakMemoryUsage: 1.56 GB (1678245888) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 414.108ms, non-child: 414.108ms, % non-child: 100.00%) - CodegenTime: 3.733ms - CompileTime: 9.988ms - LoadTime: 49.459us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 268.919ms - PrepareTime: 134.114ms DataStreamSender (dst_id=21):(Total: 104.8us, non-child: 104.8us, % non-child: 100.00%) - BytesSent: 1.96 KB (2003) - NetworkThroughput(*): 16.53 MB/sec - OverallThroughput: 18.37 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 66.403us - ThriftTransmitTime(*): 115.588us - UncompressedRowBatchSize: 5.28 KB (5404) SORT_NODE (id=12):(Total: 9s030ms, non-child: 1.928ms, % non-child: 0.02%) - PeakMemoryUsage: 20.00 KB (20480) - RowsReturned: 100 - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=20):(Total: 9s028ms, non-child: 141.361ms, % non-child: 1.57%) ExecOption: Codegen Enabled - BuildTime: 108.139us - GetNewBlockTime: 183.313us - GetResultsTime: 159.303us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 2 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.29 MB (6598656) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 132 - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 - UnpinTime: 7.605us EXCHANGE_NODE (id=19):(Total: 8s887ms, non-child: 150.282us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.96 KB (7128) - ConvertRowBatchTime: 55.334us - DeserializeRowBatchTimer: 121.148us - FirstBatchArrivalWaitTime: 8s744ms - PeakMemoryUsage: 0 - RowsReturned: 385 - RowsReturnedRate: 43.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 94da567a47606a7:70ad12d88de198c (host=desk:22000):(Total: 9s025ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB, 6.27 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.31 MB (6619136) - PerHostPeakMemUsage: 1.79 GB (1920995616) - PrepareTime: 139.724ms - RowsProduced: 100 - TotalCpuTime: 427.730ms - TotalNetworkReceiveTime: 8s882ms - TotalNetworkSendTime: 195.385us - TotalStorageWaitTime: 0ns CodeGen:(Total: 419.473ms, non-child: 419.473ms, % non-child: 100.00%) - CodegenTime: 3.721ms - CompileTime: 21.11ms - LoadTime: 20.285us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 263.119ms - PrepareTime: 134.230ms DataStreamSender (dst_id=21):(Total: 85.697us, non-child: 85.697us, % non-child: 100.00%) - BytesSent: 1.91 KB (1958) - NetworkThroughput(*): 13.66 MB/sec - OverallThroughput: 21.79 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 40.186us - ThriftTransmitTime(*): 136.709us - UncompressedRowBatchSize: 5.28 KB (5404) SORT_NODE (id=12):(Total: 9s025ms, non-child: 1.411ms, % non-child: 0.02%) - PeakMemoryUsage: 20.00 KB (20480) - RowsReturned: 100 - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=20):(Total: 9s023ms, non-child: 140.996ms, % non-child: 1.56%) ExecOption: Codegen Enabled - BuildTime: 129.605us - GetNewBlockTime: 179.331us - GetResultsTime: 114.83us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.29 MB (6598656) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 144 - RowsReturnedRate: 15.00 /sec - SpilledPartitions: 0 - UnpinTime: 7.859us EXCHANGE_NODE (id=19):(Total: 8s882ms, non-child: 178.198us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 7.33 KB (7502) - ConvertRowBatchTime: 49.853us - DeserializeRowBatchTimer: 111.550us - FirstBatchArrivalWaitTime: 8s739ms - PeakMemoryUsage: 0 - RowsReturned: 416 - RowsReturnedRate: 46.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F05: Instance 94da567a47606a7:70ad12d88de1990 (host=desk:22001):(Total: 8s834ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.33 MB, 10.37 MB, 46.50 MB, 46.48 MB, 558.40 MB, 558.43 MB, 558.42 MB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.11 GB, 1.22 GB, 1.21 GB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 2.83 - PeakMemoryUsage: 1.45 GB (1559301472) - PerHostPeakMemUsage: 1.74 GB (1871861984) - PrepareTime: 232.491ms - RowsProduced: 395 - TotalCpuTime: 16s801ms - TotalNetworkReceiveTime: 18s358ms - TotalNetworkSendTime: 655.440us - TotalStorageWaitTime: 0ns CodeGen:(Total: 540.325ms, non-child: 540.325ms, % non-child: 100.00%) - CodegenTime: 4.531ms - CompileTime: 33.744ms - LoadTime: 24.698us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 295.289ms - PrepareTime: 210.330ms DataStreamSender (dst_id=19):(Total: 253.748us, non-child: 253.748us, % non-child: 100.00%) - BytesSent: 7.03 KB (7202) - NetworkThroughput(*): 14.18 MB/sec - OverallThroughput: 27.07 MB/sec - PeakMemoryUsage: 36.00 KB (36864) - SerializeBatchTime: 152.568us - ThriftTransmitTime(*): 484.281us - UncompressedRowBatchSize: 20.84 KB (21342) AGGREGATION_NODE (id=11):(Total: 8s832ms, non-child: 212.594ms, % non-child: 2.41%) ExecOption: Codegen Enabled - BuildTime: 2.98ms - GetNewBlockTime: 288.275us - GetResultsTime: 163.66us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 11.47 MB (12026184) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 395 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 12.280us HASH_JOIN_NODE (id=10):(Total: 8s620ms, non-child: 1s575ms, % non-child: 18.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 530.653ms - BuildRows: 1.26M (1263636) - BuildRowsPartitioned: 1.26M (1263636) - BuildTime: 426.335ms - GetNewBlockTime: 1.302ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 24.08K (24084) - ProbeRowsPartitioned: 0 - ProbeTime: 8.121ms - RowsReturned: 1.33K (1329) - RowsReturnedRate: 154.00 /sec - SpilledPartitions: 0 - UnpinTime: 11.93us EXCHANGE_NODE (id=18):(Total: 7s370ms, non-child: 287.978ms, % non-child: 3.91%) BytesReceived(500.0ms): 0, 162.33 KB, 2.93 MB, 5.64 MB, 8.53 MB, 11.02 MB, 13.23 MB, 16.58 MB, 20.05 MB, 23.18 MB, 26.50 MB, 29.56 MB, 32.32 MB, 35.31 MB, 37.47 MB, 39.84 MB, 41.69 MB, 42.49 MB - BytesReceived: 42.49 MB (44552454) - ConvertRowBatchTime: 208.216ms - DeserializeRowBatchTimer: 562.908ms - FirstBatchArrivalWaitTime: 197.931ms - PeakMemoryUsage: 0 - RowsReturned: 1.26M (1263636) - RowsReturnedRate: 171.46 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 8s248ms, non-child: 4s865ms, % non-child: 58.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 375.537ms - BuildRows: 2.00M (1998412) - BuildRowsPartitioned: 2.00M (1998412) - BuildTime: 1s011ms - GetNewBlockTime: 2.123ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 24.99K (24987) - ProbeRowsPartitioned: 0 - ProbeTime: 8.879ms - RowsReturned: 24.08K (24084) - RowsReturnedRate: 2.92 K/sec - SpilledPartitions: 0 - UnpinTime: 10.763us EXCHANGE_NODE (id=17):(Total: 6s594ms, non-child: 406.256ms, % non-child: 6.16%) BytesReceived(500.0ms): 0, 0, 1.53 MB, 3.64 MB, 5.94 MB, 7.94 MB, 9.97 MB, 12.63 MB, 15.26 MB, 18.19 MB, 20.93 MB, 23.62 MB, 25.22 MB, 26.80 MB, 28.51 MB, 29.23 MB, 29.23 MB, 29.23 MB - BytesReceived: 29.23 MB (30649352) - ConvertRowBatchTime: 356.448ms - DeserializeRowBatchTimer: 164.607ms - FirstBatchArrivalWaitTime: 394.599ms - PeakMemoryUsage: 0 - RowsReturned: 2.00M (1998412) - RowsReturnedRate: 303.02 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns EXCHANGE_NODE (id=16):(Total: 5s015ms, non-child: 3.810ms, % non-child: 0.08%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 106.62 KB, 466.23 KB, 870.19 KB, 1.35 MB, 1.79 MB, 2.23 MB, 2.29 MB - BytesReceived: 2.29 MB (2403206) - ConvertRowBatchTime: 2.606ms - DeserializeRowBatchTimer: 31.447ms - FirstBatchArrivalWaitTime: 5s011ms - PeakMemoryUsage: 0 - RowsReturned: 24.99K (24987) - RowsReturnedRate: 4.98 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 94da567a47606a7:70ad12d88de198f (host=desk:22000):(Total: 8s806ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.33 MB, 10.37 MB, 46.45 MB, 46.43 MB, 558.45 MB, 558.45 MB, 558.43 MB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.09 GB, 1.18 GB, 1.24 GB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 2.83 - PeakMemoryUsage: 1.49 GB (1599579784) - PerHostPeakMemUsage: 1.79 GB (1920995616) - PrepareTime: 145.212ms - RowsProduced: 401 - TotalCpuTime: 16s986ms - TotalNetworkReceiveTime: 18s717ms - TotalNetworkSendTime: 678.16us - TotalStorageWaitTime: 0ns CodeGen:(Total: 437.630ms, non-child: 437.630ms, % non-child: 100.00%) - CodegenTime: 3.91ms - CompileTime: 21.984ms - LoadTime: 24.483us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 284.607ms - PrepareTime: 130.365ms DataStreamSender (dst_id=19):(Total: 233.822us, non-child: 233.822us, % non-child: 100.00%) - BytesSent: 7.17 KB (7345) - NetworkThroughput(*): 14.09 MB/sec - OverallThroughput: 29.96 MB/sec - PeakMemoryUsage: 36.00 KB (36864) - SerializeBatchTime: 154.939us - ThriftTransmitTime(*): 497.247us - UncompressedRowBatchSize: 21.16 KB (21666) AGGREGATION_NODE (id=11):(Total: 8s805ms, non-child: 133.107ms, % non-child: 1.51%) ExecOption: Codegen Enabled - BuildTime: 2.164ms - GetNewBlockTime: 175.547us - GetResultsTime: 154.794us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 10.87 MB (11398528) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 401 - RowsReturnedRate: 45.00 /sec - SpilledPartitions: 0 - UnpinTime: 7.860us HASH_JOIN_NODE (id=10):(Total: 8s672ms, non-child: 1s470ms, % non-child: 16.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 543.340ms - BuildRows: 1.27M (1265391) - BuildRowsPartitioned: 1.27M (1265391) - BuildTime: 395.752ms - GetNewBlockTime: 1.277ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 24.75K (24745) - ProbeRowsPartitioned: 0 - ProbeTime: 8.403ms - RowsReturned: 1.43K (1427) - RowsReturnedRate: 164.00 /sec - SpilledPartitions: 0 - UnpinTime: 10.223us EXCHANGE_NODE (id=18):(Total: 7s464ms, non-child: 308.780ms, % non-child: 4.14%) BytesReceived(500.0ms): 0, 162.61 KB, 2.89 MB, 5.65 MB, 8.57 MB, 11.08 MB, 13.30 MB, 16.63 MB, 20.10 MB, 23.22 MB, 26.52 MB, 29.57 MB, 32.31 MB, 35.33 MB, 37.54 MB, 39.89 MB, 41.75 MB, 42.55 MB - BytesReceived: 42.55 MB (44621994) - ConvertRowBatchTime: 210.630ms - DeserializeRowBatchTimer: 562.415ms - FirstBatchArrivalWaitTime: 307.66ms - PeakMemoryUsage: 0 - RowsReturned: 1.27M (1265391) - RowsReturnedRate: 169.52 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 8s371ms, non-child: 4s880ms, % non-child: 58.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 357.590ms - BuildRows: 2.00M (2003808) - BuildRowsPartitioned: 2.00M (2003808) - BuildTime: 1s020ms - GetNewBlockTime: 2.141ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 25.71K (25707) - ProbeRowsPartitioned: 0 - ProbeTime: 9.23ms - RowsReturned: 24.75K (24745) - RowsReturnedRate: 2.96 K/sec - SpilledPartitions: 0 - UnpinTime: 10.536us EXCHANGE_NODE (id=17):(Total: 6s719ms, non-child: 364.649ms, % non-child: 5.43%) BytesReceived(500.0ms): 0, 0, 1.51 MB, 3.67 MB, 5.97 MB, 8.00 MB, 10.01 MB, 12.64 MB, 15.28 MB, 18.23 MB, 20.97 MB, 23.67 MB, 25.30 MB, 26.90 MB, 28.57 MB, 29.31 MB, 29.31 MB, 29.31 MB - BytesReceived: 29.31 MB (30729478) - ConvertRowBatchTime: 324.231ms - DeserializeRowBatchTimer: 162.18ms - FirstBatchArrivalWaitTime: 502.79ms - PeakMemoryUsage: 0 - RowsReturned: 2.00M (2003808) - RowsReturnedRate: 298.20 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns EXCHANGE_NODE (id=16):(Total: 5s123ms, non-child: 3.915ms, % non-child: 0.08%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 117.44 KB, 486.45 KB, 890.59 KB, 1.38 MB, 1.85 MB, 2.29 MB, 2.36 MB - BytesReceived: 2.36 MB (2472624) - ConvertRowBatchTime: 2.611ms - DeserializeRowBatchTimer: 32.474ms - FirstBatchArrivalWaitTime: 5s119ms - PeakMemoryUsage: 0 - RowsReturned: 25.71K (25707) - RowsReturnedRate: 5.02 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 94da567a47606a7:70ad12d88de198e (host=desk:22002):(Total: 8s616ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.33 MB, 10.42 MB, 46.45 MB, 46.43 MB, 558.43 MB, 558.47 MB, 558.43 MB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.11 GB, 1.22 GB, 1.29 GB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 2.83 - PeakMemoryUsage: 1.46 GB (1569378224) - PerHostPeakMemUsage: 1.78 GB (1909530384) - PrepareTime: 145.233ms - RowsProduced: 400 - TotalCpuTime: 16s555ms - TotalNetworkReceiveTime: 18s406ms - TotalNetworkSendTime: 641.509us - TotalStorageWaitTime: 0ns CodeGen:(Total: 536.214ms, non-child: 536.214ms, % non-child: 100.00%) - CodegenTime: 3.87ms - CompileTime: 35.72ms - LoadTime: 24.510us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 370.304ms - PrepareTime: 130.70ms DataStreamSender (dst_id=19):(Total: 241.808us, non-child: 241.808us, % non-child: 100.00%) - BytesSent: 7.14 KB (7307) - NetworkThroughput(*): 14.74 MB/sec - OverallThroughput: 28.82 MB/sec - PeakMemoryUsage: 36.00 KB (36864) - SerializeBatchTime: 155.206us - ThriftTransmitTime(*): 472.912us - UncompressedRowBatchSize: 21.11 KB (21612) AGGREGATION_NODE (id=11):(Total: 8s615ms, non-child: 132.731ms, % non-child: 1.54%) ExecOption: Codegen Enabled - BuildTime: 2.152ms - GetNewBlockTime: 180.444us - GetResultsTime: 156.322us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 1 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 11.47 MB (12026184) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 400 - RowsReturnedRate: 46.00 /sec - SpilledPartitions: 0 - UnpinTime: 8.59us HASH_JOIN_NODE (id=10):(Total: 8s483ms, non-child: 1s411ms, % non-child: 16.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 530.630ms - BuildRows: 1.26M (1264269) - BuildRowsPartitioned: 1.26M (1264269) - BuildTime: 330.255ms - GetNewBlockTime: 1.336ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 24.26K (24260) - ProbeRowsPartitioned: 0 - ProbeTime: 8.325ms - RowsReturned: 1.39K (1385) - RowsReturnedRate: 163.00 /sec - SpilledPartitions: 0 - UnpinTime: 11.204us EXCHANGE_NODE (id=18):(Total: 7s382ms, non-child: 284.726ms, % non-child: 3.86%) BytesReceived(500.0ms): 0, 152.36 KB, 2.87 MB, 5.58 MB, 8.49 MB, 10.98 MB, 13.22 MB, 16.57 MB, 20.01 MB, 23.16 MB, 26.48 MB, 29.53 MB, 32.28 MB, 35.30 MB, 37.50 MB, 39.84 MB, 41.69 MB, 42.51 MB - BytesReceived: 42.51 MB (44576037) - ConvertRowBatchTime: 207.802ms - DeserializeRowBatchTimer: 563.453ms - FirstBatchArrivalWaitTime: 211.487ms - PeakMemoryUsage: 0 - RowsReturned: 1.26M (1264269) - RowsReturnedRate: 171.26 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 8s133ms, non-child: 4s627ms, % non-child: 56.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 362.198ms - BuildRows: 2.00M (1998995) - BuildRowsPartitioned: 2.00M (1998995) - BuildTime: 930.170ms - GetNewBlockTime: 1.629ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 838.05 MB (878755840) - PinTime: 0ns - ProbeRows: 25.18K (25177) - ProbeRowsPartitioned: 0 - ProbeTime: 9.10ms - RowsReturned: 24.26K (24260) - RowsReturnedRate: 2.98 K/sec - SpilledPartitions: 0 - UnpinTime: 11.15us EXCHANGE_NODE (id=17):(Total: 6s591ms, non-child: 371.493ms, % non-child: 5.64%) BytesReceived(500.0ms): 0, 0, 1.49 MB, 3.62 MB, 5.92 MB, 7.93 MB, 9.96 MB, 12.59 MB, 15.25 MB, 18.17 MB, 20.87 MB, 23.62 MB, 25.25 MB, 26.83 MB, 28.51 MB, 29.24 MB, 29.24 MB, 29.24 MB - BytesReceived: 29.24 MB (30663143) - ConvertRowBatchTime: 330.617ms - DeserializeRowBatchTimer: 165.94ms - FirstBatchArrivalWaitTime: 408.952ms - PeakMemoryUsage: 0 - RowsReturned: 2.00M (1998995) - RowsReturnedRate: 303.25 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns EXCHANGE_NODE (id=16):(Total: 5s026ms, non-child: 3.865ms, % non-child: 0.08%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 106.12 KB, 476.59 KB, 880.65 KB, 1.34 MB, 1.81 MB, 2.25 MB, 2.31 MB - BytesReceived: 2.31 MB (2422661) - ConvertRowBatchTime: 2.561ms - DeserializeRowBatchTimer: 31.837ms - FirstBatchArrivalWaitTime: 5s022ms - PeakMemoryUsage: 0 - RowsReturned: 25.18K (25177) - RowsReturnedRate: 5.01 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F06: Instance 94da567a47606a7:70ad12d88de1992 (host=desk:22000):(Total: 7s999ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 0, 8.15 MB, 65.61 MB, 49.50 MB, 49.46 MB, 49.54 MB, 57.52 MB, 57.54 MB, 49.52 MB, 49.49 MB, 49.54 MB, 49.52 MB, 49.52 MB, 49.52 MB, 49.51 MB, 49.63 MB, 17.52 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 2.88 - PeakMemoryUsage: 65.75 MB (68947968) - PerHostPeakMemUsage: 1.79 GB (1920995616) - PrepareTime: 247.834ms - RowsProduced: 1.35M (1349046) - TotalCpuTime: 23s162ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 69.467ms - TotalStorageWaitTime: 446.35ms CodeGen:(Total: 438.18ms, non-child: 438.18ms, % non-child: 100.00%) - CodegenTime: 3.407ms - CompileTime: 5.958ms - LoadTime: 73.427us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 209.374ms - PrepareTime: 221.611ms DataStreamSender (dst_id=18):(Total: 4s757ms, non-child: 4s757ms, % non-child: 100.00%) - BytesSent: 45.28 MB (47480382) - NetworkThroughput(*): 27.76 MB/sec - OverallThroughput: 9.52 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 1s359ms - ThriftTransmitTime(*): 1s631ms - UncompressedRowBatchSize: 102.94 MB (107942164) HDFS_SCAN_NODE (id=5):(Total: 3s233ms, non-child: 3s233ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 0, 64.00 MB, 64.00 MB, 80.00 MB, 96.00 MB, 112.00 MB, 128.00 MB, 144.00 MB, 160.00 MB, 176.00 MB, 192.00 MB, 208.00 MB, 224.00 MB, 240.00 MB, 256.00 MB, 256.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268437504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268437504) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.66 MB (68853760) - PerReadThreadRawHdfsThroughput: 1.91 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.13M (2133979) - RowsReturned: 1.35M (1349046) - RowsReturnedRate: 417.16 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 88 - ScannerThreadsTotalWallClockTime: 15s449ms - DelimiterParseTime: 2s137ms - MaterializeTupleTime(*): 317.965ms - ScannerThreadsSysTime: 4.0ms - ScannerThreadsUserTime: 2s420ms - ScannerThreadsVoluntaryContextSwitches: 2.49K (2491) - TotalRawHdfsReadTime(*): 130.835ms - TotalReadThroughput: 30.11 MB/sec Instance 94da567a47606a7:70ad12d88de1991 (host=desk:22002):(Total: 7s533ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 0, 41.50 MB, 49.51 MB, 49.52 MB, 57.50 MB, 49.50 MB, 49.46 MB, 57.63 MB, 57.50 MB, 57.54 MB, 49.50 MB, 49.52 MB, 49.44 MB, 57.52 MB, 33.51 MB, 17.50 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 2.88 - PeakMemoryUsage: 65.54 MB (68718592) - PerHostPeakMemUsage: 1.78 GB (1909530384) - PrepareTime: 231.7ms - RowsProduced: 1.35M (1354407) - TotalCpuTime: 21s997ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 114.86ms - TotalStorageWaitTime: 207.477ms CodeGen:(Total: 412.674ms, non-child: 412.674ms, % non-child: 100.00%) - CodegenTime: 2.673ms - CompileTime: 5.513ms - LoadTime: 66.980us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 198.751ms - PrepareTime: 207.308ms DataStreamSender (dst_id=18):(Total: 4s668ms, non-child: 4s668ms, % non-child: 100.00%) - BytesSent: 45.13 MB (47326395) - NetworkThroughput(*): 28.60 MB/sec - OverallThroughput: 9.67 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 1s398ms - ThriftTransmitTime(*): 1s578ms - UncompressedRowBatchSize: 103.35 MB (108371120) HDFS_SCAN_NODE (id=5):(Total: 2s858ms, non-child: 2s858ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:86.67% 1:13.33% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 32.00 MB, 64.00 MB, 80.00 MB, 104.00 MB, 112.00 MB, 128.00 MB, 144.00 MB, 168.00 MB, 184.00 MB, 200.00 MB, 216.00 MB, 232.00 MB, 256.00 MB, 256.00 MB, 256.00 MB - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268437504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268437504) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.45 MB (68624384) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.14M (2142543) - RowsReturned: 1.35M (1354407) - RowsReturnedRate: 473.75 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 138 - ScannerThreadsTotalWallClockTime: 14s490ms - DelimiterParseTime: 2s113ms - MaterializeTupleTime(*): 320.620ms - ScannerThreadsSysTime: 24.0ms - ScannerThreadsUserTime: 2s392ms - ScannerThreadsVoluntaryContextSwitches: 2.48K (2479) - TotalRawHdfsReadTime(*): 156.956ms - TotalReadThroughput: 31.99 MB/sec Instance 94da567a47606a7:70ad12d88de1993 (host=desk:22001):(Total: 6s176ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB MemoryUsage(500.0ms): 0, 8.15 MB, 65.62 MB, 65.64 MB, 49.47 MB, 49.54 MB, 57.60 MB, 49.51 MB, 57.52 MB, 49.50 MB, 33.47 MB, 33.43 MB, 17.43 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 2.62 - PeakMemoryUsage: 65.64 MB (68833280) - PerHostPeakMemUsage: 1.74 GB (1871861984) - PrepareTime: 220.866ms - RowsProduced: 1.09M (1089843) - TotalCpuTime: 16s498ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 48.630ms - TotalStorageWaitTime: 301.978ms CodeGen:(Total: 412.871ms, non-child: 412.871ms, % non-child: 100.00%) - CodegenTime: 2.209ms - CompileTime: 5.628ms - LoadTime: 18.958us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 206.614ms - PrepareTime: 199.710ms DataStreamSender (dst_id=18):(Total: 3s903ms, non-child: 3s903ms, % non-child: 100.00%) - BytesSent: 37.14 MB (38943708) - NetworkThroughput(*): 28.34 MB/sec - OverallThroughput: 9.51 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 1s143ms - ThriftTransmitTime(*): 1s310ms - UncompressedRowBatchSize: 83.16 MB (87202376) HDFS_SCAN_NODE (id=5):(Total: 2s268ms, non-child: 2s268ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 0, 64.00 MB, 80.00 MB, 96.00 MB, 112.00 MB, 128.00 MB, 144.00 MB, 166.94 MB, 174.94 MB, 182.94 MB, 198.94 MB, 206.94 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.75 - BytesRead: 206.94 MB (216992184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 206.94 MB (216992184) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 206.94 MB (216992184) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.55 MB (68739072) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 - RowsRead: 1.72M (1724693) - RowsReturned: 1.09M (1089843) - RowsReturnedRate: 480.44 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 342 - ScannerThreadsTotalWallClockTime: 10s448ms - DelimiterParseTime: 1s781ms - MaterializeTupleTime(*): 270.198ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 1s960ms - ScannerThreadsVoluntaryContextSwitches: 1.90K (1897) - TotalRawHdfsReadTime(*): 107.864ms - TotalReadThroughput: 31.83 MB/sec Fragment F04: Instance 94da567a47606a7:70ad12d88de1995 (host=desk:22000):(Total: 6s790ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 23.98 KB, 56.78 MB, 48.82 MB, 48.81 MB, 48.82 MB, 48.82 MB, 48.78 MB, 48.78 MB, 48.85 MB, 48.80 MB, 48.82 MB, 48.78 MB, 32.77 MB, 16.80 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 2.86 - PeakMemoryUsage: 64.84 MB (67993488) - PerHostPeakMemUsage: 1.79 GB (1920995616) - PrepareTime: 156.453ms - RowsProduced: 2.13M (2133979) - TotalCpuTime: 20s104ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 11.686ms - TotalStorageWaitTime: 107.345ms CodeGen:(Total: 369.378ms, non-child: 369.378ms, % non-child: 100.00%) - CodegenTime: 1.123ms - CompileTime: 7.801ms - LoadTime: 59.189us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 206.261ms - PrepareTime: 154.489ms DataStreamSender (dst_id=17):(Total: 3s792ms, non-child: 3s792ms, % non-child: 100.00%) - BytesSent: 31.19 MB (32705334) - NetworkThroughput(*): 30.63 MB/sec - OverallThroughput: 8.22 MB/sec - PeakMemoryUsage: 111.89 KB (114576) - SerializeBatchTime: 1s053ms - ThriftTransmitTime(*): 1s018ms - UncompressedRowBatchSize: 57.00 MB (59763936) HDFS_SCAN_NODE (id=4):(Total: 2s984ms, non-child: 2s984ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:7.692% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 64.00 MB, 72.00 MB, 88.00 MB, 104.00 MB, 120.00 MB, 144.00 MB, 160.00 MB, 192.00 MB, 208.00 MB, 232.00 MB, 248.00 MB, 256.00 MB, 256.00 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268437504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268437504) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 64.73 MB (67870720) - PerReadThreadRawHdfsThroughput: 2.00 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.13M (2133979) - RowsReturned: 2.13M (2133979) - RowsReturnedRate: 715.03 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 112 - ScannerThreadsTotalWallClockTime: 13s175ms - DelimiterParseTime: 2s110ms - MaterializeTupleTime(*): 274.244ms - ScannerThreadsSysTime: 20.1ms - ScannerThreadsUserTime: 2s348ms - ScannerThreadsVoluntaryContextSwitches: 3.95K (3951) - TotalRawHdfsReadTime(*): 124.756ms - TotalReadThroughput: 36.57 MB/sec Instance 94da567a47606a7:70ad12d88de1994 (host=desk:22002):(Total: 6s763ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 23.98 KB, 56.78 MB, 48.80 MB, 48.81 MB, 48.82 MB, 48.80 MB, 48.79 MB, 48.80 MB, 48.80 MB, 48.80 MB, 48.77 MB, 48.82 MB, 32.79 MB, 16.75 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 2.86 - PeakMemoryUsage: 64.84 MB (67993488) - PerHostPeakMemUsage: 1.78 GB (1909530384) - PrepareTime: 204.768ms - RowsProduced: 2.14M (2142543) - TotalCpuTime: 19s945ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 21.471ms - TotalStorageWaitTime: 53.179ms CodeGen:(Total: 435.295ms, non-child: 435.295ms, % non-child: 100.00%) - CodegenTime: 1.180ms - CompileTime: 4.25ms - LoadTime: 74.194us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 227.702ms - PrepareTime: 202.517ms DataStreamSender (dst_id=17):(Total: 3s706ms, non-child: 3s706ms, % non-child: 100.00%) - BytesSent: 31.28 MB (32803637) - NetworkThroughput(*): 30.81 MB/sec - OverallThroughput: 8.44 MB/sec - PeakMemoryUsage: 111.89 KB (114576) - SerializeBatchTime: 1s090ms - ThriftTransmitTime(*): 1s015ms - UncompressedRowBatchSize: 57.22 MB (60003776) HDFS_SCAN_NODE (id=4):(Total: 3s046ms, non-child: 3s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 64.00 MB, 64.00 MB, 96.00 MB, 112.00 MB, 128.00 MB, 144.00 MB, 160.00 MB, 192.00 MB, 208.00 MB, 232.00 MB, 248.00 MB, 256.00 MB, 256.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268437504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268437504) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 64.73 MB (67870720) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 703.31 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 142 - ScannerThreadsTotalWallClockTime: 13s005ms - DelimiterParseTime: 2s084ms - MaterializeTupleTime(*): 261.945ms - ScannerThreadsSysTime: 16.1ms - ScannerThreadsUserTime: 2s312ms - ScannerThreadsVoluntaryContextSwitches: 4.05K (4053) - TotalRawHdfsReadTime(*): 146.311ms - TotalReadThroughput: 36.56 MB/sec Instance 94da567a47606a7:70ad12d88de1996 (host=desk:22001):(Total: 5s134ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB MemoryUsage(500.0ms): 23.98 KB, 56.78 MB, 48.85 MB, 48.80 MB, 48.81 MB, 48.82 MB, 48.82 MB, 40.82 MB, 32.77 MB, 24.34 MB, 8.15 MB ThreadUsage(500.0ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 2.64 - PeakMemoryUsage: 64.84 MB (67993488) - PerHostPeakMemUsage: 1.74 GB (1871861984) - PrepareTime: 159.12ms - RowsProduced: 1.72M (1724693) - TotalCpuTime: 14s098ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 94.349ms - TotalStorageWaitTime: 131.757ms CodeGen:(Total: 452.298ms, non-child: 452.298ms, % non-child: 100.00%) - CodegenTime: 1.207ms - CompileTime: 6.50ms - LoadTime: 29.870us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 288.453ms - PrepareTime: 157.30ms DataStreamSender (dst_id=17):(Total: 2s919ms, non-child: 2s919ms, % non-child: 100.00%) - BytesSent: 25.30 MB (26533002) - NetworkThroughput(*): 30.70 MB/sec - OverallThroughput: 8.67 MB/sec - PeakMemoryUsage: 111.89 KB (114576) - SerializeBatchTime: 808.40ms - ThriftTransmitTime(*): 824.105ms - UncompressedRowBatchSize: 46.06 MB (48301528) HDFS_SCAN_NODE (id=4):(Total: 2s207ms, non-child: 2s207ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 64.00 MB, 80.00 MB, 96.00 MB, 112.00 MB, 128.00 MB, 152.00 MB, 166.94 MB, 182.94 MB, 198.94 MB, 206.94 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.80 - BytesRead: 206.94 MB (216992184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 206.94 MB (216992184) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 206.94 MB (216992184) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 64.73 MB (67870720) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 781.41 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 391 - ScannerThreadsTotalWallClockTime: 8s878ms - DelimiterParseTime: 1s924ms - MaterializeTupleTime(*): 254.276ms - ScannerThreadsSysTime: 8.0ms - ScannerThreadsUserTime: 1s836ms - ScannerThreadsVoluntaryContextSwitches: 2.64K (2642) - TotalRawHdfsReadTime(*): 118.384ms - TotalReadThroughput: 37.62 MB/sec Fragment F00: Instance 94da567a47606a7:70ad12d88de1997 (host=desk:22002):(Total: 7s026ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 0, 92.00 KB, 92.00 KB, 220.02 KB, 20.27 MB, 65.87 MB, 89.97 MB, 601.97 MB, 604.05 MB, 617.86 MB, 633.80 MB, 361.79 MB, 361.07 MB, 361.46 MB, 360.89 MB, 340.06 MB ThreadUsage(500.0ms): 1, 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.31 - PeakMemoryUsage: 635.93 MB (666816528) - PerHostPeakMemUsage: 1.78 GB (1909530384) - PrepareTime: 324.174ms - RowsProduced: 27.09K (27087) - TotalCpuTime: 20s585ms - TotalNetworkReceiveTime: 4s321ms - TotalNetworkSendTime: 12.183ms - TotalStorageWaitTime: 170.0ms CodeGen:(Total: 898.325ms, non-child: 898.325ms, % non-child: 100.00%) - CodegenTime: 15.592ms - CompileTime: 54.722ms - LoadTime: 62.143us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 589.669ms - PrepareTime: 252.726ms DataStreamSender (dst_id=16):(Total: 140.930ms, non-child: 140.930ms, % non-child: 100.00%) - BytesSent: 2.46 MB (2583626) - NetworkThroughput(*): 28.51 MB/sec - OverallThroughput: 17.48 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 59.144ms - ThriftTransmitTime(*): 86.423ms - UncompressedRowBatchSize: 5.45 MB (5719213) HASH_JOIN_NODE (id=8):(Total: 6s931ms, non-child: 365.573ms, % non-child: 5.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 5.598us - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 7.334us - GetNewBlockTime: 318.682us - HashBuckets: 2 - LargestPartitionPercent: 100 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 8.59 MB (9003024) - PinTime: 0ns - ProbeRows: 652.60K (652595) - ProbeRowsPartitioned: 0 - ProbeTime: 45.700ms - RowsReturned: 27.09K (27087) - RowsReturnedRate: 3.91 K/sec - SpilledPartitions: 0 - UnpinTime: 10.493us EXCHANGE_NODE (id=15):(Total: 239.328ms, non-child: 15.488us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 1.559us - DeserializeRowBatchTimer: 10.927us - FirstBatchArrivalWaitTime: 239.312ms - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 4.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 6s567ms, non-child: 4s269ms, % non-child: 65.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 227.999ms - BuildRows: 729.41K (729413) - BuildRowsPartitioned: 729.41K (729413) - BuildTime: 803.507ms - GetNewBlockTime: 2.719ms - HashBuckets: 2.10M (2097152) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 566.03 MB (593526784) - PinTime: 0ns - ProbeRows: 1.35M (1354407) - ProbeRowsPartitioned: 0 - ProbeTime: 173.695ms - RowsReturned: 652.60K (652595) - RowsReturnedRate: 99.37 K/sec - SpilledPartitions: 0 - UnpinTime: 10.784us EXCHANGE_NODE (id=14):(Total: 2s796ms, non-child: 144.758ms, % non-child: 5.18%) BytesReceived(500.0ms): 0, 0, 0, 1.85 MB, 4.59 MB, 6.86 MB, 9.10 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB - BytesReceived: 11.04 MB (11577831) - ConvertRowBatchTime: 125.683ms - DeserializeRowBatchTimer: 230.32ms - FirstBatchArrivalWaitTime: 702.649ms - PeakMemoryUsage: 0 - RowsReturned: 729.41K (729413) - RowsReturnedRate: 260.81 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 3s672ms, non-child: 1s879ms, % non-child: 51.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2.989ms - BuildRows: 10.00K (10000) - BuildRowsPartitioned: 10.00K (10000) - BuildTime: 4.543ms - GetNewBlockTime: 254.944us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 12.43 MB (13033472) - PinTime: 0ns - ProbeRows: 1.35M (1354407) - ProbeRowsPartitioned: 0 - ProbeTime: 353.478ms - RowsReturned: 1.35M (1354407) - RowsReturnedRate: 368.80 K/sec - SpilledPartitions: 0 - UnpinTime: 10.891us EXCHANGE_NODE (id=13):(Total: 1s418ms, non-child: 5.549ms, % non-child: 0.39%) BytesReceived(500.0ms): 0, 0, 0, 0, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB - BytesReceived: 207.55 KB (212530) - ConvertRowBatchTime: 1.627ms - DeserializeRowBatchTimer: 3.983ms - FirstBatchArrivalWaitTime: 1s370ms - PeakMemoryUsage: 0 - RowsReturned: 10.00K (10000) - RowsReturnedRate: 7.05 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1s805ms, non-child: 1s805ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:7.143% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 0, 0, 0, 32.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 72.00 MB, 112.00 MB, 160.00 MB, 208.00 MB, 256.00 MB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 1.71 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268436480) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268436480) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.38 MB (68558848) - PerReadThreadRawHdfsThroughput: 1.96 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.14M (2142543) - RowsReturned: 1.35M (1354407) - RowsReturnedRate: 750.18 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 2.60K (2598) - ScannerThreadsTotalWallClockTime: 11s532ms - DelimiterParseTime: 3s262ms - MaterializeTupleTime(*): 563.44ms - ScannerThreadsSysTime: 8.0ms - ScannerThreadsUserTime: 3s028ms - ScannerThreadsVoluntaryContextSwitches: 133 - TotalRawHdfsReadTime(*): 127.547ms - TotalReadThroughput: 34.12 MB/sec Instance 94da567a47606a7:70ad12d88de1999 (host=desk:22001):(Total: 6s718ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB MemoryUsage(500.0ms): 0, 92.00 KB, 92.00 KB, 220.02 KB, 20.27 MB, 89.97 MB, 89.97 MB, 601.97 MB, 604.05 MB, 627.99 MB, 361.03 MB, 361.26 MB, 365.73 MB, 356.46 MB, 329.63 MB ThreadUsage(500.0ms): 1, 1, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.20 - PeakMemoryUsage: 635.93 MB (666816528) - PerHostPeakMemUsage: 1.74 GB (1871861984) - PrepareTime: 336.340ms - RowsProduced: 21.64K (21644) - TotalCpuTime: 18s564ms - TotalNetworkReceiveTime: 4s452ms - TotalNetworkSendTime: 15.987ms - TotalStorageWaitTime: 146.24ms CodeGen:(Total: 863.83ms, non-child: 863.83ms, % non-child: 100.00%) - CodegenTime: 2.831ms - CompileTime: 91.143ms - LoadTime: 63.260us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 494.720ms - PrepareTime: 276.112ms DataStreamSender (dst_id=16):(Total: 127.858ms, non-child: 127.858ms, % non-child: 100.00%) - BytesSent: 2.02 MB (2118591) - NetworkThroughput(*): 28.33 MB/sec - OverallThroughput: 15.80 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 52.63ms - ThriftTransmitTime(*): 71.312ms - UncompressedRowBatchSize: 4.36 MB (4569972) HASH_JOIN_NODE (id=8):(Total: 6s614ms, non-child: 400.723ms, % non-child: 6.06%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6.13us - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 5.598us - GetNewBlockTime: 280.87us - HashBuckets: 2 - LargestPartitionPercent: 100 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 8.59 MB (9003024) - PinTime: 0ns - ProbeRows: 525.82K (525821) - ProbeRowsPartitioned: 0 - ProbeTime: 41.565ms - RowsReturned: 21.64K (21644) - RowsReturnedRate: 3.27 K/sec - SpilledPartitions: 0 - UnpinTime: 10.507us EXCHANGE_NODE (id=15):(Total: 288.671ms, non-child: 19.148us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 1.409us - DeserializeRowBatchTimer: 8.401us - FirstBatchArrivalWaitTime: 288.528ms - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 3.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 6s214ms, non-child: 3s462ms, % non-child: 55.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 218.530ms - BuildRows: 729.41K (729413) - BuildRowsPartitioned: 729.41K (729413) - BuildTime: 533.44ms - GetNewBlockTime: 2.784ms - HashBuckets: 2.10M (2097152) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 566.03 MB (593526784) - PinTime: 0ns - ProbeRows: 1.09M (1089843) - ProbeRowsPartitioned: 0 - ProbeTime: 140.975ms - RowsReturned: 525.82K (525821) - RowsReturnedRate: 84.61 K/sec - SpilledPartitions: 0 - UnpinTime: 10.549us EXCHANGE_NODE (id=14):(Total: 2s840ms, non-child: 134.170ms, % non-child: 4.72%) BytesReceived(500.0ms): 0, 0, 0, 1.85 MB, 4.59 MB, 6.86 MB, 9.10 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB - BytesReceived: 11.04 MB (11577831) - ConvertRowBatchTime: 117.283ms - DeserializeRowBatchTimer: 227.666ms - FirstBatchArrivalWaitTime: 737.950ms - PeakMemoryUsage: 0 - RowsReturned: 729.41K (729413) - RowsReturnedRate: 256.77 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 3s706ms, non-child: 1s822ms, % non-child: 49.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2.990ms - BuildRows: 10.00K (10000) - BuildRowsPartitioned: 10.00K (10000) - BuildTime: 4.657ms - GetNewBlockTime: 241.433us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 12.43 MB (13033472) - PinTime: 0ns - ProbeRows: 1.09M (1089843) - ProbeRowsPartitioned: 0 - ProbeTime: 320.773ms - RowsReturned: 1.09M (1089843) - RowsReturnedRate: 294.01 K/sec - SpilledPartitions: 0 - UnpinTime: 10.163us EXCHANGE_NODE (id=13):(Total: 1s446ms, non-child: 2.21ms, % non-child: 0.14%) BytesReceived(500.0ms): 0, 0, 0, 0, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB - BytesReceived: 207.55 KB (212530) - ConvertRowBatchTime: 1.609ms - DeserializeRowBatchTimer: 3.277ms - FirstBatchArrivalWaitTime: 1s406ms - PeakMemoryUsage: 0 - RowsReturned: 10.00K (10000) - RowsReturnedRate: 6.91 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1s895ms, non-child: 1s895ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/206.94 MB Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:7.692% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 0, 0, 0, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 104.00 MB, 144.00 MB, 174.94 MB, 206.94 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.62 - BytesRead: 206.94 MB (216992184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 206.94 MB (216991160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 206.94 MB (216991160) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.38 MB (68558848) - PerReadThreadRawHdfsThroughput: 1.57 GB/sec - RemoteScanRanges: 0 - RowsRead: 1.72M (1724693) - RowsReturned: 1.09M (1089843) - RowsReturnedRate: 574.99 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 2.47K (2470) - ScannerThreadsTotalWallClockTime: 10s305ms - DelimiterParseTime: 2s393ms - MaterializeTupleTime(*): 539.128ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 2s656ms - ScannerThreadsVoluntaryContextSwitches: 231 - TotalRawHdfsReadTime(*): 128.751ms - TotalReadThroughput: 29.56 MB/sec Instance 94da567a47606a7:70ad12d88de1998 (host=desk:22000):(Total: 6s687ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB MemoryUsage(500.0ms): 0, 92.00 KB, 92.00 KB, 220.02 KB, 20.27 MB, 89.97 MB, 89.97 MB, 601.97 MB, 604.05 MB, 625.30 MB, 378.24 MB, 364.49 MB, 362.45 MB, 360.79 MB, 354.17 MB ThreadUsage(500.0ms): 1, 1, 1, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.07 - PeakMemoryUsage: 635.93 MB (666816528) - PerHostPeakMemUsage: 1.79 GB (1920995616) - PrepareTime: 338.870ms - RowsProduced: 27.14K (27140) - TotalCpuTime: 19s915ms - TotalNetworkReceiveTime: 3s551ms - TotalNetworkSendTime: 17.664ms - TotalStorageWaitTime: 143.421ms CodeGen:(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) - CodegenTime: 3.225ms - CompileTime: 41.652ms - LoadTime: 62.218us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 863.700ms - PrepareTime: 237.397ms DataStreamSender (dst_id=16):(Total: 147.312ms, non-child: 147.312ms, % non-child: 100.00%) - BytesSent: 2.48 MB (2596274) - NetworkThroughput(*): 28.14 MB/sec - OverallThroughput: 16.81 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 58.869ms - ThriftTransmitTime(*): 88.3ms - UncompressedRowBatchSize: 5.46 MB (5730412) HASH_JOIN_NODE (id=8):(Total: 6s577ms, non-child: 395.320ms, % non-child: 6.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.588us - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 6.872us - GetNewBlockTime: 907.190us - HashBuckets: 2 - LargestPartitionPercent: 100 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 8.59 MB (9003024) - PinTime: 0ns - ProbeRows: 650.50K (650495) - ProbeRowsPartitioned: 0 - ProbeTime: 46.423ms - RowsReturned: 27.14K (27140) - RowsReturnedRate: 4.12 K/sec - SpilledPartitions: 0 - UnpinTime: 10.688us EXCHANGE_NODE (id=15):(Total: 12.895us, non-child: 12.895us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 0, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 1.391us - DeserializeRowBatchTimer: 9.768us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 77.55 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 6s193ms, non-child: 3s937ms, % non-child: 63.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 239.338ms - BuildRows: 729.41K (729413) - BuildRowsPartitioned: 729.41K (729413) - BuildTime: 639.948ms - GetNewBlockTime: 2.687ms - HashBuckets: 2.10M (2097152) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 566.03 MB (593526784) - PinTime: 0ns - ProbeRows: 1.35M (1349046) - ProbeRowsPartitioned: 0 - ProbeTime: 173.764ms - RowsReturned: 650.50K (650495) - RowsReturnedRate: 105.03 K/sec - SpilledPartitions: 0 - UnpinTime: 9.193us EXCHANGE_NODE (id=14):(Total: 2s531ms, non-child: 144.215ms, % non-child: 5.70%) BytesReceived(500.0ms): 0, 0, 0, 1.85 MB, 4.59 MB, 6.86 MB, 9.10 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB, 11.04 MB - BytesReceived: 11.04 MB (11577831) - ConvertRowBatchTime: 124.946ms - DeserializeRowBatchTimer: 226.891ms - FirstBatchArrivalWaitTime: 447.939ms - PeakMemoryUsage: 0 - RowsReturned: 729.41K (729413) - RowsReturnedRate: 288.15 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 3s438ms, non-child: 1s587ms, % non-child: 46.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2.957ms - BuildRows: 10.00K (10000) - BuildRowsPartitioned: 10.00K (10000) - BuildTime: 4.608ms - GetNewBlockTime: 242.400us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 12.43 MB (13033472) - PinTime: 0ns - ProbeRows: 1.35M (1349046) - ProbeRowsPartitioned: 0 - ProbeTime: 362.29ms - RowsReturned: 1.35M (1349046) - RowsReturnedRate: 392.37 K/sec - SpilledPartitions: 0 - UnpinTime: 10.64us EXCHANGE_NODE (id=13):(Total: 1s152ms, non-child: 1.765ms, % non-child: 0.15%) BytesReceived(500.0ms): 0, 0, 0, 0, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB, 207.55 KB - BytesReceived: 207.55 KB (212530) - ConvertRowBatchTime: 1.639ms - DeserializeRowBatchTimer: 3.261ms - FirstBatchArrivalWaitTime: 1s121ms - PeakMemoryUsage: 0 - RowsReturned: 10.00K (10000) - RowsReturnedRate: 8.68 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1s861ms, non-child: 1s861ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% File Formats: TEXT/NONE:2 ExecOption: Codegen enabled: 2 out of 2 BytesRead(500.0ms): 0, 0, 0, 0, 56.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 104.00 MB, 152.00 MB, 200.00 MB, 248.00 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.83 - BytesRead: 256.00 MB (268437504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.00 MB (268436480) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.00 MB (268436480) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 65.38 MB (68558848) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 - RowsRead: 2.13M (2133979) - RowsReturned: 1.35M (1349046) - RowsReturnedRate: 724.57 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 3.03K (3027) - ScannerThreadsTotalWallClockTime: 11s133ms - DelimiterParseTime: 3s507ms - MaterializeTupleTime(*): 554.862ms - ScannerThreadsSysTime: 4.0ms - ScannerThreadsUserTime: 2s776ms - ScannerThreadsVoluntaryContextSwitches: 41 - TotalRawHdfsReadTime(*): 149.764ms - TotalReadThroughput: 35.42 MB/sec Fragment F03: Instance 94da567a47606a7:70ad12d88de199a (host=desk:22001):(Total: 472.466ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 KB MemoryUsage(500.0ms): 0, 23.98 KB ThreadUsage(500.0ms): 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 64.98 KB (66544) - PerHostPeakMemUsage: 183.26 MB (192163744) - PrepareTime: 421.219ms - RowsProduced: 1 - TotalCpuTime: 876.346ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 379.731us - TotalStorageWaitTime: 16.665ms CodeGen:(Total: 786.643ms, non-child: 786.643ms, % non-child: 100.00%) - CodegenTime: 3.355ms - CompileTime: 6.238ms - LoadTime: 76.167us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 362.567ms - PrepareTime: 416.756ms DataStreamSender (dst_id=15):(Total: 78.671us, non-child: 78.671us, % non-child: 100.00%) - BytesSent: 135.00 B (135) - NetworkThroughput(*): 162.62 KB/sec - OverallThroughput: 1.64 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 10.404us - ThriftTransmitTime(*): 810.682us - UncompressedRowBatchSize: 144.00 B (144) HDFS_SCAN_NODE (id=3):(Total: 443.178ms, non-child: 443.178ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 BytesRead(500.0ms): 0, 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.15 KB (2199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.15 KB (2199) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.15 KB (2199) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 41.00 KB (41984) - PerReadThreadRawHdfsThroughput: 17.01 MB/sec - RemoteScanRanges: 0 - RowsRead: 25 - RowsReturned: 1 - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 21.519ms - DelimiterParseTime: 9.881us - MaterializeTupleTime(*): 2.485us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 123.270us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 94da567a47606a7:70ad12d88de199b (host=desk:22002):(Total: 2s747ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/128.00 MB MemoryUsage(500.0ms): 0, 20.00 KB, 24.06 MB, 24.06 MB, 24.06 MB, 24.06 MB ThreadUsage(500.0ms): 1, 1, 2, 2, 2, 2 - AverageThreadTokens: 1.67 - PeakMemoryUsage: 32.18 MB (33742848) - PerHostPeakMemUsage: 1.77 GB (1897071888) - PrepareTime: 373.342ms - RowsProduced: 574.23K (574226) - TotalCpuTime: 5s433ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 23.883ms - TotalStorageWaitTime: 95.392ms CodeGen:(Total: 795.894ms, non-child: 795.894ms, % non-child: 100.00%) - CodegenTime: 2.946ms - CompileTime: 20.142ms - LoadTime: 67.964us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 405.369ms - PrepareTime: 368.795ms DataStreamSender (dst_id=14):(Total: 343.30ms, non-child: 343.30ms, % non-child: 100.00%) - BytesSent: 25.37 MB (26605605) - NetworkThroughput(*): 19.81 MB/sec - OverallThroughput: 73.97 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 311.942ms - ThriftTransmitTime(*): 1s280ms - UncompressedRowBatchSize: 60.79 MB (63745866) HDFS_SCAN_NODE (id=2):(Total: 2s386ms, non-child: 2s386ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 BytesRead(500.0ms): 0, 0, 32.00 MB, 48.00 MB, 88.00 MB, 120.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 128.00 MB (134218752) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.00 MB (134218752) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.00 MB (134218752) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 32.16 MB (33722368) - PerReadThreadRawHdfsThroughput: 2.36 GB/sec - RemoteScanRanges: 0 - RowsRead: 1.18M (1181503) - RowsReturned: 574.23K (574226) - RowsReturnedRate: 240.63 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1760) - ScannerThreadsTotalWallClockTime: 2s352ms - DelimiterParseTime: 1s056ms - MaterializeTupleTime(*): 130.95ms - ScannerThreadsSysTime: 4.0ms - ScannerThreadsUserTime: 820.51ms - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 52.949ms - TotalReadThroughput: 39.97 MB/sec Instance 94da567a47606a7:70ad12d88de199c (host=desk:22000):(Total: 1s234ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/34.56 MB MemoryUsage(500.0ms): 0, 20.00 KB, 24.02 MB, 4.06 MB ThreadUsage(500.0ms): 1, 1, 2, 2 - AverageThreadTokens: 1.50 - PeakMemoryUsage: 32.14 MB (33701888) - PerHostPeakMemUsage: 773.19 MB (810746448) - PrepareTime: 263.798ms - RowsProduced: 155.19K (155187) - TotalCpuTime: 2s604ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 5.320ms - TotalStorageWaitTime: 52.589ms CodeGen:(Total: 735.241ms, non-child: 735.241ms, % non-child: 100.00%) - CodegenTime: 2.199ms - CompileTime: 20.220ms - LoadTime: 72.8us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 453.457ms - PrepareTime: 260.508ms DataStreamSender (dst_id=14):(Total: 92.766ms, non-child: 92.766ms, % non-child: 100.00%) - BytesSent: 7.75 MB (8127912) - NetworkThroughput(*): 17.08 MB/sec - OverallThroughput: 83.56 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 86.745ms - ThriftTransmitTime(*): 453.954ms - UncompressedRowBatchSize: 16.43 MB (17227605) HDFS_SCAN_NODE (id=2):(Total: 1s102ms, non-child: 1s102ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/34.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 BytesRead(500.0ms): 0, 0, 32.00 MB, 34.56 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 34.56 MB (36234433) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.56 MB (36234433) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.56 MB (36234433) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 32.08 MB (33640448) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 - RowsRead: 318.50K (318497) - RowsReturned: 155.19K (155187) - RowsReturnedRate: 140.82 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 430 - ScannerThreadsTotalWallClockTime: 910.176ms - DelimiterParseTime: 343.666ms - MaterializeTupleTime(*): 44.848ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 220.13ms - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 21.403ms - TotalReadThroughput: 17.28 MB/sec Fragment F01: Instance 94da567a47606a7:70ad12d88de199d (host=desk:22001):(Total: 580.468ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/1.33 MB MemoryUsage(500.0ms): 0, 20.00 KB ThreadUsage(500.0ms): 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 2.30 MB (2408448) - PerHostPeakMemUsage: 705.85 MB (740140992) - PrepareTime: 427.73ms - RowsProduced: 10.00K (10000) - TotalCpuTime: 1s200ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.125ms - TotalStorageWaitTime: 61.116ms CodeGen:(Total: 996.881ms, non-child: 996.881ms, % non-child: 100.00%) - CodegenTime: 2.792ms - CompileTime: 18.999ms - LoadTime: 73.770us - ModuleFileSize: 2.02 MB (2121420) - OptimizationTime: 553.258ms - PrepareTime: 423.495ms DataStreamSender (dst_id=13):(Total: 16.839ms, non-child: 16.839ms, % non-child: 100.00%) - BytesSent: 622.66 KB (637602) - NetworkThroughput(*): 32.54 MB/sec - OverallThroughput: 36.11 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 6.575ms - ThriftTransmitTime(*): 18.684ms - UncompressedRowBatchSize: 1.55 MB (1620132) HDFS_SCAN_NODE (id=0):(Total: 508.179ms, non-child: 508.179ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/1.33 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 BytesRead(500.0ms): 0, 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.33 MB (1399184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.33 MB (1399184) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.33 MB (1399184) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.24 MB (2347008) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 - RowsRead: 10.00K (10000) - RowsReturned: 10.00K (10000) - RowsReturnedRate: 19.68 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 69.6ms - DelimiterParseTime: 5.300ms - MaterializeTupleTime(*): 1.36ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 4.0ms - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 906.712us - TotalReadThroughput: 0.00 /sec