Query: select STRAIGHT_JOIN count(*) FROM orders l1 JOIN [broadcast] lineitem ON l_orderkey = o_orderkey WHERE l_partkey > 0 AND l_suppkey > 0 AND l_linenumber > 0 AND o_orderdate < '19000' AND l_orderkey < 350000000 +----------+ | count(*) | +----------+ | 0 | +----------+ Fetched 1 row(s) in 8.37s [localhost:21000] > summary; +-----------------+--------+----------+----------+--------+------------+-----------+---------------+----------------------------+ | Operator | #Hosts | Avg Time | Max Time | #Rows | Est. #Rows | Peak Mem | Est. Peak Mem | Detail | +-----------------+--------+----------+----------+--------+------------+-----------+---------------+----------------------------+ | 06:AGGREGATE | 1 | 120.05ms | 120.05ms | 1 | 1 | 16.00 KB | -1 B | FINALIZE | | 05:EXCHANGE | 1 | 5.84us | 5.84us | 1 | 1 | 0 B | -1 B | UNPARTITIONED | | 03:AGGREGATE | 1 | 132.94ms | 132.94ms | 1 | 1 | 20.00 KB | 10.00 MB | | | 02:HASH JOIN | 1 | 4.70s | 4.70s | 0 | 89.41K | 3.03 GB | 105.74 MB | INNER JOIN, BROADCAST | | |--04:EXCHANGE | 1 | 690.39ms | 690.39ms | 36.00M | 3.60M | 0 B | 0 B | BROADCAST | | | 01:SCAN HDFS | 1 | 317.04ms | 317.04ms | 36.00M | 3.60M | 362.06 MB | 352.00 MB | tpch_6gb_parquet.lineitem | | 00:SCAN HDFS | 1 | 785.41ms | 785.41ms | 0 | 900.00K | 44.66 MB | 176.00 MB | tpch_6gb_parquet.orders l1 | +-----------------+--------+----------+----------+--------+------------+-----------+---------------+----------------------------+ [localhost:21000] > profile; Query Runtime Profile: Query (id=a54a3eb94eff358f:307f8cab078ba397): Summary: Session ID: 2849c9ade13aab03:c1bbee5e5e8c5f8e Session Type: BEESWAX Start Time: 2016-02-09 12:00:51.274109000 End Time: 2016-02-09 12:00:59.640076000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.3.0-cdh5-INTERNAL RELEASE (build 334b66179973dfb74cc50618c770fcfea84071df) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: ::ffff:127.0.0.1:60252 Default Db: tpch_6gb_parquet Sql Statement: select STRAIGHT_JOIN count(*) FROM orders l1 JOIN [broadcast] lineitem ON l_orderkey = o_orderkey WHERE l_partkey > 0 AND l_suppkey > 0 AND l_linenumber > 0 AND o_orderdate < '19000' AND l_orderkey < 350000000 Coordinator: mostafa-01:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=457.74MB VCores=2 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=1 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: o_orderkey = l_orderkey | hosts=1 per-host-mem=105.74MB | tuple-ids=0,1 row-size=58B cardinality=89411 | |--04:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=1 row-size=28B cardinality=3600015 | | | 01:SCAN HDFS [tpch_6gb_parquet.lineitem, RANDOM] | partitions=1/1 files=5 size=1.24GB | predicates: l_partkey > 0, l_suppkey > 0, l_linenumber > 0, l_orderkey < 350000000 | table stats: 36000148 rows total | column stats: all | hosts=1 per-host-mem=352.00MB | tuple-ids=1 row-size=28B cardinality=3600015 | 00:SCAN HDFS [tpch_6gb_parquet.orders l1, RANDOM] partitions=1/1 files=2 size=324.68MB predicates: o_orderdate < '19000', l1.o_orderkey < 350000000 table stats: 9000000 rows total column stats: all hosts=1 per-host-mem=176.00MB tuple-ids=0 row-size=30B cardinality=900000 ---------------- Estimated Per-Host Mem: 479979210 Estimated Per-Host VCores: 2 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 120.052ms 120.052ms 1 1 16.00 KB -1.00 B FINALIZE 05:EXCHANGE 1 5.842us 5.842us 1 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 1 132.941ms 132.941ms 1 1 20.00 KB 10.00 MB 02:HASH JOIN 1 4s699ms 4s699ms 0 89.41K 3.03 GB 105.74 MB INNER JOIN, BROADCAST |--04:EXCHANGE 1 690.390ms 690.390ms 36.00M 3.60M 0 0 BROADCAST | 01:SCAN HDFS 1 317.036ms 317.036ms 36.00M 3.60M 362.06 MB 352.00 MB tpch_6gb_parquet.lineitem 00:SCAN HDFS 1 785.409ms 785.409ms 0 900.00K 44.66 MB 176.00 MB tpch_6gb_parquet.orders l1 Planner Timeline: 114.869ms - Analysis finished: 37.433ms (37.433ms) - Equivalence classes computed: 38.939ms (1.505ms) - Single node plan created: 67.319ms (28.379ms) - Distributed plan created: 69.166ms (1.846ms) - Planning finished: 114.869ms (45.703ms) Query Timeline: 8s366ms - Start execution: 20.742us (20.742us) - Planning finished: 117.811ms (117.790ms) - Ready to start 2 remote fragments: 238.120ms (120.309ms) - All 2 remote fragments started: 238.614ms (493.616us) - Rows available: 8s300ms (8s061ms) - First row fetched: 8s365ms (65.004ms) - Unregister query: 8s365ms (809.846us) ImpalaServer: - ClientFetchWaitTimer: 65.548ms - RowMaterializationTimer: 2.639us Execution Profile a54a3eb94eff358f:307f8cab078ba397:(Total: 8s182ms, non-child: 0.000ns, % non-child: 0.00%) Fragment start latencies: Count: 2, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: mostafa-01:22000(3.06 GB) - FinalizationTimer: 0.000ns Coordinator Fragment F02:(Total: 8s018ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 24.01 KB (24584) - PerHostPeakMemUsage: 0 - PrepareTime: 120.024ms - RowsProduced: 1 (1) - TotalCpuTime: 348.967ms - TotalNetworkReceiveTime: 7s898ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 336 (336) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.05 GB (21530036224) - PeakMemoryUsage: 3.00 GB (3221225472) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 282.818ms, non-child: 282.818ms, % non-child: 100.00%) - CodegenTime: 287.713us - CompileTime: 1.134ms - LoadTime: 0.000ns - ModuleFileSize: 0 - OptimizationTime: 161.919ms - PrepareTime: 118.942ms AGGREGATION_NODE (id=6):(Total: 8s018ms, non-child: 120.052ms, % non-child: 1.50%) ExecOption: Codegen Enabled - BuildTime: 806.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 7s898ms, non-child: 5.842us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 479.000ns - DeserializeRowBatchTimer: 1.651us - FirstBatchArrivalWaitTime: 7s898ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 7s832ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 324.68 MB, max: 324.68 MB, avg: 324.68 MB, stddev: 0 completion times: min:8s062ms max:8s062ms mean: 8s062ms stddev:0.000ns execution rates: min:40.27 MB/sec max:40.27 MB/sec mean:40.27 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.06 - PeakMemoryUsage: 3.06 GB (3286964512) - PerHostPeakMemUsage: 3.06 GB (3286976800) - PrepareTime: 135.802ms - RowsProduced: 1 (1) - TotalCpuTime: 13s662ms - TotalNetworkReceiveTime: 1s770ms - TotalNetworkSendTime: 120.962us - TotalStorageWaitTime: 703.492ms CodeGen:(Total: 362.017ms, non-child: 362.017ms, % non-child: 100.00%) - CodegenTime: 108.875us - CompileTime: 23.260ms - LoadTime: 0.000ns - ModuleFileSize: 0 - OptimizationTime: 205.672ms - PrepareTime: 132.186ms DataStreamSender (dst_id=5):(Total: 15.128us, non-child: 15.128us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 206.28 KB/sec - OverallThroughput: 1.01 MB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 5.041us - ThriftTransmitTime(*): 75.746us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 7s832ms, non-child: 132.941ms, % non-child: 1.70%) - BuildTime: 93.107us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 7s699ms, non-child: 4s699ms, % non-child: 61.04%) - BuildPartitionTime: 1s174ms - BuildRows: 36.00M (36000148) - BuildRowsPartitioned: 36.00M (36000148) - BuildTime: 2s958ms - GetNewBlockTime: 602.436us - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.03 GB (3248535136) - PinTime: 0.000ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 968.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 393.000ns EXCHANGE_NODE (id=4):(Total: 2s214ms, non-child: 2s214ms, % non-child: 100.00%) - BytesReceived: 712.48 MB (747086595) - ConvertRowBatchTime: 424.497ms - DeserializeRowBatchTimer: 1s011ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 36.00M (36000148) - RowsReturnedRate: 16.26 M/sec - SendersBlockedTimer: 123.332ms - SendersBlockedTotalTimer(*): 123.334ms HDFS_SCAN_NODE (id=0):(Total: 785.409ms, non-child: 785.409ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 47.62 MB (49935092) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.62 MB (49935092) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.62 MB (49935092) - DecompressionTime: 8.820ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 44.66 MB (46827808) - PerReadThreadRawHdfsThroughput: 115.99 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.00M (9000000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 98 (98) - ScannerThreadsTotalWallClockTime: 1s164ms - MaterializeTupleTime(*): 450.301ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 456.294ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 410.579ms - TotalReadThroughput: 5.95 MB/sec Averaged Fragment F01:(Total: 3s744ms, non-child: 15.926ms, % non-child: 0.43%) split sizes: min: 1.24 GB, max: 1.24 GB, avg: 1.24 GB, stddev: 0 completion times: min:3s772ms max:3s772ms mean: 3s772ms stddev:0.000ns execution rates: min:335.56 MB/sec max:335.56 MB/sec mean:335.56 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 6.00 - PeakMemoryUsage: 362.10 MB (379691832) - PerHostPeakMemUsage: 1.23 GB (1324453632) - PrepareTime: 97.075us - RowsProduced: 36.00M (36000148) - TotalCpuTime: 19s897ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.123ms - TotalStorageWaitTime: 1s809ms DataStreamSender (dst_id=4):(Total: 3s411ms, non-child: 3s411ms, % non-child: 100.00%) - BytesSent: 712.48 MB (747086595) - NetworkThroughput(*): 263.48 MB/sec - OverallThroughput: 208.82 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 3s108ms - ThriftTransmitTime(*): 2s704ms - UncompressedRowBatchSize: 1.21 GB (1296145964) HDFS_SCAN_NODE (id=1):(Total: 317.036ms, non-child: 317.036ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 382.42 MB (400994013) - BytesReadDataNodeCache: 0 - BytesReadLocal: 382.42 MB (400994013) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 382.42 MB (400994013) - DecompressionTime: 974.489ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 362.06 MB (379646776) - PerReadThreadRawHdfsThroughput: 277.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.00M (36000148) - RowsReturned: 36.00M (36000148) - RowsReturnedRate: 113.55 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 3.48K (3478) - ScannerThreadsTotalWallClockTime: 18s182ms - MaterializeTupleTime(*): 15s322ms - ScannerThreadsSysTime: 51.996ms - ScannerThreadsUserTime: 10s619ms - ScannerThreadsVoluntaryContextSwitches: 21.33K (21331) - TotalRawHdfsReadTime(*): 1s375ms - TotalReadThroughput: 109.26 MB/sec Fragment F00: Instance a54a3eb94eff358f:307f8cab078ba399 (host=mostafa-01:22000):(Total: 7s832ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/324.68 MB MemoryUsage(500.000ms): 138.11 MB, 266.11 MB, 394.08 MB, 522.11 MB, 778.11 MB, 908.11 MB, 1.01 GB, 1.24 GB, 1.58 GB, 1.91 GB, 2.19 GB, 2.41 GB, 2.66 GB, 2.88 GB, 3.02 GB, 3.04 GB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 2 - AverageThreadTokens: 2.06 - PeakMemoryUsage: 3.06 GB (3286964512) - PerHostPeakMemUsage: 3.06 GB (3286976800) - PrepareTime: 135.802ms - RowsProduced: 1 (1) - TotalCpuTime: 13s662ms - TotalNetworkReceiveTime: 1s770ms - TotalNetworkSendTime: 120.962us - TotalStorageWaitTime: 703.492ms CodeGen:(Total: 362.017ms, non-child: 362.017ms, % non-child: 100.00%) - CodegenTime: 108.875us - CompileTime: 23.260ms - LoadTime: 0.000ns - ModuleFileSize: 0 - OptimizationTime: 205.672ms - PrepareTime: 132.186ms DataStreamSender (dst_id=5):(Total: 15.128us, non-child: 15.128us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 206.28 KB/sec - OverallThroughput: 1.01 MB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 5.041us - ThriftTransmitTime(*): 75.746us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 7s832ms, non-child: 132.941ms, % non-child: 1.70%) ExecOption: Codegen Enabled - BuildTime: 93.107us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 7s699ms, non-child: 4s699ms, % non-child: 61.04%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s174ms - BuildRows: 36.00M (36000148) - BuildRowsPartitioned: 36.00M (36000148) - BuildTime: 2s958ms - GetNewBlockTime: 602.436us - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.03 GB (3248535136) - PinTime: 0.000ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 968.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 393.000ns EXCHANGE_NODE (id=4):(Total: 2s214ms, non-child: 690.390ms, % non-child: 31.18%) BytesReceived(500.000ms): 20.74 MB, 122.41 MB, 227.43 MB, 334.67 MB, 443.61 MB, 542.85 MB, 647.34 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB, 712.48 MB - BytesReceived: 712.48 MB (747086595) - ConvertRowBatchTime: 424.497ms - DeserializeRowBatchTimer: 1s011ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 36.00M (36000148) - RowsReturnedRate: 16.26 M/sec - SendersBlockedTimer: 123.332ms - SendersBlockedTotalTimer(*): 123.334ms HDFS_SCAN_NODE (id=0):(Total: 785.409ms, non-child: 785.409ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/324.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 100.00 KB, 47.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 47.62 MB (49935092) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.62 MB (49935092) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.62 MB (49935092) - DecompressionTime: 8.820ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 44.66 MB (46827808) - PerReadThreadRawHdfsThroughput: 115.99 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.00M (9000000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 98 (98) - ScannerThreadsTotalWallClockTime: 1s164ms - MaterializeTupleTime(*): 450.301ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 456.294ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 410.579ms - TotalReadThroughput: 5.95 MB/sec Fragment F01: Instance a54a3eb94eff358f:307f8cab078ba39a (host=mostafa-01:22000):(Total: 3s744ms, non-child: 15.926ms, % non-child: 0.43%) Hdfs split stats (:<# splits>/): 0:5/1.24 GB MemoryUsage(500.000ms): 133.58 MB, 249.35 MB, 349.85 MB, 314.13 MB, 266.11 MB, 194.37 MB, 138.28 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - PeakMemoryUsage: 362.10 MB (379691832) - PerHostPeakMemUsage: 1.23 GB (1324453632) - PrepareTime: 97.075us - RowsProduced: 36.00M (36000148) - TotalCpuTime: 19s897ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.123ms - TotalStorageWaitTime: 1s809ms DataStreamSender (dst_id=4):(Total: 3s411ms, non-child: 3s411ms, % non-child: 100.00%) - BytesSent: 712.48 MB (747086595) - NetworkThroughput(*): 263.48 MB/sec - OverallThroughput: 208.82 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 3s108ms - ThriftTransmitTime(*): 2s704ms - UncompressedRowBatchSize: 1.21 GB (1296145964) HDFS_SCAN_NODE (id=1):(Total: 317.036ms, non-child: 317.036ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:57.14% 1:42.86% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:20 ExecOption: Codegen enabled: 0 out of 5 BytesRead(500.000ms): 112.39 MB, 228.40 MB, 370.34 MB, 382.42 MB, 382.42 MB, 382.42 MB, 382.42 MB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 382.42 MB (400994013) - BytesReadDataNodeCache: 0 - BytesReadLocal: 382.42 MB (400994013) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 382.42 MB (400994013) - DecompressionTime: 974.489ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 362.06 MB (379646776) - PerReadThreadRawHdfsThroughput: 277.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.00M (36000148) - RowsReturned: 36.00M (36000148) - RowsReturnedRate: 113.55 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 3.48K (3478) - ScannerThreadsTotalWallClockTime: 18s182ms - MaterializeTupleTime(*): 15s322ms - ScannerThreadsSysTime: 51.996ms - ScannerThreadsUserTime: 10s619ms - ScannerThreadsVoluntaryContextSwitches: 21.33K (21331) - TotalRawHdfsReadTime(*): 1s375ms - TotalReadThroughput: 109.26 MB/sec