Query (id=ae497658e18d2d20:c3332e6d8d656a8c): Summary: Session ID: de4cef7c279f9f12:eb199f7322b99593 Session Type: BEESWAX Start Time: 2016-02-23 22:02:28.466267000 End Time: 2016-02-23 22:02:37.838824000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 DEBUG (build d39edee93342fb92c9a3caa509fd12f47dd5f240) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:56396 Default Db: tpch_parquet Sql Statement: select count(l1.l_tax) from lineitem l1, lineitem l2, lineitem l3 where l1.l_tax < 0.01 and l2.l_tax < 0.04 and l1.l_orderkey = l2.l_orderkey and l1.l_orderkey = l3.l_orderkey and l1.l_comment = l3.l_comment and l1.l_shipdate = l3.l_shipdate Coordinator: tarmstrong-box:22000 Query Options (non default): MAX_BLOCK_MGR_MEMORY=104857600 Plan: ---------------- Estimated Per-Host Requirements: Memory=543.27MB VCores=3 09:AGGREGATE [FINALIZE] | output: count:merge(l1.l_tax) | hosts=3 per-host-mem=unavailable | tuple-ids=3 row-size=8B cardinality=1 | 08:EXCHANGE [UNPARTITIONED] | hosts=3 per-host-mem=unavailable | tuple-ids=3 row-size=8B cardinality=1 | 05:AGGREGATE | output: count(l1.l_tax) | hosts=3 per-host-mem=10.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=3 per-host-mem=10.07MB | tuple-ids=2,0,1 row-size=177B cardinality=60013 | |--07:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=1 row-size=16B cardinality=600122 | | | 01:SCAN HDFS [tpch_parquet.lineitem l2, RANDOM] | partitions=1/1 files=3 size=195.85MB | predicates: l2.l_tax < 0.04 | table stats: 6001215 rows total | column stats: all | hosts=3 per-host-mem=160.00MB | tuple-ids=1 row-size=16B cardinality=600122 | 03:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l3.l_orderkey = l1.l_orderkey, l3.l_comment = l1.l_comment, l3.l_shipdate = l1.l_shipdate | runtime filters: RF001 <- l1.l_orderkey, RF002 <- l1.l_comment, RF003 <- l1.l_shipdate | hosts=3 per-host-mem=53.19MB | tuple-ids=2,0 row-size=161B cardinality=600122 | |--06:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=0 row-size=84B cardinality=600122 | | | 00:SCAN HDFS [tpch_parquet.lineitem l1, RANDOM] | partitions=1/1 files=3 size=195.85MB | predicates: l1.l_tax < 0.01 | table stats: 6001215 rows total | column stats: all | hosts=3 per-host-mem=320.00MB | tuple-ids=0 row-size=84B cardinality=600122 | 02:SCAN HDFS [tpch_parquet.lineitem l3, RANDOM] partitions=1/1 files=3 size=195.85MB runtime filters: RF000 -> l3.l_orderkey, RF001 -> l3.l_orderkey, RF002 -> l3.l_comment, RF003 -> l3.l_shipdate table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=240.00MB tuple-ids=2 row-size=76B cardinality=6001215 ---------------- Estimated Per-Host Mem: 569656122 Estimated Per-Host VCores: 3 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------- 09:AGGREGATE 1 98.524ms 98.524ms 1 1 24.00 KB -1.00 B FINALIZE 08:EXCHANGE 1 88.161us 88.161us 3 1 0 -1.00 B UNPARTITIONED 05:AGGREGATE 3 222.509ms 259.819ms 3 1 5.88 MB 10.00 MB 04:HASH JOIN 3 1s165ms 1s242ms 1.59M 60.01K 70.35 MB 10.07 MB INNER JOIN, BROADCAST |--07:EXCHANGE 3 1s074ms 1s105ms 2.67M 600.12K 0 0 BROADCAST | 01:SCAN HDFS 3 2s675ms 2s876ms 2.67M 600.12K 3.14 MB 160.00 MB tpch_parquet.lineitem l2 03:HASH JOIN 3 2s199ms 2s621ms 571.30K 600.12K 44.36 MB 53.19 MB INNER JOIN, BROADCAST |--06:EXCHANGE 3 194.435ms 203.653ms 665.25K 600.12K 0 0 BROADCAST | 00:SCAN HDFS 3 4s249ms 4s511ms 665.25K 600.12K 8.87 MB 320.00 MB tpch_parquet.lineitem l1 02:SCAN HDFS 3 1s138ms 1s684ms 4.41M 6.00M 7.80 MB 240.00 MB tpch_parquet.lineitem l3 Planner Timeline: 5.591ms - Analysis finished: 1.972ms (1.972ms) - Equivalence classes computed: 2.073ms (101.228us) - Single node plan created: 3.596ms (1.523ms) - Runtime filters computed: 3.719ms (123.166us) - Distributed plan created: 4.480ms (760.708us) - Planning finished: 5.591ms (1.111ms) Query Timeline: 9s378ms - Start execution: 45.048us (45.048us) - Planning finished: 6.950ms (6.905ms) - Ready to start 9 remote fragments: 106.801ms (99.851ms) - All 9 remote fragments started: 114.444ms (7.642ms) - Rows available: 9s333ms (9s219ms) - First row fetched: 9s370ms (36.910ms) - Unregister query: 9s372ms (2.153ms) ImpalaServer: - ClientFetchWaitTimer: 37.315ms - RowMaterializationTimer: 12.311us Execution Profile ae497658e18d2d20:c3332e6d8d656a8c:(Total: 9s309ms, non-child: 0.000ns, % non-child: 0.00%) Fragment start latencies: Count: 9, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 7ms, 90th %-ile: 7ms, 95th %-ile: 7ms, 99.9th %-ile: 7ms Per Node Peak Memory Usage: tarmstrong-box:22001(120.31 MB) tarmstrong-box:22002(119.83 MB) tarmstrong-box:22000(119.94 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 9s046ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 28.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.02 KB (32784) - PerHostPeakMemUsage: 0 - PrepareTime: 98.419ms - RowsProduced: 1 (1) - TotalCpuTime: 415.649ms - TotalNetworkReceiveTime: 8s947ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.30K (1299) - BlocksRecycled: 329 (329) - BufferedPins: 114 (114) - BytesWritten: 165.56 MB (173600000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.96 MB (104814400) - TotalBufferWaitTime: 81.856ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 89.670ms CodeGen:(Total: 351.257ms, non-child: 351.257ms, % non-child: 100.00%) - CodegenTime: 522.586us - CompileTime: 443.553us - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 253.045ms - PrepareTime: 96.903ms AGGREGATION_NODE (id=9):(Total: 9s045ms, non-child: 98.524ms, % non-child: 1.09%) ExecOption: Codegen Enabled - BuildTime: 2.717us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=8):(Total: 8s947ms, non-child: 88.161us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 32.00 B - BytesReceived: 48.00 B (48) - ConvertRowBatchTime: 10.928us - DeserializeRowBatchTimer: 54.115us - FirstBatchArrivalWaitTime: 8s639ms - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 8s560ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:8s919ms max:9s226ms mean: 9s053ms stddev:128.422ms execution rates: min:6.32 MB/sec max:7.75 MB/sec mean:7.21 MB/sec stddev:649.22 KB/sec num instances: 3 - AverageThreadTokens: 2.16 - BloomFilterBytes: 5.00 MB (5242880) - PeakMemoryUsage: 111.85 MB (117285746) - PerHostPeakMemUsage: 120.03 MB (125855880) - PrepareTime: 217.734ms - RowsProduced: 1 (1) - TotalCpuTime: 14s527ms - TotalNetworkReceiveTime: 5s164ms - TotalNetworkSendTime: 164.347us - TotalStorageWaitTime: 6.285ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.30K (1299) - BlocksRecycled: 354 (354) - BufferedPins: 112 (112) - BytesWritten: 165.56 MB (173600000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.96 MB (104820096) - TotalBufferWaitTime: 47.874ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 86.727ms CodeGen:(Total: 685.060ms, non-child: 685.060ms, % non-child: 100.00%) - CodegenTime: 453.055us - CompileTime: 22.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 454.012ms - PrepareTime: 207.185ms DataStreamSender (dst_id=8):(Total: 91.306us, non-child: 91.306us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 123.81 KB/sec - OverallThroughput: 178.82 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 16.760us - ThriftTransmitTime(*): 127.079us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s549ms, non-child: 222.509ms, % non-child: 2.60%) - BuildTime: 17.780ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.54 MB (4764050) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s327ms, non-child: 1s165ms, % non-child: 14.00%) - BuildPartitionTime: 701.928ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s429ms - GetNewBlockTime: 50.361ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 68.44 MB (71769280) - PinTime: 48.866ms - ProbeRows: 190.43K (190433) - ProbeRowsPartitioned: 131.05K (131054) - ProbeTime: 169.387ms - RowsReturned: 528.97K (528972) - RowsReturnedRate: 63.46 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 38.232ms EXCHANGE_NODE (id=7):(Total: 2s389ms, non-child: 2s389ms, % non-child: 100.00%) - BytesReceived: 28.47 MB (29853221) - ConvertRowBatchTime: 869.343ms - DeserializeRowBatchTimer: 139.916ms - FirstBatchArrivalWaitTime: 15.050ms - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s170ms, non-child: 2s199ms, % non-child: 30.68%) - BuildPartitionTime: 427.331ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 644.815ms - GetNewBlockTime: 136.981ms - HashBuckets: 1.05M (1048576) - HashCollisions: 265 (265) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.26 MB (46412933) - PinTime: 82.687ms - ProbeRows: 1.47M (1470154) - ProbeRowsPartitioned: 719.79K (719790) - ProbeTime: 710.148ms - RowsReturned: 190.43K (190433) - RowsReturnedRate: 26.45 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 37.325ms EXCHANGE_NODE (id=6):(Total: 3s832ms, non-child: 3s832ms, % non-child: 100.00%) - BytesReceived: 35.31 MB (37022222) - ConvertRowBatchTime: 153.027ms - DeserializeRowBatchTimer: 250.426ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 173.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 1s138ms, non-child: 1s138ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 31.37 MB (32892746) - BytesReadDataNodeCache: 0 - BytesReadLocal: 31.37 MB (32892746) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31.37 MB (32892746) - DecompressionTime: 69.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.70 MB (8068938) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 1.47M (1470154) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 45 (45) - ScannerThreadsTotalWallClockTime: 1s834ms - MaterializeTupleTime(*): 1s710ms - ScannerThreadsSysTime: 25.333ms - ScannerThreadsUserTime: 1s800ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 16.708ms - TotalReadThroughput: 4.23 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 585.82K (585819) - Rows rejected: 434.88K (434875) - Rows total: 585.82K (585820) Filter 2: - Rows processed: 150.94K (150944) - Rows rejected: 95.38K (95375) - Rows total: 585.82K (585820) Filter 3: - Rows processed: 11.33K (11333) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Averaged Fragment F02:(Total: 3s041ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:3s359ms max:3s830ms mean: 3s533ms stddev:210.731ms execution rates: min:16.77 MB/sec max:20.41 MB/sec mean:18.48 MB/sec stddev:1.49 MB/sec num instances: 3 - AverageThreadTokens: 1.73 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.10 MB (3249813) - PerHostPeakMemUsage: 109.60 MB (114927704) - PrepareTime: 238.948ms - RowsProduced: 888.86K (888855) - TotalCpuTime: 6s188ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 127.497ms - TotalStorageWaitTime: 4.812ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 512 (512) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 85.45 MB (89600000) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 720.996ms, non-child: 720.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 471.566ms - PrepareTime: 237.086ms DataStreamSender (dst_id=7):(Total: 588.047ms, non-child: 588.047ms, % non-child: 100.00%) - BytesSent: 28.47 MB (29853221) - NetworkThroughput(*): 25.18 MB/sec - OverallThroughput: 49.04 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 399.060ms - ThriftTransmitTime(*): 1s128ms - UncompressedRowBatchSize: 71.22 MB (74674340) HDFS_SCAN_NODE (id=1):(Total: 2s675ms, non-child: 2s675ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.18 MB (4380558) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4380558) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4380558) - DecompressionTime: 14.010ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.04 MB (3187024) - PerReadThreadRawHdfsThroughput: 1.78 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 888.86K (888855) - RowsReturnedRate: 332.98 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1650) - ScannerThreadsTotalWallClockTime: 2s788ms - MaterializeTupleTime(*): 2s757ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s877ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 2.330ms - TotalReadThroughput: 1.32 MB/sec Averaged Fragment F01:(Total: 4s324ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:4s407ms max:4s998ms mean: 4s773ms stddev:261.067ms execution rates: min:12.79 MB/sec max:14.17 MB/sec mean:13.64 MB/sec stddev:627.28 KB/sec num instances: 3 - AverageThreadTokens: 1.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.64 MB (9054570) - PerHostPeakMemUsage: 119.70 MB (125510632) - PrepareTime: 209.619ms - RowsProduced: 221.75K (221751) - TotalCpuTime: 8s834ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.301ms - TotalStorageWaitTime: 15.602ms CodeGen:(Total: 648.774ms, non-child: 648.774ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 431.276ms - PrepareTime: 205.421ms DataStreamSender (dst_id=6):(Total: 258.410ms, non-child: 258.410ms, % non-child: 100.00%) - BytesSent: 35.31 MB (37022222) - NetworkThroughput(*): 36.24 MB/sec - OverallThroughput: 137.05 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 238.183ms - ThriftTransmitTime(*): 972.344ms - UncompressedRowBatchSize: 61.21 MB (64188120) HDFS_SCAN_NODE (id=0):(Total: 4s249ms, non-child: 4s249ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 32.33 MB (33897673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 32.33 MB (33897673) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 32.33 MB (33897673) - DecompressionTime: 105.239ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.62 MB (9039370) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 221.75K (221751) - RowsReturnedRate: 52.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1567) - ScannerThreadsTotalWallClockTime: 4s084ms - MaterializeTupleTime(*): 3s868ms - ScannerThreadsSysTime: 34.666ms - ScannerThreadsUserTime: 3s074ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 18.749ms - TotalReadThroughput: 6.80 MB/sec Fragment F00: Instance ae497658e18d2d20:c3332e6d8d656a8e (host=tarmstrong-box:22002):(Total: 8s684ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 0, 52.00 KB, 16.46 MB, 31.76 MB, 50.24 MB, 65.35 MB, 82.81 MB, 100.46 MB, 102.95 MB, 103.60 MB, 101.98 MB, 109.90 MB, 110.86 MB, 110.64 MB, 110.86 MB, 64.84 MB, 64.60 MB, 9.72 MB, 9.93 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 2.11 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.26 MB (117717656) - PerHostPeakMemUsage: 119.83 MB (125650648) - PrepareTime: 204.115ms - RowsProduced: 1 (1) - TotalCpuTime: 14s660ms - TotalNetworkReceiveTime: 5s118ms - TotalNetworkSendTime: 170.043us - TotalStorageWaitTime: 6.924ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.30K (1299) - BlocksRecycled: 354 (354) - BufferedPins: 112 (112) - BytesWritten: 165.56 MB (173600000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.96 MB (104820096) - TotalBufferWaitTime: 47.874ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 86.727ms CodeGen:(Total: 724.600ms, non-child: 724.600ms, % non-child: 100.00%) - CodegenTime: 478.230us - CompileTime: 12.927ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 515.910ms - PrepareTime: 194.874ms DataStreamSender (dst_id=8):(Total: 99.040us, non-child: 99.040us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 117.90 KB/sec - OverallThroughput: 157.76 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 16.886us - ThriftTransmitTime(*): 132.529us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s666ms, non-child: 214.446ms, % non-child: 2.47%) ExecOption: Codegen Enabled - BuildTime: 19.636ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 5.88 MB (6166736) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s451ms, non-child: 1s212ms, % non-child: 14.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 646.503ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s493ms - GetNewBlockTime: 60.729ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 66.23 MB (69449600) - PinTime: 50.021ms - ProbeRows: 236.11K (236111) - ProbeRowsPartitioned: 162.50K (162500) - ProbeTime: 218.232ms - RowsReturned: 654.82K (654817) - RowsReturnedRate: 77.47 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 35.808ms EXCHANGE_NODE (id=7):(Total: 2s401ms, non-child: 1s035ms, % non-child: 43.10%) BytesReceived(500.000ms): 0, 4.28 MB, 9.50 MB, 15.07 MB, 19.56 MB, 24.02 MB, 27.65 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB - BytesReceived: 28.47 MB (29853221) - ConvertRowBatchTime: 839.791ms - DeserializeRowBatchTimer: 136.659ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s248ms, non-child: 2s621ms, % non-child: 36.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Disabled (Spilling) - BuildPartitionTime: 464.499ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 549.479ms - GetNewBlockTime: 170.855ms - HashBuckets: 1.05M (1048576) - HashCollisions: 375 (375) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.12 MB (46261760) - PinTime: 116.115ms - ProbeRows: 2.13M (2133979) - ProbeRowsPartitioned: 1.07M (1066985) - ProbeTime: 1s053ms - RowsReturned: 236.11K (236111) - RowsReturnedRate: 32.58 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 37.344ms EXCHANGE_NODE (id=6):(Total: 3s753ms, non-child: 203.653ms, % non-child: 5.43%) BytesReceived(500.000ms): 0, 2.03 MB, 5.52 MB, 8.99 MB, 12.95 MB, 16.59 MB, 20.87 MB, 26.66 MB, 31.55 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB - BytesReceived: 35.31 MB (37022222) - ConvertRowBatchTime: 159.328ms - DeserializeRowBatchTimer: 244.998ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 177.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 872.893ms, non-child: 872.893ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.58 MB, 15.17 MB, 24.51 MB, 32.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 33.44 MB (35062584) - BytesReadDataNodeCache: 0 - BytesReadLocal: 33.44 MB (35062584) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 33.44 MB (35062584) - DecompressionTime: 73.967ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.70 MB (8072792) - PerReadThreadRawHdfsThroughput: 1.85 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 2.13M (2133979) - RowsReturnedRate: 2.44 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 62 (62) - ScannerThreadsTotalWallClockTime: 1s853ms - MaterializeTupleTime(*): 1s747ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s844ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 17.625ms - TotalReadThroughput: 4.66 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance ae497658e18d2d20:c3332e6d8d656a90 (host=tarmstrong-box:22000):(Total: 8s516ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 0, 264.75 KB, 18.05 MB, 36.89 MB, 51.63 MB, 68.38 MB, 86.87 MB, 101.88 MB, 103.98 MB, 104.27 MB, 99.74 MB, 109.16 MB, 109.09 MB, 109.40 MB, 109.26 MB, 64.96 MB, 10.29 MB, 10.87 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 2.17 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.46 MB (117924200) - PerHostPeakMemUsage: 119.94 MB (125761576) - PrepareTime: 260.518ms - RowsProduced: 1 (1) - TotalCpuTime: 14s493ms - TotalNetworkReceiveTime: 4s956ms - TotalNetworkSendTime: 146.735us - TotalStorageWaitTime: 5.517ms CodeGen:(Total: 728.936ms, non-child: 728.936ms, % non-child: 100.00%) - CodegenTime: 399.058us - CompileTime: 33.725ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 447.074ms - PrepareTime: 247.248ms DataStreamSender (dst_id=8):(Total: 108.184us, non-child: 108.184us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 138.69 KB/sec - OverallThroughput: 144.43 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 16.274us - ThriftTransmitTime(*): 112.664us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s503ms, non-child: 259.819ms, % non-child: 3.06%) ExecOption: Codegen Enabled - BuildTime: 17.795ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.08 MB (4282872) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s243ms, non-child: 1s041ms, % non-child: 12.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 776.315ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s195ms - GetNewBlockTime: 50.079ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 68.75 MB (72088960) - PinTime: 53.489ms - ProbeRows: 237.59K (237591) - ProbeRowsPartitioned: 163.58K (163582) - ProbeTime: 194.475ms - RowsReturned: 659.14K (659136) - RowsReturnedRate: 79.96 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 40.116ms EXCHANGE_NODE (id=7):(Total: 2s262ms, non-child: 1s105ms, % non-child: 48.87%) BytesReceived(500.000ms): 0, 5.13 MB, 10.16 MB, 15.65 MB, 20.12 MB, 24.52 MB, 27.87 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB - BytesReceived: 28.47 MB (29853221) - ConvertRowBatchTime: 905.110ms - DeserializeRowBatchTimer: 136.839ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s209ms, non-child: 2s570ms, % non-child: 35.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Disabled (Spilling) - BuildPartitionTime: 420.938ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 660.509ms - GetNewBlockTime: 172.875ms - HashBuckets: 1.05M (1048576) - HashCollisions: 361 (361) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.31 MB (46461760) - PinTime: 107.468ms - ProbeRows: 2.14M (2142543) - ProbeRowsPartitioned: 1.07M (1071962) - ProbeTime: 1s015ms - RowsReturned: 237.59K (237591) - RowsReturnedRate: 32.95 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 46.629ms EXCHANGE_NODE (id=6):(Total: 3s781ms, non-child: 192.003ms, % non-child: 5.08%) BytesReceived(500.000ms): 100.42 KB, 2.26 MB, 5.88 MB, 9.42 MB, 13.34 MB, 17.02 MB, 21.60 MB, 27.28 MB, 32.06 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB - BytesReceived: 35.31 MB (37022222) - ConvertRowBatchTime: 147.224ms - DeserializeRowBatchTimer: 258.473ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 175.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 858.077ms, non-child: 858.077ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.15 MB, 12.50 MB, 21.84 MB, 31.12 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 33.58 MB (35210108) - BytesReadDataNodeCache: 0 - BytesReadLocal: 33.58 MB (35210108) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 33.58 MB (35210108) - DecompressionTime: 72.436ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.59 MB (7956440) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 2.50 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 29 (29) - ScannerThreadsTotalWallClockTime: 1s832ms - MaterializeTupleTime(*): 1s659ms - ScannerThreadsSysTime: 76.000ms - ScannerThreadsUserTime: 1s748ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 17.962ms - TotalReadThroughput: 4.45 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance ae497658e18d2d20:c3332e6d8d656a8f (host=tarmstrong-box:22001):(Total: 8s479ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB Filter 1 arrival: 5s504ms Filter 2 arrival: 5s505ms Filter 3 arrival: 5s505ms MemoryUsage(500.000ms): 0, 63.64 KB, 17.48 MB, 32.07 MB, 50.44 MB, 65.83 MB, 84.31 MB, 101.58 MB, 99.90 MB, 101.16 MB, 96.49 MB, 109.40 MB, 108.84 MB, 109.81 MB, 109.44 MB, 64.66 MB, 12.33 MB, 9.22 MB ThreadUsage(500.000ms): 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 2.22 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 110.83 MB (116215384) - PerHostPeakMemUsage: 120.31 MB (126155416) - PrepareTime: 188.570ms - RowsProduced: 1 (1) - TotalCpuTime: 14s429ms - TotalNetworkReceiveTime: 5s417ms - TotalNetworkSendTime: 176.264us - TotalStorageWaitTime: 6.415ms CodeGen:(Total: 601.643ms, non-child: 601.643ms, % non-child: 100.00%) - CodegenTime: 481.878us - CompileTime: 22.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 399.053ms - PrepareTime: 179.434ms DataStreamSender (dst_id=8):(Total: 66.696us, non-child: 66.696us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 114.85 KB/sec - OverallThroughput: 234.27 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 17.121us - ThriftTransmitTime(*): 136.044us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s478ms, non-child: 193.263ms, % non-child: 2.28%) ExecOption: Codegen Enabled - BuildTime: 15.908ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 3.66 MB (3842544) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s285ms, non-child: 1s242ms, % non-child: 15.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 682.967ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s600ms - GetNewBlockTime: 40.277ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 70.35 MB (73769280) - PinTime: 43.087ms - ProbeRows: 97.60K (97598) - ProbeRowsPartitioned: 67.08K (67082) - ProbeTime: 95.453ms - RowsReturned: 272.96K (272965) - RowsReturnedRate: 32.94 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 38.772ms EXCHANGE_NODE (id=7):(Total: 2s504ms, non-child: 1s081ms, % non-child: 43.17%) BytesReceived(500.000ms): 0, 4.70 MB, 9.82 MB, 15.32 MB, 19.83 MB, 24.28 MB, 27.76 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB, 28.47 MB - BytesReceived: 28.47 MB (29853221) - ConvertRowBatchTime: 863.128ms - DeserializeRowBatchTimer: 146.250ms - FirstBatchArrivalWaitTime: 45.151ms - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s054ms, non-child: 1s407ms, % non-child: 19.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 396.555ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 724.458ms - GetNewBlockTime: 67.213ms - HashBuckets: 1.05M (1048576) - HashCollisions: 60 (60) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.36 MB (46515280) - PinTime: 24.477ms - ProbeRows: 133.94K (133942) - ProbeRowsPartitioned: 20.42K (20423) - ProbeTime: 61.037ms - RowsReturned: 97.60K (97598) - RowsReturnedRate: 13.83 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 28.002ms EXCHANGE_NODE (id=6):(Total: 3s962ms, non-child: 187.647ms, % non-child: 4.74%) BytesReceived(500.000ms): 6.15 KB, 2.11 MB, 5.61 MB, 9.23 MB, 13.13 MB, 16.75 MB, 21.20 MB, 26.87 MB, 31.78 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB, 35.31 MB - BytesReceived: 35.31 MB (37022222) - ConvertRowBatchTime: 152.528ms - DeserializeRowBatchTimer: 247.807ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 167.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 1s684ms, non-child: 1s684ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Runtime filters: Only following filters arrived: 1, 2, 3, waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.72 MB, 11.16 MB, 18.41 MB, 25.13 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 27.09 MB (28405548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 27.09 MB (28405548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27.09 MB (28405548) - DecompressionTime: 61.745ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.80 MB (8177584) - PerReadThreadRawHdfsThroughput: 1.82 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 133.94K (133942) - RowsReturnedRate: 79.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 44 (44) - ScannerThreadsTotalWallClockTime: 1s817ms - MaterializeTupleTime(*): 1s724ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s808ms - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 14.537ms - TotalReadThroughput: 3.59 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 1.72M (1724693) - Rows rejected: 1.30M (1304625) - Rows total: 1.72M (1724693) Filter 2: - Rows processed: 420.07K (420068) - Rows rejected: 286.13K (286126) - Rows total: 1.72M (1724693) Filter 3: - Rows processed: 1.23K (1234) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Fragment F02: Instance ae497658e18d2d20:c3332e6d8d656a93 (host=tarmstrong-box:22000):(Total: 3s257ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 0, 23.98 KB, 2.60 MB, 2.42 MB, 2.29 MB, 2.04 MB, 2.04 MB, 1.39 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.25 MB (3409640) - PerHostPeakMemUsage: 117.63 MB (123340232) - PrepareTime: 297.948ms - RowsProduced: 951.22K (951217) - TotalCpuTime: 6s643ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 133.451ms - TotalStorageWaitTime: 4.180ms CodeGen:(Total: 861.170ms, non-child: 861.170ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 552.027ms - PrepareTime: 296.063ms DataStreamSender (dst_id=7):(Total: 673.216ms, non-child: 673.216ms, % non-child: 100.00%) - BytesSent: 29.67 MB (31109769) - NetworkThroughput(*): 25.66 MB/sec - OverallThroughput: 44.07 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 425.736ms - ThriftTransmitTime(*): 1s156ms - UncompressedRowBatchSize: 76.21 MB (79913484) HDFS_SCAN_NODE (id=1):(Total: 2s876ms, non-child: 2s876ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.01 MB, 2.58 MB, 3.03 MB, 3.60 MB, 3.99 MB, 4.46 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.46 MB (4673379) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.46 MB (4673379) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.46 MB (4673379) - DecompressionTime: 13.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.14 MB (3294968) - PerReadThreadRawHdfsThroughput: 1.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 951.22K (951217) - RowsReturnedRate: 330.64 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1641) - ScannerThreadsTotalWallClockTime: 2s951ms - MaterializeTupleTime(*): 2s918ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s992ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 2.641ms - TotalReadThroughput: 1.27 MB/sec Instance ae497658e18d2d20:c3332e6d8d656a91 (host=tarmstrong-box:22002):(Total: 2s959ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 0, 23.98 KB, 2.60 MB, 2.42 MB, 2.17 MB, 2.01 MB, 1.69 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.01 MB (3151264) - PerHostPeakMemUsage: 108.36 MB (113627464) - PrepareTime: 201.897ms - RowsProduced: 947.94K (947940) - TotalCpuTime: 6s011ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 141.557ms - TotalStorageWaitTime: 3.794ms CodeGen:(Total: 645.651ms, non-child: 645.651ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 435.443ms - PrepareTime: 200.035ms DataStreamSender (dst_id=7):(Total: 634.242ms, non-child: 634.242ms, % non-child: 100.00%) - BytesSent: 31.00 MB (32508207) - NetworkThroughput(*): 26.10 MB/sec - OverallThroughput: 48.88 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 436.339ms - ThriftTransmitTime(*): 1s187ms - UncompressedRowBatchSize: 75.95 MB (79638180) HDFS_SCAN_NODE (id=1):(Total: 2s512ms, non-child: 2s512ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.01 MB, 2.77 MB, 3.34 MB, 3.98 MB, 4.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.44 MB (4657953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.44 MB (4657953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.44 MB (4657953) - DecompressionTime: 15.151ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.96 MB (3102128) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 947.94K (947940) - RowsReturnedRate: 377.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1550) - ScannerThreadsTotalWallClockTime: 2s746ms - MaterializeTupleTime(*): 2s716ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s952ms - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsReadTime(*): 2.598ms - TotalReadThroughput: 1.48 MB/sec Instance ae497658e18d2d20:c3332e6d8d656a92 (host=tarmstrong-box:22001):(Total: 2s906ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB MemoryUsage(500.000ms): 0, 23.98 KB, 2.79 MB, 2.29 MB, 2.13 MB, 1.79 MB, 1.36 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.04 MB (3188536) - PerHostPeakMemUsage: 102.82 MB (107815416) - PrepareTime: 217.000ms - RowsProduced: 767.41K (767408) - TotalCpuTime: 5s910ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.484ms - TotalStorageWaitTime: 6.461ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 512 (512) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 85.45 MB (89600000) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 656.167ms, non-child: 656.167ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 427.229ms - PrepareTime: 215.160ms DataStreamSender (dst_id=7):(Total: 456.683ms, non-child: 456.683ms, % non-child: 100.00%) - BytesSent: 24.74 MB (25941687) - NetworkThroughput(*): 23.77 MB/sec - OverallThroughput: 54.17 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 335.105ms - ThriftTransmitTime(*): 1s041ms - UncompressedRowBatchSize: 61.48 MB (64471356) HDFS_SCAN_NODE (id=1):(Total: 2s637ms, non-child: 2s637ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.07 MB, 2.45 MB, 2.83 MB, 3.40 MB, 3.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.63 MB (3810342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.63 MB (3810342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.63 MB (3810342) - DecompressionTime: 13.426ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.02 MB (3163976) - PerReadThreadRawHdfsThroughput: 2.03 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 767.41K (767408) - RowsReturnedRate: 291.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1761) - ScannerThreadsTotalWallClockTime: 2s666ms - MaterializeTupleTime(*): 2s636ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s688ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 1.750ms - TotalReadThroughput: 1.21 MB/sec Fragment F01: Instance ae497658e18d2d20:c3332e6d8d656a96 (host=tarmstrong-box:22000):(Total: 4s558ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 0, 14.84 KB, 8.36 MB, 8.05 MB, 7.74 MB, 7.93 MB, 7.68 MB, 7.68 MB, 7.43 MB, 7.37 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.89 MB (9318864) - PerHostPeakMemUsage: 119.94 MB (125761576) - PrepareTime: 250.469ms - RowsProduced: 237.59K (237591) - TotalCpuTime: 9s238ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.920ms - TotalStorageWaitTime: 19.837ms CodeGen:(Total: 679.422ms, non-child: 679.422ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 420.720ms - PrepareTime: 241.470ms DataStreamSender (dst_id=6):(Total: 272.374ms, non-child: 272.374ms, % non-child: 100.00%) - BytesSent: 38.24 MB (40096935) - NetworkThroughput(*): 38.18 MB/sec - OverallThroughput: 140.39 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 250.785ms - ThriftTransmitTime(*): 1s001ms - UncompressedRowBatchSize: 65.60 MB (68782956) HDFS_SCAN_NODE (id=0):(Total: 4s511ms, non-child: 4s511ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 4.48 MB, 7.35 MB, 10.97 MB, 14.40 MB, 17.72 MB, 21.53 MB, 26.30 MB, 30.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 34.61 MB (36286428) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.61 MB (36286428) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.61 MB (36286428) - DecompressionTime: 123.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.87 MB (9303664) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 237.59K (237591) - RowsReturnedRate: 52.67 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1519) - ScannerThreadsTotalWallClockTime: 4s269ms - MaterializeTupleTime(*): 3s925ms - ScannerThreadsSysTime: 96.000ms - ScannerThreadsUserTime: 3s208ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 20.095ms - TotalReadThroughput: 6.86 MB/sec Instance ae497658e18d2d20:c3332e6d8d656a94 (host=tarmstrong-box:22002):(Total: 4s495ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 0, 1.20 MB, 7.86 MB, 7.92 MB, 7.92 MB, 7.80 MB, 7.74 MB, 7.74 MB, 7.17 MB, 7.02 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.63 MB (9050168) - PerHostPeakMemUsage: 119.83 MB (125650648) - PrepareTime: 165.341ms - RowsProduced: 236.11K (236111) - TotalCpuTime: 9s200ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.060ms - TotalStorageWaitTime: 14.005ms CodeGen:(Total: 577.518ms, non-child: 577.518ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.141ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 404.018ms - PrepareTime: 163.416ms DataStreamSender (dst_id=6):(Total: 288.507ms, non-child: 288.507ms, % non-child: 100.00%) - BytesSent: 37.53 MB (39347823) - NetworkThroughput(*): 36.10 MB/sec - OverallThroughput: 130.07 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 254.071ms - ThriftTransmitTime(*): 1s039ms - UncompressedRowBatchSize: 65.17 MB (68333814) HDFS_SCAN_NODE (id=0):(Total: 4s346ms, non-child: 4s346ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 100.00 KB, 5.82 MB, 8.68 MB, 11.92 MB, 15.43 MB, 18.29 MB, 22.48 MB, 27.44 MB, 31.73 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 34.46 MB (36134605) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.46 MB (36134605) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.46 MB (36134605) - DecompressionTime: 99.741ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.62 MB (9034968) - PerReadThreadRawHdfsThroughput: 1.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 236.11K (236111) - RowsReturnedRate: 54.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1684) - ScannerThreadsTotalWallClockTime: 4s309ms - MaterializeTupleTime(*): 4s154ms - ScannerThreadsSysTime: 8.000ms - ScannerThreadsUserTime: 3s244ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 19.883ms - TotalReadThroughput: 7.05 MB/sec Instance ae497658e18d2d20:c3332e6d8d656a95 (host=tarmstrong-box:22001):(Total: 3s919ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB MemoryUsage(500.000ms): 0, 14.84 KB, 7.36 MB, 7.61 MB, 7.56 MB, 7.68 MB, 7.56 MB, 7.24 MB, 6.68 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.78 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.39 MB (8794680) - PerHostPeakMemUsage: 119.32 MB (125119672) - PrepareTime: 213.047ms - RowsProduced: 191.55K (191552) - TotalCpuTime: 8s064ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.923ms - TotalStorageWaitTime: 12.966ms CodeGen:(Total: 689.383ms, non-child: 689.383ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 469.089ms - PrepareTime: 211.376ms DataStreamSender (dst_id=6):(Total: 214.350ms, non-child: 214.350ms, % non-child: 100.00%) - BytesSent: 30.16 MB (31621908) - NetworkThroughput(*): 34.43 MB/sec - OverallThroughput: 140.69 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 209.692ms - ThriftTransmitTime(*): 875.935ms - UncompressedRowBatchSize: 52.88 MB (55447590) HDFS_SCAN_NODE (id=0):(Total: 3s889ms, non-child: 3s889ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 4.29 MB, 7.54 MB, 10.40 MB, 13.83 MB, 17.71 MB, 21.14 MB, 25.95 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 27.92 MB (29271988) - BytesReadDataNodeCache: 0 - BytesReadLocal: 27.92 MB (29271988) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27.92 MB (29271988) - DecompressionTime: 92.594ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.37 MB (8779480) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 191.55K (191552) - RowsReturnedRate: 49.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1500) - ScannerThreadsTotalWallClockTime: 3s673ms - MaterializeTupleTime(*): 3s525ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 2s772ms - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsReadTime(*): 16.271ms - TotalReadThroughput: 6.49 MB/sec