Query (id=594ebc976a121d5b:59d55bd0f66b60b2): Summary: Session ID: 414804d74ea261db:cf8ea72270822aab Session Type: BEESWAX Start Time: 2016-02-23 22:02:18.669391000 End Time: 2016-02-23 22:02:28.333183000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 DEBUG (build d39edee93342fb92c9a3caa509fd12f47dd5f240) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:56391 Default Db: tpch_parquet Sql Statement: select count(l1.l_tax) from lineitem l1, lineitem l2, lineitem l3 where l1.l_tax < 0.01 and l2.l_tax < 0.04 and l1.l_orderkey = l2.l_orderkey and l1.l_orderkey = l3.l_orderkey and l1.l_comment = l3.l_comment and l1.l_shipdate = l3.l_shipdate Coordinator: tarmstrong-box:22000 Query Options (non default): MAX_BLOCK_MGR_MEMORY=104857600 Plan: ---------------- Estimated Per-Host Requirements: Memory=543.27MB VCores=3 09:AGGREGATE [FINALIZE] | output: count:merge(l1.l_tax) | hosts=3 per-host-mem=unavailable | tuple-ids=3 row-size=8B cardinality=1 | 08:EXCHANGE [UNPARTITIONED] | hosts=3 per-host-mem=unavailable | tuple-ids=3 row-size=8B cardinality=1 | 05:AGGREGATE | output: count(l1.l_tax) | hosts=3 per-host-mem=10.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=3 per-host-mem=10.07MB | tuple-ids=2,0,1 row-size=177B cardinality=60013 | |--07:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=1 row-size=16B cardinality=600122 | | | 01:SCAN HDFS [tpch_parquet.lineitem l2, RANDOM] | partitions=1/1 files=3 size=195.85MB | predicates: l2.l_tax < 0.04 | table stats: 6001215 rows total | column stats: all | hosts=3 per-host-mem=160.00MB | tuple-ids=1 row-size=16B cardinality=600122 | 03:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l3.l_orderkey = l1.l_orderkey, l3.l_comment = l1.l_comment, l3.l_shipdate = l1.l_shipdate | runtime filters: RF001 <- l1.l_orderkey, RF002 <- l1.l_comment, RF003 <- l1.l_shipdate | hosts=3 per-host-mem=53.19MB | tuple-ids=2,0 row-size=161B cardinality=600122 | |--06:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=0 row-size=84B cardinality=600122 | | | 00:SCAN HDFS [tpch_parquet.lineitem l1, RANDOM] | partitions=1/1 files=3 size=195.85MB | predicates: l1.l_tax < 0.01 | table stats: 6001215 rows total | column stats: all | hosts=3 per-host-mem=320.00MB | tuple-ids=0 row-size=84B cardinality=600122 | 02:SCAN HDFS [tpch_parquet.lineitem l3, RANDOM] partitions=1/1 files=3 size=195.85MB runtime filters: RF000 -> l3.l_orderkey, RF001 -> l3.l_orderkey, RF002 -> l3.l_comment, RF003 -> l3.l_shipdate table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=240.00MB tuple-ids=2 row-size=76B cardinality=6001215 ---------------- Estimated Per-Host Mem: 569656122 Estimated Per-Host VCores: 3 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------- 09:AGGREGATE 1 97.934ms 97.934ms 1 1 24.00 KB -1.00 B FINALIZE 08:EXCHANGE 1 85.416us 85.416us 3 1 0 -1.00 B UNPARTITIONED 05:AGGREGATE 3 232.660ms 273.521ms 3 1 4.49 MB 10.00 MB 04:HASH JOIN 3 1s104ms 1s231ms 1.85M 60.01K 66.75 MB 10.07 MB INNER JOIN, BROADCAST |--07:EXCHANGE 3 1s067ms 1s095ms 2.67M 600.12K 0 0 BROADCAST | 01:SCAN HDFS 3 2s661ms 2s693ms 2.67M 600.12K 3.08 MB 160.00 MB tpch_parquet.lineitem l2 03:HASH JOIN 3 2s391ms 2s634ms 665.25K 600.12K 56.14 MB 53.19 MB INNER JOIN, BROADCAST |--06:EXCHANGE 3 181.719ms 186.534ms 665.25K 600.12K 0 0 BROADCAST | 00:SCAN HDFS 3 4s255ms 4s497ms 665.25K 600.12K 8.87 MB 320.00 MB tpch_parquet.lineitem l1 02:SCAN HDFS 3 1s024ms 1s221ms 6.00M 6.00M 8.24 MB 240.00 MB tpch_parquet.lineitem l3 Planner Timeline: 7.660ms - Analysis finished: 2.785ms (2.785ms) - Equivalence classes computed: 2.928ms (142.495us) - Single node plan created: 5.153ms (2.225ms) - Runtime filters computed: 5.320ms (166.950us) - Distributed plan created: 6.494ms (1.173ms) - Planning finished: 7.660ms (1.166ms) Query Timeline: 9s670ms - Start execution: 62.338us (62.338us) - Planning finished: 9.105ms (9.043ms) - Ready to start 9 remote fragments: 108.399ms (99.293ms) - All 9 remote fragments started: 110.170ms (1.770ms) - Rows available: 9s657ms (9s547ms) - First row fetched: 9s661ms (4.296ms) - Unregister query: 9s663ms (2.152ms) ImpalaServer: - ClientFetchWaitTimer: 4.696ms - RowMaterializationTimer: 11.790us Execution Profile 594ebc976a121d5b:59d55bd0f66b60b2:(Total: 9s649ms, non-child: 0.000ns, % non-child: 0.00%) Fragment start latencies: Count: 9, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: tarmstrong-box:22001(119.31 MB) tarmstrong-box:22002(120.28 MB) tarmstrong-box:22000(119.85 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 9s276ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 24.01 KB, 28.01 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.02 KB (32784) - PerHostPeakMemUsage: 0 - PrepareTime: 97.835ms - RowsProduced: 1 (1) - TotalCpuTime: 473.881ms - TotalNetworkReceiveTime: 9s178ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.30K (1299) - BlocksRecycled: 351 (351) - BufferedPins: 113 (113) - BytesWritten: 165.56 MB (173600000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.96 MB (104820096) - TotalBufferWaitTime: 61.760ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 87.519ms CodeGen:(Total: 465.726ms, non-child: 465.726ms, % non-child: 100.00%) - CodegenTime: 580.761us - CompileTime: 6.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 361.884ms - PrepareTime: 96.281ms AGGREGATION_NODE (id=9):(Total: 9s276ms, non-child: 97.934ms, % non-child: 1.06%) ExecOption: Codegen Enabled - BuildTime: 2.274us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=8):(Total: 9s178ms, non-child: 85.416us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 32.00 B - BytesReceived: 48.00 B (48) - ConvertRowBatchTime: 19.825us - DeserializeRowBatchTimer: 52.626us - FirstBatchArrivalWaitTime: 8s452ms - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 8s629ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:8s823ms max:9s549ms mean: 9s165ms stddev:297.798ms execution rates: min:6.39 MB/sec max:7.63 MB/sec mean:7.11 MB/sec stddev:541.33 KB/sec num instances: 3 - AverageThreadTokens: 2.19 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.66 MB (118128330) - PerHostPeakMemUsage: 119.81 MB (125632269) - PrepareTime: 225.710ms - RowsProduced: 1 (1) - TotalCpuTime: 14s671ms - TotalNetworkReceiveTime: 4s974ms - TotalNetworkSendTime: 184.039us - TotalStorageWaitTime: 4.184ms CodeGen:(Total: 745.582ms, non-child: 745.582ms, % non-child: 100.00%) - CodegenTime: 546.635us - CompileTime: 36.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 492.043ms - PrepareTime: 215.722ms DataStreamSender (dst_id=8):(Total: 91.468us, non-child: 91.468us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 109.32 KB/sec - OverallThroughput: 179.13 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 17.872us - ThriftTransmitTime(*): 145.887us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s622ms, non-child: 232.660ms, % non-child: 2.70%) - BuildTime: 17.420ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.01 MB (4208949) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s389ms, non-child: 1s104ms, % non-child: 13.17%) - BuildPartitionTime: 700.744ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s355ms - GetNewBlockTime: 72.397ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 66.21 MB (69429653) - PinTime: 50.371ms - ProbeRows: 221.75K (221751) - ProbeRowsPartitioned: 156.38K (156379) - ProbeTime: 197.226ms - RowsReturned: 615.58K (615581) - RowsReturnedRate: 73.25 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 54.803ms EXCHANGE_NODE (id=7):(Total: 2s140ms, non-child: 2s140ms, % non-child: 100.00%) - BytesReceived: 30.35 MB (31819656) - ConvertRowBatchTime: 870.186ms - DeserializeRowBatchTimer: 147.173ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s292ms, non-child: 2s391ms, % non-child: 32.79%) - BuildPartitionTime: 401.726ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 534.853ms - GetNewBlockTime: 168.840ms - HashBuckets: 1.05M (1048576) - HashCollisions: 349 (349) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 48.22 MB (50566624) - PinTime: 98.295ms - ProbeRows: 2.00M (2000405) - ProbeRowsPartitioned: 892.54K (892541) - ProbeTime: 950.635ms - RowsReturned: 221.75K (221751) - RowsReturnedRate: 30.36 K/sec - SpilledPartitions: 7 (7) - UnpinTime: 24.818ms EXCHANGE_NODE (id=6):(Total: 3s876ms, non-child: 3s876ms, % non-child: 100.00%) - BytesReceived: 35.57 MB (37298428) - ConvertRowBatchTime: 145.000ms - DeserializeRowBatchTimer: 250.754ms - FirstBatchArrivalWaitTime: 5.412ms - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 171.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 1s024ms, non-child: 1s024ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.27 - BytesRead: 31.37 MB (32892746) - BytesReadDataNodeCache: 0 - BytesReadLocal: 31.37 MB (32892746) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31.37 MB (32892746) - DecompressionTime: 73.219ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.81 MB (8188773) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 2.00M (2000405) - RowsReturnedRate: 1.97 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 144 (144) - ScannerThreadsTotalWallClockTime: 1s946ms - MaterializeTupleTime(*): 1s816ms - ScannerThreadsSysTime: 26.666ms - ScannerThreadsUserTime: 1s909ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 17.071ms - TotalReadThroughput: 3.78 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Averaged Fragment F02:(Total: 3s034ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:3s250ms max:3s624ms mean: 3s474ms stddev:161.552ms execution rates: min:17.33 MB/sec max:19.69 MB/sec mean:18.74 MB/sec stddev:1.02 MB/sec num instances: 3 - AverageThreadTokens: 1.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.92 MB (3065629) - PerHostPeakMemUsage: 108.77 MB (114050773) - PrepareTime: 191.873ms - RowsProduced: 888.86K (888855) - TotalCpuTime: 6s166ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 109.242ms - TotalStorageWaitTime: 11.766ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 512 (512) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 85.45 MB (89600000) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 616.314ms, non-child: 616.314ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 15.060ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 410.332ms - PrepareTime: 189.936ms DataStreamSender (dst_id=7):(Total: 532.124ms, non-child: 532.124ms, % non-child: 100.00%) - BytesSent: 30.35 MB (31819656) - NetworkThroughput(*): 26.23 MB/sec - OverallThroughput: 57.60 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 390.130ms - ThriftTransmitTime(*): 1s156ms - UncompressedRowBatchSize: 71.22 MB (74674340) HDFS_SCAN_NODE (id=1):(Total: 2s661ms, non-child: 2s661ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.18 MB (4380558) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4380558) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4380558) - DecompressionTime: 17.890ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.89 MB (3032877) - PerReadThreadRawHdfsThroughput: 1.89 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 888.86K (888855) - RowsReturnedRate: 334.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1767) - ScannerThreadsTotalWallClockTime: 2s813ms - MaterializeTupleTime(*): 2s773ms - ScannerThreadsSysTime: 1.333ms - ScannerThreadsUserTime: 1s884ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 2.194ms - TotalReadThroughput: 1.25 MB/sec Averaged Fragment F01:(Total: 4s314ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 56.35 MB, max: 69.90 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:4s557ms max:5s070ms mean: 4s808ms stddev:209.633ms execution rates: min:12.36 MB/sec max:14.57 MB/sec mean:13.55 MB/sec stddev:929.94 KB/sec num instances: 3 - AverageThreadTokens: 1.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.64 MB (9054570) - PerHostPeakMemUsage: 119.81 MB (125632269) - PrepareTime: 220.276ms - RowsProduced: 221.75K (221751) - TotalCpuTime: 8s856ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.254ms - TotalStorageWaitTime: 17.286ms CodeGen:(Total: 697.305ms, non-child: 697.305ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 14.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 463.959ms - PrepareTime: 218.258ms DataStreamSender (dst_id=6):(Total: 258.054ms, non-child: 258.054ms, % non-child: 100.00%) - BytesSent: 35.57 MB (37298428) - NetworkThroughput(*): 38.44 MB/sec - OverallThroughput: 137.90 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 237.549ms - ThriftTransmitTime(*): 926.955ms - UncompressedRowBatchSize: 61.21 MB (64188120) HDFS_SCAN_NODE (id=0):(Total: 4s255ms, non-child: 4s255ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 32.33 MB (33897673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 32.33 MB (33897673) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 32.33 MB (33897673) - DecompressionTime: 95.844ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.62 MB (9039370) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.00M (2000405) - RowsReturned: 221.75K (221751) - RowsReturnedRate: 52.01 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1478) - ScannerThreadsTotalWallClockTime: 4s071ms - MaterializeTupleTime(*): 3s875ms - ScannerThreadsSysTime: 33.333ms - ScannerThreadsUserTime: 3s034ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 18.841ms - TotalReadThroughput: 6.51 MB/sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 790 (790) - BlocksRecycled: 39 (39) - BufferedPins: 0 (0) - BytesWritten: 58.94 MB (61800000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.95 MB (104800000) - TotalBufferWaitTime: 44.324ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F00: Instance 594ebc976a121d5b:59d55bd0f66b60b6 (host=tarmstrong-box:22000):(Total: 9s092ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 52.00 KB, 13.31 MB, 31.51 MB, 47.22 MB, 61.94 MB, 79.11 MB, 95.59 MB, 101.56 MB, 102.78 MB, 103.12 MB, 103.16 MB, 110.03 MB, 109.61 MB, 109.24 MB, 109.06 MB, 65.03 MB, 64.59 MB, 10.87 MB, 11.45 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 2.16 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.84 MB (118322248) - PerHostPeakMemUsage: 119.85 MB (125667792) - PrepareTime: 227.165ms - RowsProduced: 1 (1) - TotalCpuTime: 15s323ms - TotalNetworkReceiveTime: 5s146ms - TotalNetworkSendTime: 159.358us - TotalStorageWaitTime: 4.128ms CodeGen:(Total: 673.465ms, non-child: 673.465ms, % non-child: 100.00%) - CodegenTime: 517.049us - CompileTime: 24.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 430.498ms - PrepareTime: 217.609ms DataStreamSender (dst_id=8):(Total: 67.655us, non-child: 67.655us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 129.22 KB/sec - OverallThroughput: 230.95 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 16.482us - ThriftTransmitTime(*): 120.918us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 9s091ms, non-child: 235.672ms, % non-child: 2.59%) ExecOption: Codegen Enabled - BuildTime: 18.208ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.24 MB (4446712) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s855ms, non-child: 1s032ms, % non-child: 11.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 693.980ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s338ms - GetNewBlockTime: 67.472ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 66.48 MB (69709440) - PinTime: 48.659ms - ProbeRows: 237.59K (237591) - ProbeRowsPartitioned: 162.94K (162939) - ProbeTime: 197.360ms - RowsReturned: 659.14K (659136) - RowsReturnedRate: 74.43 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 67.197ms EXCHANGE_NODE (id=7):(Total: 2s224ms, non-child: 1s054ms, % non-child: 47.39%) BytesReceived(500.000ms): 0, 2.47 MB, 7.45 MB, 12.49 MB, 18.04 MB, 23.71 MB, 28.99 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB - BytesReceived: 30.35 MB (31819656) - ConvertRowBatchTime: 880.740ms - DeserializeRowBatchTimer: 141.958ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s832ms, non-child: 2s634ms, % non-child: 33.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Disabled (Spilling) - BuildPartitionTime: 384.793ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 608.071ms - GetNewBlockTime: 195.441ms - HashBuckets: 1.05M (1048576) - HashCollisions: 360 (360) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.17 MB (46316032) - PinTime: 116.172ms - ProbeRows: 2.14M (2142543) - ProbeRowsPartitioned: 1.07M (1071230) - ProbeTime: 1s027ms - RowsReturned: 237.59K (237591) - RowsReturnedRate: 30.34 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 33.084ms EXCHANGE_NODE (id=6):(Total: 3s976ms, non-child: 181.691ms, % non-child: 4.57%) BytesReceived(500.000ms): 0, 866.73 KB, 4.27 MB, 7.91 MB, 11.44 MB, 15.12 MB, 19.09 MB, 24.51 MB, 29.79 MB, 34.77 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB - BytesReceived: 35.57 MB (37298428) - ConvertRowBatchTime: 150.172ms - DeserializeRowBatchTimer: 251.729ms - FirstBatchArrivalWaitTime: 16.237ms - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 167.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 1s221ms, non-child: 1s221ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.54 MB, 15.36 MB, 22.41 MB, 30.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.29 - BytesRead: 33.58 MB (35210108) - BytesReadDataNodeCache: 0 - BytesReadLocal: 33.58 MB (35210108) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 33.58 MB (35210108) - DecompressionTime: 78.235ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.65 MB (8022024) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 1.75 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 115 (115) - ScannerThreadsTotalWallClockTime: 2s171ms - MaterializeTupleTime(*): 1s984ms - ScannerThreadsSysTime: 80.000ms - ScannerThreadsUserTime: 2s080ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 18.321ms - TotalReadThroughput: 4.07 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 594ebc976a121d5b:59d55bd0f66b60b4 (host=tarmstrong-box:22002):(Total: 8s535ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 52.00 KB, 13.38 MB, 25.54 MB, 43.73 MB, 59.29 MB, 77.47 MB, 93.04 MB, 103.33 MB, 100.74 MB, 103.35 MB, 109.04 MB, 109.65 MB, 109.60 MB, 110.78 MB, 65.28 MB, 64.71 MB, 12.45 MB, 9.10 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 2.17 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.28 MB (117730584) - PerHostPeakMemUsage: 120.28 MB (126126512) - PrepareTime: 182.433ms - RowsProduced: 1 (1) - TotalCpuTime: 14s437ms - TotalNetworkReceiveTime: 5s015ms - TotalNetworkSendTime: 182.437us - TotalStorageWaitTime: 3.968ms CodeGen:(Total: 758.302ms, non-child: 758.302ms, % non-child: 100.00%) - CodegenTime: 553.523us - CompileTime: 29.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 555.920ms - PrepareTime: 172.196ms DataStreamSender (dst_id=8):(Total: 91.357us, non-child: 91.357us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 107.80 KB/sec - OverallThroughput: 171.03 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 19.816us - ThriftTransmitTime(*): 144.942us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s535ms, non-child: 188.788ms, % non-child: 2.21%) ExecOption: Codegen Enabled - BuildTime: 17.009ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 3.31 MB (3469232) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 8s346ms, non-child: 1s049ms, % non-child: 12.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 680.883ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s244ms - GetNewBlockTime: 68.188ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 66.75 MB (69989760) - PinTime: 49.335ms - ProbeRows: 236.11K (236111) - ProbeRowsPartitioned: 162.38K (162380) - ProbeTime: 215.439ms - RowsReturned: 654.82K (654817) - RowsReturnedRate: 78.45 K/sec - SpilledPartitions: 11 (11) - UnpinTime: 40.142ms EXCHANGE_NODE (id=7):(Total: 2s161ms, non-child: 1s051ms, % non-child: 48.62%) BytesReceived(500.000ms): 0, 2.02 MB, 6.96 MB, 11.94 MB, 17.43 MB, 23.16 MB, 28.55 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB - BytesReceived: 30.35 MB (31819656) - ConvertRowBatchTime: 854.623ms - DeserializeRowBatchTimer: 145.158ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 7s304ms, non-child: 2s444ms, % non-child: 33.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Disabled (Spilling) - BuildPartitionTime: 402.061ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 429.971ms - GetNewBlockTime: 163.278ms - HashBuckets: 1.05M (1048576) - HashCollisions: 376 (376) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 44.36 MB (46516032) - PinTime: 111.961ms - ProbeRows: 2.13M (2133979) - ProbeRowsPartitioned: 1.07M (1067022) - ProbeTime: 1s110ms - RowsReturned: 236.11K (236111) - RowsReturnedRate: 32.32 K/sec - SpilledPartitions: 8 (8) - UnpinTime: 21.805ms EXCHANGE_NODE (id=6):(Total: 3s882ms, non-child: 186.534ms, % non-child: 4.80%) BytesReceived(500.000ms): 0, 588.00 KB, 3.85 MB, 7.48 MB, 11.08 MB, 14.72 MB, 18.70 MB, 24.00 MB, 29.24 MB, 34.44 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB - BytesReceived: 35.57 MB (37298428) - ConvertRowBatchTime: 141.557ms - DeserializeRowBatchTimer: 251.893ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 171.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 977.822ms, non-child: 977.822ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.15 MB, 12.30 MB, 20.70 MB, 28.52 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 33.44 MB (35062584) - BytesReadDataNodeCache: 0 - BytesReadLocal: 33.44 MB (35062584) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 33.44 MB (35062584) - DecompressionTime: 78.659ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.54 MB (7908784) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 2.13M (2133979) - RowsReturnedRate: 2.18 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 118 (118) - ScannerThreadsTotalWallClockTime: 2s035ms - MaterializeTupleTime(*): 1s925ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 2s028ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 17.814ms - TotalReadThroughput: 4.07 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 594ebc976a121d5b:59d55bd0f66b60b5 (host=tarmstrong-box:22001):(Total: 8s260ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB MemoryUsage(500.000ms): 52.00 KB, 12.34 MB, 27.87 MB, 45.53 MB, 59.60 MB, 78.06 MB, 93.76 MB, 100.23 MB, 98.97 MB, 102.17 MB, 101.22 MB, 110.50 MB, 111.08 MB, 110.08 MB, 53.84 MB, 10.93 MB, 10.11 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 2.24 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 112.85 MB (118332160) - PerHostPeakMemUsage: 119.31 MB (125102504) - PrepareTime: 267.531ms - RowsProduced: 1 (1) - TotalCpuTime: 14s251ms - TotalNetworkReceiveTime: 4s760ms - TotalNetworkSendTime: 210.323us - TotalStorageWaitTime: 4.457ms CodeGen:(Total: 804.978ms, non-child: 804.978ms, % non-child: 100.00%) - CodegenTime: 569.334us - CompileTime: 56.672ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 489.711ms - PrepareTime: 257.359ms DataStreamSender (dst_id=8):(Total: 115.393us, non-child: 115.393us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 90.95 KB/sec - OverallThroughput: 135.41 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 17.319us - ThriftTransmitTime(*): 171.802us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=5):(Total: 8s240ms, non-child: 273.521ms, % non-child: 3.32%) ExecOption: Codegen Enabled - BuildTime: 17.044ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.49 MB (4710904) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=4):(Total: 7s966ms, non-child: 1s231ms, % non-child: 15.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (Spilling), Spilled - BuildPartitionTime: 727.369ms - BuildRows: 2.67M (2666565) - BuildRowsPartitioned: 2.67M (2666565) - BuildTime: 1s484ms - GetNewBlockTime: 81.531ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 12 (12) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 65.41 MB (68589760) - PinTime: 53.120ms - ProbeRows: 191.55K (191552) - ProbeRowsPartitioned: 143.82K (143818) - ProbeTime: 178.879ms - RowsReturned: 532.79K (532790) - RowsReturnedRate: 66.88 K/sec - SpilledPartitions: 12 (12) - UnpinTime: 57.071ms EXCHANGE_NODE (id=7):(Total: 2s035ms, non-child: 1s095ms, % non-child: 53.85%) BytesReceived(500.000ms): 0, 2.24 MB, 7.20 MB, 12.19 MB, 17.74 MB, 23.48 MB, 28.78 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB, 30.35 MB - BytesReceived: 30.35 MB (31819656) - ConvertRowBatchTime: 875.194ms - DeserializeRowBatchTimer: 154.404ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.67M (2666565) - RowsReturnedRate: 1.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 6s740ms, non-child: 2s096ms, % non-child: 31.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled, Build-Side Runtime-Filter Disabled (Spilling) - BuildPartitionTime: 418.325ms - BuildRows: 665.25K (665254) - BuildRowsPartitioned: 665.25K (665254) - BuildTime: 566.518ms - GetNewBlockTime: 147.802ms - HashBuckets: 1.05M (1048576) - HashCollisions: 311 (311) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 56.14 MB (58867808) - PinTime: 66.752ms - ProbeRows: 1.72M (1724693) - ProbeRowsPartitioned: 539.37K (539372) - ProbeTime: 714.364ms - RowsReturned: 191.55K (191552) - RowsReturnedRate: 28.42 K/sec - SpilledPartitions: 5 (5) - UnpinTime: 19.566ms EXCHANGE_NODE (id=6):(Total: 3s771ms, non-child: 176.931ms, % non-child: 4.69%) BytesReceived(500.000ms): 0, 705.88 KB, 4.07 MB, 7.64 MB, 11.28 MB, 14.94 MB, 18.85 MB, 24.27 MB, 29.56 MB, 34.59 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB, 35.57 MB - BytesReceived: 35.57 MB (37298428) - ConvertRowBatchTime: 143.271ms - DeserializeRowBatchTimer: 248.641ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 665.25K (665254) - RowsReturnedRate: 176.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=2):(Total: 873.262ms, non-child: 873.262ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.82 MB, 14.02 MB, 22.41 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.23 - BytesRead: 27.09 MB (28405548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 27.09 MB (28405548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27.09 MB (28405548) - DecompressionTime: 62.764ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.24 MB (8635512) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 1.97 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 201 (201) - ScannerThreadsTotalWallClockTime: 1s633ms - MaterializeTupleTime(*): 1s539ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s620ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 15.079ms - TotalReadThroughput: 3.20 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 2: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Fragment F02: Instance 594ebc976a121d5b:59d55bd0f66b60b7 (host=tarmstrong-box:22002):(Total: 3s117ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 23.98 KB, 2.88 MB, 2.42 MB, 2.29 MB, 2.07 MB, 1.79 MB, 1.67 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.10 MB (3254056) - PerHostPeakMemUsage: 112.28 MB (117732808) - PrepareTime: 161.107ms - RowsProduced: 947.94K (947940) - TotalCpuTime: 6s395ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 145.371ms - TotalStorageWaitTime: 14.017ms CodeGen:(Total: 639.536ms, non-child: 639.536ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 26.048ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 453.321ms - PrepareTime: 159.248ms DataStreamSender (dst_id=7):(Total: 624.231ms, non-child: 624.231ms, % non-child: 100.00%) - BytesSent: 32.44 MB (34016688) - NetworkThroughput(*): 25.64 MB/sec - OverallThroughput: 51.97 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 413.593ms - ThriftTransmitTime(*): 1s265ms - UncompressedRowBatchSize: 75.95 MB (79638180) HDFS_SCAN_NODE (id=1):(Total: 2s623ms, non-child: 2s623ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.01 MB, 2.39 MB, 2.84 MB, 3.60 MB, 4.17 MB, 4.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.44 MB (4657953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.44 MB (4657953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.44 MB (4657953) - DecompressionTime: 17.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.08 MB (3229496) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 947.94K (947940) - RowsReturnedRate: 361.39 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1967) - ScannerThreadsTotalWallClockTime: 2s930ms - MaterializeTupleTime(*): 2s889ms - ScannerThreadsSysTime: 4.000ms - ScannerThreadsUserTime: 1s992ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 2.422ms - TotalReadThroughput: 1.27 MB/sec Instance 594ebc976a121d5b:59d55bd0f66b60b9 (host=tarmstrong-box:22000):(Total: 3s114ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 23.98 KB, 2.58 MB, 2.51 MB, 2.38 MB, 2.04 MB, 1.92 MB, 1.29 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.85 MB (2991864) - PerHostPeakMemUsage: 111.71 MB (117140960) - PrepareTime: 165.567ms - RowsProduced: 951.22K (951217) - TotalCpuTime: 6s308ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 106.426ms - TotalStorageWaitTime: 17.047ms CodeGen:(Total: 588.293ms, non-child: 588.293ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 414.226ms - PrepareTime: 163.552ms DataStreamSender (dst_id=7):(Total: 549.227ms, non-child: 549.227ms, % non-child: 100.00%) - BytesSent: 32.59 MB (34168698) - NetworkThroughput(*): 28.54 MB/sec - OverallThroughput: 59.33 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 420.121ms - ThriftTransmitTime(*): 1s141ms - UncompressedRowBatchSize: 76.21 MB (79913484) HDFS_SCAN_NODE (id=1):(Total: 2s669ms, non-child: 2s669ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 1.81 MB, 2.58 MB, 3.15 MB, 3.60 MB, 4.18 MB, 4.46 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.46 MB (4673379) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.46 MB (4673379) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.46 MB (4673379) - DecompressionTime: 14.106ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.83 MB (2967304) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 951.22K (951217) - RowsReturnedRate: 356.38 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1659) - ScannerThreadsTotalWallClockTime: 2s883ms - MaterializeTupleTime(*): 2s841ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s956ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 2.490ms - TotalReadThroughput: 1.27 MB/sec Instance 594ebc976a121d5b:59d55bd0f66b60b8 (host=tarmstrong-box:22001):(Total: 2s871ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB MemoryUsage(500.000ms): 23.98 KB, 2.48 MB, 2.35 MB, 2.01 MB, 1.79 MB, 1.58 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.81 MB (2950968) - PerHostPeakMemUsage: 102.31 MB (107278552) - PrepareTime: 248.944ms - RowsProduced: 767.41K (767408) - TotalCpuTime: 5s794ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 75.929ms - TotalStorageWaitTime: 4.235ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 512 (512) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 85.45 MB (89600000) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 621.112ms, non-child: 621.112ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 363.448ms - PrepareTime: 247.010ms DataStreamSender (dst_id=7):(Total: 422.914ms, non-child: 422.914ms, % non-child: 100.00%) - BytesSent: 26.01 MB (27273582) - NetworkThroughput(*): 24.50 MB/sec - OverallThroughput: 61.50 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 336.677ms - ThriftTransmitTime(*): 1s061ms - UncompressedRowBatchSize: 61.48 MB (64471356) HDFS_SCAN_NODE (id=1):(Total: 2s693ms, non-child: 2s693ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 1.88 MB, 2.26 MB, 2.83 MB, 3.40 MB, 3.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.63 MB (3810342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.63 MB (3810342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.63 MB (3810342) - DecompressionTime: 22.487ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.77 MB (2901832) - PerReadThreadRawHdfsThroughput: 2.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 767.41K (767408) - RowsReturnedRate: 284.92 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1676) - ScannerThreadsTotalWallClockTime: 2s625ms - MaterializeTupleTime(*): 2s588ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1s704ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 1.670ms - TotalReadThroughput: 1.21 MB/sec Fragment F01: Instance 594ebc976a121d5b:59d55bd0f66b60ba (host=tarmstrong-box:22002):(Total: 4s544ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.61 MB MemoryUsage(500.000ms): 14.84 KB, 7.51 MB, 7.97 MB, 7.86 MB, 7.74 MB, 7.55 MB, 7.61 MB, 7.36 MB, 7.49 MB, 6.52 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.38 MB (8788024) - PerHostPeakMemUsage: 120.28 MB (126126512) - PrepareTime: 229.046ms - RowsProduced: 236.11K (236111) - TotalCpuTime: 9s347ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.918ms - TotalStorageWaitTime: 13.128ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 790 (790) - BlocksRecycled: 39 (39) - BufferedPins: 0 (0) - BytesWritten: 58.94 MB (61800000) - MaxBlockSize: 195.31 KB (200000) - MemoryLimit: 100.00 MB (104857600) - PeakMemoryUsage: 99.95 MB (104800000) - TotalBufferWaitTime: 44.324ms - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 745.653ms, non-child: 745.653ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 18.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 499.105ms - PrepareTime: 227.046ms DataStreamSender (dst_id=6):(Total: 259.001ms, non-child: 259.001ms, % non-child: 100.00%) - BytesSent: 37.72 MB (39548274) - NetworkThroughput(*): 43.58 MB/sec - OverallThroughput: 145.62 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 243.362ms - ThriftTransmitTime(*): 865.431ms - UncompressedRowBatchSize: 65.17 MB (68333814) HDFS_SCAN_NODE (id=0):(Total: 4s497ms, non-child: 4s497ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 3.15 MB, 5.63 MB, 8.68 MB, 11.73 MB, 14.21 MB, 17.65 MB, 22.10 MB, 26.49 MB, 32.50 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 34.46 MB (36134605) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.46 MB (36134605) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.46 MB (36134605) - DecompressionTime: 107.611ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.37 MB (8772824) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.13M (2133979) - RowsReturned: 236.11K (236111) - RowsReturnedRate: 52.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.28K (1279) - ScannerThreadsTotalWallClockTime: 4s295ms - MaterializeTupleTime(*): 4s114ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3s148ms - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 19.658ms - TotalReadThroughput: 6.50 MB/sec Instance 594ebc976a121d5b:59d55bd0f66b60bc (host=tarmstrong-box:22000):(Total: 4s370ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.90 MB MemoryUsage(500.000ms): 14.84 KB, 8.07 MB, 8.05 MB, 7.74 MB, 7.99 MB, 7.87 MB, 7.43 MB, 7.37 MB, 7.15 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.89 MB (9318864) - PerHostPeakMemUsage: 119.85 MB (125667792) - PrepareTime: 234.349ms - RowsProduced: 237.59K (237591) - TotalCpuTime: 8s889ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.575ms - TotalStorageWaitTime: 12.225ms CodeGen:(Total: 650.672ms, non-child: 650.672ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.612ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 408.744ms - PrepareTime: 232.160ms DataStreamSender (dst_id=6):(Total: 292.658ms, non-child: 292.658ms, % non-child: 100.00%) - BytesSent: 38.99 MB (40882224) - NetworkThroughput(*): 38.62 MB/sec - OverallThroughput: 133.22 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 258.970ms - ThriftTransmitTime(*): 1s009ms - UncompressedRowBatchSize: 65.60 MB (68782956) HDFS_SCAN_NODE (id=0):(Total: 4s280ms, non-child: 4s280ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/69.90 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:12.5% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 3.91 MB, 7.35 MB, 10.59 MB, 13.83 MB, 17.15 MB, 21.15 MB, 26.30 MB, 31.19 MB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 34.61 MB (36286428) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.61 MB (36286428) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.61 MB (36286428) - DecompressionTime: 97.057ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.87 MB (9303664) - PerReadThreadRawHdfsThroughput: 1.63 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14M (2142543) - RowsReturned: 237.59K (237591) - RowsReturnedRate: 55.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1679) - ScannerThreadsTotalWallClockTime: 4s108ms - MaterializeTupleTime(*): 3s846ms - ScannerThreadsSysTime: 96.000ms - ScannerThreadsUserTime: 3s132ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 20.772ms - TotalReadThroughput: 6.93 MB/sec Instance 594ebc976a121d5b:59d55bd0f66b60bb (host=tarmstrong-box:22001):(Total: 4s026ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/56.35 MB MemoryUsage(500.000ms): 14.84 KB, 7.76 MB, 7.86 MB, 7.93 MB, 7.68 MB, 7.68 MB, 7.68 MB, 7.24 MB, 6.12 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.64 MB (9056824) - PerHostPeakMemUsage: 119.31 MB (125102504) - PrepareTime: 197.434ms - RowsProduced: 191.55K (191552) - TotalCpuTime: 8s332ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.271ms - TotalStorageWaitTime: 26.506ms CodeGen:(Total: 695.591ms, non-child: 695.591ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 15.031ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939640) - OptimizationTime: 484.028ms - PrepareTime: 195.567ms DataStreamSender (dst_id=6):(Total: 222.502ms, non-child: 222.502ms, % non-child: 100.00%) - BytesSent: 30.01 MB (31464786) - NetworkThroughput(*): 33.13 MB/sec - OverallThroughput: 134.86 MB/sec - PeakMemoryUsage: 6.84 KB (7008) - SerializeBatchTime: 210.314ms - ThriftTransmitTime(*): 905.841ms - UncompressedRowBatchSize: 52.88 MB (55447590) HDFS_SCAN_NODE (id=0):(Total: 3s988ms, non-child: 3s988ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/56.35 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 3.72 MB, 6.58 MB, 9.70 MB, 13.32 MB, 16.37 MB, 19.81 MB, 24.00 MB, 27.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 27.92 MB (29271988) - BytesReadDataNodeCache: 0 - BytesReadLocal: 27.92 MB (29271988) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27.92 MB (29271988) - DecompressionTime: 82.864ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.62 MB (9041624) - PerReadThreadRawHdfsThroughput: 1.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.72M (1724693) - RowsReturned: 191.55K (191552) - RowsReturnedRate: 48.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1476) - ScannerThreadsTotalWallClockTime: 3s808ms - MaterializeTupleTime(*): 3s664ms - ScannerThreadsSysTime: 4.000ms - ScannerThreadsUserTime: 2s824ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 16.092ms - TotalReadThroughput: 6.11 MB/sec