Query (id=ef44e97f459bf642:d8f0abb60e1b7abf): Summary: Session ID: f64c1e5615ab40fc:ffb4745bf55c128c Session Type: BEESWAX Start Time: 2016-06-03 07:48:41.670708000 End Time: 2016-06-03 07:50:33.133567000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5-INTERNAL DEBUG (build 2916cc2eb503af075caf22bf8354e64430e967f9) User: mikeb Connected User: mikeb Delegated User: Network Address: ::ffff:127.0.0.1:39575 Default Db: default Sql Statement: select o_orderdate, o_custkey, o_comment from tpch.orders order by o_orderdate Coordinator: mikeb-desktop:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=168.00MB VCores=1 02:MERGING-EXCHANGE [UNPARTITIONED] | order by: o_orderdate ASC | hosts=3 per-host-mem=unavailable | tuple-ids=1 row-size=99B cardinality=1500000 | 01:SORT | order by: o_orderdate ASC | hosts=3 per-host-mem=48.00MB | tuple-ids=1 row-size=99B cardinality=1500000 | 00:SCAN HDFS [tpch.orders, RANDOM] partitions=1/1 files=1 size=162.56MB table stats: 1500000 rows total column stats: all hosts=3 per-host-mem=120.00MB tuple-ids=0 row-size=99B cardinality=1500000 ---------------- Estimated Per-Host Mem: 176160768 Estimated Per-Host VCores: 1 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------- 02:MERGING-EXCHANGE 1 745.806ms 745.806ms 1.50M 1.50M 0 -1.00 B UNPARTITIONED 01:SORT 3 1s001ms 1s222ms 1.50M 1.50M 88.15 MB 48.00 MB 00:SCAN HDFS 3 5s180ms 7s179ms 1.50M 1.50M 40.27 MB 120.00 MB tpch.orders Planner Timeline: 8.278ms - Analysis finished: 2.444ms (2.444ms) - Equivalence classes computed: 2.699ms (254.859us) - Single node plan created: 4.158ms (1.459ms) - Runtime filters computed: 4.180ms (21.586us) - Distributed plan created: 5.224ms (1.044ms) - Planning finished: 8.278ms (3.054ms) Query Timeline: 1m51s - Start execution: 50.798us (50.798us) - Planning finished: 11.945ms (11.894ms) - Submit for admission: 12.103ms (158.126us) - Completed admission: 12.142ms (38.228us) - Ready to start 3 remote fragments: 12.476ms (334.872us) - All 3 remote fragments started: 13.125ms (648.284us) - Rows available: 8s358ms (8s345ms) - First row fetched: 8s448ms (89.736ms) - Unregister query: 1m51s (1m43s) ImpalaServer: - ClientFetchWaitTimer: 1m40s - RowMaterializationTimer: 1s901ms Execution Profile ef44e97f459bf642:d8f0abb60e1b7abf:(Total: 9s170ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 3, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: mikeb-desktop:22001(96.34 MB) mikeb-desktop:22002(61.83 MB) mikeb-desktop:22000(112.29 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 9s091ms, non-child: 1.829ms, % non-child: 0.02%) MemoryUsage(2s000ms): 8.00 KB, 11.62 MB, 23.23 MB, 23.28 MB, 23.61 MB, 23.58 MB, 23.66 MB, 23.72 MB, 23.74 MB, 23.64 MB, 23.63 MB, 23.66 MB, 23.71 MB, 23.71 MB, 23.73 MB, 23.68 MB, 23.60 MB, 23.68 MB, 23.71 MB, 23.57 MB, 23.74 MB, 23.76 MB, 23.58 MB, 23.58 MB, 23.56 MB, 23.59 MB, 23.56 MB, 23.56 MB, 23.62 MB, 23.61 MB, 23.65 MB, 23.57 MB, 23.59 MB, 23.72 MB, 23.64 MB, 23.64 MB, 23.56 MB, 23.67 MB, 23.70 MB, 23.60 MB, 23.66 MB, 23.63 MB, 23.65 MB, 23.59 MB, 23.66 MB, 23.64 MB, 23.67 MB, 23.68 MB, 23.28 MB, 20.38 MB, 17.15 MB, 13.94 MB, 10.70 MB, 7.57 MB, 4.35 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.09 MB (25257944) - PerHostPeakMemUsage: 0 - PrepareTime: 34.264us - RowsProduced: 1.50M (1500000) - TotalCpuTime: 1m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 10 (10) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 80.00 MB (83886080) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=2):(Total: 9s089ms, non-child: 745.806ms, % non-child: 8.21%) BytesReceived(2s000ms): 0, 5.03 MB, 10.05 MB, 10.09 MB, 10.57 MB, 11.89 MB, 13.30 MB, 14.68 MB, 16.07 MB, 17.39 MB, 18.79 MB, 20.18 MB, 21.57 MB, 22.93 MB, 24.30 MB, 25.64 MB, 27.00 MB, 28.37 MB, 29.74 MB, 31.08 MB, 32.50 MB, 33.87 MB, 35.15 MB, 36.50 MB, 37.84 MB, 39.20 MB, 40.58 MB, 41.92 MB, 43.29 MB, 44.63 MB, 45.98 MB, 47.31 MB, 48.67 MB, 50.09 MB, 51.43 MB, 52.81 MB, 54.13 MB, 55.55 MB, 56.95 MB, 58.27 MB, 59.68 MB, 61.01 MB, 62.37 MB, 63.68 MB, 65.09 MB, 66.46 MB, 67.81 MB, 69.18 MB, 70.31 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB - BytesReceived: 70.41 MB (73825453) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 336.920ms - FirstBatchArrivalWaitTime: 8s343ms - MergeGetNext: 743.302ms - MergeGetNextBatch: 11.319ms - PeakMemoryUsage: 0 - RowsReturned: 1.50M (1500000) - RowsReturnedRate: 165.03 K/sec - SendersBlockedTimer: 1m33s - SendersBlockedTotalTimer(*): 3m38s Averaged Fragment F00:(Total: 1m19s, non-child: 1m12s, % non-child: 91.45%) split sizes: min: 34.56 MB, max: 64.00 MB, avg: 54.19 MB, stddev: 13.88 MB completion times: min:44s408ms max:1m36s mean: 1m19s stddev:24s651ms execution rates: min:676.98 KB/sec max:796.81 KB/sec mean:717.41 KB/sec stddev:56.15 KB/sec num instances: 3 - AverageThreadTokens: 1.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 82.41 MB (86411261) - PerHostPeakMemUsage: 90.15 MB (94530114) - PrepareTime: 117.732ms - RowsProduced: 500.00K (500000) - TotalCpuTime: 9s239ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 9s007ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 8 (8) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 64.00 MB (67108864) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 202.146ms, non-child: 202.146ms, % non-child: 100.00%) - CodegenTime: 586.886us - CompileTime: 4.346ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220000) - NumFunctions: 47 (47) - NumInstructions: 891 (891) - OptimizationTime: 80.735ms - PrepareTime: 116.697ms DataStreamSender (dst_id=2):(Total: 383.255ms, non-child: 383.255ms, % non-child: 100.00%) - BytesSent: 23.47 MB (24608484) - NetworkThroughput(*): 759.82 MB/sec - OverallThroughput: 60.93 MB/sec - PeakMemoryUsage: 2.66 KB (2728) - RowsReturned: 500.00K (500000) - SerializeBatchTime: 351.955ms - TransmitDataRPCTime: 31.167ms - UncompressedRowBatchSize: 52.70 MB (55258894) SORT_NODE (id=1):(Total: 6s181ms, non-child: 1s001ms, % non-child: 16.20%) - InMemorySortTime: 601.599ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 77.42 MB (81179989) - RowsReturned: 500.00K (500000) - RowsReturnedRate: 88.36 K/sec - SortDataSize: 50.79 MB (53256936) - TotalMergesPerformed: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s180ms, non-child: 5s180ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 1.71 - AverageScannerThreadConcurrency: 1.76 - BytesRead: 54.19 MB (56819093) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 33.96 MB (35610624) - PerReadThreadRawHdfsThroughput: 7.38 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 500.00K (500000) - RowsReturned: 500.00K (500000) - RowsReturnedRate: 108.92 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 25 (25) - ScannerThreadsTotalWallClockTime: 9s239ms - DelimiterParseTime: 201.596ms - MaterializeTupleTime(*): 26.501ms - ScannerThreadsSysTime: 1.333ms - ScannerThreadsUserTime: 226.666ms - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 8s275ms - TotalReadThroughput: 8.91 MB/sec Fragment F00: Instance ef44e97f459bf642:d8f0abb60e1b7ac2 (host=mikeb-desktop:22001):(Total: 1m36s, non-child: 1m28s, % non-child: 91.62%) Hdfs split stats (:<# splits>/): -1:2/64.00 MB MemoryUsage(2s000ms): 30.10 MB, 56.36 MB, 82.10 MB, 82.05 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB ThreadUsage(2s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 96.34 MB (101019304) - PerHostPeakMemUsage: 96.34 MB (101019304) - PrepareTime: 119.439ms - RowsProduced: 589.55K (589553) - TotalCpuTime: 10s808ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m28s - TotalStorageWaitTime: 10s534ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 10 (10) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 80.00 MB (83886080) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 205.034ms, non-child: 205.034ms, % non-child: 100.00%) - CodegenTime: 603.526us - CompileTime: 4.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220000) - NumFunctions: 47 (47) - NumInstructions: 891 (891) - OptimizationTime: 81.450ms - PrepareTime: 118.431ms DataStreamSender (dst_id=2):(Total: 447.141ms, non-child: 447.141ms, % non-child: 100.00%) - BytesSent: 27.66 MB (29006265) - NetworkThroughput(*): 728.23 MB/sec - OverallThroughput: 61.87 MB/sec - PeakMemoryUsage: 2.66 KB (2728) - RowsReturned: 589.55K (589553) - SerializeBatchTime: 408.964ms - TransmitDataRPCTime: 37.986ms - UncompressedRowBatchSize: 62.14 MB (65163111) SORT_NODE (id=1):(Total: 7s457ms, non-child: 1s222ms, % non-child: 16.39%) ExecOption: Codegen Enabled - InMemorySortTime: 754.166ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 88.05 MB (92332032) - RowsReturned: 589.55K (589553) - RowsReturnedRate: 79.06 K/sec - SortDataSize: 59.89 MB (62802591) - TotalMergesPerformed: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 6s234ms, non-child: 6s234ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 2 out of 2 Hdfs split stats (:<# splits>/): -1:2/64.00 MB Hdfs Read Thread Concurrency Bucket: 0:7.692% 1:30.77% 2:61.54% 3:0% 4:0% 5:0% File Formats: TEXT/NONE:2 BytesRead(500.000ms): 0, 0, 0, 0, 0, 8.00 MB, 16.00 MB, 32.00 MB, 40.00 MB, 56.00 MB, 56.00 MB, 56.00 MB, 56.00 MB, 64.00 MB - AverageHdfsReadThreadConcurrency: 1.54 - AverageScannerThreadConcurrency: 1.62 - BytesRead: 64.00 MB (67110912) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 40.27 MB (42229760) - PerReadThreadRawHdfsThroughput: 6.57 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 589.55K (589553) - RowsReturned: 589.55K (589553) - RowsReturnedRate: 94.56 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 31 (31) - ScannerThreadsTotalWallClockTime: 10s808ms - DelimiterParseTime: 237.928ms - MaterializeTupleTime(*): 31.300ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 268.000ms - ScannerThreadsVoluntaryContextSwitches: 26 (26) - TotalRawHdfsReadTime(*): 9s737ms - TotalReadThroughput: 9.14 MB/sec Instance ef44e97f459bf642:d8f0abb60e1b7ac3 (host=mikeb-desktop:22000):(Total: 1m36s, non-child: 1m27s, % non-child: 90.71%) Hdfs split stats (:<# splits>/): -1:2/64.00 MB MemoryUsage(2s000ms): 30.10 MB, 54.14 MB, 76.13 MB, 82.08 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB, 80.02 MB ThreadUsage(2s000ms): 2, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.13 - BloomFilterBytes: 0 - PeakMemoryUsage: 89.06 MB (93384360) - PerHostPeakMemUsage: 112.29 MB (117740920) - PrepareTime: 117.071ms - RowsProduced: 591.97K (591972) - TotalCpuTime: 12s723ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m27s - TotalStorageWaitTime: 12s444ms CodeGen:(Total: 200.787ms, non-child: 200.787ms, % non-child: 100.00%) - CodegenTime: 565.430us - CompileTime: 4.135ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220000) - NumFunctions: 47 (47) - NumInstructions: 891 (891) - OptimizationTime: 80.226ms - PrepareTime: 116.045ms DataStreamSender (dst_id=2):(Total: 449.445ms, non-child: 449.445ms, % non-child: 100.00%) - BytesSent: 27.77 MB (29117840) - NetworkThroughput(*): 757.87 MB/sec - OverallThroughput: 61.78 MB/sec - PeakMemoryUsage: 2.66 KB (2728) - RowsReturned: 591.97K (591972) - SerializeBatchTime: 412.694ms - TransmitDataRPCTime: 36.640ms - UncompressedRowBatchSize: 62.40 MB (65431455) SORT_NODE (id=1):(Total: 8s314ms, non-child: 1s135ms, % non-child: 13.65%) ExecOption: Codegen Enabled - InMemorySortTime: 660.322ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 88.15 MB (92430336) - RowsReturned: 591.97K (591972) - RowsReturnedRate: 71.19 K/sec - SortDataSize: 60.14 MB (63061247) - TotalMergesPerformed: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 7s179ms, non-child: 7s179ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 2 out of 2 Hdfs split stats (:<# splits>/): -1:2/64.00 MB Hdfs Read Thread Concurrency Bucket: 0:6.667% 1:26.67% 2:66.67% 3:0% 4:0% 5:0% File Formats: TEXT/NONE:2 BytesRead(500.000ms): 0, 0, 0, 0, 8.00 MB, 16.00 MB, 16.00 MB, 16.00 MB, 24.00 MB, 32.00 MB, 32.00 MB, 48.00 MB, 48.00 MB, 56.00 MB, 56.00 MB, 64.00 MB - AverageHdfsReadThreadConcurrency: 1.60 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 64.00 MB (67110912) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 33.43 MB (35057664) - PerReadThreadRawHdfsThroughput: 5.49 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 591.97K (591972) - RowsReturned: 591.97K (591972) - RowsReturnedRate: 82.45 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 28 (28) - ScannerThreadsTotalWallClockTime: 12s723ms - DelimiterParseTime: 242.444ms - MaterializeTupleTime(*): 31.775ms - ScannerThreadsSysTime: 4.000ms - ScannerThreadsUserTime: 272.000ms - ScannerThreadsVoluntaryContextSwitches: 26 (26) - TotalRawHdfsReadTime(*): 11s661ms - TotalReadThroughput: 8.00 MB/sec Instance ef44e97f459bf642:d8f0abb60e1b7ac1 (host=mikeb-desktop:22002):(Total: 44s322ms, non-child: 41s095ms, % non-child: 92.72%) Hdfs split stats (:<# splits>/): -1:2/34.56 MB MemoryUsage(1s000ms): 30.07 MB, 40.14 MB, 54.08 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 61.83 MB (64830120) - PerHostPeakMemUsage: 61.83 MB (64830120) - PrepareTime: 116.685ms - RowsProduced: 318.48K (318475) - TotalCpuTime: 4s186ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s312ms - TotalStorageWaitTime: 4s043ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 6 (6) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 48.00 MB (50331648) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 200.616ms, non-child: 200.616ms, % non-child: 100.00%) - CodegenTime: 591.702us - CompileTime: 4.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220000) - NumFunctions: 47 (47) - NumInstructions: 891 (891) - OptimizationTime: 80.528ms - PrepareTime: 115.614ms DataStreamSender (dst_id=2):(Total: 253.179ms, non-child: 253.179ms, % non-child: 100.00%) - BytesSent: 14.97 MB (15701348) - NetworkThroughput(*): 793.36 MB/sec - OverallThroughput: 59.14 MB/sec - PeakMemoryUsage: 2.66 KB (2728) - RowsReturned: 318.48K (318475) - SerializeBatchTime: 234.208ms - TransmitDataRPCTime: 18.874ms - UncompressedRowBatchSize: 33.55 MB (35182118) SORT_NODE (id=1):(Total: 2s773ms, non-child: 646.840ms, % non-child: 23.32%) ExecOption: Codegen Enabled - InMemorySortTime: 390.308ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 56.05 MB (58777600) - RowsReturned: 318.48K (318475) - RowsReturnedRate: 114.83 K/sec - SortDataSize: 32.34 MB (33906970) - TotalMergesPerformed: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s126ms, non-child: 2s126ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 2 out of 2 Hdfs split stats (:<# splits>/): -1:2/34.56 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:100% 3:0% 4:0% 5:0% File Formats: TEXT/NONE:2 BytesRead(500.000ms): 0, 0, 0, 8.00 MB, 24.00 MB - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 34.56 MB (36235457) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 28.18 MB (29544448) - PerReadThreadRawHdfsThroughput: 10.08 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 318.48K (318475) - RowsReturned: 318.48K (318475) - RowsReturnedRate: 149.76 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 4s186ms - DelimiterParseTime: 124.416ms - MaterializeTupleTime(*): 16.427ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 140.000ms - ScannerThreadsVoluntaryContextSwitches: 20 (20) - TotalRawHdfsReadTime(*): 3s427ms - TotalReadThroughput: 9.60 MB/sec