Query (id=4547c113d4fc5fdc:be196a6dddc84da6) Summary Session ID: 8b4e0a5b6b1395f8:3ff491497f8308bd Session Type: BEESWAX Start Time: 2016-09-02 14:32:54.828804000 End Time: 2016-09-02 14:33:11.576180000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.3.0-cdh5.5.2 RELEASE (build cc1125f10419a7269366f7f950f57b24b07acd64) User: hadoop-wd Connected User: hadoop-wd Delegated User: Network Address: ::ffff:10.202.40.10:43332 Default Db: wd3 Sql Statement: select SUM(sum_session_count) AS PreAggSessionSmallDims_Visits , SUM(sum_pv_count) AS PreAggSessionSmallDims_SessionPageViews , SUM(sum_ecom_converted_count) AS PreAggSessionSmallDims_SessionECommerceCount , SUM(sum_pv_count)/SUM(sum_session_count) AS PreAggSessionSmallDims_AvgSessionPageViews , SUM(sum_bounced_session_count)/SUM(sum_session_count) AS PreAggSessionSmallDims_BounceRate , SUM(sum_session_duration)/SUM(sum_session_count) AS PreAggSessionSmallDims_AvgSessionDuration , COUNT(*) OVER() AS TotalRows FROM preagg_sessionsmalldims WHERE profile_id IN(333) AND day between 20160818 and 20160824 ORDER BY PreAggSessionSmallDims_Visits Desc LIMIT 100000 OFFSET 0 Coordinator: gs-server-1000:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=106.00MB VCores=1 F01:PLAN FRAGMENT [UNPARTITIONED] 03:TOP-N [LIMIT=100000] | order by: sum(sum_session_count) DESC | hosts=17 per-host-mem=unavailable | tuple-ids=3 row-size=48B cardinality=1 | 02:ANALYTIC | functions: count(*) | hosts=17 per-host-mem=unavailable | tuple-ids=1,4 row-size=48B cardinality=1 | 05:AGGREGATE [FINALIZE] | output: sum:merge(sum_session_count), sum:merge(sum_pv_count), sum:merge(sum_ecom_converted_count), sum:merge(sum_bounced_session_count), sum:merge(sum_session_duration) | hosts=17 per-host-mem=unavailable | tuple-ids=1 row-size=40B cardinality=1 | 04:EXCHANGE [UNPARTITIONED] hosts=17 per-host-mem=unavailable tuple-ids=1 row-size=40B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=04, UNPARTITIONED] 01:AGGREGATE | output: sum(sum_session_count), sum(sum_pv_count), sum(sum_ecom_converted_count), sum(sum_bounced_session_count), sum(sum_session_duration) | hosts=17 per-host-mem=10.00MB | tuple-ids=1 row-size=40B cardinality=1 | 00:SCAN HDFS [wd3.preagg_sessionsmalldims, RANDOM] partitions=7/26 files=118 size=1.71MB predicates: profile_id IN (333) table stats: 210444 rows total column stats: all hosts=17 per-host-mem=96.00MB tuple-ids=0 row-size=24B cardinality=104 ---------------- Estimated Per-Host Mem: 111149056 Estimated Per-Host VCores: 1 Admission result: Admitted immediately Request Pool: root.hadoop-wd ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------- 03:TOP-N 1 374.779us 374.779us 1 1 24.00 KB -1.00 B 02:ANALYTIC 1 375.115us 375.115us 1 1 8.02 MB -1.00 B 05:AGGREGATE 1 245.183ms 245.183ms 1 1 68.00 KB -1.00 B FINALIZE 04:EXCHANGE 1 201.868us 201.868us 17 1 0 -1.00 B UNPARTITIONED 01:AGGREGATE 17 382.15ms 880.98ms 17 1 76.00 KB 10.00 MB 00:SCAN HDFS 17 2s469ms 15s215ms 268 104 247.00 KB 96.00 MB wd3.preagg_sessionsmalldims Planner Timeline Analysis finished: 3172280 Equivalence classes computed: 3324962 Single node plan created: 4552539 Distributed plan created: 5181954 Lineage info computed: 5598025 Planning finished: 6563219 Query Timeline Start execution: 58944 Planning finished: 8856377 Submit for admission: 9359762 Completed admission: 9444882 Ready to start remote fragments: 257118923 Remote fragments started: 725636856 Rows available: 16588052387 First row fetched: 16742575766 Unregister query: 16747379872 ImpalaServer - ClientFetchWaitTimer: 156977629 - InactiveTotalTime: 0 - RowMaterializationTimer: 25092 - TotalTime: 0 Execution Profile 4547c113d4fc5fdc:be196a6dddc84da6 Fragment start latencies: count: 17, last: 0.459298ns, min: 0.224181ns, max: 0.459298ns, mean: 0.281126ns, stddev: 0.076353ns Per Node Peak Memory Usage: gs-server-1001:22000(160.66 KB) gs-server-1020:22000(241.66 KB) gs-server-1006:22000(269.66 KB) gs-server-1011:22000(226.66 KB) gs-server-1008:22000(247.66 KB) gs-server-1005:22000(226.66 KB) gs-server-1018:22000(257.66 KB) gs-server-1004:22000(228.66 KB) gs-server-1010:22000(272.66 KB) gs-server-1007:22000(240.66 KB) gs-server-1013:22000(226.66 KB) gs-server-1019:22000(240.66 KB) gs-server-1012:22000(251.66 KB) gs-server-1009:22000(210.66 KB) gs-server-1000:22000(8.07 MB) gs-server-1014:22000(241.66 KB) gs-server-1015:22000(271.66 KB) - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 16579948687 Coordinator Fragment F01 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8445952 - PerHostPeakMemUsage: 0 - PrepareTime: 245033817 - RowsProduced: 1 - TotalCpuTime: 1174653481 - TotalNetworkReceiveTime: 15557973537 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 15804408531 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 1 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 8388608 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2129486 - CompileTime: 10660683 - InactiveTotalTime: 0 - LoadTime: 195292 - ModuleFileSize: 2530960 - OptimizationTime: 292136604 - PrepareTime: 241092213 - TotalTime: 546207676 SORT_NODE (id=3) - InactiveTotalTime: 0 - PeakMemoryUsage: 24576 - RowsReturned: 1 - RowsReturnedRate: 0 - TotalTime: 15803989800 ANALYTIC_EVAL_NODE (id=2) - EvaluationTime: 10442 - GetNewBlockTime: 291603 - InactiveTotalTime: 0 - PeakMemoryUsage: 8413184 - PinTime: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - TotalTime: 15803615021 - UnpinTime: 0 AGGREGATION_NODE (id=5) ExecOption: Codegen Enabled - BuildTime: 32186 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 69632 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 15803239906 EXCHANGE_NODE (id=4) - BytesReceived: 718 - ConvertRowBatchTime: 31237 - DeserializeRowBatchTimer: 136697 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15557854443 - PeakMemoryUsage: 0 - RowsReturned: 17 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 15558056311 Averaged Fragment F00 split sizes: min: 89.25 KB, max: 117.88 KB, avg: 103.23 KB, stddev: 8.58 KB completion times: min:382.581ms max:16s081ms mean: 2s898ms stddev:3s898ms execution rates: min:6.58 KB/sec max:235.12 KB/sec mean:85.35 KB/sec stddev:58.38 KB/sec num instances: 17 - AverageThreadTokens: 2.3653953889248 - InactiveTotalTime: 0 - PeakMemoryUsage: 239753 - PerHostPeakMemUsage: 727378 - PrepareTime: 252680835 - RowsProduced: 1 - TotalCpuTime: 4343634427 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 2812504 - TotalStorageWaitTime: 3523765410 - TotalTime: 2852060273 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1731593 - CompileTime: 8216180 - InactiveTotalTime: 0 - LoadTime: 262309 - ModuleFileSize: 2530960 - OptimizationTime: 284027471 - PrepareTime: 247477260 - TotalTime: 541910848 DataStreamSender (dst_id=4) - BytesSent: 42 - InactiveTotalTime: 0 - NetworkThroughput(*): 64077 - OverallThroughput: 1338862 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9344 - ThriftTransmitTime(*): 2760342 - TotalTime: 34428 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) - BuildTime: 421172 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2851093419 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0317980564659885 - BytesRead: 166032 - BytesReadDataNodeCache: 0 - BytesReadLocal: 146370 - BytesReadRemoteUnexpected: 19662 - BytesReadShortCircuit: 146370 - DecompressionTime: 123368 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 41 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 208534 - PerReadThreadRawHdfsThroughput: 512807388 - RemoteScanRanges: 5 - RowsRead: 3438 - RowsReturned: 15 - RowsReturnedRate: 21 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 4072139935 - MaterializeTupleTime(*): 855939 - ScannerThreadsSysTime: 529000 - ScannerThreadsUserTime: 3821000 - ScannerThreadsVoluntaryContextSwitches: 106 - TotalRawHdfsReadTime(*): 365865 - TotalReadThroughput: 91078 - TotalTime: 2469077543 Fragment F00 Instance 4547c113d4fc5fdc:be196a6dddc84db5 (host=gs-server-1000:22000) Hdfs split stats (:<# splits>/): 3:1/15.51 KB 0:1/15.52 KB 4:2/28.72 KB 1:1/15.71 KB 2:2/30.31 KB - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 168616 - PerHostPeakMemUsage: 8458240 - PrepareTime: 236692996 - RowsProduced: 1 - TotalCpuTime: 21419885493 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 147073 - TotalStorageWaitTime: 20846402753 - TotalTime: 16045699923 CodeGen - CodegenTime: 1835084 - CompileTime: 7249212 - InactiveTotalTime: 0 - LoadTime: 187886 - ModuleFileSize: 2530960 - OptimizationTime: 264332814 - PrepareTime: 231176276 - TotalTime: 504884663 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 430512 - OverallThroughput: 797566 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11212 - ThriftTransmitTime(*): 99881 - TotalTime: 53914 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 515727 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 16044795918 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/15.51 KB 0:1/15.52 KB 4:2/28.72 KB 1:1/15.71 KB 2:2/30.31 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.4193548387096775 - BytesRead: 170149 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 170149 - BytesReadShortCircuit: 0 - DecompressionTime: 184692 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 145408 - PerReadThreadRawHdfsThroughput: 248216593 - RemoteScanRanges: 49 - RowsRead: 3522 - RowsReturned: 19 - RowsReturnedRate: 1 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 21419893730 - MaterializeTupleTime(*): 1076338 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 4997000 - ScannerThreadsVoluntaryContextSwitches: 107 - TotalRawHdfsReadTime(*): 685486 - TotalReadThroughput: 10732 - TotalTime: 15215752127 Instance 4547c113d4fc5fdc:be196a6dddc84db8 (host=gs-server-1001:22000) Hdfs split stats (:<# splits>/): 5:4/58.47 KB 1:2/29.32 KB 4:1/14.41 KB - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 164520 - PerHostPeakMemUsage: 164520 - PrepareTime: 232435443 - RowsProduced: 1 - TotalCpuTime: 12068042308 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 4360937 - TotalStorageWaitTime: 11505350455 - TotalTime: 8521759578 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1583676 - CompileTime: 7267946 - InactiveTotalTime: 0 - LoadTime: 256904 - ModuleFileSize: 2530960 - OptimizationTime: 264279679 - PrepareTime: 227359199 - TotalTime: 501171759 DataStreamSender (dst_id=4) - BytesSent: 40 - InactiveTotalTime: 0 - NetworkThroughput(*): 9236 - OverallThroughput: 824691 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11011 - ThriftTransmitTime(*): 4330731 - TotalTime: 48503 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 440678 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8520837993 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:4/58.47 KB 1:2/29.32 KB 4:1/14.41 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.5 - BytesRead: 164108 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 164108 - BytesReadShortCircuit: 0 - DecompressionTime: 164606 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 3 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 134144 - PerReadThreadRawHdfsThroughput: 252826247 - RemoteScanRanges: 49 - RowsRead: 3386 - RowsReturned: 13 - RowsReturnedRate: 1 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 12068050079 - MaterializeTupleTime(*): 901911 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 4998000 - ScannerThreadsVoluntaryContextSwitches: 109 - TotalRawHdfsReadTime(*): 649094 - TotalReadThroughput: 19838 - TotalTime: 7887366919 Instance 4547c113d4fc5fdc:be196a6dddc84db1 (host=gs-server-1005:22000) Hdfs split stats (:<# splits>/): 3:1/13.94 KB 1:1/15.63 KB 2:1/15.63 KB 7:1/14.97 KB 9:2/30.07 KB 8:1/14.47 KB - AverageThreadTokens: 2.230769230769231 - InactiveTotalTime: 0 - PeakMemoryUsage: 232104 - PerHostPeakMemUsage: 232104 - PrepareTime: 257032394 - RowsProduced: 1 - TotalCpuTime: 7148148337 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3824472 - TotalStorageWaitTime: 6864183325 - TotalTime: 5827552357 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2130155 - CompileTime: 14929897 - InactiveTotalTime: 0 - LoadTime: 205458 - ModuleFileSize: 2530960 - OptimizationTime: 518007908 - PrepareTime: 250981982 - TotalTime: 786464100 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 11507 - OverallThroughput: 997355 - PeakMemoryUsage: 2728 - SerializeBatchTime: 14790 - ThriftTransmitTime(*): 3736715 - TotalTime: 43114 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 964950 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 5826436497 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/13.94 KB 1:1/15.63 KB 2:1/15.63 KB 7:1/14.97 KB 9:2/30.07 KB 8:1/14.47 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.4545454545454546 - BytesRead: 168362 - BytesReadDataNodeCache: 0 - BytesReadLocal: 168362 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 168362 - DecompressionTime: 160129 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 189440 - PerReadThreadRawHdfsThroughput: 355265295 - RemoteScanRanges: 0 - RowsRead: 3510 - RowsReturned: 14 - RowsReturnedRate: 2 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 7148161597 - MaterializeTupleTime(*): 1323463 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 5997000 - ScannerThreadsVoluntaryContextSwitches: 107 - TotalRawHdfsReadTime(*): 473905 - TotalReadThroughput: 27357 - TotalTime: 5448980961 Instance 4547c113d4fc5fdc:be196a6dddc84db4 (host=gs-server-1014:22000) Hdfs split stats (:<# splits>/): 3:1/14.38 KB 5:1/14.48 KB 0:1/14.74 KB 6:1/13.83 KB 4:2/28.23 KB 2:1/15.62 KB 9:1/15.31 KB - AverageThreadTokens: 2.7142857142857144 - InactiveTotalTime: 0 - PeakMemoryUsage: 247464 - PerHostPeakMemUsage: 247464 - PrepareTime: 220189253 - RowsProduced: 1 - TotalCpuTime: 6462561753 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 955282 - TotalStorageWaitTime: 2348351704 - TotalTime: 2931006450 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1630170 - CompileTime: 6617097 - InactiveTotalTime: 0 - LoadTime: 207310 - ModuleFileSize: 2530960 - OptimizationTime: 227258460 - PrepareTime: 215395994 - TotalTime: 451371555 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 46003 - OverallThroughput: 1680947 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5334 - ThriftTransmitTime(*): 891231 - TotalTime: 24391 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 311524 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2929985209 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/14.38 KB 5:1/14.48 KB 0:1/14.74 KB 6:1/13.83 KB 4:2/28.23 KB 2:1/15.62 KB 9:1/15.31 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 187449 - BytesReadDataNodeCache: 0 - BytesReadLocal: 187449 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187449 - DecompressionTime: 112014 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 7 - NumRowGroups: 8 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 224256 - PerReadThreadRawHdfsThroughput: 584831429 - RemoteScanRanges: 0 - RowsRead: 3886 - RowsReturned: 17 - RowsReturnedRate: 6 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 5644894736 - MaterializeTupleTime(*): 653601 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 3998000 - ScannerThreadsVoluntaryContextSwitches: 86 - TotalRawHdfsReadTime(*): 320518 - TotalReadThroughput: 61106 - TotalTime: 2698965690 Instance 4547c113d4fc5fdc:be196a6dddc84dad (host=gs-server-1010:22000) Hdfs split stats (:<# splits>/): 9:1/15.19 KB 8:1/14.50 KB 6:1/15.91 KB 11:1/13.98 KB 2:3/44.77 KB - AverageThreadTokens: 1.8333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 279208 - PerHostPeakMemUsage: 279208 - PrepareTime: 416216328 - RowsProduced: 1 - TotalCpuTime: 4235086357 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 919805 - TotalStorageWaitTime: 1418170166 - TotalTime: 2429095661 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2631457 - CompileTime: 12638926 - InactiveTotalTime: 0 - LoadTime: 300609 - ModuleFileSize: 2530960 - OptimizationTime: 429570965 - PrepareTime: 408487035 - TotalTime: 854005432 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 47144 - OverallThroughput: 868165 - PeakMemoryUsage: 2728 - SerializeBatchTime: 13423 - ThriftTransmitTime(*): 869659 - TotalTime: 47226 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 472559 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2427683046 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/15.19 KB 8:1/14.50 KB 6:1/15.91 KB 11:1/13.98 KB 2:3/44.77 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.6666666666666667 - BytesRead: 167766 - BytesReadDataNodeCache: 0 - BytesReadLocal: 167766 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 167766 - DecompressionTime: 167123 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 224256 - PerReadThreadRawHdfsThroughput: 330840679 - RemoteScanRanges: 0 - RowsRead: 3437 - RowsReturned: 11 - RowsReturnedRate: 7 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2780139392 - MaterializeTupleTime(*): 1274838 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 4998000 - ScannerThreadsVoluntaryContextSwitches: 130 - TotalRawHdfsReadTime(*): 507090 - TotalReadThroughput: 83117 - TotalTime: 1547584535 Instance 4547c113d4fc5fdc:be196a6dddc84daa (host=gs-server-1019:22000) Hdfs split stats (:<# splits>/): 3:2/29.18 KB 5:2/29.25 KB 0:1/14.87 KB 2:1/15.25 KB 11:2/29.33 KB - AverageThreadTokens: 2.6 - InactiveTotalTime: 0 - PeakMemoryUsage: 246440 - PerHostPeakMemUsage: 246440 - PrepareTime: 227627178 - RowsProduced: 1 - TotalCpuTime: 4164680601 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7386401 - TotalStorageWaitTime: 2915870178 - TotalTime: 2286753439 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1482822 - CompileTime: 6085767 - InactiveTotalTime: 0 - LoadTime: 699107 - ModuleFileSize: 2530960 - OptimizationTime: 215224129 - PrepareTime: 222668979 - TotalTime: 446312430 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 5865 - OverallThroughput: 1492174 - PeakMemoryUsage: 2728 - SerializeBatchTime: 10031 - ThriftTransmitTime(*): 7331080 - TotalTime: 28817 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 324038 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2285800069 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:2/29.18 KB 5:2/29.25 KB 0:1/14.87 KB 2:1/15.25 KB 11:2/29.33 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 189483 - BytesReadDataNodeCache: 0 - BytesReadLocal: 189483 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189483 - DecompressionTime: 102140 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 5 - NumRowGroups: 8 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 223232 - PerReadThreadRawHdfsThroughput: 703341450 - RemoteScanRanges: 0 - RowsRead: 3882 - RowsReturned: 22 - RowsReturnedRate: 10 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 4164686624 - MaterializeTupleTime(*): 835381 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3997000 - ScannerThreadsVoluntaryContextSwitches: 126 - TotalRawHdfsReadTime(*): 269404 - TotalReadThroughput: 74278 - TotalTime: 2003843881 Instance 4547c113d4fc5fdc:be196a6dddc84da8 (host=gs-server-1009:22000) Hdfs split stats (:<# splits>/): 11:1/14.71 KB 7:1/14.71 KB 9:1/14.26 KB 0:1/15.66 KB 5:1/14.69 KB 4:2/29.64 KB - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 215720 - PerHostPeakMemUsage: 215720 - PrepareTime: 213950762 - RowsProduced: 1 - TotalCpuTime: 2728504168 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 317367 - TotalStorageWaitTime: 2723513654 - TotalTime: 1364203705 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1350314 - CompileTime: 6701457 - InactiveTotalTime: 0 - LoadTime: 166087 - ModuleFileSize: 2530960 - OptimizationTime: 236418016 - PrepareTime: 209930065 - TotalTime: 454684602 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 149111 - OverallThroughput: 1302083 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11049 - ThriftTransmitTime(*): 288374 - TotalTime: 33024 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 369572 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1363384100 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/14.71 KB 7:1/14.71 KB 9:1/14.26 KB 0:1/15.66 KB 5:1/14.69 KB 4:2/29.64 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 166647 - BytesReadDataNodeCache: 0 - BytesReadLocal: 166647 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166647 - DecompressionTime: 88074 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 192512 - PerReadThreadRawHdfsThroughput: 700029824 - RemoteScanRanges: 0 - RowsRead: 3442 - RowsReturned: 23 - RowsReturnedRate: 21 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2728509488 - MaterializeTupleTime(*): 682638 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 2998000 - ScannerThreadsVoluntaryContextSwitches: 99 - TotalRawHdfsReadTime(*): 238057 - TotalReadThroughput: 107460 - TotalTime: 1068551624 Instance 4547c113d4fc5fdc:be196a6dddc84db7 (host=gs-server-1006:22000) Hdfs split stats (:<# splits>/): 3:1/15.55 KB 6:1/14.46 KB 9:1/15.47 KB 1:1/15.40 KB 5:2/29.92 KB - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 276136 - PerHostPeakMemUsage: 276136 - PrepareTime: 380570543 - RowsProduced: 1 - TotalCpuTime: 1896789554 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 4609452 - TotalStorageWaitTime: 967506696 - TotalTime: 1235051267 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2517829 - CompileTime: 14240231 - InactiveTotalTime: 0 - LoadTime: 338823 - ModuleFileSize: 2530960 - OptimizationTime: 418872146 - PrepareTime: 373009021 - TotalTime: 809362456 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 9399 - OverallThroughput: 998444 - PeakMemoryUsage: 2728 - SerializeBatchTime: 10166 - ThriftTransmitTime(*): 4574952 - TotalTime: 43067 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 894760 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1233777784 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/15.55 KB 6:1/14.46 KB 9:1/15.47 KB 1:1/15.40 KB 5:2/29.92 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 146332 - BytesReadDataNodeCache: 0 - BytesReadLocal: 146332 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146332 - DecompressionTime: 135069 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 252928 - PerReadThreadRawHdfsThroughput: 338454919 - RemoteScanRanges: 0 - RowsRead: 3021 - RowsReturned: 15 - RowsReturnedRate: 18 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 1192523809 - MaterializeTupleTime(*): 1539644 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 5997000 - ScannerThreadsVoluntaryContextSwitches: 99 - TotalRawHdfsReadTime(*): 432353 - TotalReadThroughput: 93928 - TotalTime: 801772725 Instance 4547c113d4fc5fdc:be196a6dddc84dab (host=gs-server-1013:22000) Hdfs split stats (:<# splits>/): 7:1/15.13 KB 10:1/15.59 KB 9:1/14.89 KB 5:1/14.33 KB 0:1/15.74 KB 4:1/15.85 KB - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 232104 - PerHostPeakMemUsage: 232104 - PrepareTime: 199034252 - RowsProduced: 1 - TotalCpuTime: 2311167376 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1872348 - TotalStorageWaitTime: 1232318973 - TotalTime: 1233851759 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1279128 - CompileTime: 6083815 - InactiveTotalTime: 0 - LoadTime: 305790 - ModuleFileSize: 2530960 - OptimizationTime: 221162359 - PrepareTime: 194805669 - TotalTime: 423958783 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 24632 - OverallThroughput: 1050823 - PeakMemoryUsage: 2728 - SerializeBatchTime: 14238 - ThriftTransmitTime(*): 1664471 - TotalTime: 39017 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 295963 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1233053489 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/15.13 KB 10:1/15.59 KB 9:1/14.89 KB 5:1/14.33 KB 0:1/15.74 KB 4:1/15.85 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 147346 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147346 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147346 - DecompressionTime: 83076 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 6 - NumRowGroups: 6 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 206848 - PerReadThreadRawHdfsThroughput: 668602725 - RemoteScanRanges: 0 - RowsRead: 3115 - RowsReturned: 14 - RowsReturnedRate: 13 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2080047924 - MaterializeTupleTime(*): 526255 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 1998000 - ScannerThreadsVoluntaryContextSwitches: 92 - TotalRawHdfsReadTime(*): 220379 - TotalReadThroughput: 121764 - TotalTime: 1006214199 Instance 4547c113d4fc5fdc:be196a6dddc84daf (host=gs-server-1018:22000) Hdfs split stats (:<# splits>/): 11:1/15.61 KB 0:1/15.62 KB 3:1/14.78 KB 10:2/29.14 KB 4:2/29.35 KB - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 263848 - PerHostPeakMemUsage: 263848 - PrepareTime: 201231893 - RowsProduced: 1 - TotalCpuTime: 2228083342 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1418269 - TotalStorageWaitTime: 2068067405 - TotalTime: 1209193981 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1459224 - CompileTime: 6312183 - InactiveTotalTime: 0 - LoadTime: 182296 - ModuleFileSize: 2530960 - OptimizationTime: 232500164 - PrepareTime: 196791853 - TotalTime: 437389615 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 31716 - OverallThroughput: 1406285 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9202 - ThriftTransmitTime(*): 1355777 - TotalTime: 30577 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 316953 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1208356783 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/15.61 KB 0:1/15.62 KB 3:1/14.78 KB 10:2/29.14 KB 4:2/29.35 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 168271 - BytesReadDataNodeCache: 0 - BytesReadLocal: 168271 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 168271 - DecompressionTime: 96551 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 211968 - PerReadThreadRawHdfsThroughput: 496342420 - RemoteScanRanges: 0 - RowsRead: 3501 - RowsReturned: 11 - RowsReturnedRate: 13 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2228088918 - MaterializeTupleTime(*): 623857 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3997000 - ScannerThreadsVoluntaryContextSwitches: 107 - TotalRawHdfsReadTime(*): 339022 - TotalReadThroughput: 150147 - TotalTime: 795201243 Instance 4547c113d4fc5fdc:be196a6dddc84dae (host=gs-server-1004:22000) Hdfs split stats (:<# splits>/): 2:2/30.18 KB 0:1/15.04 KB 5:2/28.65 KB 1:1/14.30 KB 6:1/15.33 KB - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 234152 - PerHostPeakMemUsage: 234152 - PrepareTime: 245900807 - RowsProduced: 1 - TotalCpuTime: 1865865950 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 245072 - TotalStorageWaitTime: 1687155607 - TotalTime: 1088048579 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1507980 - CompileTime: 7296352 - InactiveTotalTime: 0 - LoadTime: 184299 - ModuleFileSize: 2530960 - OptimizationTime: 256103161 - PrepareTime: 241096452 - TotalTime: 506524124 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 215727 - OverallThroughput: 1117683 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11920 - ThriftTransmitTime(*): 190055 - TotalTime: 36683 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 331209 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1087098399 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:2/30.18 KB 0:1/15.04 KB 5:2/28.65 KB 1:1/14.30 KB 6:1/15.33 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 166279 - BytesReadDataNodeCache: 0 - BytesReadLocal: 166279 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166279 - DecompressionTime: 114443 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 210944 - PerReadThreadRawHdfsThroughput: 519834682 - RemoteScanRanges: 0 - RowsRead: 3463 - RowsReturned: 17 - RowsReturnedRate: 22 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1865871973 - MaterializeTupleTime(*): 666298 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3997000 - ScannerThreadsVoluntaryContextSwitches: 107 - TotalRawHdfsReadTime(*): 319869 - TotalReadThroughput: 114916 - TotalTime: 749589055 Instance 4547c113d4fc5fdc:be196a6dddc84db2 (host=gs-server-1011:22000) Hdfs split stats (:<# splits>/): 9:1/14.80 KB 2:1/14.73 KB 8:1/14.59 KB 6:1/15.08 KB 5:1/13.56 KB 1:1/15.05 KB 10:1/14.51 KB - AverageThreadTokens: 2.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 232104 - PerHostPeakMemUsage: 232104 - PrepareTime: 422304858 - RowsProduced: 1 - TotalCpuTime: 1685312007 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1458721 - TotalStorageWaitTime: 730920040 - TotalTime: 1004825339 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2599221 - CompileTime: 12821165 - InactiveTotalTime: 0 - LoadTime: 219152 - ModuleFileSize: 2530960 - OptimizationTime: 427542870 - PrepareTime: 415392840 - TotalTime: 858283914 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 30211 - OverallThroughput: 1067023 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9377 - ThriftTransmitTime(*): 1423297 - TotalTime: 40299 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 406283 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1003717968 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/14.80 KB 2:1/14.73 KB 8:1/14.59 KB 6:1/15.08 KB 5:1/13.56 KB 1:1/15.05 KB 10:1/14.51 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 164329 - BytesReadDataNodeCache: 0 - BytesReadLocal: 164329 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 164329 - DecompressionTime: 155937 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 7 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 208896 - PerReadThreadRawHdfsThroughput: 392842116 - RemoteScanRanges: 0 - RowsRead: 3373 - RowsReturned: 17 - RowsReturnedRate: 34 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 968355819 - MaterializeTupleTime(*): 1245924 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 2998000 - ScannerThreadsVoluntaryContextSwitches: 120 - TotalRawHdfsReadTime(*): 418308 - TotalReadThroughput: 102454 - TotalTime: 492060727 Instance 4547c113d4fc5fdc:be196a6dddc84db0 (host=gs-server-1008:22000) Hdfs split stats (:<# splits>/): 5:1/15.42 KB 3:1/14.37 KB 9:4/58.60 KB 7:2/27.36 KB - AverageThreadTokens: 2.6666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 253608 - PerHostPeakMemUsage: 253608 - PrepareTime: 212371476 - RowsProduced: 1 - TotalCpuTime: 1875840598 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1600993 - TotalStorageWaitTime: 1870467761 - TotalTime: 898581292 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1366344 - CompileTime: 6060694 - InactiveTotalTime: 0 - LoadTime: 196931 - ModuleFileSize: 2530960 - OptimizationTime: 215627069 - PrepareTime: 208047056 - TotalTime: 431632296 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 27184 - OverallThroughput: 1891190 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5377 - ThriftTransmitTime(*): 1581768 - TotalTime: 22737 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 342958 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 897800149 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/15.42 KB 3:1/14.37 KB 9:4/58.60 KB 7:2/27.36 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5 - BytesRead: 185850 - BytesReadDataNodeCache: 0 - BytesReadLocal: 185850 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185850 - DecompressionTime: 119408 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 4 - NumRowGroups: 8 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 230400 - PerReadThreadRawHdfsThroughput: 613639740 - RemoteScanRanges: 0 - RowsRead: 3824 - RowsReturned: 24 - RowsReturnedRate: 35 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 1875845488 - MaterializeTupleTime(*): 685887 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2997000 - ScannerThreadsVoluntaryContextSwitches: 117 - TotalRawHdfsReadTime(*): 302865 - TotalReadThroughput: 156040 - TotalTime: 685664625 Instance 4547c113d4fc5fdc:be196a6dddc84da9 (host=gs-server-1012:22000) Hdfs split stats (:<# splits>/): 1:1/14.86 KB 4:1/14.19 KB 8:1/15.18 KB 2:2/28.56 KB 3:1/15.80 KB 9:1/15.48 KB - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 257704 - PerHostPeakMemUsage: 257704 - PrepareTime: 202184279 - RowsProduced: 1 - TotalCpuTime: 1233603086 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1548558 - TotalStorageWaitTime: 881319206 - TotalTime: 871891647 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1385830 - CompileTime: 6073894 - InactiveTotalTime: 0 - LoadTime: 141675 - ModuleFileSize: 2530960 - OptimizationTime: 220562012 - PrepareTime: 198004778 - TotalTime: 426374731 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 28617 - OverallThroughput: 1859620 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5849 - ThriftTransmitTime(*): 1502598 - TotalTime: 23123 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 344927 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 870993427 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/14.86 KB 4:1/14.19 KB 8:1/15.18 KB 2:2/28.56 KB 3:1/15.80 KB 9:1/15.48 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 167570 - BytesReadDataNodeCache: 0 - BytesReadLocal: 167570 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 167570 - DecompressionTime: 95331 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 234496 - PerReadThreadRawHdfsThroughput: 690179248 - RemoteScanRanges: 0 - RowsRead: 3509 - RowsReturned: 11 - RowsReturnedRate: 16 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 1014424038 - MaterializeTupleTime(*): 782536 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2997000 - ScannerThreadsVoluntaryContextSwitches: 118 - TotalRawHdfsReadTime(*): 242792 - TotalReadThroughput: 160722 - TotalTime: 664159887 Instance 4547c113d4fc5fdc:be196a6dddc84dac (host=gs-server-1007:22000) Hdfs split stats (:<# splits>/): 4:2/30.16 KB 11:1/13.68 KB 9:1/15.42 KB 8:1/14.71 KB 7:1/15.28 KB - AverageThreadTokens: 2.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 246440 - PerHostPeakMemUsage: 246440 - PrepareTime: 207910252 - RowsProduced: 1 - TotalCpuTime: 1069537911 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5453062 - TotalStorageWaitTime: 690549691 - TotalTime: 626545293 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1615588 - CompileTime: 6657211 - InactiveTotalTime: 0 - LoadTime: 257892 - ModuleFileSize: 2530960 - OptimizationTime: 236682978 - PrepareTime: 203259071 - TotalTime: 448454473 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 7908 - OverallThroughput: 1647888 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5437 - ThriftTransmitTime(*): 5437038 - TotalTime: 26094 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 286197 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 625776346 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:2/30.16 KB 11:1/13.68 KB 9:1/15.42 KB 8:1/14.71 KB 7:1/15.28 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 143682 - BytesReadDataNodeCache: 0 - BytesReadLocal: 143682 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143682 - DecompressionTime: 109626 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 223232 - PerReadThreadRawHdfsThroughput: 649345601 - RemoteScanRanges: 0 - RowsRead: 2958 - RowsReturned: 13 - RowsReturnedRate: 31 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 883403017 - MaterializeTupleTime(*): 536986 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3997000 - ScannerThreadsVoluntaryContextSwitches: 93 - TotalRawHdfsReadTime(*): 221272 - TotalReadThroughput: 233286 - TotalTime: 418390993 Instance 4547c113d4fc5fdc:be196a6dddc84db6 (host=gs-server-1020:22000) Hdfs split stats (:<# splits>/): 2:1/15.39 KB 11:1/15.43 KB 3:2/31.35 KB 1:2/30.39 KB 10:1/15.56 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 247464 - PerHostPeakMemUsage: 247464 - PrepareTime: 208851712 - RowsProduced: 1 - TotalCpuTime: 867901582 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 6324027 - TotalStorageWaitTime: 862556245 - TotalTime: 565141443 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1610409 - CompileTime: 6101784 - InactiveTotalTime: 0 - LoadTime: 397972 - ModuleFileSize: 2530960 - OptimizationTime: 226372531 - PrepareTime: 204009701 - TotalTime: 438547399 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 6507 - OverallThroughput: 1840959 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5339 - ThriftTransmitTime(*): 6300173 - TotalTime: 22271 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 346639 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 564224102 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/15.39 KB 11:1/15.43 KB 3:2/31.35 KB 1:2/30.39 KB 10:1/15.56 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 174242 - BytesReadDataNodeCache: 0 - BytesReadLocal: 174242 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174242 - DecompressionTime: 117082 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 208896 - PerReadThreadRawHdfsThroughput: 464514030 - RemoteScanRanges: 0 - RowsRead: 3617 - RowsReturned: 13 - RowsReturnedRate: 36 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 867906131 - MaterializeTupleTime(*): 695667 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2997000 - ScannerThreadsVoluntaryContextSwitches: 100 - TotalRawHdfsReadTime(*): 375106 - TotalReadThroughput: 0 - TotalTime: 355925284 Instance 4547c113d4fc5fdc:be196a6dddc84db3 (host=gs-server-1015:22000) Hdfs split stats (:<# splits>/): 7:1/14.59 KB 3:1/14.94 KB 6:1/15.76 KB 5:1/14.44 KB 2:1/15.23 KB 11:1/14.99 KB - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 278184 - PerHostPeakMemUsage: 278184 - PrepareTime: 211069779 - RowsProduced: 1 - TotalCpuTime: 580774850 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5370742 - TotalStorageWaitTime: 291308127 - TotalTime: 345822932 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1451864 - CompileTime: 6537430 - InactiveTotalTime: 0 - LoadTime: 211071 - ModuleFileSize: 2530960 - OptimizationTime: 217949751 - PrepareTime: 206697457 - TotalTime: 433062100 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 8040 - OverallThroughput: 1917759 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5094 - ThriftTransmitTime(*): 5348018 - TotalTime: 22422 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 194997 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 344866860 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/14.59 KB 3:1/14.94 KB 6:1/15.76 KB 5:1/14.44 KB 2:1/15.23 KB 11:1/14.99 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 144690 - BytesReadDataNodeCache: 0 - BytesReadLocal: 144690 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144690 - DecompressionTime: 91966 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 6 - NumRowGroups: 6 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 223232 - PerReadThreadRawHdfsThroughput: 708618612 - RemoteScanRanges: 0 - RowsRead: 3004 - RowsReturned: 14 - RowsReturnedRate: 104 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 295576146 - MaterializeTupleTime(*): 499750 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 999000 - ScannerThreadsVoluntaryContextSwitches: 91 - TotalRawHdfsReadTime(*): 204186 - TotalReadThroughput: 31188 - TotalTime: 134293757