Query (id=16489725b57d7466:d2448f683f00cba7) Summary Session ID: 24a70fadf1c3291:fb75e2acafc25e86 Session Type: BEESWAX Start Time: 2016-09-02 15:30:18.494320000 End Time: 2016-09-02 15:30:21.368689000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.3.0-cdh5.5.2 RELEASE (build cc1125f10419a7269366f7f950f57b24b07acd64) User: hadoop-wd Connected User: hadoop-wd Delegated User: Network Address: ::ffff:10.202.40.10:64441 Default Db: wd3 Sql Statement: select SUM(sum_session_count) AS PreAggSessionSmallDims_Visits , SUM(sum_pv_count) AS PreAggSessionSmallDims_SessionPageViews , SUM(sum_ecom_converted_count) AS PreAggSessionSmallDims_SessionECommerceCount , SUM(sum_pv_count)/SUM(sum_session_count) AS PreAggSessionSmallDims_AvgSessionPageViews , SUM(sum_bounced_session_count)/SUM(sum_session_count) AS PreAggSessionSmallDims_BounceRate , SUM(sum_session_duration)/SUM(sum_session_count) AS PreAggSessionSmallDims_AvgSessionDuration , COUNT(*) OVER() AS TotalRows FROM preagg_sessionsmalldims WHERE profile_id IN(333) AND day between 20160818 and 20160824 ORDER BY PreAggSessionSmallDims_Visits Desc LIMIT 100000 OFFSET 0 Coordinator: gs-server-1000:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=106.00MB VCores=1 F01:PLAN FRAGMENT [UNPARTITIONED] 03:TOP-N [LIMIT=100000] | order by: sum(sum_session_count) DESC | hosts=17 per-host-mem=unavailable | tuple-ids=3 row-size=48B cardinality=1 | 02:ANALYTIC | functions: count(*) | hosts=17 per-host-mem=unavailable | tuple-ids=1,4 row-size=48B cardinality=1 | 05:AGGREGATE [FINALIZE] | output: sum:merge(sum_session_count), sum:merge(sum_pv_count), sum:merge(sum_ecom_converted_count), sum:merge(sum_bounced_session_count), sum:merge(sum_session_duration) | hosts=17 per-host-mem=unavailable | tuple-ids=1 row-size=40B cardinality=1 | 04:EXCHANGE [UNPARTITIONED] hosts=17 per-host-mem=unavailable tuple-ids=1 row-size=40B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=04, UNPARTITIONED] 01:AGGREGATE | output: sum(sum_session_count), sum(sum_pv_count), sum(sum_ecom_converted_count), sum(sum_bounced_session_count), sum(sum_session_duration) | hosts=17 per-host-mem=10.00MB | tuple-ids=1 row-size=40B cardinality=1 | 00:SCAN HDFS [wd3.preagg_sessionsmalldims, RANDOM] partitions=7/26 files=118 size=1.71MB predicates: profile_id IN (333) table stats: 210444 rows total column stats: all hosts=17 per-host-mem=96.00MB tuple-ids=0 row-size=24B cardinality=104 ---------------- Estimated Per-Host Mem: 111149056 Estimated Per-Host VCores: 1 Admission result: Admitted immediately Request Pool: root.hadoop-wd ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------- 03:TOP-N 1 255.918us 255.918us 1 1 24.00 KB -1.00 B 02:ANALYTIC 1 1.167ms 1.167ms 1 1 8.02 MB -1.00 B 05:AGGREGATE 1 440.306ms 440.306ms 1 1 36.00 KB -1.00 B FINALIZE 04:EXCHANGE 1 193.217us 193.217us 17 1 0 -1.00 B UNPARTITIONED 01:AGGREGATE 17 243.822ms 383.5ms 17 1 76.00 KB 10.00 MB 00:SCAN HDFS 17 275.155ms 1s748ms 268 104 413.00 KB 96.00 MB wd3.preagg_sessionsmalldims Planner Timeline Analysis finished: 6978240 Equivalence classes computed: 7244809 Single node plan created: 9578423 Distributed plan created: 11063486 Lineage info computed: 11867832 Planning finished: 14155529 Query Timeline Start execution: 193806 Planning finished: 21072219 Submit for admission: 22874172 Completed admission: 23112720 Ready to start remote fragments: 472285896 Remote fragments started: 1001004994 Rows available: 2760942500 First row fetched: 2862982331 Unregister query: 2874004234 ImpalaServer - ClientFetchWaitTimer: 107431191 - InactiveTotalTime: 0 - RowMaterializationTimer: 52028 - TotalTime: 0 Execution Profile 16489725b57d7466:d2448f683f00cba7 Fragment start latencies: count: 17, last: 0.515105ns, min: 0.203761ns, max: 0.515105ns, mean: 0.278197ns, stddev: 0.079292ns Per Node Peak Memory Usage: gs-server-1001:22000(291.66 KB) gs-server-1020:22000(364.66 KB) gs-server-1006:22000(347.66 KB) gs-server-1011:22000(407.66 KB) gs-server-1008:22000(362.66 KB) gs-server-1005:22000(400.66 KB) gs-server-1018:22000(416.66 KB) gs-server-1004:22000(399.66 KB) gs-server-1010:22000(351.66 KB) gs-server-1007:22000(351.66 KB) gs-server-1013:22000(396.66 KB) gs-server-1019:22000(453.66 KB) gs-server-1012:22000(403.66 KB) gs-server-1009:22000(432.66 KB) gs-server-1000:22000(374.77 KB) gs-server-1014:22000(382.66 KB) gs-server-1015:22000(367.66 KB) - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 2741404254 Coordinator Fragment F01 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8445952 - PerHostPeakMemUsage: 0 - PrepareTime: 440252215 - RowsProduced: 1 - TotalCpuTime: 1880911547 - TotalNetworkReceiveTime: 957712826 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 1401100547 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 1 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 8388608 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 3774049 - CompileTime: 28599544 - InactiveTotalTime: 0 - LoadTime: 315349 - ModuleFileSize: 2530960 - OptimizationTime: 770883990 - PrepareTime: 433488492 - TotalTime: 1236500184 SORT_NODE (id=3) - InactiveTotalTime: 0 - PeakMemoryUsage: 24576 - RowsReturned: 1 - RowsReturnedRate: 0 - TotalTime: 1399531533 ANALYTIC_EVAL_NODE (id=2) - EvaluationTime: 18711 - GetNewBlockTime: 737944 - InactiveTotalTime: 0 - PeakMemoryUsage: 8413184 - PinTime: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - TotalTime: 1399275615 - UnpinTime: 0 AGGREGATION_NODE (id=5) ExecOption: Codegen Enabled - BuildTime: 37650 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 36864 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1398107774 EXCHANGE_NODE (id=4) - BytesReceived: 718 - ConvertRowBatchTime: 30841 - DeserializeRowBatchTimer: 327743 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 957607856 - PeakMemoryUsage: 0 - RowsReturned: 17 - RowsReturnedRate: 17 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 957801073 Averaged Fragment F00 split sizes: min: 89.25 KB, max: 117.88 KB, avg: 103.23 KB, stddev: 8.58 KB completion times: min:287.808ms max:1s998ms mean: 654.165917.165.916941ms stddev:485.655011.655.010550ms execution rates: min:54.11 KB/sec max:409.58 KB/sec mean:229.73 KB/sec stddev:114.28 KB/sec num instances: 17 - AverageThreadTokens: 1.411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 388053 - PerHostPeakMemUsage: 391914 - PrepareTime: 244134907 - RowsProduced: 1 - TotalCpuTime: 1142268231 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 838810 - TotalStorageWaitTime: 518495186 - TotalTime: 519975294 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1549308 - CompileTime: 44276019 - InactiveTotalTime: 0 - LoadTime: 354607 - ModuleFileSize: 2530960 - OptimizationTime: 308094388 - PrepareTime: 239260069 - TotalTime: 593767533 DataStreamSender (dst_id=4) - BytesSent: 42 - InactiveTotalTime: 0 - NetworkThroughput(*): 104984 - OverallThroughput: 1446930 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8674 - ThriftTransmitTime(*): 784634 - TotalTime: 30636 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) - BuildTime: 295730 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 518977660 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.6764705882352942 - BytesRead: 166032 - BytesReadDataNodeCache: 0 - BytesReadLocal: 146370 - BytesReadRemoteUnexpected: 19662 - BytesReadShortCircuit: 146370 - DecompressionTime: 97239 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 41 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 358400 - PerReadThreadRawHdfsThroughput: 573657648 - RemoteScanRanges: 5 - RowsRead: 3438 - RowsReturned: 15 - RowsReturnedRate: 187 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 721027509 - MaterializeTupleTime(*): 801115 - ScannerThreadsSysTime: 176294 - ScannerThreadsUserTime: 1234294 - ScannerThreadsVoluntaryContextSwitches: 101 - TotalRawHdfsReadTime(*): 354867 - TotalReadThroughput: 46164 - TotalTime: 275155225 Fragment F00 Instance 16489725b57d7466:d2448f683f00cbb7 (host=gs-server-1020:22000) Hdfs split stats (:<# splits>/): 2:1/15.39 KB 11:1/15.43 KB 3:2/31.35 KB 1:2/30.39 KB 10:1/15.56 KB - AverageThreadTokens: 3.25 - InactiveTotalTime: 0 - PeakMemoryUsage: 373416 - PerHostPeakMemUsage: 373416 - PrepareTime: 258010337 - RowsProduced: 1 - TotalCpuTime: 5363779670 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 913651 - TotalStorageWaitTime: 546020578 - TotalTime: 2007117343 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1356945 - CompileTime: 6305015 - InactiveTotalTime: 0 - LoadTime: 401423 - ModuleFileSize: 2530960 - OptimizationTime: 239161292 - PrepareTime: 253388370 - TotalTime: 500941941 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 47044 - OverallThroughput: 1472119 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8906 - ThriftTransmitTime(*): 871514 - TotalTime: 27851 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 273763 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2006142519 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/15.39 KB 11:1/15.43 KB 3:2/31.35 KB 1:2/30.39 KB 10:1/15.56 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 174242 - BytesReadDataNodeCache: 0 - BytesReadLocal: 174242 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174242 - DecompressionTime: 82392 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 350208 - PerReadThreadRawHdfsThroughput: 549988952 - RemoteScanRanges: 0 - RowsRead: 3617 - RowsReturned: 13 - RowsReturnedRate: 7 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3655878535 - MaterializeTupleTime(*): 833553 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 115 - TotalRawHdfsReadTime(*): 316810 - TotalReadThroughput: 0 - TotalTime: 1748256200 Instance 16489725b57d7466:d2448f683f00cbb6 (host=gs-server-1000:22000) Hdfs split stats (:<# splits>/): 3:1/15.51 KB 0:1/15.52 KB 4:2/28.72 KB 1:1/15.71 KB 2:2/30.31 KB - AverageThreadTokens: 2.75 - InactiveTotalTime: 0 - PeakMemoryUsage: 318120 - PerHostPeakMemUsage: 383760 - PrepareTime: 337356225 - RowsProduced: 1 - TotalCpuTime: 2130736802 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 219450 - TotalStorageWaitTime: 2105878691 - TotalTime: 1026786650 CodeGen - CodegenTime: 2366326 - CompileTime: 24373282 - InactiveTotalTime: 0 - LoadTime: 313129 - ModuleFileSize: 2530960 - OptimizationTime: 727521063 - PrepareTime: 330118450 - TotalTime: 1085081936 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 239829 - OverallThroughput: 1044982 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9493 - ThriftTransmitTime(*): 179294 - TotalTime: 41149 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 634881 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1025462344 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/15.51 KB 0:1/15.52 KB 4:2/28.72 KB 1:1/15.71 KB 2:2/30.31 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.5 - BytesRead: 170149 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 170149 - BytesReadShortCircuit: 0 - DecompressionTime: 193231 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 274432 - PerReadThreadRawHdfsThroughput: 154939093 - RemoteScanRanges: 49 - RowsRead: 3522 - RowsReturned: 19 - RowsReturnedRate: 27 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 2130754610 - MaterializeTupleTime(*): 1272709 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 7995000 - ScannerThreadsVoluntaryContextSwitches: 118 - TotalRawHdfsReadTime(*): 1098167 - TotalReadThroughput: 101593 - TotalTime: 688732676 Instance 16489725b57d7466:d2448f683f00cbb9 (host=gs-server-1001:22000) Hdfs split stats (:<# splits>/): 5:4/58.47 KB 1:2/29.32 KB 4:1/14.41 KB - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 298664 - PerHostPeakMemUsage: 298664 - PrepareTime: 228265317 - RowsProduced: 1 - TotalCpuTime: 1931566027 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3510398 - TotalStorageWaitTime: 1923516928 - TotalTime: 857327375 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1486359 - CompileTime: 7178871 - InactiveTotalTime: 0 - LoadTime: 335853 - ModuleFileSize: 2530960 - OptimizationTime: 259695413 - PrepareTime: 223353618 - TotalTime: 492362100 DataStreamSender (dst_id=4) - BytesSent: 40 - InactiveTotalTime: 0 - NetworkThroughput(*): 11532 - OverallThroughput: 1308857 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9986 - ThriftTransmitTime(*): 3468395 - TotalTime: 30561 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 358619 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 856343436 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:4/58.47 KB 1:2/29.32 KB 4:1/14.41 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 164108 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 164108 - BytesReadShortCircuit: 0 - DecompressionTime: 126730 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 3 - NumRowGroups: 7 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 260096 - PerReadThreadRawHdfsThroughput: 222321870 - RemoteScanRanges: 49 - RowsRead: 3386 - RowsReturned: 13 - RowsReturnedRate: 20 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 1931576459 - MaterializeTupleTime(*): 791703 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 1998000 - ScannerThreadsVoluntaryContextSwitches: 120 - TotalRawHdfsReadTime(*): 738155 - TotalReadThroughput: 158596 - TotalTime: 627653247 Instance 16489725b57d7466:d2448f683f00cbad (host=gs-server-1007:22000) Hdfs split stats (:<# splits>/): 4:2/30.16 KB 11:1/13.68 KB 9:1/15.42 KB 8:1/14.71 KB 7:1/15.28 KB - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 360104 - PerHostPeakMemUsage: 360104 - PrepareTime: 202872172 - RowsProduced: 1 - TotalCpuTime: 981935394 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 731257 - TotalStorageWaitTime: 812883579 - TotalTime: 768462386 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1298387 - CompileTime: 5820050 - InactiveTotalTime: 0 - LoadTime: 253240 - ModuleFileSize: 2530960 - OptimizationTime: 198154495 - PrepareTime: 198810164 - TotalTime: 404512117 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 64365 - OverallThroughput: 1887372 - PeakMemoryUsage: 2728 - SerializeBatchTime: 6150 - ThriftTransmitTime(*): 668058 - TotalTime: 22783 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 273707 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 767596065 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:2/30.16 KB 11:1/13.68 KB 9:1/15.42 KB 8:1/14.71 KB 7:1/15.28 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 143682 - BytesReadDataNodeCache: 0 - BytesReadLocal: 143682 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143682 - DecompressionTime: 71766 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 336896 - PerReadThreadRawHdfsThroughput: 672592967 - RemoteScanRanges: 0 - RowsRead: 2958 - RowsReturned: 13 - RowsReturnedRate: 23 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 821318933 - MaterializeTupleTime(*): 630491 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 999000 - ScannerThreadsVoluntaryContextSwitches: 68 - TotalRawHdfsReadTime(*): 213624 - TotalReadThroughput: 237764 - TotalTime: 564992655 Instance 16489725b57d7466:d2448f683f00cbae (host=gs-server-1010:22000) Hdfs split stats (:<# splits>/): 9:1/15.19 KB 8:1/14.50 KB 6:1/15.91 KB 11:1/13.98 KB 2:3/44.77 KB - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 360104 - PerHostPeakMemUsage: 360104 - PrepareTime: 383494824 - RowsProduced: 1 - TotalCpuTime: 931567384 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 281036 - TotalStorageWaitTime: 357533039 - TotalTime: 533294391 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2628406 - CompileTime: 10517431 - InactiveTotalTime: 0 - LoadTime: 718343 - ModuleFileSize: 2530960 - OptimizationTime: 331479365 - PrepareTime: 375757266 - TotalTime: 721215305 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 180372 - OverallThroughput: 1000854 - PeakMemoryUsage: 2728 - SerializeBatchTime: 10038 - ThriftTransmitTime(*): 227308 - TotalTime: 40965 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 288677 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 531364796 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/15.19 KB 8:1/14.50 KB 6:1/15.91 KB 11:1/13.98 KB 2:3/44.77 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 167766 - BytesReadDataNodeCache: 0 - BytesReadLocal: 167766 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 167766 - DecompressionTime: 115196 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 336896 - PerReadThreadRawHdfsThroughput: 461829413 - RemoteScanRanges: 0 - RowsRead: 3437 - RowsReturned: 11 - RowsReturnedRate: 74 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 412767838 - MaterializeTupleTime(*): 1140636 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 106 - TotalRawHdfsReadTime(*): 363264 - TotalReadThroughput: 286838 - TotalTime: 148359337 Instance 16489725b57d7466:d2448f683f00cbb8 (host=gs-server-1006:22000) Hdfs split stats (:<# splits>/): 3:1/15.55 KB 6:1/14.46 KB 9:1/15.47 KB 1:1/15.40 KB 5:2/29.92 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 356008 - PerHostPeakMemUsage: 356008 - PrepareTime: 346997648 - RowsProduced: 1 - TotalCpuTime: 1438810766 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 344993 - TotalStorageWaitTime: 166585652 - TotalTime: 398311224 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2354794 - CompileTime: 621912065 - InactiveTotalTime: 0 - LoadTime: 242786 - ModuleFileSize: 2530960 - OptimizationTime: 401636857 - PrepareTime: 340310304 - TotalTime: 1366575955 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 134842 - OverallThroughput: 1075726 - PeakMemoryUsage: 2728 - SerializeBatchTime: 9596 - ThriftTransmitTime(*): 318890 - TotalTime: 39973 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 508413 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 397392015 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/15.55 KB 6:1/14.46 KB 9:1/15.47 KB 1:1/15.40 KB 5:2/29.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 146332 - BytesReadDataNodeCache: 0 - BytesReadLocal: 146332 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146332 - DecompressionTime: 93016 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 5 - NumRowGroups: 6 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 301056 - PerReadThreadRawHdfsThroughput: 376498072 - RemoteScanRanges: 0 - RowsRead: 3021 - RowsReturned: 15 - RowsReturnedRate: 295 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 182591982 - MaterializeTupleTime(*): 1113182 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3997000 - ScannerThreadsVoluntaryContextSwitches: 122 - TotalRawHdfsReadTime(*): 388666 - TotalReadThroughput: 0 - TotalTime: 50823648 Instance 16489725b57d7466:d2448f683f00cbb3 (host=gs-server-1011:22000) Hdfs split stats (:<# splits>/): 9:1/14.80 KB 2:1/14.73 KB 8:1/14.59 KB 6:1/15.08 KB 5:1/13.56 KB 1:1/15.05 KB 10:1/14.51 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 417448 - PerHostPeakMemUsage: 417448 - PrepareTime: 253880407 - RowsProduced: 1 - TotalCpuTime: 817487947 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 262726 - TotalStorageWaitTime: 407840704 - TotalTime: 387796067 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1355896 - CompileTime: 12696429 - InactiveTotalTime: 0 - LoadTime: 221146 - ModuleFileSize: 2530960 - OptimizationTime: 399624937 - PrepareTime: 249242067 - TotalTime: 663567846 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 191663 - OverallThroughput: 1103016 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8867 - ThriftTransmitTime(*): 224352 - TotalTime: 38984 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 319545 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 386956358 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/14.80 KB 2:1/14.73 KB 8:1/14.59 KB 6:1/15.08 KB 5:1/13.56 KB 1:1/15.05 KB 10:1/14.51 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 164329 - BytesReadDataNodeCache: 0 - BytesReadLocal: 164329 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 164329 - DecompressionTime: 136118 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 7 - NumRowGroups: 7 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 394240 - PerReadThreadRawHdfsThroughput: 380965297 - RemoteScanRanges: 0 - RowsRead: 3373 - RowsReturned: 17 - RowsReturnedRate: 127 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 424309632 - MaterializeTupleTime(*): 1381963 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 1998000 - ScannerThreadsVoluntaryContextSwitches: 104 - TotalRawHdfsReadTime(*): 431349 - TotalReadThroughput: 0 - TotalTime: 133308135 Instance 16489725b57d7466:d2448f683f00cbb1 (host=gs-server-1008:22000) Hdfs split stats (:<# splits>/): 5:1/15.42 KB 3:1/14.37 KB 9:4/58.60 KB 7:2/27.36 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 371368 - PerHostPeakMemUsage: 371368 - PrepareTime: 245871134 - RowsProduced: 1 - TotalCpuTime: 668421222 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1327283 - TotalStorageWaitTime: 411393226 - TotalTime: 350913945 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1229570 - CompileTime: 5753969 - InactiveTotalTime: 0 - LoadTime: 393434 - ModuleFileSize: 2530960 - OptimizationTime: 214731551 - PrepareTime: 241652791 - TotalTime: 464063951 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 33737 - OverallThroughput: 1702767 - PeakMemoryUsage: 2728 - SerializeBatchTime: 7802 - ThriftTransmitTime(*): 1274541 - TotalTime: 25253 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 308890 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 349818165 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/15.42 KB 3:1/14.37 KB 9:4/58.60 KB 7:2/27.36 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 185850 - BytesReadDataNodeCache: 0 - BytesReadLocal: 185850 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185850 - DecompressionTime: 90650 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 4 - NumRowGroups: 8 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 348160 - PerReadThreadRawHdfsThroughput: 691280235 - RemoteScanRanges: 0 - RowsRead: 3824 - RowsReturned: 24 - RowsReturnedRate: 230 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 506231299 - MaterializeTupleTime(*): 647539 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 1998000 - ScannerThreadsVoluntaryContextSwitches: 115 - TotalRawHdfsReadTime(*): 268849 - TotalReadThroughput: 0 - TotalTime: 104321933 Instance 16489725b57d7466:d2448f683f00cbb2 (host=gs-server-1005:22000) Hdfs split stats (:<# splits>/): 3:1/13.94 KB 1:1/15.63 KB 2:1/15.63 KB 7:1/14.97 KB 9:2/30.07 KB 8:1/14.47 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 410280 - PerHostPeakMemUsage: 410280 - PrepareTime: 218331347 - RowsProduced: 1 - TotalCpuTime: 613525591 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 721116 - TotalStorageWaitTime: 332801200 - TotalTime: 340938841 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1628173 - CompileTime: 7013097 - InactiveTotalTime: 0 - LoadTime: 204534 - ModuleFileSize: 2530960 - OptimizationTime: 259010369 - PrepareTime: 213444869 - TotalTime: 481533152 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 64968 - OverallThroughput: 1199207 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11132 - ThriftTransmitTime(*): 661857 - TotalTime: 35857 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 257120 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 340053170 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/13.94 KB 1:1/15.63 KB 2:1/15.63 KB 7:1/14.97 KB 9:2/30.07 KB 8:1/14.47 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 168362 - BytesReadDataNodeCache: 0 - BytesReadLocal: 168362 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 168362 - DecompressionTime: 80843 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 369664 - PerReadThreadRawHdfsThroughput: 540148093 - RemoteScanRanges: 0 - RowsRead: 3510 - RowsReturned: 14 - RowsReturnedRate: 114 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 338559433 - MaterializeTupleTime(*): 592636 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 92 - TotalRawHdfsReadTime(*): 311696 - TotalReadThroughput: 0 - TotalTime: 122227500 Instance 16489725b57d7466:d2448f683f00cbb5 (host=gs-server-1014:22000) Hdfs split stats (:<# splits>/): 3:1/14.38 KB 5:1/14.48 KB 0:1/14.74 KB 6:1/13.83 KB 4:2/28.23 KB 2:1/15.62 KB 9:1/15.31 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 391848 - PerHostPeakMemUsage: 391848 - PrepareTime: 201697686 - RowsProduced: 1 - TotalCpuTime: 589867713 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 856322 - TotalStorageWaitTime: 306377453 - TotalTime: 296928324 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1245277 - CompileTime: 6554052 - InactiveTotalTime: 0 - LoadTime: 293061 - ModuleFileSize: 2530960 - OptimizationTime: 272682468 - PrepareTime: 197682659 - TotalTime: 478717898 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 50330 - OverallThroughput: 1678264 - PeakMemoryUsage: 2728 - SerializeBatchTime: 7770 - ThriftTransmitTime(*): 814611 - TotalTime: 24430 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 250307 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 295863205 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/14.38 KB 5:1/14.48 KB 0:1/14.74 KB 6:1/13.83 KB 4:2/28.23 KB 2:1/15.62 KB 9:1/15.31 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 187449 - BytesReadDataNodeCache: 0 - BytesReadLocal: 187449 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187449 - DecompressionTime: 106109 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 7 - NumRowGroups: 8 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 362496 - PerReadThreadRawHdfsThroughput: 798937018 - RemoteScanRanges: 0 - RowsRead: 3886 - RowsReturned: 17 - RowsReturnedRate: 180 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 317748225 - MaterializeTupleTime(*): 630770 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 999000 - ScannerThreadsVoluntaryContextSwitches: 88 - TotalRawHdfsReadTime(*): 234623 - TotalReadThroughput: 0 - TotalTime: 94441265 Instance 16489725b57d7466:d2448f683f00cbb0 (host=gs-server-1018:22000) Hdfs split stats (:<# splits>/): 11:1/15.61 KB 0:1/15.62 KB 3:1/14.78 KB 10:2/29.14 KB 4:2/29.35 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 426664 - PerHostPeakMemUsage: 426664 - PrepareTime: 206411015 - RowsProduced: 1 - TotalCpuTime: 520918820 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1582082 - TotalStorageWaitTime: 248297742 - TotalTime: 288797658 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1337656 - CompileTime: 6766783 - InactiveTotalTime: 0 - LoadTime: 252473 - ModuleFileSize: 2530960 - OptimizationTime: 211897189 - PrepareTime: 202235719 - TotalTime: 422761382 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 28427 - OverallThroughput: 1638095 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8382 - ThriftTransmitTime(*): 1512634 - TotalTime: 26250 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 307022 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 287832446 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/15.61 KB 0:1/15.62 KB 3:1/14.78 KB 10:2/29.14 KB 4:2/29.35 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 168271 - BytesReadDataNodeCache: 0 - BytesReadLocal: 168271 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 168271 - DecompressionTime: 110634 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 403456 - PerReadThreadRawHdfsThroughput: 610697578 - RemoteScanRanges: 0 - RowsRead: 3501 - RowsReturned: 11 - RowsReturnedRate: 134 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 259718416 - MaterializeTupleTime(*): 748922 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 94 - TotalRawHdfsReadTime(*): 275539 - TotalReadThroughput: 0 - TotalTime: 81646594 Instance 16489725b57d7466:d2448f683f00cbaf (host=gs-server-1004:22000) Hdfs split stats (:<# splits>/): 2:2/30.18 KB 0:1/15.04 KB 5:2/28.65 KB 1:1/14.30 KB 6:1/15.33 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 409256 - PerHostPeakMemUsage: 409256 - PrepareTime: 224322924 - RowsProduced: 1 - TotalCpuTime: 570541659 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 850530 - TotalStorageWaitTime: 285978371 - TotalTime: 287418401 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1587961 - CompileTime: 7647348 - InactiveTotalTime: 0 - LoadTime: 231116 - ModuleFileSize: 2530960 - OptimizationTime: 257498982 - PrepareTime: 219667547 - TotalTime: 486739303 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 52481 - OverallThroughput: 1225526 - PeakMemoryUsage: 2728 - SerializeBatchTime: 11964 - ThriftTransmitTime(*): 781224 - TotalTime: 33455 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 194207 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 286553412 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:2/30.18 KB 0:1/15.04 KB 5:2/28.65 KB 1:1/14.30 KB 6:1/15.33 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 166279 - BytesReadDataNodeCache: 0 - BytesReadLocal: 166279 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166279 - DecompressionTime: 98292 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 5 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 386048 - PerReadThreadRawHdfsThroughput: 577688606 - RemoteScanRanges: 0 - RowsRead: 3463 - RowsReturned: 17 - RowsReturnedRate: 271 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 302203919 - MaterializeTupleTime(*): 699157 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 101 - TotalRawHdfsReadTime(*): 287835 - TotalReadThroughput: 0 - TotalTime: 62656551 Instance 16489725b57d7466:d2448f683f00cbab (host=gs-server-1019:22000) Hdfs split stats (:<# splits>/): 3:2/29.18 KB 5:2/29.25 KB 0:1/14.87 KB 2:1/15.25 KB 11:2/29.33 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 464552 - PerHostPeakMemUsage: 464552 - PrepareTime: 217104179 - RowsProduced: 1 - TotalCpuTime: 514387398 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 243150 - TotalStorageWaitTime: 165804637 - TotalTime: 276808440 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1427738 - CompileTime: 6743035 - InactiveTotalTime: 0 - LoadTime: 188818 - ModuleFileSize: 2530960 - OptimizationTime: 209079836 - PrepareTime: 212845292 - TotalTime: 430403332 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 216567 - OverallThroughput: 1155976 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8445 - ThriftTransmitTime(*): 198552 - TotalTime: 37198 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 196987 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 275983056 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:2/29.18 KB 5:2/29.25 KB 0:1/14.87 KB 2:1/15.25 KB 11:2/29.33 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 ExecOption: Codegen enabled: 0 out of 8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 189483 - BytesReadDataNodeCache: 0 - BytesReadLocal: 189483 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189483 - DecompressionTime: 79168 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 48 - NumDisksAccessed: 5 - NumRowGroups: 8 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 422912 - PerReadThreadRawHdfsThroughput: 729546793 - RemoteScanRanges: 0 - RowsRead: 3882 - RowsReturned: 22 - RowsReturnedRate: 370 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 186439992 - MaterializeTupleTime(*): 689643 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 999000 - ScannerThreadsVoluntaryContextSwitches: 105 - TotalRawHdfsReadTime(*): 259727 - TotalReadThroughput: 0 - TotalTime: 59318360 Instance 16489725b57d7466:d2448f683f00cbb4 (host=gs-server-1015:22000) Hdfs split stats (:<# splits>/): 7:1/14.59 KB 3:1/14.94 KB 6:1/15.76 KB 5:1/14.44 KB 2:1/15.23 KB 11:1/14.99 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 376488 - PerHostPeakMemUsage: 376488 - PrepareTime: 230780297 - RowsProduced: 1 - TotalCpuTime: 934126661 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 284357 - TotalStorageWaitTime: 156596437 - TotalTime: 271218882 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1259838 - CompileTime: 6056153 - InactiveTotalTime: 0 - LoadTime: 214489 - ModuleFileSize: 2530960 - OptimizationTime: 644775083 - PrepareTime: 226631130 - TotalTime: 879245887 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 194967 - OverallThroughput: 1817720 - PeakMemoryUsage: 2728 - SerializeBatchTime: 6882 - ThriftTransmitTime(*): 220550 - TotalTime: 23656 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 260989 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 270356027 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/14.59 KB 3:1/14.94 KB 6:1/15.76 KB 5:1/14.44 KB 2:1/15.23 KB 11:1/14.99 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 144690 - BytesReadDataNodeCache: 0 - BytesReadLocal: 144690 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144690 - DecompressionTime: 54059 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 6 - NumRowGroups: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 353280 - PerReadThreadRawHdfsThroughput: 704289796 - RemoteScanRanges: 0 - RowsRead: 3004 - RowsReturned: 14 - RowsReturnedRate: 350 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 167778355 - MaterializeTupleTime(*): 544532 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 205441 - TotalReadThroughput: 0 - TotalTime: 39998676 Instance 16489725b57d7466:d2448f683f00cba9 (host=gs-server-1009:22000) Hdfs split stats (:<# splits>/): 11:1/14.71 KB 7:1/14.71 KB 9:1/14.26 KB 0:1/15.66 KB 5:1/14.69 KB 4:2/29.64 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 443048 - PerHostPeakMemUsage: 443048 - PrepareTime: 208896892 - RowsProduced: 1 - TotalCpuTime: 474333490 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 918188 - TotalStorageWaitTime: 213793819 - TotalTime: 258828848 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1076615 - CompileTime: 5480975 - InactiveTotalTime: 0 - LoadTime: 1552765 - ModuleFileSize: 2530960 - OptimizationTime: 195231605 - PrepareTime: 204027699 - TotalTime: 407658671 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 50740 - OverallThroughput: 1946582 - PeakMemoryUsage: 2728 - SerializeBatchTime: 5990 - ThriftTransmitTime(*): 847446 - TotalTime: 22090 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 149429 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 3 - SpilledPartitions: 0 - TotalTime: 257823063 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/14.71 KB 7:1/14.71 KB 9:1/14.26 KB 0:1/15.66 KB 5:1/14.69 KB 4:2/29.64 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 166647 - BytesReadDataNodeCache: 0 - BytesReadLocal: 166647 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166647 - DecompressionTime: 78411 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 419840 - PerReadThreadRawHdfsThroughput: 878851802 - RemoteScanRanges: 0 - RowsRead: 3442 - RowsReturned: 23 - RowsReturnedRate: 467 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 227643865 - MaterializeTupleTime(*): 571170 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 104 - TotalRawHdfsReadTime(*): 189619 - TotalReadThroughput: 0 - TotalTime: 49185793 Instance 16489725b57d7466:d2448f683f00cbac (host=gs-server-1013:22000) Hdfs split stats (:<# splits>/): 7:1/15.13 KB 10:1/15.59 KB 9:1/14.89 KB 5:1/14.33 KB 0:1/15.74 KB 4:1/15.85 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 406184 - PerHostPeakMemUsage: 406184 - PrepareTime: 188671884 - RowsProduced: 1 - TotalCpuTime: 472459712 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 308955 - TotalStorageWaitTime: 166529189 - TotalTime: 246039762 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1418982 - CompileTime: 6228194 - InactiveTotalTime: 0 - LoadTime: 24456 - ModuleFileSize: 2530960 - OptimizationTime: 213011193 - PrepareTime: 184766624 - TotalTime: 405501940 DataStreamSender (dst_id=4) - BytesSent: 41 - InactiveTotalTime: 0 - NetworkThroughput(*): 171051 - OverallThroughput: 1718789 - PeakMemoryUsage: 2728 - SerializeBatchTime: 7133 - ThriftTransmitTime(*): 239694 - TotalTime: 23854 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 182251 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 245319208 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/15.13 KB 10:1/15.59 KB 9:1/14.89 KB 5:1/14.33 KB 0:1/15.74 KB 4:1/15.85 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:36 ExecOption: Codegen enabled: 0 out of 6 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 147346 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147346 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147346 - DecompressionTime: 63349 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 36 - NumDisksAccessed: 6 - NumRowGroups: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 382976 - PerReadThreadRawHdfsThroughput: 701043386 - RemoteScanRanges: 0 - RowsRead: 3115 - RowsReturned: 14 - RowsReturnedRate: 245 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 173028635 - MaterializeTupleTime(*): 585240 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 86 - TotalRawHdfsReadTime(*): 210181 - TotalReadThroughput: 0 - TotalTime: 56972213 Instance 16489725b57d7466:d2448f683f00cbaa (host=gs-server-1012:22000) Hdfs split stats (:<# splits>/): 1:1/14.86 KB 4:1/14.19 KB 8:1/15.18 KB 2:2/28.56 KB 3:1/15.80 KB 9:1/15.48 KB - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 413352 - PerHostPeakMemUsage: 413352 - PrepareTime: 197329141 - RowsProduced: 1 - TotalCpuTime: 464093675 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 904284 - TotalStorageWaitTime: 206586923 - TotalTime: 242591465 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1279318 - CompileTime: 5645590 - InactiveTotalTime: 0 - LoadTime: 187257 - ModuleFileSize: 2530960 - OptimizationTime: 202412898 - PrepareTime: 193486616 - TotalTime: 403165355 DataStreamSender (dst_id=4) - BytesSent: 43 - InactiveTotalTime: 0 - NetworkThroughput(*): 51815 - OverallThroughput: 1621968 - PeakMemoryUsage: 2728 - SerializeBatchTime: 8926 - ThriftTransmitTime(*): 829860 - TotalTime: 26511 - UncompressedRowBatchSize: 56 AGGREGATION_NODE (id=1) ExecOption: Codegen Enabled - BuildTime: 262618 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 77824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 241760936 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/14.86 KB 4:1/14.19 KB 8:1/15.18 KB 2:2/28.56 KB 3:1/15.80 KB 9:1/15.48 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:42 ExecOption: Codegen enabled: 0 out of 7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 167570 - BytesReadDataNodeCache: 0 - BytesReadLocal: 167570 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 167570 - DecompressionTime: 73107 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 42 - NumDisksAccessed: 6 - NumRowGroups: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 390144 - PerReadThreadRawHdfsThroughput: 700561050 - RemoteScanRanges: 0 - RowsRead: 3509 - RowsReturned: 11 - RowsReturnedRate: 245 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 218917527 - MaterializeTupleTime(*): 745125 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 110 - TotalRawHdfsReadTime(*): 239194 - TotalReadThroughput: 0 - TotalTime: 44744048