Query (id=6541c5b903212c02:63276eb38dcc1c89) Summary Session ID: 1943e068c7ba76f3:82ba3e9fc1b6c082 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V5 Start Time: 2015-03-08 23:22:03.415225000 End Time: 2015-03-08 23:22:11.728856000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.1.2-cdh5 RELEASE (build 92438b7fb62a875041ffd2ab324f408ecf8129e5) User: mreynolds-prod Connected User: mreynolds-prod Delegated User: Network Address: ::ffff:10.16.3.36:56453 Default Db: irdw_prod Sql Statement: select count(*), sum(adv_commission) from action_fact2 where p_action_date_ym in (select p_action_date_ym from action_partitions where p_action_date_ym >= '201401' and p_action_date_ym <= '201412') Coordinator: hadoop1.phx.impactradius.net:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.03GB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. irdw_prod.action_partitions F02:PLAN FRAGMENT [UNPARTITIONED] 06:AGGREGATE [FINALIZE] | output: count:merge(*), sum:merge(adv_commission) | hosts=8 per-host-mem=unavailable | tuple-ids=3 row-size=24B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] hosts=8 per-host-mem=unavailable tuple-ids=3 row-size=24B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=05, UNPARTITIONED] 03:AGGREGATE | output: count(*), sum(adv_commission) | hosts=8 per-host-mem=10.00MB | tuple-ids=3 row-size=24B cardinality=1 | 02:HASH JOIN [LEFT SEMI JOIN, BROADCAST] | hash predicates: p_action_date_ym = p_action_date_ym | hosts=8 per-host-mem=2.00GB | tuple-ids=0 row-size=23B cardinality=22377986 | |--04:EXCHANGE [BROADCAST] | hosts=4 per-host-mem=0B | tuple-ids=1 row-size=15B cardinality=unavailable | 00:SCAN HDFS [irdw_prod.action_fact2, RANDOM] partitions=120/531 files=531 size=5.06GB table stats: 48700856 rows total column stats: all hosts=8 per-host-mem=24.00MB tuple-ids=0 row-size=23B cardinality=22377986 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=04, BROADCAST] 01:SCAN HDFS [irdw_prod.action_partitions, RANDOM] partitions=1/1 files=4 size=378B predicates: p_action_date_ym >= '201401', p_action_date_ym <= '201412' table stats: unavailable column stats: unavailable hosts=4 per-host-mem=32.00MB tuple-ids=1 row-size=15B cardinality=unavailable ---------------- Estimated Per-Host Mem: 2183135232 Estimated Per-Host VCores: 2 Tables Missing Stats: irdw_prod.action_partitions Request Pool: root.mreynolds-prod ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 220.387ms 220.387ms 1 1 32.00 KB -1.00 B FINALIZE 05:EXCHANGE 1 158.136us 158.136us 8 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 8 211.225ms 300.765ms 8 1 320.21 KB 10.00 MB 02:HASH JOIN 8 371.157ms 442.602ms 22.38M 22.38M 4.15 MB 2.00 GB LEFT SEMI JOIN, BROADCAST |--04:EXCHANGE 8 61.180us 79.671us 12 -1 0 0 BROADCAST | 01:SCAN HDFS 4 183.34ms 188.60ms 12 -1 38.00 KB 32.00 MB irdw_prod.action_partitions 00:SCAN HDFS 8 37.848ms 53.965ms 22.38M 22.38M 35.15 MB 24.00 MB irdw_prod.action_fact2 Query Timeline Start execution: 78162 Planning finished: 13279242 Ready to start remote fragments: 238066647 Remote fragments started: 688331561 Rows available: 1288173588 First row fetched: 1788671885 Unregister query: 8313632807 ImpalaServer - AsyncTotalTime: 0 - ClientFetchWaitTimer: 7022051297 - InactiveTotalTime: 0 - RowMaterializationTimer: 28129 - TotalTime: 0 Execution Profile 6541c5b903212c02:63276eb38dcc1c89 Fragment start latencies: count: 12, last: 0.189953, min: 0.162796, max: 0.252892, mean: 0.185824, stddev: 0.0233735 Per Node Peak Memory Usage: hadoop11.phx.impactradius.net:22000(10.06 MB) hadoop7.phx.impactradius.net:22000(10.88 MB) hadoop2.phx.impactradius.net:22000(35.98 MB) hadoop4.phx.impactradius.net:22000(36.62 MB) hadoop3.phx.impactradius.net:22000(36.81 MB) hadoop5.phx.impactradius.net:22000(10.35 MB) hadoop9.phx.impactradius.net:22000(11.43 MB) hadoop1.phx.impactradius.net:22000(23.63 MB) - AsyncTotalTime: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 1274667152 Coordinator Fragment F02 - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 49152 - PerHostPeakMemUsage: 0 - PrepareTime: 220254521 - RowsProduced: 1 - TotalCpuTime: 1360377175 - TotalNetworkReceiveTime: 412005240 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 633197046 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1543426 - CompileTime: 6717519 - InactiveTotalTime: 0 - LoadTime: 155438 - ModuleFileSize: 2055524 - OptimizationTime: 179869090 - PrepareTime: 216642241 - TotalTime: 405598022 AGGREGATION_NODE (id=6) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 36873 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 32768 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 632459082 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 287 - ConvertRowBatchTime: 20325 - DeserializeRowBatchTimer: 64147 - FirstBatchArrivalWaitTime: 80520659 - InactiveTotalTime: 411913414 - PeakMemoryUsage: 0 - RowsReturned: 8 - RowsReturnedRate: 19 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 412071550 Averaged Fragment F00 split sizes: min: 142.09 MB, max: 1.11 GB, avg: 647.88 MB, stddev: 481.05 MB completion times: min:548.374ms max:844.130ms mean: 691.459ms stddev:137.143ms execution rates: min:256.39 MB/sec max:1.40 GB/sec mean:832.79 MB/sec stddev:533.16 MB/sec num instances: 8 - AsyncTotalTime: 0 - AverageThreadTokens: 6.1875 - InactiveTotalTime: 0 - PeakMemoryUsage: 23035882 - PerHostPeakMemUsage: 23037418 - PrepareTime: 181291142 - RowsProduced: 1 - TotalCpuTime: 12882596943 - TotalNetworkReceiveTime: 216053125 - TotalNetworkSendTime: 394579 - TotalStorageWaitTime: 1104915819 - TotalTime: 620375382 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40884159634 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 491013 - CompileTime: 46553936 - InactiveTotalTime: 0 - LoadTime: 139809 - ModuleFileSize: 2055524 - OptimizationTime: 204384496 - PrepareTime: 175120715 - TotalTime: 427660304 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 35 - InactiveTotalTime: 0 - NetworkThroughput(*): 115789 - OverallThroughput: 1038024 - PeakMemoryUsage: 4096 - SerializeBatchTime: 9618 - ThriftTransmitTime(*): 314623 - TotalTime: 35778 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) - AsyncTotalTime: 0 - BuildTime: 31845464 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 297877 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 619364072 HASH_JOIN_NODE (id=2) - AsyncTotalTime: 0 - BuildPartitionTime: 21191 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 145934 - GetNewBlockTime: 150797 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 2797711 - ProbeRowsPartitioned: 0 - ProbeTime: 142601080 - RowsReturned: 2797711 - RowsReturnedRate: 6259100 - SpilledPartitions: 0 - TotalTime: 408138802 - UnpinTime: 2573 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 7612 - DeserializeRowBatchTimer: 42545 - FirstBatchArrivalWaitTime: 166850380 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 63 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 216088085 HDFS_SCAN_NODE (id=0) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 9.625 - BytesRead: 12247019 - BytesReadDataNodeCache: 0 - BytesReadLocal: 12247019 - BytesReadRemoteUnexpected: 903525448 - BytesReadShortCircuit: 12247019 - DecompressionTime: 6085292 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 10 - NumScannerThreadsStarted: 50 - PeakMemoryUsage: 21322070 - PerReadThreadRawHdfsThroughput: 491176814 - RemoteScanRanges: 1625 - RowsRead: 2797711 - RowsReturned: 2797711 - RowsReturnedRate: 62021434 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 220 - ScannerThreadsTotalWallClockTime: 12574060988 - MaterializeTupleTime(*): 9140959955 - ScannerThreadsSysTime: 686998500 - ScannerThreadsUserTime: 366171375 - ScannerThreadsVoluntaryContextSwitches: 8483 - TotalRawHdfsReadTime(*): 38377458 - TotalReadThroughput: 5053722 - TotalTime: 37848542 Averaged Fragment F01 split sizes: min: 91.00 B, max: 98.00 B, avg: 94.00 B, stddev: 3.00 B completion times: min:176.181ms max:214.119ms mean: 189.952ms stddev:14.391ms execution rates: min:457.00 B/sec max:532.00 B/sec mean:498.00 B/sec stddev:28.00 B/sec num instances: 4 - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 90752 - PerHostPeakMemUsage: 4340364 - PrepareTime: 179187306 - RowsProduced: 3 - TotalCpuTime: 370291326 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 496114 - TotalStorageWaitTime: 3260943 - TotalTime: 185705637 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1545803 - CompileTime: 9128179 - InactiveTotalTime: 0 - LoadTime: 139249 - ModuleFileSize: 2055524 - OptimizationTime: 172384713 - PrepareTime: 175965208 - TotalTime: 359105002 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 640 - InactiveTotalTime: 0 - NetworkThroughput(*): 150980 - OverallThroughput: 830234 - PeakMemoryUsage: 43648 - SerializeBatchTime: 11928 - ThriftTransmitTime(*): 4301736 - TotalTime: 867322 - UncompressedRowBatchSize: 880 HDFS_SCAN_NODE (id=1) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 94 - BytesReadDataNodeCache: 0 - BytesReadLocal: 94 - BytesReadRemoteUnexpected: 51269 - BytesReadShortCircuit: 94 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 7402028 - RemoteScanRanges: 87 - RowsRead: 13 - RowsReturned: 3 - RowsReturnedRate: 16 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3477967 - DelimiterParseTime: 2158 - MaterializeTupleTime(*): 2537 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 13516 - TotalReadThroughput: 0 - TotalTime: 183034446 Fragment F00 Instance 6541c5b903212c02:63276eb38dcc1c90 (host=hadoop2.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 10:12/130.12 MB 1:11/79.27 MB 4:10/62.99 MB 0:13/167.17 MB 5:10/68.14 MB 3:12/102.01 MB 2:11/85.14 MB 7:11/72.58 MB 6:12/88.14 MB 9:11/108.76 MB 8:14/164.18 MB - AsyncTotalTime: 0 - AverageThreadTokens: 15.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 37732872 - PerHostPeakMemUsage: 37732872 - PrepareTime: 248223303 - RowsProduced: 1 - TotalCpuTime: 28133279958 - TotalNetworkReceiveTime: 114120358 - TotalNetworkSendTime: 348179 - TotalStorageWaitTime: 2070550233 - TotalTime: 734096126 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 499437 - CompileTime: 54512977 - InactiveTotalTime: 0 - LoadTime: 133716 - ModuleFileSize: 2055524 - OptimizationTime: 246633811 - PrepareTime: 241305262 - TotalTime: 544173556 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 129900 - OverallThroughput: 1043508 - PeakMemoryUsage: 4096 - SerializeBatchTime: 9470 - ThriftTransmitTime(*): 277136 - TotalTime: 34499 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 53177546 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 284120 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 733019513 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 115888442 - BuildPartitionTime: 15518 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 1062842 - GetNewBlockTime: 131564 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 4928452 - ProbeRowsPartitioned: 0 - ProbeTime: 253056481 - RowsReturned: 4928452 - RowsReturnedRate: 11401744 - SpilledPartitions: 0 - TotalTime: 432254211 - UnpinTime: 1870 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 7046 - DeserializeRowBatchTimer: 30154 - FirstBatchArrivalWaitTime: 50023172 - InactiveTotalTime: 114097352 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 105 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114150310 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:12/130.12 MB 1:11/79.27 MB 4:10/62.99 MB 0:13/167.17 MB 5:10/68.14 MB 3:12/102.01 MB 2:11/85.14 MB 7:11/72.58 MB 6:12/88.14 MB 9:11/108.76 MB 8:14/164.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:124 ExecOption: Codegen enabled: 0 out of 127 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 28.0 - BytesRead: 22096277 - BytesReadDataNodeCache: 0 - BytesReadLocal: 22096277 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22096277 - DecompressionTime: 10098975 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 36015240 - PerReadThreadRawHdfsThroughput: 543525567 - RemoteScanRanges: 159 - RowsRead: 4928452 - RowsReturned: 4928452 - RowsReturnedRate: 99760061 - ScanRangesComplete: 127 - ScannerThreadsInvoluntaryContextSwitches: 278 - ScannerThreadsTotalWallClockTime: 28017517641 - MaterializeTupleTime(*): 20989979636 - ScannerThreadsSysTime: 842819000 - ScannerThreadsUserTime: 510877000 - ScannerThreadsVoluntaryContextSwitches: 7973 - TotalRawHdfsReadTime(*): 40653611 - TotalReadThroughput: 22096277 - TotalTime: 49403057 Instance 6541c5b903212c02:63276eb38dcc1c8f (host=hadoop4.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 8:7/86.25 MB 10:9/74.87 MB 7:8/73.64 MB 6:11/87.00 MB 2:9/141.26 MB 1:12/133.20 MB 9:6/49.40 MB 0:8/64.50 MB 5:10/108.82 MB 3:14/123.93 MB 4:12/173.05 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 38398816 - PerHostPeakMemUsage: 38398816 - PrepareTime: 182479062 - RowsProduced: 1 - TotalCpuTime: 26901738402 - TotalNetworkReceiveTime: 175668954 - TotalNetworkSendTime: 358648 - TotalStorageWaitTime: 2051691640 - TotalTime: 728183455 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 533336 - CompileTime: 52326531 - InactiveTotalTime: 0 - LoadTime: 142835 - ModuleFileSize: 2055524 - OptimizationTime: 234891137 - PrepareTime: 174347502 - TotalTime: 463255835 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 35 - InactiveTotalTime: 0 - NetworkThroughput(*): 113533 - OverallThroughput: 720461 - PeakMemoryUsage: 4096 - SerializeBatchTime: 8517 - ThriftTransmitTime(*): 308280 - TotalTime: 48580 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 52545308 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 312704 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 727267318 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 176389151 - BuildPartitionTime: 21975 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 14817 - GetNewBlockTime: 141096 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 4924132 - ProbeRowsPartitioned: 0 - ProbeTime: 248997937 - RowsReturned: 4924132 - RowsReturnedRate: 9954307 - SpilledPartitions: 0 - TotalTime: 494673477 - UnpinTime: 2313 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 5650 - DeserializeRowBatchTimer: 31395 - FirstBatchArrivalWaitTime: 129332565 - InactiveTotalTime: 175648629 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 68 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 175690671 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:7/86.25 MB 10:9/74.87 MB 7:8/73.64 MB 6:11/87.00 MB 2:9/141.26 MB 1:12/133.20 MB 9:6/49.40 MB 0:8/64.50 MB 5:10/108.82 MB 3:14/123.93 MB 4:12/173.05 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:104 ExecOption: Codegen enabled: 0 out of 106 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 20334683 - BytesReadDataNodeCache: 0 - BytesReadLocal: 20334683 - BytesReadRemoteUnexpected: 324282 - BytesReadShortCircuit: 20334683 - DecompressionTime: 10139415 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 36713696 - PerReadThreadRawHdfsThroughput: 447978093 - RemoteScanRanges: 228 - RowsRead: 4924132 - RowsReturned: 4924132 - RowsReturnedRate: 93314383 - ScanRangesComplete: 106 - ScannerThreadsInvoluntaryContextSwitches: 451 - ScannerThreadsTotalWallClockTime: 26725493757 - MaterializeTupleTime(*): 18864754714 - ScannerThreadsSysTime: 1240774000 - ScannerThreadsUserTime: 557872000 - ScannerThreadsVoluntaryContextSwitches: 9196 - TotalRawHdfsReadTime(*): 45392137 - TotalReadThroughput: 0 - TotalTime: 52769271 Instance 6541c5b903212c02:63276eb38dcc1c8e (host=hadoop3.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 6:7/84.14 MB 7:12/134.44 MB 3:7/61.26 MB 5:8/90.13 MB 0:10/77.56 MB 2:15/147.34 MB 4:12/119.19 MB 9:7/112.28 MB 1:9/78.26 MB 10:16/149.11 MB 8:6/86.77 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 38598096 - PerHostPeakMemUsage: 38598096 - PrepareTime: 180433212 - RowsProduced: 1 - TotalCpuTime: 25341250914 - TotalNetworkReceiveTime: 165950791 - TotalNetworkSendTime: 475904 - TotalStorageWaitTime: 2510705917 - TotalTime: 722740125 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 479408 - CompileTime: 56390090 - InactiveTotalTime: 0 - LoadTime: 188339 - ModuleFileSize: 2055524 - OptimizationTime: 242394018 - PrepareTime: 174036053 - TotalTime: 474465343 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 95723 - OverallThroughput: 851607 - PeakMemoryUsage: 4096 - SerializeBatchTime: 14044 - ThriftTransmitTime(*): 376083 - TotalTime: 42273 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 59175562 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 301664 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 721525854 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 166861586 - BuildPartitionTime: 13420 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 16280 - GetNewBlockTime: 214646 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 4954919 - ProbeRowsPartitioned: 0 - ProbeTime: 247334286 - RowsReturned: 4954919 - RowsReturnedRate: 10283429 - SpilledPartitions: 0 - TotalTime: 481835289 - UnpinTime: 3461 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 8666 - DeserializeRowBatchTimer: 39103 - FirstBatchArrivalWaitTime: 118520952 - InactiveTotalTime: 165922591 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 72 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 165995528 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:7/84.14 MB 7:12/134.44 MB 3:7/61.26 MB 5:8/90.13 MB 0:10/77.56 MB 2:15/147.34 MB 4:12/119.19 MB 9:7/112.28 MB 1:9/78.26 MB 10:16/149.11 MB 8:6/86.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:1 PARQUET/SNAPPY:108 ExecOption: Codegen enabled: 0 out of 109 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 21222519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 21222519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21222519 - DecompressionTime: 11085782 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 36859216 - PerReadThreadRawHdfsThroughput: 330295910 - RemoteScanRanges: 162 - RowsRead: 4954919 - RowsReturned: 4954919 - RowsReturnedRate: 91816491 - ScanRangesComplete: 109 - ScannerThreadsInvoluntaryContextSwitches: 278 - ScannerThreadsTotalWallClockTime: 25174660283 - MaterializeTupleTime(*): 19372932293 - ScannerThreadsSysTime: 420897000 - ScannerThreadsUserTime: 569866000 - ScannerThreadsVoluntaryContextSwitches: 6424 - TotalRawHdfsReadTime(*): 64253048 - TotalReadThroughput: 0 - TotalTime: 53965458 Instance 6541c5b903212c02:63276eb38dcc1c8c (host=hadoop1.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 3:6/74.65 MB 6:7/48.48 MB 9:14/105.27 MB 4:12/131.49 MB 10:8/78.30 MB 2:10/100.59 MB 8:16/143.62 MB 1:14/109.80 MB 7:15/126.25 MB 0:11/117.32 MB 5:8/94.45 MB - AsyncTotalTime: 0 - AverageThreadTokens: 24.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 24760616 - PerHostPeakMemUsage: 24772904 - PrepareTime: 199137182 - RowsProduced: 1 - TotalCpuTime: 16197169745 - TotalNetworkReceiveTime: 125324254 - TotalNetworkSendTime: 447739 - TotalStorageWaitTime: 1227338446 - TotalTime: 718492986 CodeGen - AsyncTotalTime: 0 - CodegenTime: 636787 - CompileTime: 63191281 - InactiveTotalTime: 0 - LoadTime: 115363 - ModuleFileSize: 2055524 - OptimizationTime: 260042954 - PrepareTime: 191590263 - TotalTime: 516724790 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 109869 - OverallThroughput: 898405 - PeakMemoryUsage: 4096 - SerializeBatchTime: 12452 - ThriftTransmitTime(*): 327661 - TotalTime: 40071 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 62525352 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 288136 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 717684069 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 126035731 - BuildPartitionTime: 15756 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 17384 - GetNewBlockTime: 110972 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 4791444 - ProbeRowsPartitioned: 0 - ProbeTime: 263062806 - RowsReturned: 4791444 - RowsReturnedRate: 10479040 - SpilledPartitions: 0 - TotalTime: 457240702 - UnpinTime: 2044 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 7112 - DeserializeRowBatchTimer: 30372 - FirstBatchArrivalWaitTime: 78856227 - InactiveTotalTime: 125301900 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 95 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 125349989 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:6/74.65 MB 6:7/48.48 MB 9:14/105.27 MB 4:12/131.49 MB 10:8/78.30 MB 2:10/100.59 MB 8:16/143.62 MB 1:14/109.80 MB 7:15/126.25 MB 0:11/117.32 MB 5:8/94.45 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:100% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:119 ExecOption: Codegen enabled: 0 out of 121 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 2.0 - AverageScannerThreadConcurrency: 47.0 - BytesRead: 22238986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 22238986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22238986 - DecompressionTime: 11429760 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 47 - PeakMemoryUsage: 23105640 - PerReadThreadRawHdfsThroughput: 162936117 - RemoteScanRanges: 150 - RowsRead: 4791444 - RowsReturned: 4791444 - RowsReturnedRate: 91260419 - ScanRangesComplete: 121 - ScannerThreadsInvoluntaryContextSwitches: 345 - ScannerThreadsTotalWallClockTime: 16071245016 - MaterializeTupleTime(*): 13486820824 - ScannerThreadsSysTime: 608886000 - ScannerThreadsUserTime: 671881000 - ScannerThreadsVoluntaryContextSwitches: 8262 - TotalRawHdfsReadTime(*): 136488989 - TotalReadThroughput: 15508643 - TotalTime: 52502980 Instance 6541c5b903212c02:63276eb38dcc1c8b (host=hadoop9.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 4:1/10.96 MB 1:1/21.24 MB 8:2/16.48 MB 10:4/27.21 MB 9:1/21.44 KB 3:2/27.83 KB 6:1/13.92 KB 7:2/33.14 MB 0:2/14.55 MB 5:1/20.79 KB 2:4/53.28 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11986400 - PerHostPeakMemUsage: 11986400 - PrepareTime: 162489550 - RowsProduced: 1 - TotalCpuTime: 1051738317 - TotalNetworkReceiveTime: 286647387 - TotalNetworkSendTime: 472628 - TotalStorageWaitTime: 252460846 - TotalTime: 522488076 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 450292 - CompileTime: 36580960 - InactiveTotalTime: 0 - LoadTime: 149654 - ModuleFileSize: 2055524 - OptimizationTime: 161413565 - PrepareTime: 157340240 - TotalTime: 356856113 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 97195 - OverallThroughput: 1092962 - PeakMemoryUsage: 4096 - SerializeBatchTime: 9376 - ThriftTransmitTime(*): 370388 - TotalTime: 32938 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 7735864 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 277264 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 521417319 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 287449220 - BuildPartitionTime: 8246 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 8339 - GetNewBlockTime: 182399 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 737582 - ProbeRowsPartitioned: 0 - ProbeTime: 36636057 - RowsReturned: 737582 - RowsReturnedRate: 2084216 - SpilledPartitions: 0 - TotalTime: 353889261 - UnpinTime: 3383 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 8074 - DeserializeRowBatchTimer: 33258 - FirstBatchArrivalWaitTime: 238943004 - InactiveTotalTime: 286621265 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 41 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 286698619 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/10.96 MB 1:1/21.24 MB 8:2/16.48 MB 10:4/27.21 MB 9:1/21.44 KB 3:2/27.83 KB 6:1/13.92 KB 7:2/33.14 MB 0:2/14.55 MB 5:1/20.79 KB 2:4/53.28 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:5 PARQUET/SNAPPY:16 ExecOption: Codegen enabled: 0 out of 21 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 3280873 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3280873 - BytesReadRemoteUnexpected: 4619987539 - BytesReadShortCircuit: 3280873 - DecompressionTime: 2133840 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 21 - PeakMemoryUsage: 10290464 - PerReadThreadRawHdfsThroughput: 568391530 - RemoteScanRanges: 3803 - RowsRead: 737582 - RowsReturned: 737582 - RowsReturnedRate: 32673270 - ScanRangesComplete: 21 - ScannerThreadsInvoluntaryContextSwitches: 34 - ScannerThreadsTotalWallClockTime: 582046907 - MaterializeTupleTime(*): 176591613 - ScannerThreadsSysTime: 32987000 - ScannerThreadsUserTime: 89977000 - ScannerThreadsVoluntaryContextSwitches: 824 - TotalRawHdfsReadTime(*): 5772206 - TotalReadThroughput: 0 - TotalTime: 22574477 Instance 6541c5b903212c02:63276eb38dcc1c92 (host=hadoop11.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 2:1/8.21 MB 10:1/9.50 MB 3:1/22.74 MB 1:2/23.59 MB 4:1/4.34 MB 7:1/21.09 KB 5:1/39.93 MB 6:2/27.58 MB 9:1/41.87 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 10544976 - PerHostPeakMemUsage: 10544976 - PrepareTime: 157746371 - RowsProduced: 1 - TotalCpuTime: 839270161 - TotalNetworkReceiveTime: 287511169 - TotalNetworkSendTime: 426968 - TotalStorageWaitTime: 244250845 - TotalTime: 513801520 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 436941 - CompileTime: 36292471 - InactiveTotalTime: 0 - LoadTime: 84437 - ModuleFileSize: 2055524 - OptimizationTime: 165421972 - PrepareTime: 152659660 - TotalTime: 355821295 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 113657 - OverallThroughput: 1303261 - PeakMemoryUsage: 4096 - SerializeBatchTime: 6639 - ThriftTransmitTime(*): 316741 - TotalTime: 27623 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 7544512 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 293992 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 513084279 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 288453148 - BuildPartitionTime: 54129 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 16499 - GetNewBlockTime: 178910 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 760002 - ProbeRowsPartitioned: 0 - ProbeTime: 35186268 - RowsReturned: 760002 - RowsReturnedRate: 2167642 - SpilledPartitions: 0 - TotalTime: 350612266 - UnpinTime: 3632 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 9473 - DeserializeRowBatchTimer: 39374 - FirstBatchArrivalWaitTime: 239249879 - InactiveTotalTime: 287477995 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 41 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 287548595 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/8.21 MB 10:1/9.50 MB 3:1/22.74 MB 1:2/23.59 MB 4:1/4.34 MB 7:1/21.09 KB 5:1/39.93 MB 6:2/27.58 MB 9:1/41.87 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:11 ExecOption: Codegen enabled: 0 out of 11 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 2836842 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2836842 - BytesReadRemoteUnexpected: 521967023 - BytesReadShortCircuit: 2836842 - DecompressionTime: 1986398 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 9 - NumScannerThreadsStarted: 11 - PeakMemoryUsage: 8799888 - PerReadThreadRawHdfsThroughput: 564042803 - RemoteScanRanges: 3210 - RowsRead: 760002 - RowsReturned: 760002 - RowsReturnedRate: 37197040 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 17 - ScannerThreadsTotalWallClockTime: 366273644 - MaterializeTupleTime(*): 81732858 - ScannerThreadsSysTime: 8995000 - ScannerThreadsUserTime: 62985000 - ScannerThreadsVoluntaryContextSwitches: 438 - TotalRawHdfsReadTime(*): 5029480 - TotalReadThroughput: 0 - TotalTime: 20431787 Instance 6541c5b903212c02:63276eb38dcc1c91 (host=hadoop7.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 2:1/10.43 MB 9:1/17.81 MB 1:1/9.37 MB 10:2/17.72 MB 3:2/27.83 KB 4:2/27.83 KB 8:2/14.67 MB 6:2/27.83 KB 7:3/40.94 MB 5:1/13.92 KB 0:4/31.06 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11410000 - PerHostPeakMemUsage: 11410000 - PrepareTime: 158952259 - RowsProduced: 1 - TotalCpuTime: 1565958015 - TotalNetworkReceiveTime: 287585375 - TotalNetworkSendTime: 320676 - TotalStorageWaitTime: 312734096 - TotalTime: 512414167 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 416762 - CompileTime: 37043716 - InactiveTotalTime: 0 - LoadTime: 135939 - ModuleFileSize: 2055524 - OptimizationTime: 162643709 - PrepareTime: 153955652 - TotalTime: 355035473 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 130410 - OverallThroughput: 1149095 - PeakMemoryUsage: 4096 - SerializeBatchTime: 8782 - ThriftTransmitTime(*): 276051 - TotalTime: 31329 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5987256 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 327896 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 511358825 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 288346888 - BuildPartitionTime: 25633 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 16345 - GetNewBlockTime: 119724 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 579918 - ProbeRowsPartitioned: 0 - ProbeTime: 28217993 - RowsReturned: 579918 - RowsReturnedRate: 1660940 - SpilledPartitions: 0 - TotalTime: 349150373 - UnpinTime: 2094 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 8956 - DeserializeRowBatchTimer: 91947 - FirstBatchArrivalWaitTime: 239968734 - InactiveTotalTime: 287549748 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 41 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 287629419 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/10.43 MB 9:1/17.81 MB 1:1/9.37 MB 10:2/17.72 MB 3:2/27.83 KB 4:2/27.83 KB 8:2/14.67 MB 6:2/27.83 KB 7:3/40.94 MB 5:1/13.92 KB 0:4/31.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 21 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 2782300 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2782300 - BytesReadRemoteUnexpected: 518503470 - BytesReadShortCircuit: 2782300 - DecompressionTime: 881648 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 21 - PeakMemoryUsage: 9633072 - PerReadThreadRawHdfsThroughput: 508919489 - RemoteScanRanges: 1868 - RowsRead: 579918 - RowsReturned: 579918 - RowsReturnedRate: 23488828 - ScanRangesComplete: 21 - ScannerThreadsInvoluntaryContextSwitches: 89 - ScannerThreadsTotalWallClockTime: 1165038153 - MaterializeTupleTime(*): 85984352 - ScannerThreadsSysTime: 536910000 - ScannerThreadsUserTime: 112974000 - ScannerThreadsVoluntaryContextSwitches: 5689 - TotalRawHdfsReadTime(*): 5467073 - TotalReadThroughput: 0 - TotalTime: 24689098 Instance 6541c5b903212c02:63276eb38dcc1c8d (host=hadoop5.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 4:2/9.68 MB 6:1/4.63 MB 10:3/56.62 MB 3:3/26.23 MB 1:1/6.09 MB 9:2/47.69 MB 0:1/5.36 MB 5:2/14.82 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 10855280 - PerHostPeakMemUsage: 10855280 - PrepareTime: 160868199 - RowsProduced: 1 - TotalCpuTime: 3030370038 - TotalNetworkReceiveTime: 285616716 - TotalNetworkSendTime: 305895 - TotalStorageWaitTime: 169594536 - TotalTime: 510786607 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 66 - BlocksRecycled: 10 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 192 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 475142 - CompileTime: 36093469 - InactiveTotalTime: 0 - LoadTime: 168193 - ModuleFileSize: 2055524 - OptimizationTime: 161634802 - PrepareTime: 155731089 - TotalTime: 354950034 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 136029 - OverallThroughput: 1244899 - PeakMemoryUsage: 4096 - SerializeBatchTime: 7666 - ThriftTransmitTime(*): 264649 - TotalTime: 28918 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 6072312 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 297240 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 509555405 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 286218411 - BuildPartitionTime: 14855 - BuildRows: 12 - BuildRowsPartitioned: 12 - BuildTime: 14968 - GetNewBlockTime: 127068 - HashBuckets: 24 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4349984 - PinTime: 0 - ProbeRows: 705242 - ProbeRowsPartitioned: 0 - ProbeTime: 28316816 - RowsReturned: 705242 - RowsReturnedRate: 2041488 - SpilledPartitions: 0 - TotalTime: 345454843 - UnpinTime: 1794 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 304 - ConvertRowBatchTime: 5921 - DeserializeRowBatchTimer: 44762 - FirstBatchArrivalWaitTime: 239908510 - InactiveTotalTime: 285595765 - PeakMemoryUsage: 0 - RowsReturned: 12 - RowsReturnedRate: 42 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 285641554 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:2/9.68 MB 6:1/4.63 MB 10:3/56.62 MB 3:3/26.23 MB 1:1/6.09 MB 9:2/47.69 MB 0:1/5.36 MB 5:2/14.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:1 PARQUET/SNAPPY:14 ExecOption: Codegen enabled: 0 out of 15 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 3183675 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3183675 - BytesReadRemoteUnexpected: 1567421276 - BytesReadShortCircuit: 3183675 - DecompressionTime: 926519 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 9159344 - PerReadThreadRawHdfsThroughput: 803325004 - RemoteScanRanges: 3427 - RowsRead: 705242 - RowsReturned: 705242 - RowsReturnedRate: 26660981 - ScanRangesComplete: 15 - ScannerThreadsInvoluntaryContextSwitches: 273 - ScannerThreadsTotalWallClockTime: 2490212509 - MaterializeTupleTime(*): 68883354 - ScannerThreadsSysTime: 1803720000 - ScannerThreadsUserTime: 352939000 - ScannerThreadsVoluntaryContextSwitches: 29059 - TotalRawHdfsReadTime(*): 3963122 - TotalReadThroughput: 2824857 - TotalTime: 26452214 Fragment F01 Instance 6541c5b903212c02:63276eb38dcc1c93 (host=hadoop2.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 6:1/91.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 90752 - PerHostPeakMemUsage: 4330112 - PrepareTime: 185646456 - RowsProduced: 4 - TotalCpuTime: 371645789 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 610195 - TotalStorageWaitTime: 2027037 - TotalTime: 190535753 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1654807 - CompileTime: 8550816 - InactiveTotalTime: 0 - LoadTime: 104887 - ModuleFileSize: 2055524 - OptimizationTime: 169854794 - PrepareTime: 182578336 - TotalTime: 362453632 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 872 - InactiveTotalTime: 0 - NetworkThroughput(*): 216260 - OverallThroughput: 918167 - PeakMemoryUsage: 43648 - SerializeBatchTime: 10122 - ThriftTransmitTime(*): 4032181 - TotalTime: 949718 - UncompressedRowBatchSize: 1152 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/91.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 91 - BytesReadDataNodeCache: 0 - BytesReadLocal: 91 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 91 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 8849557 - RemoteScanRanges: 135 - RowsRead: 13 - RowsReturned: 4 - RowsReturnedRate: 21 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2170624 - DelimiterParseTime: 1821 - MaterializeTupleTime(*): 1648 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 10283 - TotalReadThroughput: 0 - TotalTime: 188060913 Instance 6541c5b903212c02:63276eb38dcc1c94 (host=hadoop3.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 5:1/98.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 90752 - PerHostPeakMemUsage: 4330112 - PrepareTime: 182412179 - RowsProduced: 3 - TotalCpuTime: 366774870 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1027259 - TotalStorageWaitTime: 2725196 - TotalTime: 188825639 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1549805 - CompileTime: 8837158 - InactiveTotalTime: 0 - LoadTime: 115357 - ModuleFileSize: 2055524 - OptimizationTime: 166103147 - PrepareTime: 179301824 - TotalTime: 355744159 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 608 - InactiveTotalTime: 0 - NetworkThroughput(*): 110832 - OverallThroughput: 428921 - PeakMemoryUsage: 43648 - SerializeBatchTime: 14350 - ThriftTransmitTime(*): 5485737 - TotalTime: 1417508 - UncompressedRowBatchSize: 880 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/98.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 98 - BytesReadDataNodeCache: 0 - BytesReadLocal: 98 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 98 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 5477614 - RemoteScanRanges: 78 - RowsRead: 14 - RowsReturned: 3 - RowsReturnedRate: 16 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2881531 - DelimiterParseTime: 2556 - MaterializeTupleTime(*): 2712 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 17891 - TotalReadThroughput: 0 - TotalTime: 185797425 Instance 6541c5b903212c02:63276eb38dcc1c96 (host=hadoop1.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 10:1/98.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 90752 - PerHostPeakMemUsage: 4414128 - PrepareTime: 178356690 - RowsProduced: 3 - TotalCpuTime: 395114448 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 147111 - TotalStorageWaitTime: 6612731 - TotalTime: 188657601 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1502586 - CompileTime: 10390014 - InactiveTotalTime: 0 - LoadTime: 159290 - ModuleFileSize: 2055524 - OptimizationTime: 192144626 - PrepareTime: 174935069 - TotalTime: 379312312 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 672 - InactiveTotalTime: 0 - NetworkThroughput(*): 152176 - OverallThroughput: 1252308 - PeakMemoryUsage: 43648 - SerializeBatchTime: 12670 - ThriftTransmitTime(*): 4415926 - TotalTime: 536609 - UncompressedRowBatchSize: 880 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 10:1/98.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 98 - BytesReadDataNodeCache: 0 - BytesReadLocal: 98 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 98 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 6155392 - RemoteScanRanges: 19 - RowsRead: 14 - RowsReturned: 3 - RowsReturnedRate: 16 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 7028347 - DelimiterParseTime: 2199 - MaterializeTupleTime(*): 3373 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 15921 - TotalReadThroughput: 0 - TotalTime: 185658617 Instance 6541c5b903212c02:63276eb38dcc1c95 (host=hadoop4.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 5:1/91.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 90752 - PerHostPeakMemUsage: 4287104 - PrepareTime: 170333901 - RowsProduced: 2 - TotalCpuTime: 347630197 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 199894 - TotalStorageWaitTime: 1678811 - TotalTime: 174803557 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1476014 - CompileTime: 8734731 - InactiveTotalTime: 0 - LoadTime: 177462 - ModuleFileSize: 2055524 - OptimizationTime: 161436287 - PrepareTime: 167045604 - TotalTime: 338909907 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 408 - InactiveTotalTime: 0 - NetworkThroughput(*): 124652 - OverallThroughput: 721541 - PeakMemoryUsage: 43648 - SerializeBatchTime: 10573 - ThriftTransmitTime(*): 3273102 - TotalTime: 565456 - UncompressedRowBatchSize: 608 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/91.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 91 - BytesReadDataNodeCache: 0 - BytesReadLocal: 91 - BytesReadRemoteUnexpected: 205076 - BytesReadShortCircuit: 91 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 9125551 - RemoteScanRanges: 119 - RowsRead: 13 - RowsReturned: 2 - RowsReturnedRate: 11 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 1831366 - DelimiterParseTime: 2056 - MaterializeTupleTime(*): 2417 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 9972 - TotalReadThroughput: 0 - TotalTime: 172620829