Query (id=d347b9fcb9c5b81f:12d983c726b66681) Summary Session ID: 1943e068c7ba76f3:82ba3e9fc1b6c082 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V5 Start Time: 2015-03-08 23:43:28.444313000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.1.2-cdh5 RELEASE (build 92438b7fb62a875041ffd2ab324f408ecf8129e5) User: mreynolds-prod Connected User: mreynolds-prod Delegated User: Network Address: ::ffff:10.16.3.36:56453 Default Db: irdw_prod Sql Statement: select count(*), sum(adv_commission) from action_fact2 where p_action_date_ym in (select p_action_date_ym from action_partitions limit 10) Coordinator: hadoop1.phx.impactradius.net:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=32.00MB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. irdw_prod.action_fact2, irdw_prod.action_partitions F03:PLAN FRAGMENT [UNPARTITIONED] 07:AGGREGATE [FINALIZE] | output: count:merge(*), sum:merge(adv_commission) | hosts=8 per-host-mem=unavailable | tuple-ids=3 row-size=24B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] hosts=8 per-host-mem=unavailable tuple-ids=3 row-size=24B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F03, EXCHANGE=06, UNPARTITIONED] 03:AGGREGATE | output: count(*), sum(adv_commission) | hosts=8 per-host-mem=10.00MB | tuple-ids=3 row-size=24B cardinality=1 | 02:HASH JOIN [LEFT SEMI JOIN, BROADCAST] | hash predicates: p_action_date_ym = p_action_date_ym | hosts=8 per-host-mem=165B | tuple-ids=0 row-size=23B cardinality=48700856 | |--05:EXCHANGE [BROADCAST] | hosts=4 per-host-mem=0B | tuple-ids=1 row-size=15B cardinality=10 | 00:SCAN HDFS [irdw_prod.action_fact2, RANDOM] partitions=531/531 files=2696 size=10.86GB table stats: 48700856 rows total column stats: all hosts=8 per-host-mem=16.00MB tuple-ids=0 row-size=23B cardinality=48700856 F02:PLAN FRAGMENT [UNPARTITIONED] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=05, BROADCAST] 04:EXCHANGE [UNPARTITIONED] limit: 10 hosts=4 per-host-mem=unavailable tuple-ids=1 row-size=15B cardinality=10 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=04, UNPARTITIONED] 01:SCAN HDFS [irdw_prod.action_partitions, RANDOM] partitions=1/1 files=4 size=378B table stats: unavailable column stats: unavailable limit: 10 hosts=4 per-host-mem=32.00MB tuple-ids=1 row-size=15B cardinality=10 ---------------- Estimated Per-Host Mem: 33554597 Estimated Per-Host VCores: 2 Tables Missing Stats: irdw_prod.action_fact2,irdw_prod.action_partitions Request Pool: root.mreynolds-prod Query Timeline Start execution: 60234 Planning finished: 35931187 Ready to start remote fragments: 274406345 Remote fragments started: 716970406 Rows available: 1518840269 First row fetched: 1979406872 ImpalaServer - AsyncTotalTime: 0 - ClientFetchWaitTimer: 631042969 - InactiveTotalTime: 0 - RowMaterializationTimer: 35036 - TotalTime: 0 Execution Profile d347b9fcb9c5b81f:12d983c726b66681 Fragment start latencies: count: 13, last: 0.196383, min: 0.0134776, max: 0.209022, mean: 0.168993, stddev: 0.0489881 Per Node Peak Memory Usage: hadoop2.phx.impactradius.net:22000(33.26 MB) hadoop4.phx.impactradius.net:22000(31.93 MB) hadoop3.phx.impactradius.net:22000(33.41 MB) hadoop5.phx.impactradius.net:22000(19.32 MB) hadoop7.phx.impactradius.net:22000(19.20 MB) hadoop11.phx.impactradius.net:22000(19.46 MB) hadoop9.phx.impactradius.net:22000(14.76 MB) hadoop1.phx.impactradius.net:22000(25.87 MB) - AsyncTotalTime: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 1472842454 Coordinator Fragment F03 - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 53248 - PerHostPeakMemUsage: 0 - PrepareTime: 222803184 - RowsProduced: 1 - TotalCpuTime: 1320730516 - TotalNetworkReceiveTime: 610853211 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 835705931 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1310120 - CompileTime: 9200890 - InactiveTotalTime: 0 - LoadTime: 176385 - ModuleFileSize: 2055524 - OptimizationTime: 179151839 - PrepareTime: 219909533 - TotalTime: 410073400 AGGREGATION_NODE (id=7) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 7814 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 40960 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 833848236 EXCHANGE_NODE (id=6) - AsyncTotalTime: 0 - BytesReceived: 224 - ConvertRowBatchTime: 23295 - DeserializeRowBatchTimer: 63151 - FirstBatchArrivalWaitTime: 367949 - InactiveTotalTime: 610782042 - PeakMemoryUsage: 0 - RowsReturned: 8 - RowsReturnedRate: 13 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 610931724 Averaged Fragment F00 split sizes: min: 230.47 MB, max: 2.47 GB, avg: 1.36 GB, stddev: 1.10 GB completion times: min:481.251ms max:1s035ms mean: 728.131ms stddev:225.747ms execution rates: min:451.66 MB/sec max:2.74 GB/sec mean:1.55 GB/sec stddev:1.05 GB/sec num instances: 8 - AsyncTotalTime: 0 - AverageThreadTokens: 26.1875 - InactiveTotalTime: 0 - PeakMemoryUsage: 25844546 - PerHostPeakMemUsage: 25848130 - PrepareTime: 165214627 - RowsProduced: 1 - TotalCpuTime: 23972975703 - TotalNetworkReceiveTime: 140363131 - TotalNetworkSendTime: 364351 - TotalStorageWaitTime: 4951815689 - TotalTime: 651462520 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40884159634 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 447302 - CompileTime: 45506127 - InactiveTotalTime: 0 - LoadTime: 102186 - ModuleFileSize: 2055524 - OptimizationTime: 195955201 - PrepareTime: 157813737 - TotalTime: 400768201 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 28 - InactiveTotalTime: 0 - NetworkThroughput(*): 104380 - OverallThroughput: 782362 - PeakMemoryUsage: 4096 - SerializeBatchTime: 11466 - ThriftTransmitTime(*): 277753 - TotalTime: 36124 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) - AsyncTotalTime: 0 - BuildTime: 22545903 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8470659 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 649530128 HASH_JOIN_NODE (id=2) - AsyncTotalTime: 0 - BuildPartitionTime: 8201 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 9619 - GetNewBlockTime: 149273 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 6332372 - ProbeRowsPartitioned: 0 - ProbeTime: 187306750 - RowsReturned: 1136902 - RowsReturnedRate: 1809591 - SpilledPartitions: 0 - TotalTime: 467051942 - UnpinTime: 2883 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 1928 - DeserializeRowBatchTimer: 10416 - FirstBatchArrivalWaitTime: 139632343 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 89 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 140372681 HDFS_SCAN_NODE (id=0) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 50.0 - BytesRead: 37402811 - BytesReadDataNodeCache: 0 - BytesReadLocal: 37351012 - BytesReadRemoteUnexpected: 1286414401 - BytesReadShortCircuit: 37351012 - DecompressionTime: 14690133 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 68 - PeakMemoryUsage: 19526844 - PerReadThreadRawHdfsThroughput: 549480612 - RemoteScanRanges: 1572 - RowsRead: 6332372 - RowsReturned: 6332372 - RowsReturnedRate: 49440218 - ScanRangesComplete: 337 - ScannerThreadsInvoluntaryContextSwitches: 349 - ScannerThreadsTotalWallClockTime: 23827601755 - MaterializeTupleTime(*): 14426901963 - ScannerThreadsSysTime: 691612750 - ScannerThreadsUserTime: 777599500 - ScannerThreadsVoluntaryContextSwitches: 10087 - TotalRawHdfsReadTime(*): 58493207 - TotalReadThroughput: 27580802 - TotalTime: 108911038 Averaged Fragment F02 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:337.507ms max:337.507ms mean: 337.507ms stddev:0ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AsyncTotalTime: 0 - AverageThreadTokens: 0.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 60032 - PerHostPeakMemUsage: 4381040 - PrepareTime: 24834 - RowsProduced: 10 - TotalCpuTime: 5741525 - TotalNetworkReceiveTime: 334321014 - TotalNetworkSendTime: 375558 - TotalStorageWaitTime: 0 - TotalTime: 337414605 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 2120 - InactiveTotalTime: 0 - NetworkThroughput(*): 934867 - OverallThroughput: 15773809 - PeakMemoryUsage: 43648 - SerializeBatchTime: 25323 - ThriftTransmitTime(*): 2267700 - TotalTime: 134400 - UncompressedRowBatchSize: 2752 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 4970 - DeserializeRowBatchTimer: 11366 - FirstBatchArrivalWaitTime: 334317816 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 29 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 334327745 Averaged Fragment F01 split sizes: min: 91.00 B, max: 98.00 B, avg: 94.00 B, stddev: 3.00 B completion times: min:143.617ms max:153.799ms mean: 147.941ms stddev:4.396ms execution rates: min:632.00 B/sec max:650.00 B/sec mean:638.00 B/sec stddev:7.00 B/sec num instances: 4 - AsyncTotalTime: 0 - AverageThreadTokens: 0.75 - InactiveTotalTime: 0 - PeakMemoryUsage: 52560 - PerHostPeakMemUsage: 3984854 - PrepareTime: 176024969 - RowsProduced: 10 - TotalCpuTime: 325283767 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 212031 - TotalStorageWaitTime: 5113019 - TotalTime: 183530037 CodeGen - AsyncTotalTime: 0 - CodegenTime: 770725 - CompileTime: 2913346 - InactiveTotalTime: 0 - LoadTime: 340667 - ModuleFileSize: 2055524 - OptimizationTime: 138184214 - PrepareTime: 173357601 - TotalTime: 316383616 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 221 - InactiveTotalTime: 0 - NetworkThroughput(*): 1248564 - OverallThroughput: 4130248 - PeakMemoryUsage: 5456 - SerializeBatchTime: 10191 - ThriftTransmitTime(*): 197975 - TotalTime: 81146 - UncompressedRowBatchSize: 344 HDFS_SCAN_NODE (id=1) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 94 - BytesReadDataNodeCache: 0 - BytesReadLocal: 94 - BytesReadRemoteUnexpected: 68916511 - BytesReadShortCircuit: 94 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 7393411 - RemoteScanRanges: 130 - RowsRead: 13 - RowsReturned: 10 - RowsReturnedRate: 54 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 5230286 - DelimiterParseTime: 3315 - MaterializeTupleTime(*): 1080 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 13888 - TotalReadThroughput: 0 - TotalTime: 181582999 Fragment F00 Instance d347b9fcb9c5b81f:12d983c726b6668a (host=hadoop2.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 9:52/244.28 MB 3:60/228.56 MB 8:65/234.01 MB 6:53/197.18 MB 2:67/298.32 MB 1:58/148.60 MB 10:53/237.17 MB 7:61/258.73 MB 0:61/271.32 MB 5:56/205.27 MB 4:58/193.90 MB - AsyncTotalTime: 0 - AverageThreadTokens: 48.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 34875928 - PerHostPeakMemUsage: 34875928 - PrepareTime: 183286198 - RowsProduced: 1 - TotalCpuTime: 56749032896 - TotalNetworkReceiveTime: 76060777 - TotalNetworkSendTime: 374481 - TotalStorageWaitTime: 11352153227 - TotalTime: 930414013 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 447970 - CompileTime: 53295959 - InactiveTotalTime: 0 - LoadTime: 112917 - ModuleFileSize: 2055524 - OptimizationTime: 234980142 - PrepareTime: 173735497 - TotalTime: 463693674 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 111773 - OverallThroughput: 938379 - PeakMemoryUsage: 4096 - SerializeBatchTime: 12790 - ThriftTransmitTime(*): 322081 - TotalTime: 38364 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 46491082 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8433536 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 928378452 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 76800671 - BuildPartitionTime: 12330 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 11530 - GetNewBlockTime: 140588 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 11661767 - ProbeRowsPartitioned: 0 - ProbeTime: 359324840 - RowsReturned: 2315928 - RowsReturnedRate: 3283351 - SpilledPartitions: 0 - TotalTime: 705354799 - UnpinTime: 2394 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 2350 - DeserializeRowBatchTimer: 8348 - FirstBatchArrivalWaitTime: 75188469 - InactiveTotalTime: 76049849 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 131 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 76070705 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:52/244.28 MB 3:60/228.56 MB 8:65/234.01 MB 6:53/197.18 MB 2:67/298.32 MB 1:58/148.60 MB 10:53/237.17 MB 7:61/258.73 MB 0:61/271.32 MB 5:56/205.27 MB 4:58/193.90 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:151 PARQUET/SNAPPY:493 ExecOption: Codegen enabled: 0 out of 644 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 95.0 - BytesRead: 68464062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68464062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68464062 - DecompressionTime: 34561361 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 32045480 - PerReadThreadRawHdfsThroughput: 577116931 - RemoteScanRanges: 191 - RowsRead: 11661767 - RowsReturned: 11661767 - RowsReturnedRate: 55088730 - ScanRangesComplete: 644 - ScannerThreadsInvoluntaryContextSwitches: 735 - ScannerThreadsTotalWallClockTime: 56672471745 - MaterializeTupleTime(*): 36364673613 - ScannerThreadsSysTime: 1657699000 - ScannerThreadsUserTime: 1720691000 - ScannerThreadsVoluntaryContextSwitches: 20293 - TotalRawHdfsReadTime(*): 118631179 - TotalReadThroughput: 41157283 - TotalTime: 211690612 Instance d347b9fcb9c5b81f:12d983c726b66689 (host=hadoop1.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 8:65/364.38 MB 1:69/158.84 MB 9:62/191.58 MB 2:59/274.17 MB 0:56/192.79 MB 5:55/184.26 MB 3:56/177.06 MB 6:70/297.33 MB 7:58/159.04 MB 4:54/309.87 MB 10:61/209.06 MB - AsyncTotalTime: 0 - AverageThreadTokens: 24.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 27093040 - PerHostPeakMemUsage: 27121712 - PrepareTime: 176493064 - RowsProduced: 1 - TotalCpuTime: 24929029024 - TotalNetworkReceiveTime: 94671130 - TotalNetworkSendTime: 267772 - TotalStorageWaitTime: 4616579003 - TotalTime: 848944448 CodeGen - AsyncTotalTime: 0 - CodegenTime: 515602 - CompileTime: 53535053 - InactiveTotalTime: 0 - LoadTime: 112246 - ModuleFileSize: 2055524 - OptimizationTime: 225030999 - PrepareTime: 166522173 - TotalTime: 446681920 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 177666 - OverallThroughput: 1023308 - PeakMemoryUsage: 4096 - SerializeBatchTime: 10198 - ThriftTransmitTime(*): 202627 - TotalTime: 35180 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 45840331 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8567216 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 846993645 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 95238496 - BuildPartitionTime: 6966 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 7639 - GetNewBlockTime: 113538 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 11596774 - ProbeRowsPartitioned: 0 - ProbeTime: 364501133 - RowsReturned: 2357886 - RowsReturnedRate: 3724870 - SpilledPartitions: 0 - TotalTime: 633011537 - UnpinTime: 1916 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 1540 - DeserializeRowBatchTimer: 7472 - FirstBatchArrivalWaitTime: 92682538 - InactiveTotalTime: 94663224 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 105 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 94678804 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:65/364.38 MB 1:69/158.84 MB 9:62/191.58 MB 2:59/274.17 MB 0:56/192.79 MB 5:55/184.26 MB 3:56/177.06 MB 6:70/297.33 MB 7:58/159.04 MB 4:54/309.87 MB 10:61/209.06 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:170 PARQUET/SNAPPY:495 ExecOption: Codegen enabled: 0 out of 665 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 47.0 - BytesRead: 69782731 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69782731 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69782731 - DecompressionTime: 25866949 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 47 - PeakMemoryUsage: 20373320 - PerReadThreadRawHdfsThroughput: 722546402 - RemoteScanRanges: 9 - RowsRead: 11596774 - RowsReturned: 11596774 - RowsReturnedRate: 88150443 - ScanRangesComplete: 665 - ScannerThreadsInvoluntaryContextSwitches: 332 - ScannerThreadsTotalWallClockTime: 24833867886 - MaterializeTupleTime(*): 18339277948 - ScannerThreadsSysTime: 182949000 - ScannerThreadsUserTime: 1374770000 - ScannerThreadsVoluntaryContextSwitches: 15936 - TotalRawHdfsReadTime(*): 96578892 - TotalReadThroughput: 41190432 - TotalTime: 131556615 Instance d347b9fcb9c5b81f:12d983c726b66688 (host=hadoop4.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 7:59/264.57 MB 3:62/336.54 MB 4:49/199.89 MB 9:42/164.80 MB 8:51/100.71 MB 1:59/305.56 MB 2:49/193.96 MB 6:52/197.56 MB 0:63/285.23 MB 5:51/286.71 MB 10:61/193.11 MB - AsyncTotalTime: 0 - AverageThreadTokens: 48.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 33479088 - PerHostPeakMemUsage: 33479088 - PrepareTime: 192526372 - RowsProduced: 1 - TotalCpuTime: 48194823011 - TotalNetworkReceiveTime: 75730994 - TotalNetworkSendTime: 344631 - TotalStorageWaitTime: 8924219011 - TotalTime: 833312282 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 509669 - CompileTime: 53916037 - InactiveTotalTime: 0 - LoadTime: 129588 - ModuleFileSize: 2055524 - OptimizationTime: 224281661 - PrepareTime: 182310522 - TotalTime: 462505175 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 145266 - OverallThroughput: 997174 - PeakMemoryUsage: 4096 - SerializeBatchTime: 10477 - ThriftTransmitTime(*): 247820 - TotalTime: 36102 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 40443232 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8457272 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 831088509 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 76344528 - BuildPartitionTime: 6368 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 7035 - GetNewBlockTime: 123719 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 11477241 - ProbeRowsPartitioned: 0 - ProbeTime: 323100673 - RowsReturned: 2200708 - RowsReturnedRate: 3632267 - SpilledPartitions: 0 - TotalTime: 605877260 - UnpinTime: 2119 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 1452 - DeserializeRowBatchTimer: 11623 - FirstBatchArrivalWaitTime: 75358838 - InactiveTotalTime: 75722947 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 132 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 75738951 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:59/264.57 MB 3:62/336.54 MB 4:49/199.89 MB 9:42/164.80 MB 8:51/100.71 MB 1:59/305.56 MB 2:49/193.96 MB 6:52/197.56 MB 0:63/285.23 MB 5:51/286.71 MB 10:61/193.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:109 PARQUET/SNAPPY:489 ExecOption: Codegen enabled: 0 out of 598 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 95.0 - BytesRead: 69044939 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69044939 - BytesReadRemoteUnexpected: 324282 - BytesReadShortCircuit: 69044939 - DecompressionTime: 24479712 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 30983240 - PerReadThreadRawHdfsThroughput: 727727270 - RemoteScanRanges: 233 - RowsRead: 11477241 - RowsReturned: 11477241 - RowsReturnedRate: 70936836 - ScanRangesComplete: 598 - ScannerThreadsInvoluntaryContextSwitches: 687 - ScannerThreadsTotalWallClockTime: 48118706936 - MaterializeTupleTime(*): 30421361266 - ScannerThreadsSysTime: 1532719000 - ScannerThreadsUserTime: 1296761000 - ScannerThreadsVoluntaryContextSwitches: 19719 - TotalRawHdfsReadTime(*): 94877493 - TotalReadThroughput: 63903271 - TotalTime: 161795218 Instance d347b9fcb9c5b81f:12d983c726b66687 (host=hadoop3.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 6:51/270.98 MB 8:54/180.92 MB 3:50/210.32 MB 4:41/247.28 MB 10:59/197.97 MB 1:46/201.57 MB 2:48/219.25 MB 9:54/214.35 MB 5:55/263.38 MB 0:55/314.46 MB 7:59/194.07 MB - AsyncTotalTime: 0 - AverageThreadTokens: 48.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 35033304 - PerHostPeakMemUsage: 35033304 - PrepareTime: 188959351 - RowsProduced: 1 - TotalCpuTime: 42953882064 - TotalNetworkReceiveTime: 67267039 - TotalNetworkSendTime: 424645 - TotalStorageWaitTime: 10098029110 - TotalTime: 802039491 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 41231687680 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 532981 - CompileTime: 55499404 - InactiveTotalTime: 0 - LoadTime: 124085 - ModuleFileSize: 2055524 - OptimizationTime: 228053653 - PrepareTime: 178195363 - TotalTime: 463501975 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 36 - InactiveTotalTime: 0 - NetworkThroughput(*): 109291 - OverallThroughput: 991653 - PeakMemoryUsage: 4096 - SerializeBatchTime: 11606 - ThriftTransmitTime(*): 329394 - TotalTime: 36303 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 40008347 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8417824 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 1 - SpilledPartitions: 0 - TotalTime: 799207194 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 67935448 - BuildPartitionTime: 4819 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 7007 - GetNewBlockTime: 169152 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 11633560 - ProbeRowsPartitioned: 0 - ProbeTime: 344500652 - RowsReturned: 2220701 - RowsReturnedRate: 3836247 - SpilledPartitions: 0 - TotalTime: 578873210 - UnpinTime: 1842 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 1538 - DeserializeRowBatchTimer: 11136 - FirstBatchArrivalWaitTime: 67217290 - InactiveTotalTime: 67261401 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 148 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 67275612 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:51/270.98 MB 8:54/180.92 MB 3:50/210.32 MB 4:41/247.28 MB 10:59/197.97 MB 1:46/201.57 MB 2:48/219.25 MB 9:54/214.35 MB 5:55/263.38 MB 0:55/314.46 MB 7:59/194.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:97 PARQUET/SNAPPY:475 ExecOption: Codegen enabled: 0 out of 572 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 95.0 - BytesRead: 67724900 - BytesReadDataNodeCache: 0 - BytesReadLocal: 67724900 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 67724900 - DecompressionTime: 24357316 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 32469456 - PerReadThreadRawHdfsThroughput: 712284650 - RemoteScanRanges: 152 - RowsRead: 11633560 - RowsReturned: 11633560 - RowsReturnedRate: 91376274 - ScanRangesComplete: 572 - ScannerThreadsInvoluntaryContextSwitches: 290 - ScannerThreadsTotalWallClockTime: 42886128870 - MaterializeTupleTime(*): 29771140174 - ScannerThreadsSysTime: 170927000 - ScannerThreadsUserTime: 1222770000 - ScannerThreadsVoluntaryContextSwitches: 15434 - TotalRawHdfsReadTime(*): 95081229 - TotalReadThroughput: 62688283 - TotalTime: 127314886 Instance d347b9fcb9c5b81f:12d983c726b66684 (host=hadoop11.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 1:5/4.18 MB 4:8/36.19 MB 10:6/17.26 MB 2:10/35.36 MB 3:6/27.25 MB 9:4/45.56 MB 7:6/22.35 MB 0:9/22.25 MB 5:8/23.34 MB 8:7/21.51 MB 6:4/10.58 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 20405792 - PerHostPeakMemUsage: 20405792 - PrepareTime: 160397298 - RowsProduced: 1 - TotalCpuTime: 9070361333 - TotalNetworkReceiveTime: 186497881 - TotalNetworkSendTime: 406220 - TotalStorageWaitTime: 1991829385 - TotalTime: 483505660 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 438576 - CompileTime: 36223274 - InactiveTotalTime: 0 - LoadTime: 86920 - ModuleFileSize: 2055524 - OptimizationTime: 163825944 - PrepareTime: 155152963 - TotalTime: 356508036 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 20 - InactiveTotalTime: 0 - NetworkThroughput(*): 71718 - OverallThroughput: 579340 - PeakMemoryUsage: 4096 - SerializeBatchTime: 11598 - ThriftTransmitTime(*): 278869 - TotalTime: 34522 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2058203 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8449744 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 481858777 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 187308872 - BuildPartitionTime: 10783 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 10772 - GetNewBlockTime: 153964 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 1078113 - ProbeRowsPartitioned: 0 - ProbeTime: 36131249 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 322669568 - UnpinTime: 3502 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 2136 - DeserializeRowBatchTimer: 12640 - FirstBatchArrivalWaitTime: 185483224 - InactiveTotalTime: 186489228 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 53 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 186508937 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:5/4.18 MB 4:8/36.19 MB 10:6/17.26 MB 2:10/35.36 MB 3:6/27.25 MB 9:4/45.56 MB 7:6/22.35 MB 0:9/22.25 MB 5:8/23.34 MB 8:7/21.51 MB 6:4/10.58 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:27 PARQUET/SNAPPY:46 ExecOption: Codegen enabled: 0 out of 73 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 7292085 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7263583 - BytesReadRemoteUnexpected: 1599717720 - BytesReadShortCircuit: 7263583 - DecompressionTime: 2677450 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 73 - PeakMemoryUsage: 11111664 - PerReadThreadRawHdfsThroughput: 311838601 - RemoteScanRanges: 4229 - RowsRead: 1078113 - RowsReturned: 1078113 - RowsReturnedRate: 13167492 - ScanRangesComplete: 73 - ScannerThreadsInvoluntaryContextSwitches: 231 - ScannerThreadsTotalWallClockTime: 8883249546 - MaterializeTupleTime(*): 174307438 - ScannerThreadsSysTime: 662868000 - ScannerThreadsUserTime: 189935000 - ScannerThreadsVoluntaryContextSwitches: 2597 - TotalRawHdfsReadTime(*): 23384164 - TotalReadThroughput: 0 - TotalTime: 81876866 Instance d347b9fcb9c5b81f:12d983c726b66683 (host=hadoop9.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 6:1/1.70 MB 9:4/10.66 MB 7:4/25.13 MB 8:2/4.93 MB 3:2/3.15 MB 10:7/46.35 MB 1:3/53.04 MB 5:5/36.77 MB 0:9/61.55 MB 4:4/11.40 MB 2:3/9.26 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 15480008 - PerHostPeakMemUsage: 15480008 - PrepareTime: 157174005 - RowsProduced: 1 - TotalCpuTime: 2825324414 - TotalNetworkReceiveTime: 190813384 - TotalNetworkSendTime: 368053 - TotalStorageWaitTime: 845901817 - TotalTime: 463579103 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 430568 - CompileTime: 37009345 - InactiveTotalTime: 0 - LoadTime: 88967 - ModuleFileSize: 2055524 - OptimizationTime: 163991224 - PrepareTime: 152140243 - TotalTime: 354487486 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 20 - InactiveTotalTime: 0 - NetworkThroughput(*): 73936 - OverallThroughput: 451824 - PeakMemoryUsage: 4096 - SerializeBatchTime: 16219 - ThriftTransmitTime(*): 270503 - TotalTime: 44265 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1661434 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8452192 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 461919852 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 191636809 - BuildPartitionTime: 10083 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 10247 - GetNewBlockTime: 138857 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 1091641 - ProbeRowsPartitioned: 0 - ProbeTime: 22315358 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 305888465 - UnpinTime: 3665 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 1873 - DeserializeRowBatchTimer: 11400 - FirstBatchArrivalWaitTime: 189451862 - InactiveTotalTime: 190804286 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 190823323 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:1/1.70 MB 9:4/10.66 MB 7:4/25.13 MB 8:2/4.93 MB 3:2/3.15 MB 10:7/46.35 MB 1:3/53.04 MB 5:5/36.77 MB 0:9/61.55 MB 4:4/11.40 MB 2:3/9.26 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:28 ExecOption: Codegen enabled: 0 out of 44 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 5749497 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5720995 - BytesReadRemoteUnexpected: 5758807800 - BytesReadShortCircuit: 5720995 - DecompressionTime: 1820308 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 44 - PeakMemoryUsage: 7211736 - PerReadThreadRawHdfsThroughput: 553478124 - RemoteScanRanges: 2829 - RowsRead: 1091641 - RowsReturned: 1091641 - RowsReturnedRate: 13667632 - ScanRangesComplete: 44 - ScannerThreadsInvoluntaryContextSwitches: 130 - ScannerThreadsTotalWallClockTime: 2633812820 - MaterializeTupleTime(*): 81415181 - ScannerThreadsSysTime: 386927000 - ScannerThreadsUserTime: 130957000 - ScannerThreadsVoluntaryContextSwitches: 1492 - TotalRawHdfsReadTime(*): 10387939 - TotalReadThroughput: 0 - TotalTime: 79870526 Instance d347b9fcb9c5b81f:12d983c726b66685 (host=hadoop7.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 2:4/1.18 MB 9:6/24.25 MB 1:3/32.98 MB 6:7/10.41 MB 7:5/2.74 MB 8:5/8.32 MB 3:4/13.32 MB 4:6/25.86 MB 5:4/25.55 MB 0:15/50.53 MB 10:9/35.34 MB - AsyncTotalTime: 0 - AverageThreadTokens: 35.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20131728 - PerHostPeakMemUsage: 20131728 - PrepareTime: 131187746 - RowsProduced: 1 - TotalCpuTime: 5547771494 - TotalNetworkReceiveTime: 215419741 - TotalNetworkSendTime: 311300 - TotalStorageWaitTime: 1425840431 - TotalTime: 440688991 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 379516 - CompileTime: 37464825 - InactiveTotalTime: 0 - LoadTime: 84665 - ModuleFileSize: 2055524 - OptimizationTime: 162870861 - PrepareTime: 126858657 - TotalTime: 328368570 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 20 - InactiveTotalTime: 0 - NetworkThroughput(*): 86474 - OverallThroughput: 536999 - PeakMemoryUsage: 4096 - SerializeBatchTime: 10487 - ThriftTransmitTime(*): 231282 - TotalTime: 37244 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2214050 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8454064 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 439199318 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 216396250 - BuildPartitionTime: 7896 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 11843 - GetNewBlockTime: 178827 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 939429 - ProbeRowsPartitioned: 0 - ProbeTime: 26203683 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 307988189 - UnpinTime: 4103 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 2316 - DeserializeRowBatchTimer: 7860 - FirstBatchArrivalWaitTime: 215239819 - InactiveTotalTime: 215413137 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 46 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 215430559 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:4/1.18 MB 9:6/24.25 MB 1:3/32.98 MB 6:7/10.41 MB 7:5/2.74 MB 8:5/8.32 MB 3:4/13.32 MB 4:6/25.86 MB 5:4/25.55 MB 0:15/50.53 MB 10:9/35.34 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:33 PARQUET/SNAPPY:35 ExecOption: Codegen enabled: 0 out of 68 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 68.0 - BytesRead: 6130189 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5866830 - BytesReadRemoteUnexpected: 1630537938 - BytesReadShortCircuit: 5866830 - DecompressionTime: 1501000 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 68 - PeakMemoryUsage: 11133424 - PerReadThreadRawHdfsThroughput: 347129620 - RemoteScanRanges: 1271 - RowsRead: 939429 - RowsReturned: 939429 - RowsReturnedRate: 18520276 - ScanRangesComplete: 68 - ScannerThreadsInvoluntaryContextSwitches: 301 - ScannerThreadsTotalWallClockTime: 5331522918 - MaterializeTupleTime(*): 72598187 - ScannerThreadsSysTime: 753859000 - ScannerThreadsUserTime: 161944000 - ScannerThreadsVoluntaryContextSwitches: 3258 - TotalRawHdfsReadTime(*): 17659654 - TotalReadThroughput: 11707150 - TotalTime: 50724351 Instance d347b9fcb9c5b81f:12d983c726b66686 (host=hadoop5.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 3:1/13.92 KB 10:1/397.82 KB 6:2/11.53 MB 8:3/61.43 MB 2:7/80.07 MB 1:3/16.72 MB 9:1/16.45 MB 7:4/52.24 MB 0:5/119.04 KB 5:3/32.04 MB 4:2/7.66 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20257480 - PerHostPeakMemUsage: 20257480 - PrepareTime: 131692984 - RowsProduced: 1 - TotalCpuTime: 1513581389 - TotalNetworkReceiveTime: 216444108 - TotalNetworkSendTime: 417712 - TotalStorageWaitTime: 359973531 - TotalTime: 409216176 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 65 - BlocksRecycled: 6 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 40623513600 - PeakMemoryUsage: 160 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 323541 - CompileTime: 37105122 - InactiveTotalTime: 0 - LoadTime: 78107 - ModuleFileSize: 2055524 - OptimizationTime: 164607125 - PrepareTime: 127594482 - TotalTime: 330398774 DataStreamSender (dst_id=6) - AsyncTotalTime: 0 - BytesSent: 20 - InactiveTotalTime: 0 - NetworkThroughput(*): 58919 - OverallThroughput: 740219 - PeakMemoryUsage: 4096 - SerializeBatchTime: 8354 - ThriftTransmitTime(*): 339448 - TotalTime: 27019 - UncompressedRowBatchSize: 40 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1650546 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8533424 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 2 - SpilledPartitions: 0 - TotalTime: 407595277 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - AsyncTotalTime: 217299106 - BuildPartitionTime: 6367 - BuildRows: 10 - BuildRowsPartitioned: 10 - BuildTime: 10884 - GetNewBlockTime: 175543 - HashBuckets: 20 - InactiveTotalTime: 0 - LargestPartitionPercent: 20 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4284448 - PinTime: 0 - ProbeRows: 1180454 - ProbeRowsPartitioned: 0 - ProbeTime: 22376416 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 276752512 - UnpinTime: 3529 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 2223 - DeserializeRowBatchTimer: 12856 - FirstBatchArrivalWaitTime: 216436704 - InactiveTotalTime: 216438224 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 46 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 216454560 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/13.92 KB 10:1/397.82 KB 6:2/11.53 MB 8:3/61.43 MB 2:7/80.07 MB 1:3/16.72 MB 9:1/16.45 MB 7:4/52.24 MB 0:5/119.04 KB 5:3/32.04 MB 4:2/7.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/NONE:13 PARQUET/SNAPPY:19 ExecOption: Codegen enabled: 0 out of 32 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 5034091 - BytesReadDataNodeCache: 0 - BytesReadLocal: 4940059 - BytesReadRemoteUnexpected: 1301927469 - BytesReadShortCircuit: 4940059 - DecompressionTime: 2256973 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 32 - PeakMemoryUsage: 10886432 - PerReadThreadRawHdfsThroughput: 443723301 - RemoteScanRanges: 3669 - RowsRead: 1180454 - RowsReturned: 1180454 - RowsReturnedRate: 44614065 - ScanRangesComplete: 32 - ScannerThreadsInvoluntaryContextSwitches: 92 - ScannerThreadsTotalWallClockTime: 1261053319 - MaterializeTupleTime(*): 190441903 - ScannerThreadsSysTime: 184954000 - ScannerThreadsUserTime: 122968000 - ScannerThreadsVoluntaryContextSwitches: 1971 - TotalRawHdfsReadTime(*): 11345113 - TotalReadThroughput: 0 - TotalTime: 26459234 Fragment F02 Instance d347b9fcb9c5b81f:12d983c726b6668b (host=hadoop1.phx.impactradius.net:22000) - AsyncTotalTime: 0 - AverageThreadTokens: 0.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 60032 - PerHostPeakMemUsage: 4381040 - PrepareTime: 24834 - RowsProduced: 10 - TotalCpuTime: 5741525 - TotalNetworkReceiveTime: 334321014 - TotalNetworkSendTime: 375558 - TotalStorageWaitTime: 0 - TotalTime: 337414605 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 2120 - InactiveTotalTime: 0 - NetworkThroughput(*): 934867 - OverallThroughput: 15773809 - PeakMemoryUsage: 43648 - SerializeBatchTime: 25323 - ThriftTransmitTime(*): 2267700 - TotalTime: 134400 - UncompressedRowBatchSize: 2752 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 265 - ConvertRowBatchTime: 4970 - DeserializeRowBatchTimer: 11366 - FirstBatchArrivalWaitTime: 334317816 - InactiveTotalTime: 334318371 - PeakMemoryUsage: 0 - RowsReturned: 10 - RowsReturnedRate: 29 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 334327745 Fragment F01 Instance d347b9fcb9c5b81f:12d983c726b6668d (host=hadoop3.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 5:1/98.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 52560 - PerHostPeakMemUsage: 7162664 - PrepareTime: 184435791 - RowsProduced: 10 - TotalCpuTime: 336327164 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 140722 - TotalStorageWaitTime: 9270847 - TotalTime: 196096757 CodeGen - AsyncTotalTime: 0 - CodegenTime: 913495 - CompileTime: 3122440 - InactiveTotalTime: 0 - LoadTime: 139238 - ModuleFileSize: 2055524 - OptimizationTime: 136439493 - PrepareTime: 182008520 - TotalTime: 323178238 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 218 - InactiveTotalTime: 0 - NetworkThroughput(*): 1015833 - OverallThroughput: 1121820 - PeakMemoryUsage: 5456 - SerializeBatchTime: 15382 - ThriftTransmitTime(*): 214602 - TotalTime: 194327 - UncompressedRowBatchSize: 344 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/98.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 98 - BytesReadDataNodeCache: 0 - BytesReadLocal: 98 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 98 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 9181187 - RemoteScanRanges: 116 - RowsRead: 14 - RowsReturned: 10 - RowsReturnedRate: 51 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 9386404 - DelimiterParseTime: 3584 - MaterializeTupleTime(*): 1233 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 10674 - TotalReadThroughput: 0 - TotalTime: 194005876 Instance d347b9fcb9c5b81f:12d983c726b6668e (host=hadoop4.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 5:1/91.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 52560 - PerHostPeakMemUsage: 4314480 - PrepareTime: 179770377 - RowsProduced: 10 - TotalCpuTime: 324831156 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 281323 - TotalStorageWaitTime: 3663889 - TotalTime: 185923183 CodeGen - AsyncTotalTime: 0 - CodegenTime: 837286 - CompileTime: 2482034 - InactiveTotalTime: 0 - LoadTime: 123241 - ModuleFileSize: 2055524 - OptimizationTime: 135748719 - PrepareTime: 177184365 - TotalTime: 317176790 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 191 - InactiveTotalTime: 0 - NetworkThroughput(*): 807416 - OverallThroughput: 4503973 - PeakMemoryUsage: 5456 - SerializeBatchTime: 10241 - ThriftTransmitTime(*): 236557 - TotalTime: 42407 - UncompressedRowBatchSize: 344 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/91.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 91 - BytesReadDataNodeCache: 0 - BytesReadLocal: 91 - BytesReadRemoteUnexpected: 205076 - BytesReadShortCircuit: 91 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 7991569 - RemoteScanRanges: 137 - RowsRead: 13 - RowsReturned: 10 - RowsReturnedRate: 54 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3792955 - DelimiterParseTime: 3636 - MaterializeTupleTime(*): 970 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 11387 - TotalReadThroughput: 0 - TotalTime: 184038406 Instance d347b9fcb9c5b81f:12d983c726b6668c (host=hadoop2.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 6:1/91.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 52560 - PerHostPeakMemUsage: 81232 - PrepareTime: 172854202 - RowsProduced: 10 - TotalCpuTime: 317504984 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 292442 - TotalStorageWaitTime: 4579295 - TotalTime: 179786364 CodeGen - AsyncTotalTime: 0 - CodegenTime: 699373 - CompileTime: 2994511 - InactiveTotalTime: 0 - LoadTime: 121539 - ModuleFileSize: 2055524 - OptimizationTime: 134037352 - PrepareTime: 170497298 - TotalTime: 309207224 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 265 - InactiveTotalTime: 0 - NetworkThroughput(*): 1112253 - OverallThroughput: 6258856 - PeakMemoryUsage: 5456 - SerializeBatchTime: 8319 - ThriftTransmitTime(*): 238255 - TotalTime: 42340 - UncompressedRowBatchSize: 344 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/91.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 91 - BytesReadDataNodeCache: 0 - BytesReadLocal: 91 - BytesReadRemoteUnexpected: 275460970 - BytesReadShortCircuit: 91 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 4233542 - RemoteScanRanges: 124 - RowsRead: 13 - RowsReturned: 10 - RowsReturnedRate: 56 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 4696057 - DelimiterParseTime: 3666 - MaterializeTupleTime(*): 1013 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 21495 - TotalReadThroughput: 0 - TotalTime: 177996492 Instance d347b9fcb9c5b81f:12d983c726b6668f (host=hadoop1.phx.impactradius.net:22000) Hdfs split stats (:<# splits>/): 10:1/98.00 B - AsyncTotalTime: 0 - AverageThreadTokens: 0.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 52560 - PerHostPeakMemUsage: 4381040 - PrepareTime: 167039506 - RowsProduced: 10 - TotalCpuTime: 322471766 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 133638 - TotalStorageWaitTime: 2938048 - TotalTime: 172313847 CodeGen - AsyncTotalTime: 0 - CodegenTime: 632748 - CompileTime: 3054402 - InactiveTotalTime: 0 - LoadTime: 978653 - ModuleFileSize: 2055524 - OptimizationTime: 146511292 - PrepareTime: 163740224 - TotalTime: 315972215 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 211 - InactiveTotalTime: 0 - NetworkThroughput(*): 2058757 - OverallThroughput: 4636343 - PeakMemoryUsage: 5456 - SerializeBatchTime: 6822 - ThriftTransmitTime(*): 102489 - TotalTime: 45510 - UncompressedRowBatchSize: 344 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 10:1/98.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: TEXT/NONE:1 ExecOption: Codegen enabled: 1 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 98 - BytesReadDataNodeCache: 0 - BytesReadLocal: 98 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 98 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38912 - PerReadThreadRawHdfsThroughput: 8167347 - RemoteScanRanges: 143 - RowsRead: 14 - RowsReturned: 10 - RowsReturnedRate: 58 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3045731 - DelimiterParseTime: 2376 - MaterializeTupleTime(*): 1104 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 11999 - TotalReadThroughput: 0 - TotalTime: 170291223