================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 259.22ms | 0ns | 259.22ms | 1 | 1 | | 06:EXCHANGE | 1 | 214.70us | 0ns | 214.70us | 15 | 1 | | 03:AGGREGATE | 15 | 861.81ms | 0ns | 921.91ms | 15 | 1 | | 02:HASH JOIN | 15 | 67.98s | 0ns | 70.73s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 8.74s | 0ns | 11.42s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 923.92ms | 0ns | 1.07s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 2.94s | 0ns | 3.44s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 1.63s | 0ns | 1.78s | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=fc4196b242ff8416:aac7ad511f2ba4a8): Summary: Session ID: 994cc0a7bd0ce449:987b0a167c65118a Session Type: BEESWAX Start Time: 2016-04-26 17:22:52.011337000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 35713197462670a62625b3b36c9af3f24339abc5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50258 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 15.452ms - Analysis finished: 4.766ms (4.766ms) - Equivalence classes computed: 5.178ms (412.265us) - Single node plan created: 10.235ms (5.056ms) - Runtime filters computed: 10.391ms (156.409us) - Distributed plan created: 12.405ms (2.013ms) - Lineage info computed: 13.115ms (710.589us) - Planning finished: 15.452ms (2.337ms) Query Timeline: 1m39s - Start execution: 93.308us (93.308us) - Planning finished: 19.505ms (19.411ms) - Ready to start 45 remote fragments: 280.800ms (261.295ms) - All 45 remote fragments started: 4s466ms (4s185ms) - First dynamic filter received: 42s750ms (38s284ms) - Rows available: 1m39s (56s396ms) - First row fetched: 1m39s (48.377ms) ImpalaServer: - ClientFetchWaitTimer: 48.801ms - RowMaterializationTimer: 42.021us Execution Profile fc4196b242ff8416:aac7ad511f2ba4a8:(Total: 1m39s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 15 (15) N/A N/A Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 38ms, 95th %-ile: 4s180ms, 99.9th %-ile: 4s184ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 0 (15) 42s750ms 42s750ms Per Node Peak Memory Usage: vb0222.halxg.cloudera.com:22000(11.31 GB) vb0224.halxg.cloudera.com:22000(11.31 GB) vb0218.halxg.cloudera.com:22000(11.31 GB) vb0220.halxg.cloudera.com:22000(11.31 GB) vb0228.halxg.cloudera.com:22000(11.32 GB) vb0206.halxg.cloudera.com:22000(11.31 GB) vb0234.halxg.cloudera.com:22000(11.31 GB) vb0216.halxg.cloudera.com:22000(11.32 GB) vb0226.halxg.cloudera.com:22000(11.31 GB) vb0232.halxg.cloudera.com:22000(11.31 GB) vb0212.halxg.cloudera.com:22000(11.31 GB) vb0214.halxg.cloudera.com:22000(11.31 GB) vb0230.halxg.cloudera.com:22000(11.31 GB) vb0208.halxg.cloudera.com:22000(11.31 GB) vb0204.halxg.cloudera.com:22000(11.32 GB) - FiltersReceived: 1 (1) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m34s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 258.814ms - RowsProduced: 1 (1) - TotalCpuTime: 4s688ms - TotalNetworkReceiveTime: 1m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 448.970ms, non-child: 448.970ms, % non-child: 100.00%) - CodegenTime: 1.675ms - CompileTime: 1.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 189.739ms - PrepareTime: 255.676ms AGGREGATION_NODE (id=7):(Total: 1m34s, non-child: 259.218ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 67.688us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m34s, non-child: 214.699us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 31.554us - DeserializeRowBatchTimer: 136.006us - FirstBatchArrivalWaitTime: 1m34s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m34s max:1m38s mean: 1m38s stddev:1s012ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.62 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11997510860) - PerHostPeakMemUsage: 11.31 GB (12145298988) - PrepareTime: 146.560ms - RowsProduced: 1 (1) - TotalCpuTime: 2m16s - TotalNetworkReceiveTime: 23s461ms - TotalNetworkSendTime: 318.247us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 478.631ms, non-child: 478.631ms, % non-child: 100.00%) - CodegenTime: 171.236us - CompileTime: 54.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 280.905ms - PrepareTime: 141.799ms DataStreamSender (dst_id=6):(Total: 69.671us, non-child: 69.671us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 387.92 KB/sec - OverallThroughput: 233.37 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.605us - TransmitDataRPCTime: 42.718us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 861.807ms, % non-child: 0.88%) - BuildTime: 476.266ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.21 KB (49370) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m7s, % non-child: 69.89%) - BuildPartitionTime: 18s045ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 14s743ms - GetNewBlockTime: 8.948ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s637ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 6.17 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.715us EXCHANGE_NODE (id=5):(Total: 23s448ms, non-child: 23s448ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671748018) - ConvertRowBatchTime: 3s531ms - DeserializeRowBatchTimer: 10s851ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 5.16 M/sec - SendersBlockedTimer: 1s941ms - SendersBlockedTotalTimer(*): 18s727ms EXCHANGE_NODE (id=4):(Total: 6s337ms, non-child: 6s337ms, % non-child: 100.00%) - BytesReceived: 822.71 MB (862674583) - ConvertRowBatchTime: 2s263ms - DeserializeRowBatchTimer: 2s782ms - FirstBatchArrivalWaitTime: 504.780ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 19.53 M/sec - SendersBlockedTimer: 59s576ms - SendersBlockedTotalTimer(*): 12m17s Averaged Fragment F01:(Total: 40s385ms, non-child: 11s667ms, % non-child: 28.89%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:37s234ms max:42s475ms mean: 40s832ms stddev:1s534ms execution rates: min:103.83 MB/sec max:119.23 MB/sec mean:107.64 MB/sec stddev:3.45 MB/sec num instances: 15 - AverageThreadTokens: 10.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 999.15 MB (1047681736) - PerHostPeakMemUsage: 4.74 GB (5093422580) - PrepareTime: 143.038ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 6m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s181ms - TotalStorageWaitTime: 524.857ms CodeGen:(Total: 325.930ms, non-child: 325.930ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.451ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.367ms - PrepareTime: 140.217ms DataStreamSender (dst_id=5):(Total: 27s468ms, non-child: 27s468ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671748018) - NetworkThroughput(*): 304.71 MB/sec - OverallThroughput: 93.15 MB/sec - PeakMemoryUsage: 434.33 KB (444753) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 18s763ms - TransmitDataRPCTime: 8s660ms - UncompressedRowBatchSize: 4.92 GB (5281141619) HDFS_SCAN_NODE (id=1):(Total: 923.921ms, non-child: 923.921ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 6s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 998.77 MB (1047288854) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 131.17 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 15.47K (15472) - ScannerThreadsTotalWallClockTime: 6m25s - MaterializeTupleTime(*): 6m17s - ScannerThreadsSysTime: 970.847ms - ScannerThreadsUserTime: 28s725ms - ScannerThreadsVoluntaryContextSwitches: 117.42K (117420) - TotalRawHdfsReadTime(*): 941.110ms - TotalReadThroughput: 35.66 MB/sec Averaged Fragment F00:(Total: 1m36s, non-child: 1m22s, % non-child: 85.46%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:1m33s max:1m38s mean: 1m36s stddev:1s450ms execution rates: min:42.49 MB/sec max:48.74 MB/sec mean:45.36 MB/sec stddev:1.59 MB/sec num instances: 15 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.16 MB (148018601) - PerHostPeakMemUsage: 11.31 GB (12145298988) - PrepareTime: 305.677us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 17m - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 211.664ms DataStreamSender (dst_id=4):(Total: 12s425ms, non-child: 12s425ms, % non-child: 100.00%) - BytesSent: 822.71 MB (862674583) - NetworkThroughput(*): 206.93 MB/sec - OverallThroughput: 66.80 MB/sec - PeakMemoryUsage: 536.27 KB (549137) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 8s336ms - TransmitDataRPCTime: 4s067ms - UncompressedRowBatchSize: 2.24 GB (2400454228) HDFS_SCAN_NODE (id=0):(Total: 1s632ms, non-child: 1s632ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s343ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.73 MB (147568861) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 73.67 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.84K (5845) - ScannerThreadsTotalWallClockTime: 16m36s - MaterializeTupleTime(*): 16m35s - ScannerThreadsSysTime: 467.790ms - ScannerThreadsUserTime: 8s918ms - ScannerThreadsVoluntaryContextSwitches: 117.34K (117342) - TotalRawHdfsReadTime(*): 125.419ms - TotalReadThroughput: 1.90 MB/sec Filter 0: - Rows processed: 181.31K (181305) - Rows rejected: 0 (0) - Rows total: 181.32K (181316) Fragment F02: Instance fc4196b242ff8416:aac7ad511f2ba4b7 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.80 MB, 2.55 MB, 158.65 MB, 360.01 MB, 616.02 MB, 872.02 MB, 1.04 GB, 1.29 GB, 1.54 GB, 1.79 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.26 GB, 3.48 GB, 3.73 GB, 3.98 GB, 4.23 GB, 4.48 GB, 4.86 GB, 5.66 GB, 6.32 GB, 7.01 GB, 7.58 GB, 8.26 GB, 8.89 GB, 9.51 GB, 10.15 GB, 10.77 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12145176400) - PrepareTime: 144.129ms - RowsProduced: 1 (1) - TotalCpuTime: 2m17s - TotalNetworkReceiveTime: 23s235ms - TotalNetworkSendTime: 355.682us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 468.087ms, non-child: 468.087ms, % non-child: 100.00%) - CodegenTime: 185.002us - CompileTime: 53.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 273.133ms - PrepareTime: 139.943ms DataStreamSender (dst_id=6):(Total: 58.026us, non-child: 58.026us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 426.39 KB/sec - OverallThroughput: 269.28 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.560us - TransmitDataRPCTime: 36.645us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 902.417ms, % non-child: 0.92%) ExecOption: Codegen Enabled - BuildTime: 490.972ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.30 KB (48432) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m8s, % non-child: 70.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s766ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 14s731ms - GetNewBlockTime: 9.622ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s793ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.114us EXCHANGE_NODE (id=5):(Total: 24s045ms, non-child: 7s963ms, % non-child: 33.12%) BytesReceived(2s000ms): 148.93 KB, 198.57 KB, 32.67 MB, 161.86 MB, 299.69 MB, 425.18 MB, 552.77 MB, 696.90 MB, 838.64 MB, 981.14 MB, 1.09 GB, 1.21 GB, 1.36 GB, 1.50 GB, 1.64 GB, 1.76 GB, 1.89 GB, 2.04 GB, 2.17 GB, 2.30 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672284715) - ConvertRowBatchTime: 3s628ms - DeserializeRowBatchTimer: 10s014ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 4.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s582ms, non-child: 2s853ms, % non-child: 51.12%) BytesReceived(2s000ms): 78.32 KB, 156.64 KB, 7.59 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 12.44 MB, 50.78 MB, 100.81 MB, 150.11 MB, 198.24 MB, 246.66 MB, 292.33 MB, 336.00 MB, 380.31 MB, 426.16 MB, 472.46 MB, 518.92 MB, 566.38 MB, 614.28 MB, 661.48 MB, 707.78 MB, 754.03 MB, 799.77 MB - BytesReceived: 822.85 MB (862818514) - ConvertRowBatchTime: 2s239ms - DeserializeRowBatchTimer: 2s600ms - FirstBatchArrivalWaitTime: 553.679ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 21.50 M/sec - SendersBlockedTimer: 57s931ms - SendersBlockedTotalTimer(*): 8m40s Instance fc4196b242ff8416:aac7ad511f2ba4b4 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.82 MB, 2.59 MB, 158.64 MB, 424.04 MB, 642.01 MB, 872.00 MB, 1.10 GB, 1.35 GB, 1.58 GB, 1.85 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.28 GB, 3.50 GB, 3.79 GB, 3.99 GB, 4.23 GB, 4.48 GB, 4.86 GB, 5.66 GB, 6.49 GB, 7.32 GB, 8.15 GB, 8.98 GB, 9.65 GB, 10.33 GB, 10.89 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.16 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.18 GB (12000268288) - PerHostPeakMemUsage: 11.32 GB (12149511944) - PrepareTime: 140.802ms - RowsProduced: 1 (1) - TotalCpuTime: 2m13s - TotalNetworkReceiveTime: 24s812ms - TotalNetworkSendTime: 402.301us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 453.017ms, non-child: 453.017ms, % non-child: 100.00%) - CodegenTime: 155.098us - CompileTime: 50.673ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 264.219ms - PrepareTime: 136.878ms DataStreamSender (dst_id=6):(Total: 60.982us, non-child: 60.982us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 432.33 KB/sec - OverallThroughput: 256.22 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.456us - TransmitDataRPCTime: 36.141us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 810.212ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 460.559ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.73 KB (46832) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m7s, % non-child: 69.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s289ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 13s511ms - GetNewBlockTime: 9.079ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s494ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 6.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.801us EXCHANGE_NODE (id=5):(Total: 24s531ms, non-child: 7s351ms, % non-child: 29.97%) BytesReceived(2s000ms): 149.03 KB, 198.71 KB, 39.28 MB, 170.62 MB, 307.99 MB, 433.08 MB, 561.79 MB, 706.48 MB, 847.16 MB, 989.61 MB, 1.09 GB, 1.22 GB, 1.37 GB, 1.51 GB, 1.65 GB, 1.77 GB, 1.90 GB, 2.05 GB, 2.18 GB, 2.31 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671155795) - ConvertRowBatchTime: 3s441ms - DeserializeRowBatchTimer: 9s508ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 4.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s291ms, non-child: 2s643ms, % non-child: 42.02%) BytesReceived(2s000ms): 84.58 KB, 169.16 KB, 7.61 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 13.27 MB, 54.18 MB, 104.09 MB, 153.24 MB, 201.40 MB, 249.78 MB, 295.12 MB, 338.76 MB, 383.13 MB, 429.07 MB, 475.39 MB, 521.87 MB, 569.35 MB, 617.27 MB, 664.37 MB, 710.65 MB, 756.79 MB, 802.33 MB - BytesReceived: 822.64 MB (862597198) - ConvertRowBatchTime: 2s076ms - DeserializeRowBatchTimer: 2s244ms - FirstBatchArrivalWaitTime: 571.463ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 19.07 M/sec - SendersBlockedTimer: 1m11s - SendersBlockedTotalTimer(*): 15m42s Instance fc4196b242ff8416:aac7ad511f2ba4b1 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.61 MB, 125.90 MB, 362.05 MB, 616.76 MB, 840.03 MB, 1.04 GB, 1.29 GB, 1.54 GB, 1.80 GB, 2.03 GB, 2.23 GB, 2.49 GB, 2.79 GB, 3.02 GB, 3.23 GB, 3.48 GB, 3.73 GB, 3.98 GB, 4.22 GB, 4.44 GB, 4.78 GB, 5.46 GB, 6.20 GB, 6.96 GB, 7.77 GB, 8.59 GB, 9.41 GB, 10.16 GB, 10.84 GB, 11.14 GB, 11.14 GB, 11.16 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.17 GB, 11.17 GB, 11.16 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.18 GB (12000808960) - PerHostPeakMemUsage: 11.32 GB (12150126344) - PrepareTime: 145.717ms - RowsProduced: 1 (1) - TotalCpuTime: 2m17s - TotalNetworkReceiveTime: 20s665ms - TotalNetworkSendTime: 270.608us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 475.734ms, non-child: 475.734ms, % non-child: 100.00%) - CodegenTime: 182.225us - CompileTime: 55.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 276.777ms - PrepareTime: 141.891ms DataStreamSender (dst_id=6):(Total: 82.024us, non-child: 82.024us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 262.99 KB/sec - OverallThroughput: 190.49 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.197us - TransmitDataRPCTime: 59.413us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 875.742ms, % non-child: 0.89%) ExecOption: Codegen Enabled - BuildTime: 474.714ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.30 KB (52528) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m10s, % non-child: 72.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 20s268ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 13s818ms - GetNewBlockTime: 9.489ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s670ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.261us EXCHANGE_NODE (id=5):(Total: 21s487ms, non-child: 8s603ms, % non-child: 40.04%) BytesReceived(2s000ms): 181.47 KB, 181.47 KB, 51.44 MB, 183.91 MB, 320.34 MB, 444.76 MB, 574.82 MB, 720.31 MB, 860.29 MB, 1002.50 MB, 1.10 GB, 1.23 GB, 1.38 GB, 1.52 GB, 1.66 GB, 1.78 GB, 1.91 GB, 2.06 GB, 2.19 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671921637) - ConvertRowBatchTime: 4s056ms - DeserializeRowBatchTimer: 10s415ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 5.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s882ms, non-child: 2s675ms, % non-child: 45.49%) BytesReceived(2s000ms): 84.38 KB, 168.75 KB, 9.24 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 15.47 MB, 58.90 MB, 108.76 MB, 157.75 MB, 205.89 MB, 254.19 MB, 299.28 MB, 343.01 MB, 387.55 MB, 433.49 MB, 479.80 MB, 526.34 MB, 573.84 MB, 621.80 MB, 668.71 MB, 714.96 MB, 761.18 MB, 806.17 MB - BytesReceived: 822.72 MB (862686923) - ConvertRowBatchTime: 2s082ms - DeserializeRowBatchTimer: 2s228ms - FirstBatchArrivalWaitTime: 547.086ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 20.40 M/sec - SendersBlockedTimer: 1m9s - SendersBlockedTotalTimer(*): 13m9s Instance fc4196b242ff8416:aac7ad511f2ba4ae (host=vb0212.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.89 MB, 2.57 MB, 161.17 MB, 424.20 MB, 648.05 MB, 872.05 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.07 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.05 GB, 3.29 GB, 3.51 GB, 3.79 GB, 4.04 GB, 4.23 GB, 4.48 GB, 4.88 GB, 5.67 GB, 6.34 GB, 7.15 GB, 8.00 GB, 8.82 GB, 9.50 GB, 10.07 GB, 10.75 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12145046464) - PrepareTime: 146.126ms - RowsProduced: 1 (1) - TotalCpuTime: 2m16s - TotalNetworkReceiveTime: 22s912ms - TotalNetworkSendTime: 354.204us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.769ms, non-child: 481.769ms, % non-child: 100.00%) - CodegenTime: 161.839us - CompileTime: 54.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 283.886ms - PrepareTime: 142.002ms DataStreamSender (dst_id=6):(Total: 67.295us, non-child: 67.295us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 346.12 KB/sec - OverallThroughput: 232.19 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.237us - TransmitDataRPCTime: 45.143us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 852.767ms, % non-child: 0.87%) ExecOption: Codegen Enabled - BuildTime: 476.095ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.59 KB (50784) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m8s, % non-child: 70.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s482ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 13s836ms - GetNewBlockTime: 8.953ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s658ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 986.000ns EXCHANGE_NODE (id=5):(Total: 22s297ms, non-child: 7s566ms, % non-child: 33.93%) BytesReceived(2s000ms): 167.69 KB, 172.23 KB, 42.66 MB, 174.56 MB, 311.76 MB, 436.50 MB, 565.86 MB, 710.99 MB, 851.16 MB, 994.27 MB, 1.10 GB, 1.23 GB, 1.37 GB, 1.51 GB, 1.65 GB, 1.77 GB, 1.90 GB, 2.05 GB, 2.18 GB, 2.32 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672538033) - ConvertRowBatchTime: 3s952ms - DeserializeRowBatchTimer: 9s045ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 5.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s362ms, non-child: 2s910ms, % non-child: 39.53%) BytesReceived(2s000ms): 81.31 KB, 162.62 KB, 7.70 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 13.73 MB, 55.60 MB, 105.50 MB, 154.64 MB, 202.86 MB, 251.21 MB, 296.52 MB, 340.19 MB, 384.64 MB, 430.62 MB, 476.93 MB, 523.49 MB, 571.00 MB, 618.96 MB, 666.02 MB, 712.33 MB, 758.51 MB, 803.87 MB - BytesReceived: 822.95 MB (862926908) - ConvertRowBatchTime: 2s266ms - DeserializeRowBatchTimer: 2s668ms - FirstBatchArrivalWaitTime: 542.136ms - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 16.30 M/sec - SendersBlockedTimer: 56s310ms - SendersBlockedTotalTimer(*): 8m26s Instance fc4196b242ff8416:aac7ad511f2ba4ab (host=vb0230.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.78 MB, 2.51 MB, 158.66 MB, 360.04 MB, 616.08 MB, 872.07 MB, 1.04 GB, 1.29 GB, 1.56 GB, 1.80 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.26 GB, 3.48 GB, 3.76 GB, 3.98 GB, 4.23 GB, 4.48 GB, 4.86 GB, 5.52 GB, 6.30 GB, 6.84 GB, 7.52 GB, 8.08 GB, 8.76 GB, 9.32 GB, 9.94 GB, 10.56 GB, 11.11 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.64 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12144783552) - PrepareTime: 150.064ms - RowsProduced: 1 (1) - TotalCpuTime: 2m19s - TotalNetworkReceiveTime: 21s809ms - TotalNetworkSendTime: 374.296us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 518.503ms, non-child: 518.503ms, % non-child: 100.00%) - CodegenTime: 238.920us - CompileTime: 57.991ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 313.221ms - PrepareTime: 145.940ms DataStreamSender (dst_id=6):(Total: 83.619us, non-child: 83.619us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 318.32 KB/sec - OverallThroughput: 186.86 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.589us - TransmitDataRPCTime: 49.086us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 810.475ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 453.884ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.00 KB (48128) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m9s, % non-child: 71.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s517ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 15s354ms - GetNewBlockTime: 9.337ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s391ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.796us EXCHANGE_NODE (id=5):(Total: 22s224ms, non-child: 7s361ms, % non-child: 33.12%) BytesReceived(2s000ms): 142.58 KB, 190.11 KB, 33.92 MB, 164.29 MB, 301.84 MB, 427.30 MB, 555.26 MB, 699.31 MB, 840.91 MB, 983.45 MB, 1.09 GB, 1.21 GB, 1.36 GB, 1.50 GB, 1.64 GB, 1.76 GB, 1.89 GB, 2.04 GB, 2.17 GB, 2.30 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672142193) - ConvertRowBatchTime: 3s819ms - DeserializeRowBatchTimer: 8s916ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 5.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s308ms, non-child: 2s950ms, % non-child: 46.78%) BytesReceived(2s000ms): 73.77 KB, 147.55 KB, 7.58 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 12.66 MB, 51.75 MB, 101.70 MB, 150.96 MB, 199.17 MB, 247.53 MB, 293.18 MB, 336.85 MB, 381.17 MB, 427.00 MB, 473.28 MB, 519.80 MB, 567.29 MB, 615.15 MB, 662.30 MB, 708.53 MB, 754.64 MB, 800.44 MB - BytesReceived: 822.78 MB (862746682) - ConvertRowBatchTime: 2s377ms - DeserializeRowBatchTimer: 2s320ms - FirstBatchArrivalWaitTime: 504.949ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 19.03 M/sec - SendersBlockedTimer: 58s667ms - SendersBlockedTotalTimer(*): 8m49s Instance fc4196b242ff8416:aac7ad511f2ba4b8 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.86 MB, 2.66 MB, 160.27 MB, 424.03 MB, 648.08 MB, 872.06 MB, 1.10 GB, 1.35 GB, 1.59 GB, 1.85 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.29 GB, 3.51 GB, 3.79 GB, 4.01 GB, 4.23 GB, 4.48 GB, 4.87 GB, 5.59 GB, 6.33 GB, 7.13 GB, 7.94 GB, 8.69 GB, 9.31 GB, 9.91 GB, 10.46 GB, 11.01 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12144616096) - PrepareTime: 150.837ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 24s762ms - TotalNetworkSendTime: 278.695us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 463.989ms, non-child: 463.989ms, % non-child: 100.00%) - CodegenTime: 160.059us - CompileTime: 49.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 266.096ms - PrepareTime: 145.451ms DataStreamSender (dst_id=6):(Total: 51.354us, non-child: 51.354us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 517.73 KB/sec - OverallThroughput: 304.26 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 8.775us - TransmitDataRPCTime: 30.180us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 921.909ms, % non-child: 0.94%) ExecOption: Codegen Enabled - BuildTime: 495.578ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.30 KB (47408) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m7s, % non-child: 69.06%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s907ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 14s965ms - GetNewBlockTime: 9.121ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s208ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 6.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.774us EXCHANGE_NODE (id=5):(Total: 24s902ms, non-child: 8s769ms, % non-child: 35.21%) BytesReceived(2s000ms): 136.03 KB, 181.37 KB, 39.61 MB, 171.18 MB, 308.64 MB, 433.76 MB, 562.61 MB, 707.54 MB, 848.21 MB, 990.77 MB, 1.09 GB, 1.22 GB, 1.37 GB, 1.51 GB, 1.65 GB, 1.77 GB, 1.90 GB, 2.05 GB, 2.18 GB, 2.31 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671938515) - ConvertRowBatchTime: 3s274ms - DeserializeRowBatchTimer: 11s645ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 4.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s818ms, non-child: 2s733ms, % non-child: 46.97%) BytesReceived(2s000ms): 92.05 KB, 184.10 KB, 7.61 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 13.31 MB, 54.42 MB, 104.37 MB, 153.51 MB, 201.79 MB, 250.16 MB, 295.51 MB, 339.15 MB, 383.55 MB, 429.49 MB, 475.76 MB, 522.22 MB, 569.71 MB, 617.70 MB, 664.78 MB, 710.99 MB, 757.15 MB, 802.65 MB - BytesReceived: 822.78 MB (862747161) - ConvertRowBatchTime: 2s188ms - DeserializeRowBatchTimer: 2s369ms - FirstBatchArrivalWaitTime: 558.358ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 20.63 M/sec - SendersBlockedTimer: 57s276ms - SendersBlockedTotalTimer(*): 11m26s Instance fc4196b242ff8416:aac7ad511f2ba4af (host=vb0232.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.67 MB, 2.52 MB, 126.03 MB, 361.15 MB, 619.72 MB, 840.05 MB, 1.04 GB, 1.29 GB, 1.56 GB, 1.80 GB, 2.00 GB, 2.25 GB, 2.49 GB, 2.79 GB, 3.00 GB, 3.25 GB, 3.46 GB, 3.73 GB, 3.98 GB, 4.23 GB, 4.43 GB, 4.77 GB, 5.47 GB, 6.28 GB, 7.10 GB, 7.76 GB, 8.37 GB, 8.92 GB, 9.59 GB, 10.15 GB, 10.75 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996688384) - PerHostPeakMemUsage: 11.31 GB (12144699048) - PrepareTime: 144.970ms - RowsProduced: 1 (1) - TotalCpuTime: 2m19s - TotalNetworkReceiveTime: 21s277ms - TotalNetworkSendTime: 265.970us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 467.087ms, non-child: 467.087ms, % non-child: 100.00%) - CodegenTime: 162.825us - CompileTime: 56.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 268.689ms - PrepareTime: 139.387ms DataStreamSender (dst_id=6):(Total: 57.983us, non-child: 57.983us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 450.14 KB/sec - OverallThroughput: 269.47 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.264us - TransmitDataRPCTime: 34.711us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 866.859ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 478.208ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.88 KB (53120) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m10s, % non-child: 72.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s425ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 15s164ms - GetNewBlockTime: 9.466ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s859ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.004us EXCHANGE_NODE (id=5):(Total: 22s310ms, non-child: 11s417ms, % non-child: 51.18%) BytesReceived(2s000ms): 172.34 KB, 172.34 KB, 51.43 MB, 183.79 MB, 320.26 MB, 444.48 MB, 574.69 MB, 720.09 MB, 860.04 MB, 1002.11 MB, 1.10 GB, 1.23 GB, 1.38 GB, 1.52 GB, 1.66 GB, 1.78 GB, 1.91 GB, 2.06 GB, 2.19 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671843938) - ConvertRowBatchTime: 3s731ms - DeserializeRowBatchTimer: 12s478ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 5.38 M/sec - SendersBlockedTimer: 10s613ms - SendersBlockedTotalTimer(*): 1m46s EXCHANGE_NODE (id=4):(Total: 5s504ms, non-child: 2s841ms, % non-child: 51.63%) BytesReceived(2s000ms): 75.80 KB, 151.61 KB, 9.25 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 15.46 MB, 58.83 MB, 108.71 MB, 157.76 MB, 205.91 MB, 254.20 MB, 299.23 MB, 342.94 MB, 387.48 MB, 433.44 MB, 479.77 MB, 526.43 MB, 574.00 MB, 621.99 MB, 668.85 MB, 715.04 MB, 761.21 MB, 806.16 MB - BytesReceived: 822.78 MB (862747044) - ConvertRowBatchTime: 2s213ms - DeserializeRowBatchTimer: 2s676ms - FirstBatchArrivalWaitTime: 557.352ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 21.80 M/sec - SendersBlockedTimer: 57s974ms - SendersBlockedTotalTimer(*): 14m28s Instance fc4196b242ff8416:aac7ad511f2ba4b3 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.85 MB, 2.63 MB, 159.62 MB, 420.09 MB, 616.09 MB, 872.11 MB, 1.07 GB, 1.33 GB, 1.57 GB, 1.83 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.26 GB, 3.48 GB, 3.78 GB, 3.98 GB, 4.23 GB, 4.48 GB, 4.86 GB, 5.51 GB, 6.31 GB, 7.11 GB, 7.87 GB, 8.59 GB, 9.20 GB, 9.75 GB, 10.35 GB, 10.90 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996786688) - PerHostPeakMemUsage: 11.31 GB (12144825040) - PrepareTime: 144.509ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 24s771ms - TotalNetworkSendTime: 255.808us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.541ms, non-child: 472.541ms, % non-child: 100.00%) - CodegenTime: 163.806us - CompileTime: 51.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 279.459ms - PrepareTime: 138.966ms DataStreamSender (dst_id=6):(Total: 54.252us, non-child: 54.252us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 527.12 KB/sec - OverallThroughput: 288.01 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.409us - TransmitDataRPCTime: 29.642us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 844.387ms, % non-child: 0.86%) ExecOption: Codegen Enabled - BuildTime: 472.933ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.61 KB (49776) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m7s, % non-child: 68.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s651ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 15s145ms - GetNewBlockTime: 8.634ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s776ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.866us EXCHANGE_NODE (id=5):(Total: 24s140ms, non-child: 8s546ms, % non-child: 35.40%) BytesReceived(2s000ms): 135.43 KB, 180.57 KB, 36.30 MB, 167.11 MB, 304.61 MB, 429.75 MB, 558.00 MB, 702.29 MB, 843.61 MB, 985.88 MB, 1.09 GB, 1.22 GB, 1.36 GB, 1.51 GB, 1.64 GB, 1.77 GB, 1.89 GB, 2.04 GB, 2.18 GB, 2.31 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671109824) - ConvertRowBatchTime: 3s428ms - DeserializeRowBatchTimer: 11s062ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s956ms, non-child: 3s129ms, % non-child: 44.98%) BytesReceived(2s000ms): 88.71 KB, 177.43 KB, 7.63 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 12.97 MB, 52.86 MB, 102.80 MB, 151.96 MB, 200.10 MB, 248.45 MB, 293.98 MB, 337.64 MB, 381.97 MB, 427.84 MB, 474.10 MB, 520.61 MB, 568.09 MB, 615.99 MB, 663.10 MB, 709.35 MB, 755.50 MB, 801.14 MB - BytesReceived: 822.53 MB (862486028) - ConvertRowBatchTime: 2s362ms - DeserializeRowBatchTimer: 3s105ms - FirstBatchArrivalWaitTime: 552.310ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 17.25 M/sec - SendersBlockedTimer: 57s642ms - SendersBlockedTotalTimer(*): 14m23s Instance fc4196b242ff8416:aac7ad511f2ba4aa (host=vb0208.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.85 MB, 2.53 MB, 158.81 MB, 424.00 MB, 648.00 MB, 872.00 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.06 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.05 GB, 3.29 GB, 3.51 GB, 3.79 GB, 4.03 GB, 4.23 GB, 4.48 GB, 4.88 GB, 5.66 GB, 6.41 GB, 7.04 GB, 7.66 GB, 8.27 GB, 8.89 GB, 9.51 GB, 10.07 GB, 10.74 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996688384) - PerHostPeakMemUsage: 11.31 GB (12138780056) - PrepareTime: 149.847ms - RowsProduced: 1 (1) - TotalCpuTime: 2m18s - TotalNetworkReceiveTime: 22s228ms - TotalNetworkSendTime: 318.409us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.129ms, non-child: 490.129ms, % non-child: 100.00%) - CodegenTime: 172.398us - CompileTime: 51.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 292.628ms - PrepareTime: 144.207ms DataStreamSender (dst_id=6):(Total: 105.720us, non-child: 105.720us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 262.83 KB/sec - OverallThroughput: 147.80 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.543us - TransmitDataRPCTime: 59.450us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 818.631ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 461.589ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.59 KB (52832) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m9s, % non-child: 71.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s351ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 15s230ms - GetNewBlockTime: 8.443ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s771ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.479us EXCHANGE_NODE (id=5):(Total: 23s415ms, non-child: 7s198ms, % non-child: 30.74%) BytesReceived(2s000ms): 172.23 KB, 190.40 KB, 41.99 MB, 173.89 MB, 311.11 MB, 435.95 MB, 565.19 MB, 710.37 MB, 850.58 MB, 993.34 MB, 1.10 GB, 1.22 GB, 1.37 GB, 1.51 GB, 1.65 GB, 1.77 GB, 1.90 GB, 2.05 GB, 2.18 GB, 2.31 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672060802) - ConvertRowBatchTime: 3s639ms - DeserializeRowBatchTimer: 8s893ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 5.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s248ms, non-child: 3s169ms, % non-child: 60.39%) BytesReceived(2s000ms): 78.79 KB, 157.59 KB, 7.65 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 13.66 MB, 55.44 MB, 105.40 MB, 154.57 MB, 202.80 MB, 251.17 MB, 296.45 MB, 340.04 MB, 384.48 MB, 430.42 MB, 476.72 MB, 523.20 MB, 570.71 MB, 618.62 MB, 665.65 MB, 711.92 MB, 758.12 MB, 803.52 MB - BytesReceived: 822.78 MB (862746068) - ConvertRowBatchTime: 2s268ms - DeserializeRowBatchTimer: 3s628ms - FirstBatchArrivalWaitTime: 532.322ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 22.86 M/sec - SendersBlockedTimer: 58s368ms - SendersBlockedTotalTimer(*): 12m38s Instance fc4196b242ff8416:aac7ad511f2ba4b5 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.82 MB, 2.60 MB, 126.67 MB, 360.03 MB, 616.37 MB, 872.03 MB, 1.04 GB, 1.29 GB, 1.54 GB, 1.79 GB, 2.04 GB, 2.24 GB, 2.50 GB, 2.79 GB, 3.04 GB, 3.23 GB, 3.48 GB, 3.73 GB, 3.98 GB, 4.23 GB, 4.47 GB, 4.79 GB, 5.49 GB, 6.21 GB, 6.93 GB, 7.60 GB, 8.28 GB, 8.89 GB, 9.50 GB, 10.03 GB, 10.58 GB, 11.11 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.64 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12145194728) - PrepareTime: 146.153ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 25s730ms - TotalNetworkSendTime: 362.531us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 459.802ms, non-child: 459.802ms, % non-child: 100.00%) - CodegenTime: 167.547us - CompileTime: 55.700ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 260.617ms - PrepareTime: 142.481ms DataStreamSender (dst_id=6):(Total: 66.576us, non-child: 66.576us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 344.22 KB/sec - OverallThroughput: 234.69 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.492us - TransmitDataRPCTime: 45.393us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 845.410ms, % non-child: 0.86%) ExecOption: Codegen Enabled - BuildTime: 468.718ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.47 KB (49632) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m6s, % non-child: 68.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 15s906ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 15s846ms - GetNewBlockTime: 8.424ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s143ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.717us EXCHANGE_NODE (id=5):(Total: 25s913ms, non-child: 8s272ms, % non-child: 31.92%) BytesReceived(2s000ms): 207.95 KB, 207.95 KB, 56.67 MB, 191.70 MB, 326.80 MB, 450.96 MB, 581.74 MB, 727.81 MB, 867.45 MB, 1008.71 MB, 1.11 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.79 GB, 1.92 GB, 2.07 GB, 2.20 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671447503) - ConvertRowBatchTime: 3s028ms - DeserializeRowBatchTimer: 10s956ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 4.63 M/sec - SendersBlockedTimer: 1s675ms - SendersBlockedTotalTimer(*): 16s963ms EXCHANGE_NODE (id=4):(Total: 5s652ms, non-child: 3s024ms, % non-child: 53.50%) BytesReceived(2s000ms): 132.98 KB, 177.31 KB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 16.94 MB, 61.44 MB, 111.31 MB, 160.23 MB, 208.43 MB, 256.60 MB, 301.41 MB, 345.09 MB, 389.75 MB, 435.78 MB, 482.13 MB, 528.74 MB, 576.29 MB, 624.27 MB, 671.10 MB, 717.32 MB, 763.43 MB, 808.03 MB - BytesReceived: 822.64 MB (862596861) - ConvertRowBatchTime: 2s320ms - DeserializeRowBatchTimer: 2s914ms - FirstBatchArrivalWaitTime: 563.206ms - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 21.23 M/sec - SendersBlockedTimer: 58s573ms - SendersBlockedTotalTimer(*): 13m39s Instance fc4196b242ff8416:aac7ad511f2ba4b0 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.91 MB, 2.59 MB, 162.26 MB, 424.07 MB, 648.06 MB, 872.04 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.07 GB, 2.29 GB, 2.54 GB, 2.80 GB, 3.06 GB, 3.29 GB, 3.52 GB, 3.79 GB, 4.04 GB, 4.23 GB, 4.48 GB, 4.88 GB, 5.69 GB, 6.53 GB, 7.36 GB, 8.17 GB, 8.78 GB, 9.41 GB, 10.03 GB, 10.65 GB, 11.12 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12144842296) - PrepareTime: 146.049ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 26s635ms - TotalNetworkSendTime: 339.696us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 476.897ms, non-child: 476.897ms, % non-child: 100.00%) - CodegenTime: 155.582us - CompileTime: 55.735ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 277.946ms - PrepareTime: 140.254ms DataStreamSender (dst_id=6):(Total: 60.723us, non-child: 60.723us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 423.68 KB/sec - OverallThroughput: 257.32 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.414us - TransmitDataRPCTime: 36.879us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 840.274ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 473.743ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.52 KB (51728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m5s, % non-child: 66.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s848ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 14s084ms - GetNewBlockTime: 8.166ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s829ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.317us EXCHANGE_NODE (id=5):(Total: 24s946ms, non-child: 9s250ms, % non-child: 37.08%) BytesReceived(2s000ms): 178.86 KB, 181.08 KB, 45.08 MB, 176.61 MB, 313.59 MB, 438.13 MB, 567.73 MB, 713.06 MB, 852.70 MB, 995.73 MB, 1.10 GB, 1.23 GB, 1.37 GB, 1.52 GB, 1.65 GB, 1.78 GB, 1.90 GB, 2.05 GB, 2.19 GB, 2.32 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671160309) - ConvertRowBatchTime: 3s264ms - DeserializeRowBatchTimer: 12s246ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 4.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s862ms, non-child: 3s162ms, % non-child: 40.22%) BytesReceived(2s000ms): 82.19 KB, 164.37 KB, 8.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 14.15 MB, 56.49 MB, 106.36 MB, 155.46 MB, 203.61 MB, 251.90 MB, 297.10 MB, 340.74 MB, 385.15 MB, 431.08 MB, 477.37 MB, 523.92 MB, 571.44 MB, 619.38 MB, 666.33 MB, 712.56 MB, 758.68 MB, 804.00 MB - BytesReceived: 822.51 MB (862467495) - ConvertRowBatchTime: 2s384ms - DeserializeRowBatchTimer: 3s128ms - FirstBatchArrivalWaitTime: 546.916ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 15.26 M/sec - SendersBlockedTimer: 56s668ms - SendersBlockedTotalTimer(*): 13m12s Instance fc4196b242ff8416:aac7ad511f2ba4ac (host=vb0204.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.80 MB, 2.58 MB, 126.64 MB, 365.36 MB, 637.50 MB, 861.55 MB, 1.06 GB, 1.31 GB, 1.54 GB, 1.79 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.81 GB, 3.04 GB, 3.24 GB, 3.48 GB, 3.73 GB, 3.98 GB, 4.23 GB, 4.48 GB, 4.79 GB, 5.49 GB, 6.20 GB, 6.92 GB, 7.58 GB, 8.29 GB, 8.92 GB, 9.51 GB, 10.05 GB, 10.58 GB, 11.10 GB, 11.18 GB, 11.18 GB, 11.17 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.64 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.18 GB (12000735232) - PerHostPeakMemUsage: 11.32 GB (12149966600) - PrepareTime: 144.150ms - RowsProduced: 1 (1) - TotalCpuTime: 2m18s - TotalNetworkReceiveTime: 23s020ms - TotalNetworkSendTime: 247.685us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 501.478ms, non-child: 501.478ms, % non-child: 100.00%) - CodegenTime: 174.991us - CompileTime: 57.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 302.582ms - PrepareTime: 139.098ms DataStreamSender (dst_id=6):(Total: 75.979us, non-child: 75.979us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 313.65 KB/sec - OverallThroughput: 205.65 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.725us - TransmitDataRPCTime: 49.817us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 885.051ms, % non-child: 0.90%) ExecOption: Codegen Enabled - BuildTime: 479.649ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.23 KB (47344) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m8s, % non-child: 70.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s395ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 16s084ms - GetNewBlockTime: 7.905ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s679ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 6.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.725us EXCHANGE_NODE (id=5):(Total: 24s354ms, non-child: 10s477ms, % non-child: 43.02%) BytesReceived(2s000ms): 164.45 KB, 164.45 KB, 58.44 MB, 193.93 MB, 329.03 MB, 453.33 MB, 584.54 MB, 730.53 MB, 870.50 MB, 1012.00 MB, 1.11 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.79 GB, 1.92 GB, 2.07 GB, 2.20 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672485226) - ConvertRowBatchTime: 3s370ms - DeserializeRowBatchTimer: 12s216ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 4.93 M/sec - SendersBlockedTimer: 8s532ms - SendersBlockedTotalTimer(*): 1m21s EXCHANGE_NODE (id=4):(Total: 4s796ms, non-child: 2s936ms, % non-child: 61.23%) BytesReceived(2s000ms): 128.06 KB, 170.75 KB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 17.43 MB, 62.37 MB, 112.21 MB, 161.15 MB, 209.36 MB, 257.58 MB, 302.37 MB, 346.13 MB, 390.80 MB, 436.84 MB, 483.14 MB, 529.79 MB, 577.37 MB, 625.39 MB, 672.25 MB, 718.49 MB, 764.57 MB, 809.01 MB - BytesReceived: 822.94 MB (862919291) - ConvertRowBatchTime: 2s215ms - DeserializeRowBatchTimer: 2s940ms - FirstBatchArrivalWaitTime: 522.895ms - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 25.02 M/sec - SendersBlockedTimer: 1m3s - SendersBlockedTotalTimer(*): 15m39s Instance fc4196b242ff8416:aac7ad511f2ba4b2 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.82 MB, 2.59 MB, 126.66 MB, 364.56 MB, 617.82 MB, 868.03 MB, 1.04 GB, 1.29 GB, 1.54 GB, 1.79 GB, 2.04 GB, 2.24 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.23 GB, 3.48 GB, 3.73 GB, 3.98 GB, 4.23 GB, 4.47 GB, 4.78 GB, 5.48 GB, 6.28 GB, 6.97 GB, 7.77 GB, 8.58 GB, 9.32 GB, 10.01 GB, 10.56 GB, 11.09 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12144494656) - PrepareTime: 146.801ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 26s739ms - TotalNetworkSendTime: 334.663us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 473.464ms, non-child: 473.464ms, % non-child: 100.00%) - CodegenTime: 151.145us - CompileTime: 50.121ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 279.249ms - PrepareTime: 143.117ms DataStreamSender (dst_id=6):(Total: 92.061us, non-child: 92.061us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 257.71 KB/sec - OverallThroughput: 169.72 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.401us - TransmitDataRPCTime: 60.631us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 920.921ms, % non-child: 0.94%) ExecOption: Codegen Enabled - BuildTime: 495.970ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.47 KB (47584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m5s, % non-child: 67.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 15s611ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 14s663ms - GetNewBlockTime: 8.497ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s123ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 6.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.040us EXCHANGE_NODE (id=5):(Total: 26s159ms, non-child: 9s554ms, % non-child: 36.52%) BytesReceived(2s000ms): 171.70 KB, 171.70 KB, 56.33 MB, 191.04 MB, 326.33 MB, 450.49 MB, 581.16 MB, 727.26 MB, 867.20 MB, 1008.39 MB, 1.11 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.66 GB, 1.79 GB, 1.92 GB, 2.07 GB, 2.20 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671857794) - ConvertRowBatchTime: 3s040ms - DeserializeRowBatchTimer: 12s816ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 4.59 M/sec - SendersBlockedTimer: 380.750ms - SendersBlockedTotalTimer(*): 3s668ms EXCHANGE_NODE (id=4):(Total: 6s305ms, non-child: 2s751ms, % non-child: 43.63%) BytesReceived(2s000ms): 128.23 KB, 170.98 KB, 10.08 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 16.86 MB, 61.27 MB, 111.18 MB, 160.01 MB, 208.18 MB, 256.47 MB, 301.28 MB, 345.01 MB, 389.65 MB, 435.63 MB, 481.97 MB, 528.62 MB, 576.19 MB, 624.24 MB, 671.13 MB, 717.37 MB, 763.47 MB, 808.03 MB - BytesReceived: 822.74 MB (862703953) - ConvertRowBatchTime: 2s201ms - DeserializeRowBatchTimer: 2s336ms - FirstBatchArrivalWaitTime: 508.597ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 19.03 M/sec - SendersBlockedTimer: 56s770ms - SendersBlockedTotalTimer(*): 10m23s Instance fc4196b242ff8416:aac7ad511f2ba4b6 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.78 MB, 2.50 MB, 158.68 MB, 424.03 MB, 616.02 MB, 872.03 MB, 1.08 GB, 1.33 GB, 1.57 GB, 1.83 GB, 2.04 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.26 GB, 3.48 GB, 3.78 GB, 3.98 GB, 4.23 GB, 4.48 GB, 4.86 GB, 5.67 GB, 6.49 GB, 7.12 GB, 7.69 GB, 8.36 GB, 8.92 GB, 9.60 GB, 10.16 GB, 10.84 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996737536) - PerHostPeakMemUsage: 11.31 GB (12144692256) - PrepareTime: 144.862ms - RowsProduced: 1 (1) - TotalCpuTime: 2m18s - TotalNetworkReceiveTime: 22s634ms - TotalNetworkSendTime: 339.351us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 478.954ms, non-child: 478.954ms, % non-child: 100.00%) - CodegenTime: 162.216us - CompileTime: 56.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 281.189ms - PrepareTime: 138.474ms DataStreamSender (dst_id=6):(Total: 60.022us, non-child: 60.022us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 415.27 KB/sec - OverallThroughput: 260.32 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.170us - TransmitDataRPCTime: 37.626us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m38s, non-child: 870.186ms, % non-child: 0.89%) ExecOption: Codegen Enabled - BuildTime: 481.292ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.66 KB (47776) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m37s, non-child: 1m9s, % non-child: 70.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s407ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 14s882ms - GetNewBlockTime: 10.439ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s687ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 6.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.697us EXCHANGE_NODE (id=5):(Total: 23s347ms, non-child: 8s057ms, % non-child: 34.51%) BytesReceived(2s000ms): 115.95 KB, 154.60 KB, 36.73 MB, 167.48 MB, 304.90 MB, 429.93 MB, 558.09 MB, 702.43 MB, 843.80 MB, 985.96 MB, 1.09 GB, 1.22 GB, 1.36 GB, 1.51 GB, 1.64 GB, 1.77 GB, 1.89 GB, 2.04 GB, 2.18 GB, 2.31 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670346937) - ConvertRowBatchTime: 3s528ms - DeserializeRowBatchTimer: 10s249ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 5.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s599ms, non-child: 2s913ms, % non-child: 52.04%) BytesReceived(2s000ms): 71.16 KB, 142.32 KB, 7.62 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 13.02 MB, 53.10 MB, 103.02 MB, 152.09 MB, 200.22 MB, 248.54 MB, 294.00 MB, 337.55 MB, 381.88 MB, 427.81 MB, 474.10 MB, 520.57 MB, 568.00 MB, 615.92 MB, 663.07 MB, 709.33 MB, 755.44 MB, 801.08 MB - BytesReceived: 822.31 MB (862250391) - ConvertRowBatchTime: 2s258ms - DeserializeRowBatchTimer: 2s731ms - FirstBatchArrivalWaitTime: 510.439ms - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 21.42 M/sec - SendersBlockedTimer: 58s005ms - SendersBlockedTotalTimer(*): 14m29s Instance fc4196b242ff8416:aac7ad511f2ba4ad (host=vb0214.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 186.95 MB, 434.79 MB, 680.08 MB, 904.13 MB, 1.10 GB, 1.35 GB, 1.61 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.31 GB, 3.54 GB, 3.81 GB, 4.06 GB, 4.31 GB, 4.51 GB, 4.97 GB, 5.68 GB, 6.42 GB, 7.16 GB, 7.96 GB, 8.77 GB, 9.52 GB, 10.27 GB, 11.00 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11996786688) - PerHostPeakMemUsage: 11.31 GB (12142729352) - PrepareTime: 153.383ms - RowsProduced: 1 (1) - TotalCpuTime: 2m9s - TotalNetworkReceiveTime: 20s689ms - TotalNetworkSendTime: 273.818us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 498.014ms, non-child: 498.014ms, % non-child: 100.00%) - CodegenTime: 174.899us - CompileTime: 53.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 293.882ms - PrepareTime: 148.903ms DataStreamSender (dst_id=6):(Total: 68.463us, non-child: 68.463us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 520.38 KB/sec - OverallThroughput: 228.22 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.844us - TransmitDataRPCTime: 30.026us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m34s, non-child: 861.866ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 480.083ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.56 KB (46656) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m33s, non-child: 1m5s, % non-child: 70.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s856ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 13s832ms - GetNewBlockTime: 8.639ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s479ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 6.42 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.162us EXCHANGE_NODE (id=5):(Total: 17s653ms, non-child: 10s722ms, % non-child: 60.74%) BytesReceived(2s000ms): 60.44 MB, 197.01 MB, 332.02 MB, 456.17 MB, 587.62 MB, 733.47 MB, 873.33 MB, 1014.63 MB, 1.12 GB, 1.25 GB, 1.39 GB, 1.54 GB, 1.67 GB, 1.79 GB, 1.92 GB, 2.07 GB, 2.20 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671927062) - ConvertRowBatchTime: 3s767ms - DeserializeRowBatchTimer: 12s305ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 6.80 M/sec - SendersBlockedTimer: 7s914ms - SendersBlockedTotalTimer(*): 1m12s EXCHANGE_NODE (id=4):(Total: 9s894ms, non-child: 3s438ms, % non-child: 34.75%) BytesReceived(2s000ms): 10.07 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 17.95 MB, 63.39 MB, 113.26 MB, 162.17 MB, 210.36 MB, 258.50 MB, 303.28 MB, 346.96 MB, 391.67 MB, 437.73 MB, 484.04 MB, 530.70 MB, 578.24 MB, 626.16 MB, 672.98 MB, 719.24 MB, 765.38 MB, 809.54 MB - BytesReceived: 822.71 MB (862678230) - ConvertRowBatchTime: 2s501ms - DeserializeRowBatchTimer: 3s849ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 12.13 M/sec - SendersBlockedTimer: 54s905ms - SendersBlockedTotalTimer(*): 9m13s Fragment F01: Instance fc4196b242ff8416:aac7ad511f2ba4c2 (host=vb0206.halxg.cloudera.com:22000):(Total: 42s004ms, non-child: 11s873ms, % non-child: 28.27%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB MemoryUsage(1s000ms): 499.82 MB, 999.59 MB, 999.59 MB, 999.59 MB, 1000.62 MB, 1003.08 MB, 1002.70 MB, 1002.67 MB, 1002.86 MB, 959.32 MB, 864.65 MB, 828.66 MB, 828.90 MB, 828.76 MB, 812.89 MB, 740.87 MB, 664.70 MB, 652.87 MB, 652.81 MB, 624.85 MB, 564.74 MB, 564.80 MB, 484.87 MB, 389.01 MB, 360.66 MB, 301.14 MB, 301.34 MB, 257.16 MB, 608.74 MB, 641.85 MB, 641.93 MB, 614.29 MB, 535.10 MB, 531.39 MB, 503.16 MB, 447.18 MB, 419.10 MB, 395.20 MB, 363.03 MB, 279.43 MB, 223.42 MB, 195.41 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.63 MB (1052381040) - PerHostPeakMemUsage: 4.93 GB (5290398344) - PrepareTime: 140.982ms - RowsProduced: 124.58M (124580591) - TotalCpuTime: 7m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s456ms - TotalStorageWaitTime: 561.820ms CodeGen:(Total: 323.387ms, non-child: 323.387ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.306ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.982ms - PrepareTime: 137.275ms DataStreamSender (dst_id=5):(Total: 28s871ms, non-child: 28s871ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773491260) - NetworkThroughput(*): 286.45 MB/sec - OverallThroughput: 91.61 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 19s594ms - TransmitDataRPCTime: 9s233ms - UncompressedRowBatchSize: 5.11 GB (5482764428) HDFS_SCAN_NODE (id=1):(Total: 935.989ms, non-child: 935.989ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.19% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.38 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 918.77 MB, 1.43 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.61 - BytesRead: 1.47 GB (1576536384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576536384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576536384) - DecompressionTime: 6s967ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008376) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 133.10 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 16.46K (16461) - ScannerThreadsTotalWallClockTime: 6m45s - MaterializeTupleTime(*): 6m37s - ScannerThreadsSysTime: 1s034ms - ScannerThreadsUserTime: 28s944ms - ScannerThreadsVoluntaryContextSwitches: 121.95K (121949) - TotalRawHdfsReadTime(*): 1s071ms - TotalReadThroughput: 35.38 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4be (host=vb0232.halxg.cloudera.com:22000):(Total: 41s948ms, non-child: 10s169ms, % non-child: 24.24%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB MemoryUsage(1s000ms): 999.72 MB, 999.72 MB, 999.72 MB, 999.72 MB, 1001.67 MB, 1002.93 MB, 1003.06 MB, 1002.95 MB, 1002.82 MB, 935.76 MB, 829.11 MB, 828.95 MB, 828.80 MB, 828.94 MB, 784.93 MB, 736.92 MB, 652.87 MB, 652.80 MB, 652.59 MB, 580.83 MB, 564.91 MB, 528.85 MB, 436.96 MB, 389.30 MB, 321.10 MB, 301.10 MB, 301.11 MB, 324.30 MB, 641.79 MB, 641.96 MB, 641.95 MB, 602.53 MB, 531.09 MB, 531.21 MB, 499.12 MB, 435.15 MB, 419.23 MB, 391.21 MB, 355.23 MB, 267.19 MB, 215.34 MB, 171.28 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258408) - PerHostPeakMemUsage: 4.87 GB (5226996808) - PrepareTime: 141.275ms - RowsProduced: 124.58M (124581482) - TotalCpuTime: 7m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s631ms - TotalStorageWaitTime: 506.549ms CodeGen:(Total: 324.047ms, non-child: 324.047ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.178ms - PrepareTime: 137.459ms DataStreamSender (dst_id=5):(Total: 30s619ms, non-child: 30s619ms, % non-child: 100.00%) - BytesSent: 2.59 GB (2776827423) - NetworkThroughput(*): 243.33 MB/sec - OverallThroughput: 86.49 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 19s691ms - TransmitDataRPCTime: 10s882ms - UncompressedRowBatchSize: 5.11 GB (5482803644) HDFS_SCAN_NODE (id=1):(Total: 834.957ms, non-child: 834.957ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.19% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.02 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 1.47 GB (1576537578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537578) - DecompressionTime: 6s069ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 149.21 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.38K (14384) - ScannerThreadsTotalWallClockTime: 6m44s - MaterializeTupleTime(*): 6m37s - ScannerThreadsSysTime: 859.865ms - ScannerThreadsUserTime: 25s016ms - ScannerThreadsVoluntaryContextSwitches: 121.84K (121844) - TotalRawHdfsReadTime(*): 926.583ms - TotalReadThroughput: 35.80 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c1 (host=vb0234.halxg.cloudera.com:22000):(Total: 41s748ms, non-child: 10s149ms, % non-child: 24.31%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB MemoryUsage(1s000ms): 499.78 MB, 999.56 MB, 999.56 MB, 999.56 MB, 1000.46 MB, 1002.73 MB, 1002.66 MB, 1002.86 MB, 1003.02 MB, 959.35 MB, 872.55 MB, 828.72 MB, 829.02 MB, 828.93 MB, 816.85 MB, 740.89 MB, 653.11 MB, 652.88 MB, 652.74 MB, 608.82 MB, 565.09 MB, 564.81 MB, 476.83 MB, 389.14 MB, 345.12 MB, 301.17 MB, 301.08 MB, 253.14 MB, 641.48 MB, 641.98 MB, 642.01 MB, 602.52 MB, 531.04 MB, 531.27 MB, 503.17 MB, 427.24 MB, 419.30 MB, 391.26 MB, 359.07 MB, 275.33 MB, 223.06 MB, 194.99 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052323600) - PerHostPeakMemUsage: 4.87 GB (5226834944) - PrepareTime: 143.479ms - RowsProduced: 124.58M (124581192) - TotalCpuTime: 7m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s579ms - TotalStorageWaitTime: 540.920ms CodeGen:(Total: 327.988ms, non-child: 327.988ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.554ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.919ms - PrepareTime: 141.304ms DataStreamSender (dst_id=5):(Total: 30s429ms, non-child: 30s429ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773562561) - NetworkThroughput(*): 243.83 MB/sec - OverallThroughput: 86.93 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 19s536ms - TransmitDataRPCTime: 10s847ms - UncompressedRowBatchSize: 5.11 GB (5482790876) HDFS_SCAN_NODE (id=1):(Total: 842.114ms, non-child: 842.114ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.18 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.60 - BytesRead: 1.47 GB (1576528335) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576528335) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576528335) - DecompressionTime: 6s218ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942568) - PerReadThreadRawHdfsThroughput: 1.53 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 147.94 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.51K (14514) - ScannerThreadsTotalWallClockTime: 6m42s - MaterializeTupleTime(*): 6m35s - ScannerThreadsSysTime: 838.869ms - ScannerThreadsUserTime: 25s669ms - ScannerThreadsVoluntaryContextSwitches: 121.87K (121873) - TotalRawHdfsReadTime(*): 958.273ms - TotalReadThroughput: 35.80 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4bb (host=vb0204.halxg.cloudera.com:22000):(Total: 41s615ms, non-child: 10s092ms, % non-child: 24.25%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB MemoryUsage(1s000ms): 499.67 MB, 999.34 MB, 999.34 MB, 999.34 MB, 1000.64 MB, 1002.86 MB, 1002.68 MB, 1002.59 MB, 1003.11 MB, 959.48 MB, 868.59 MB, 828.78 MB, 828.74 MB, 828.76 MB, 785.18 MB, 736.87 MB, 652.85 MB, 653.08 MB, 652.92 MB, 564.90 MB, 564.82 MB, 521.02 MB, 432.95 MB, 388.86 MB, 333.14 MB, 301.12 MB, 301.02 MB, 213.15 MB, 641.78 MB, 641.89 MB, 641.89 MB, 562.93 MB, 531.14 MB, 530.99 MB, 499.14 MB, 439.10 MB, 419.27 MB, 391.21 MB, 355.12 MB, 267.30 MB, 215.39 MB, 179.34 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.64 MB (1052397336) - PerHostPeakMemUsage: 4.87 GB (5227196520) - PrepareTime: 140.211ms - RowsProduced: 124.58M (124581324) - TotalCpuTime: 7m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s438ms - TotalStorageWaitTime: 554.657ms CodeGen:(Total: 320.187ms, non-child: 320.187ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.262ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 178.614ms - PrepareTime: 137.065ms DataStreamSender (dst_id=5):(Total: 30s348ms, non-child: 30s348ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772257713) - NetworkThroughput(*): 246.66 MB/sec - OverallThroughput: 87.11 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 19s585ms - TransmitDataRPCTime: 10s718ms - UncompressedRowBatchSize: 5.11 GB (5482796692) HDFS_SCAN_NODE (id=1):(Total: 854.070ms, non-child: 854.070ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.18 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.65 - BytesRead: 1.47 GB (1576541342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576541342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576541342) - DecompressionTime: 6s041ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008288) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 145.87 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.04K (13041) - ScannerThreadsTotalWallClockTime: 6m41s - MaterializeTupleTime(*): 6m34s - ScannerThreadsSysTime: 896.857ms - ScannerThreadsUserTime: 24s648ms - ScannerThreadsVoluntaryContextSwitches: 121.92K (121921) - TotalRawHdfsReadTime(*): 1s066ms - TotalReadThroughput: 36.23 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c6 (host=vb0224.halxg.cloudera.com:22000):(Total: 41s449ms, non-child: 13s208ms, % non-child: 31.87%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 495.73 MB, 991.40 MB, 991.40 MB, 991.40 MB, 992.42 MB, 994.81 MB, 994.79 MB, 994.67 MB, 994.96 MB, 951.42 MB, 848.60 MB, 820.79 MB, 820.86 MB, 820.98 MB, 780.85 MB, 728.88 MB, 645.06 MB, 644.72 MB, 644.96 MB, 585.04 MB, 556.94 MB, 533.08 MB, 428.83 MB, 381.11 MB, 316.90 MB, 328.83 MB, 356.77 MB, 400.48 MB, 641.82 MB, 637.95 MB, 622.12 MB, 555.11 MB, 531.27 MB, 519.13 MB, 467.00 MB, 419.17 MB, 411.34 MB, 371.28 MB, 327.09 MB, 247.20 MB, 199.20 MB, 144.82 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.49 MB (1043844952) - PerHostPeakMemUsage: 4.84 GB (5199779728) - PrepareTime: 141.753ms - RowsProduced: 123.88M (123876716) - TotalCpuTime: 7m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s508ms - TotalStorageWaitTime: 481.191ms CodeGen:(Total: 325.614ms, non-child: 325.614ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.379ms - PrepareTime: 139.554ms DataStreamSender (dst_id=5):(Total: 26s925ms, non-child: 26s925ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2757092112) - NetworkThroughput(*): 341.88 MB/sec - OverallThroughput: 97.66 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 19s186ms - TransmitDataRPCTime: 7s690ms - UncompressedRowBatchSize: 5.08 GB (5451787044) HDFS_SCAN_NODE (id=1):(Total: 989.757ms, non-child: 989.757ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.8% 1:0% 2:1.205% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 455.16 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 910.32 MB, 952.10 MB, 993.87 MB, 1.10 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.63 - BytesRead: 1.46 GB (1567668714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567668714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567668714) - DecompressionTime: 8s016ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.09 MB (1043423272) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 125.16 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.35K (17350) - ScannerThreadsTotalWallClockTime: 6m39s - MaterializeTupleTime(*): 6m30s - ScannerThreadsSysTime: 1s138ms - ScannerThreadsUserTime: 33s861ms - ScannerThreadsVoluntaryContextSwitches: 121.18K (121178) - TotalRawHdfsReadTime(*): 914.687ms - TotalReadThroughput: 35.60 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4b9 (host=vb0208.halxg.cloudera.com:22000):(Total: 41s326ms, non-child: 14s115ms, % non-child: 34.16%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB MemoryUsage(1s000ms): 543.96 MB, 894.02 MB, 894.02 MB, 894.02 MB, 895.09 MB, 981.29 MB, 981.50 MB, 981.38 MB, 981.43 MB, 922.30 MB, 811.14 MB, 807.49 MB, 807.28 MB, 807.20 MB, 767.43 MB, 711.43 MB, 635.23 MB, 631.27 MB, 631.29 MB, 575.21 MB, 543.36 MB, 519.53 MB, 500.68 MB, 444.99 MB, 388.86 MB, 364.65 MB, 360.85 MB, 316.14 MB, 628.18 MB, 618.11 MB, 614.01 MB, 582.66 MB, 507.02 MB, 503.08 MB, 475.08 MB, 415.26 MB, 387.17 MB, 359.20 MB, 327.35 MB, 232.84 MB, 156.71 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 982.11 MB (1029820272) - PerHostPeakMemUsage: 4.81 GB (5165741632) - PrepareTime: 144.685ms - RowsProduced: 122.21M (122205738) - TotalCpuTime: 7m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s249ms - TotalStorageWaitTime: 486.996ms CodeGen:(Total: 329.072ms, non-child: 329.072ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.782ms - PrepareTime: 141.615ms DataStreamSender (dst_id=5):(Total: 25s820ms, non-child: 25s820ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2720745290) - NetworkThroughput(*): 387.43 MB/sec - OverallThroughput: 100.49 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 19s073ms - TransmitDataRPCTime: 6s697ms - UncompressedRowBatchSize: 5.01 GB (5378247676) HDFS_SCAN_NODE (id=1):(Total: 1s061ms, non-child: 1s061ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:97.59% 1:0% 2:1.205% 3:0% 4:0% 5:1.205% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 485.79 MB, 816.17 MB, 816.17 MB, 816.17 MB, 816.17 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 899.71 MB, 983.22 MB, 983.22 MB, 983.22 MB, 983.22 MB, 983.22 MB, 1017.38 MB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 9.64 - BytesRead: 1.44 GB (1547015523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1547015523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1547015523) - DecompressionTime: 8s398ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 981.71 MB (1029398536) - PerReadThreadRawHdfsThroughput: 1.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 115.14 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 19.41K (19411) - ScannerThreadsTotalWallClockTime: 6m38s - MaterializeTupleTime(*): 6m28s - ScannerThreadsSysTime: 1s237ms - ScannerThreadsUserTime: 35s408ms - ScannerThreadsVoluntaryContextSwitches: 119.56K (119565) - TotalRawHdfsReadTime(*): 872.160ms - TotalReadThroughput: 35.55 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c7 (host=vb0222.halxg.cloudera.com:22000):(Total: 41s138ms, non-child: 11s207ms, % non-child: 27.24%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB MemoryUsage(1s000ms): 491.13 MB, 982.21 MB, 982.21 MB, 982.21 MB, 983.04 MB, 985.33 MB, 985.60 MB, 985.26 MB, 985.25 MB, 898.68 MB, 811.50 MB, 811.30 MB, 811.44 MB, 811.42 MB, 767.24 MB, 711.68 MB, 635.48 MB, 635.26 MB, 635.41 MB, 547.48 MB, 547.44 MB, 503.46 MB, 403.48 MB, 444.88 MB, 368.70 MB, 365.13 MB, 365.07 MB, 453.12 MB, 625.95 MB, 626.09 MB, 626.01 MB, 546.79 MB, 515.19 MB, 515.13 MB, 459.06 MB, 407.10 MB, 395.21 MB, 339.27 MB, 315.20 MB, 226.17 MB, 168.79 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 986.06 MB (1033957312) - PerHostPeakMemUsage: 4.84 GB (5199285896) - PrepareTime: 146.007ms - RowsProduced: 123.30M (123304062) - TotalCpuTime: 7m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s443ms - TotalStorageWaitTime: 521.018ms CodeGen:(Total: 330.799ms, non-child: 330.799ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.236ms - PrepareTime: 142.574ms DataStreamSender (dst_id=5):(Total: 28s714ms, non-child: 28s714ms, % non-child: 100.00%) - BytesSent: 2.56 GB (2745208660) - NetworkThroughput(*): 277.52 MB/sec - OverallThroughput: 91.18 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 19s239ms - TransmitDataRPCTime: 9s433ms - UncompressedRowBatchSize: 5.05 GB (5426584668) HDFS_SCAN_NODE (id=1):(Total: 886.640ms, non-child: 886.640ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Hdfs Read Thread Concurrency Bucket: 0:98.78% 1:1.22% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 450.57 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 901.15 MB, 984.67 MB, 984.67 MB, 984.67 MB, 984.67 MB, 1.17 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.63 - BytesRead: 1.45 GB (1560799796) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.45 GB (1560799796) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.45 GB (1560799796) - DecompressionTime: 6s606ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 985.66 MB (1033535488) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 139.07 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 14.57K (14570) - ScannerThreadsTotalWallClockTime: 6m36s - MaterializeTupleTime(*): 6m28s - ScannerThreadsSysTime: 933.853ms - ScannerThreadsUserTime: 27s413ms - ScannerThreadsVoluntaryContextSwitches: 120.65K (120648) - TotalRawHdfsReadTime(*): 987.450ms - TotalReadThroughput: 35.87 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4ba (host=vb0230.halxg.cloudera.com:22000):(Total: 40s665ms, non-child: 14s161ms, % non-child: 34.82%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 499.96 MB, 999.87 MB, 999.87 MB, 999.87 MB, 1000.62 MB, 1003.14 MB, 1002.84 MB, 1002.90 MB, 1002.63 MB, 959.41 MB, 864.51 MB, 828.81 MB, 828.72 MB, 828.95 MB, 793.06 MB, 740.65 MB, 660.73 MB, 652.88 MB, 652.78 MB, 624.91 MB, 564.95 MB, 564.77 MB, 485.01 MB, 396.96 MB, 357.00 MB, 301.24 MB, 301.10 MB, 265.40 MB, 447.11 MB, 551.58 MB, 551.72 MB, 524.02 MB, 456.70 MB, 456.77 MB, 412.52 MB, 360.84 MB, 356.77 MB, 312.82 MB, 236.91 MB, 188.79 MB, 164.88 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.52 MB (1052266336) - PerHostPeakMemUsage: 4.72 GB (5065207408) - PrepareTime: 148.460ms - RowsProduced: 117.66M (117659846) - TotalCpuTime: 6m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s365ms - TotalStorageWaitTime: 573.989ms CodeGen:(Total: 333.349ms, non-child: 333.349ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.499ms - PrepareTime: 146.282ms DataStreamSender (dst_id=5):(Total: 25s098ms, non-child: 25s098ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619409706) - NetworkThroughput(*): 385.26 MB/sec - OverallThroughput: 99.53 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 18s563ms - TransmitDataRPCTime: 6s484ms - UncompressedRowBatchSize: 4.82 GB (5178183964) HDFS_SCAN_NODE (id=1):(Total: 1s072ms, non-child: 1s072ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.77% 1:0% 2:0% 3:1.235% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.42 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 1.24 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488963118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488963118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488963118) - DecompressionTime: 8s067ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877288) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 109.70 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 18.00K (18002) - ScannerThreadsTotalWallClockTime: 6m24s - MaterializeTupleTime(*): 6m15s - ScannerThreadsSysTime: 1s100ms - ScannerThreadsUserTime: 34s042ms - ScannerThreadsVoluntaryContextSwitches: 115.26K (115257) - TotalRawHdfsReadTime(*): 979.490ms - TotalReadThroughput: 34.63 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c5 (host=vb0218.halxg.cloudera.com:22000):(Total: 40s524ms, non-child: 12s613ms, % non-child: 31.13%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB MemoryUsage(1s000ms): 499.73 MB, 999.41 MB, 999.41 MB, 999.41 MB, 1000.59 MB, 1002.93 MB, 1002.87 MB, 1002.84 MB, 1002.96 MB, 959.50 MB, 872.70 MB, 829.00 MB, 828.89 MB, 828.77 MB, 796.92 MB, 740.75 MB, 660.89 MB, 652.96 MB, 653.02 MB, 612.96 MB, 564.98 MB, 565.02 MB, 500.89 MB, 393.10 MB, 389.14 MB, 301.25 MB, 301.15 MB, 273.16 MB, 373.97 MB, 551.71 MB, 551.54 MB, 527.97 MB, 456.84 MB, 456.70 MB, 384.71 MB, 360.79 MB, 336.75 MB, 308.75 MB, 232.93 MB, 184.90 MB, 144.85 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.50 MB (1052242016) - PerHostPeakMemUsage: 4.72 GB (5065043840) - PrepareTime: 142.299ms - RowsProduced: 117.66M (117659888) - TotalCpuTime: 6m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s359ms - TotalStorageWaitTime: 462.464ms CodeGen:(Total: 324.066ms, non-child: 324.066ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.570ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.438ms - PrepareTime: 138.002ms DataStreamSender (dst_id=5):(Total: 26s615ms, non-child: 26s615ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619175379) - NetworkThroughput(*): 319.15 MB/sec - OverallThroughput: 93.85 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 18s745ms - TransmitDataRPCTime: 7s826ms - UncompressedRowBatchSize: 4.82 GB (5178185812) HDFS_SCAN_NODE (id=1):(Total: 970.720ms, non-child: 970.720ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.14 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488962094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488962094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488962094) - DecompressionTime: 7s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.13 MB (1051860984) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 121.21 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.08K (16082) - ScannerThreadsTotalWallClockTime: 6m24s - MaterializeTupleTime(*): 6m16s - ScannerThreadsSysTime: 1s048ms - ScannerThreadsUserTime: 29s776ms - ScannerThreadsVoluntaryContextSwitches: 115.21K (115208) - TotalRawHdfsReadTime(*): 837.140ms - TotalReadThroughput: 34.63 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4bf (host=vb0226.halxg.cloudera.com:22000):(Total: 40s472ms, non-child: 11s178ms, % non-child: 27.62%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB MemoryUsage(1s000ms): 869.21 MB, 999.21 MB, 999.21 MB, 999.21 MB, 1000.90 MB, 1002.80 MB, 1003.03 MB, 1002.75 MB, 1002.63 MB, 959.48 MB, 828.75 MB, 828.96 MB, 828.80 MB, 828.72 MB, 784.71 MB, 712.95 MB, 653.02 MB, 653.15 MB, 652.64 MB, 589.04 MB, 564.74 MB, 532.88 MB, 432.97 MB, 388.83 MB, 337.16 MB, 300.92 MB, 300.90 MB, 224.65 MB, 551.45 MB, 551.59 MB, 551.65 MB, 472.41 MB, 456.71 MB, 432.74 MB, 384.91 MB, 360.79 MB, 312.74 MB, 288.79 MB, 216.94 MB, 168.80 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.64 MB (1052397512) - PerHostPeakMemUsage: 4.72 GB (5065247464) - PrepareTime: 142.595ms - RowsProduced: 117.66M (117660001) - TotalCpuTime: 6m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s286ms - TotalStorageWaitTime: 580.763ms CodeGen:(Total: 324.951ms, non-child: 324.951ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.123ms - PrepareTime: 138.795ms DataStreamSender (dst_id=5):(Total: 28s131ms, non-child: 28s131ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2620406608) - NetworkThroughput(*): 258.46 MB/sec - OverallThroughput: 88.83 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 18s420ms - TransmitDataRPCTime: 9s668ms - UncompressedRowBatchSize: 4.82 GB (5178190780) HDFS_SCAN_NODE (id=1):(Total: 837.749ms, non-child: 837.749ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:98.77% 1:0% 2:0% 3:1.235% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 784.91 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488950230) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488950230) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488950230) - DecompressionTime: 6s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942920) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 140.45 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.26K (13260) - ScannerThreadsTotalWallClockTime: 6m21s - MaterializeTupleTime(*): 6m14s - ScannerThreadsSysTime: 779.875ms - ScannerThreadsUserTime: 25s526ms - ScannerThreadsVoluntaryContextSwitches: 115.06K (115065) - TotalRawHdfsReadTime(*): 879.606ms - TotalReadThroughput: 35.06 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c0 (host=vb0216.halxg.cloudera.com:22000):(Total: 40s057ms, non-child: 12s113ms, % non-child: 30.24%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB MemoryUsage(1s000ms): 499.59 MB, 999.18 MB, 999.18 MB, 999.18 MB, 1000.56 MB, 1002.08 MB, 1002.91 MB, 1002.98 MB, 1002.72 MB, 998.62 MB, 872.50 MB, 828.67 MB, 828.98 MB, 828.55 MB, 828.87 MB, 740.79 MB, 688.73 MB, 653.03 MB, 652.65 MB, 617.00 MB, 565.01 MB, 564.89 MB, 476.81 MB, 389.07 MB, 353.16 MB, 301.01 MB, 301.39 MB, 257.33 MB, 579.54 MB, 551.68 MB, 551.63 MB, 480.51 MB, 456.79 MB, 448.69 MB, 384.82 MB, 360.83 MB, 324.73 MB, 292.80 MB, 208.74 MB, 168.95 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299200) - PerHostPeakMemUsage: 4.70 GB (5048045184) - PrepareTime: 140.714ms - RowsProduced: 117.66M (117659985) - TotalCpuTime: 6m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s527ms - TotalStorageWaitTime: 439.400ms CodeGen:(Total: 322.943ms, non-child: 322.943ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.654ms - PrepareTime: 138.571ms DataStreamSender (dst_id=5):(Total: 26s703ms, non-child: 26s703ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2620339193) - NetworkThroughput(*): 304.59 MB/sec - OverallThroughput: 93.58 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 18s457ms - TransmitDataRPCTime: 8s204ms - UncompressedRowBatchSize: 4.82 GB (5178190084) HDFS_SCAN_NODE (id=1):(Total: 917.707ms, non-child: 917.707ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.14 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 1.39 GB (1488939222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488939222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488939222) - DecompressionTime: 7s155ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 128.21 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 15.45K (15452) - ScannerThreadsTotalWallClockTime: 6m18s - MaterializeTupleTime(*): 6m10s - ScannerThreadsSysTime: 995.843ms - ScannerThreadsUserTime: 29s945ms - ScannerThreadsVoluntaryContextSwitches: 115.07K (115072) - TotalRawHdfsReadTime(*): 1s017ms - TotalReadThroughput: 35.50 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c3 (host=vb0228.halxg.cloudera.com:22000):(Total: 39s750ms, non-child: 13s433ms, % non-child: 33.80%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB MemoryUsage(1s000ms): 456.85 MB, 913.64 MB, 913.64 MB, 913.64 MB, 914.98 MB, 982.63 MB, 982.84 MB, 982.77 MB, 982.70 MB, 935.49 MB, 832.75 MB, 808.93 MB, 808.82 MB, 808.95 MB, 768.91 MB, 708.81 MB, 636.83 MB, 632.84 MB, 632.74 MB, 572.78 MB, 544.73 MB, 512.88 MB, 412.83 MB, 444.79 MB, 385.03 MB, 364.78 MB, 356.70 MB, 388.06 MB, 535.83 MB, 535.71 MB, 512.09 MB, 444.69 MB, 440.86 MB, 416.73 MB, 348.90 MB, 332.70 MB, 288.82 MB, 236.82 MB, 158.41 MB, 138.42 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 984.19 MB (1031993080) - PerHostPeakMemUsage: 4.63 GB (4976413840) - PrepareTime: 141.215ms - RowsProduced: 116.10M (116100730) - TotalCpuTime: 6m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s362ms - TotalStorageWaitTime: 487.577ms CodeGen:(Total: 322.697ms, non-child: 322.697ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.487ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.924ms - PrepareTime: 139.156ms DataStreamSender (dst_id=5):(Total: 25s004ms, non-child: 25s004ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2585914114) - NetworkThroughput(*): 364.55 MB/sec - OverallThroughput: 98.63 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 18s196ms - TransmitDataRPCTime: 6s764ms - UncompressedRowBatchSize: 4.76 GB (5109567616) HDFS_SCAN_NODE (id=1):(Total: 989.181ms, non-child: 989.181ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Hdfs Read Thread Concurrency Bucket: 0:98.73% 1:1.266% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 418.62 MB, 837.23 MB, 837.23 MB, 837.23 MB, 837.23 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 900.45 MB, 983.99 MB, 983.99 MB, 983.99 MB, 983.99 MB, 1.09 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.43 - BytesRead: 1.37 GB (1469705850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469705850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469705850) - DecompressionTime: 7s493ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 983.83 MB (1031620416) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 117.37 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 16.89K (16892) - ScannerThreadsTotalWallClockTime: 6m14s - MaterializeTupleTime(*): 6m6s - ScannerThreadsSysTime: 1s104ms - ScannerThreadsUserTime: 31s365ms - ScannerThreadsVoluntaryContextSwitches: 113.72K (113723) - TotalRawHdfsReadTime(*): 813.987ms - TotalReadThroughput: 35.04 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4bd (host=vb0212.halxg.cloudera.com:22000):(Total: 38s593ms, non-child: 13s811ms, % non-child: 35.79%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB MemoryUsage(1s000ms): 703.78 MB, 999.32 MB, 999.32 MB, 999.32 MB, 1000.79 MB, 1002.97 MB, 1003.05 MB, 1002.73 MB, 1002.79 MB, 947.54 MB, 844.58 MB, 828.95 MB, 828.87 MB, 828.89 MB, 796.79 MB, 740.77 MB, 652.83 MB, 652.86 MB, 652.66 MB, 612.90 MB, 564.88 MB, 560.94 MB, 456.76 MB, 389.04 MB, 341.20 MB, 300.90 MB, 301.05 MB, 272.84 MB, 462.11 MB, 461.46 MB, 437.71 MB, 382.38 MB, 378.33 MB, 322.36 MB, 302.39 MB, 262.39 MB, 198.46 MB, 142.37 MB, 122.37 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052323864) - PerHostPeakMemUsage: 4.50 GB (4827008960) - PrepareTime: 142.797ms - RowsProduced: 110.74M (110738660) - TotalCpuTime: 6m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s163ms - TotalStorageWaitTime: 475.207ms CodeGen:(Total: 325.015ms, non-child: 325.015ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.194ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.917ms - PrepareTime: 140.690ms DataStreamSender (dst_id=5):(Total: 23s422ms, non-child: 23s422ms, % non-child: 100.00%) - BytesSent: 2.30 GB (2465243162) - NetworkThroughput(*): 395.06 MB/sec - OverallThroughput: 100.38 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 17s424ms - TransmitDataRPCTime: 5s951ms - UncompressedRowBatchSize: 4.54 GB (4873584088) HDFS_SCAN_NODE (id=1):(Total: 1s035ms, non-child: 1s035ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.72% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.282% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 613.93 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 960.56 MB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.31 GB (1401382482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401382482) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401382482) - DecompressionTime: 7s888ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051943008) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 106.98 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 18.33K (18326) - ScannerThreadsTotalWallClockTime: 6m - MaterializeTupleTime(*): 5m51s - ScannerThreadsSysTime: 1s110ms - ScannerThreadsUserTime: 33s161ms - ScannerThreadsVoluntaryContextSwitches: 108.35K (108348) - TotalRawHdfsReadTime(*): 880.334ms - TotalReadThroughput: 34.27 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4bc (host=vb0214.halxg.cloudera.com:22000):(Total: 37s646ms, non-child: 5s918ms, % non-child: 15.72%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB MemoryUsage(1s000ms): 1000.98 MB, 1002.73 MB, 1002.97 MB, 1002.79 MB, 1002.89 MB, 916.06 MB, 828.93 MB, 828.63 MB, 828.96 MB, 828.64 MB, 776.85 MB, 708.81 MB, 652.84 MB, 652.99 MB, 652.83 MB, 588.68 MB, 564.79 MB, 529.03 MB, 432.79 MB, 388.88 MB, 325.02 MB, 301.12 MB, 301.09 MB, 216.90 MB, 633.66 MB, 633.72 MB, 633.82 MB, 566.85 MB, 523.32 MB, 523.31 MB, 467.47 MB, 411.31 MB, 411.04 MB, 375.11 MB, 327.18 MB, 243.20 MB, 187.31 MB, 135.79 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 10.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.61 MB (1052356376) - PerHostPeakMemUsage: 4.86 GB (5216735856) - PrepareTime: 147.658ms - RowsProduced: 124.06M (124059923) - TotalCpuTime: 6m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s373ms - TotalStorageWaitTime: 604.716ms CodeGen:(Total: 333.565ms, non-child: 333.565ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.515ms - PrepareTime: 145.436ms DataStreamSender (dst_id=5):(Total: 30s525ms, non-child: 30s525ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2762574839) - NetworkThroughput(*): 238.16 MB/sec - OverallThroughput: 86.31 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 19s417ms - TransmitDataRPCTime: 11s062ms - UncompressedRowBatchSize: 5.08 GB (5459849940) HDFS_SCAN_NODE (id=1):(Total: 869.344ms, non-child: 869.344ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 1.46 GB (1569927832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1569927832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1569927832) - DecompressionTime: 6s202ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008288) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 142.71 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.03K (14032) - ScannerThreadsTotalWallClockTime: 5m58s - MaterializeTupleTime(*): 5m50s - ScannerThreadsSysTime: 834.868ms - ScannerThreadsUserTime: 25s544ms - ScannerThreadsVoluntaryContextSwitches: 121.37K (121373) - TotalRawHdfsReadTime(*): 1s025ms - TotalReadThroughput: 39.40 MB/sec Instance fc4196b242ff8416:aac7ad511f2ba4c4 (host=vb0220.halxg.cloudera.com:22000):(Total: 36s842ms, non-child: 10s958ms, % non-child: 29.74%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB MemoryUsage(1s000ms): 499.96 MB, 999.92 MB, 999.92 MB, 999.92 MB, 1000.54 MB, 1002.63 MB, 1002.68 MB, 1002.99 MB, 1002.99 MB, 959.50 MB, 860.64 MB, 828.77 MB, 828.86 MB, 828.72 MB, 784.68 MB, 728.96 MB, 652.88 MB, 652.82 MB, 648.87 MB, 564.80 MB, 564.69 MB, 476.90 MB, 389.03 MB, 373.08 MB, 301.23 MB, 300.93 MB, 252.93 MB, 460.67 MB, 461.47 MB, 402.19 MB, 382.35 MB, 362.14 MB, 302.24 MB, 282.29 MB, 230.50 MB, 162.51 MB, 142.38 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.61 MB (1052364744) - PerHostPeakMemUsage: 4.29 GB (4601402288) - PrepareTime: 141.444ms - RowsProduced: 110.74M (110738953) - TotalCpuTime: 6m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s979ms - TotalStorageWaitTime: 595.588ms CodeGen:(Total: 321.266ms, non-child: 321.266ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 178.340ms - PrepareTime: 139.478ms DataStreamSender (dst_id=5):(Total: 24s801ms, non-child: 24s801ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2463972263) - NetworkThroughput(*): 278.27 MB/sec - OverallThroughput: 94.75 MB/sec - PeakMemoryUsage: 467.93 KB (479160) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 16s319ms - TransmitDataRPCTime: 8s444ms - UncompressedRowBatchSize: 4.54 GB (4873596984) HDFS_SCAN_NODE (id=1):(Total: 761.451ms, non-child: 761.451ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 1.10 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.28 - BytesRead: 1.31 GB (1401416952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401416952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401416952) - DecompressionTime: 4s972ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008464) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 145.43 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.30K (10303) - ScannerThreadsTotalWallClockTime: 5m44s - MaterializeTupleTime(*): 5m38s - ScannerThreadsSysTime: 645.896ms - ScannerThreadsUserTime: 20s551ms - ScannerThreadsVoluntaryContextSwitches: 108.28K (108283) - TotalRawHdfsReadTime(*): 886.541ms - TotalReadThroughput: 36.12 MB/sec Fragment F00: Instance fc4196b242ff8416:aac7ad511f2ba4d1 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 1m21s, % non-child: 83.49%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Filter 0 arrival: 42s463ms MemoryUsage(2s000ms): 70.12 MB, 140.12 MB, 140.17 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.46 MB, 141.15 MB, 141.09 MB, 141.04 MB, 141.06 MB, 141.08 MB, 141.11 MB, 141.15 MB, 119.17 MB, 53.34 MB, 53.40 MB, 72.14 MB, 91.49 MB, 91.53 MB, 91.55 MB, 91.52 MB, 91.53 MB, 35.70 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.31 GB (12144825040) - PrepareTime: 307.955us - RowsProduced: 124.58M (124580591) - TotalCpuTime: 17m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 210.946ms DataStreamSender (dst_id=4):(Total: 14s426ms, non-child: 14s426ms, % non-child: 100.00%) - BytesSent: 856.76 MB (898375937) - NetworkThroughput(*): 189.87 MB/sec - OverallThroughput: 59.39 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 9s888ms - TransmitDataRPCTime: 4s512ms - UncompressedRowBatchSize: 2.32 GB (2492098492) HDFS_SCAN_NODE (id=0):(Total: 1s780ms, non-child: 1s780ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.30 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 153.72 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 190.83 MB (200100815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200100815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200100815) - DecompressionTime: 1s366ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 69.97 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.24K (6239) - ScannerThreadsTotalWallClockTime: 16m57s - MaterializeTupleTime(*): 16m55s - ScannerThreadsSysTime: 518.916ms - ScannerThreadsUserTime: 9s095ms - ScannerThreadsVoluntaryContextSwitches: 121.81K (121809) - TotalRawHdfsReadTime(*): 125.534ms - TotalReadThroughput: 1.94 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4ca (host=vb0204.halxg.cloudera.com:22000):(Total: 1m38s, non-child: 1m23s, % non-child: 84.80%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Filter 0 arrival: 42s465ms MemoryUsage(2s000ms): 70.06 MB, 139.99 MB, 140.21 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.29 MB, 140.47 MB, 141.17 MB, 141.03 MB, 141.08 MB, 141.06 MB, 141.19 MB, 141.15 MB, 141.15 MB, 141.19 MB, 53.34 MB, 53.33 MB, 62.69 MB, 91.49 MB, 91.55 MB, 91.48 MB, 91.51 MB, 91.50 MB, 49.66 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12149966600) - PrepareTime: 310.120us - RowsProduced: 124.58M (124581324) - TotalCpuTime: 17m22s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 207.109ms DataStreamSender (dst_id=4):(Total: 13s279ms, non-child: 13s279ms, % non-child: 100.00%) - BytesSent: 857.47 MB (899126319) - NetworkThroughput(*): 191.87 MB/sec - OverallThroughput: 64.57 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 8s789ms - TransmitDataRPCTime: 4s469ms - UncompressedRowBatchSize: 2.32 GB (2492113152) HDFS_SCAN_NODE (id=0):(Total: 1s634ms, non-child: 1s634ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Runtime filters: Only following filters arrived: , waited 1s005ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.30 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 135.16 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 190.83 MB (200096771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200096771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200096771) - DecompressionTime: 1s394ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 76.24 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.57K (5569) - ScannerThreadsTotalWallClockTime: 16m58s - MaterializeTupleTime(*): 16m57s - ScannerThreadsSysTime: 505.917ms - ScannerThreadsUserTime: 9s281ms - ScannerThreadsVoluntaryContextSwitches: 121.91K (121909) - TotalRawHdfsReadTime(*): 129.245ms - TotalReadThroughput: 1.94 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4cd (host=vb0232.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m23s, % non-child: 85.54%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Filter 0 arrival: 42s465ms MemoryUsage(2s000ms): 70.04 MB, 139.96 MB, 140.19 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.15 MB, 140.58 MB, 141.09 MB, 141.10 MB, 141.03 MB, 141.03 MB, 141.24 MB, 141.07 MB, 141.04 MB, 119.18 MB, 53.39 MB, 53.29 MB, 72.14 MB, 91.58 MB, 91.61 MB, 91.44 MB, 91.50 MB, 77.54 MB, 35.61 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285200) - PerHostPeakMemUsage: 11.31 GB (12144699048) - PrepareTime: 315.617us - RowsProduced: 124.58M (124581482) - TotalCpuTime: 17m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 215.153ms DataStreamSender (dst_id=4):(Total: 12s413ms, non-child: 12s413ms, % non-child: 100.00%) - BytesSent: 856.14 MB (897726254) - NetworkThroughput(*): 208.63 MB/sec - OverallThroughput: 68.97 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 8s288ms - TransmitDataRPCTime: 4s103ms - UncompressedRowBatchSize: 2.32 GB (2492116308) HDFS_SCAN_NODE (id=0):(Total: 1s746ms, non-child: 1s746ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s005ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 153.73 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 190.84 MB (200107069) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200107069) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200107069) - DecompressionTime: 1s492ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 71.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.29K (7288) - ScannerThreadsTotalWallClockTime: 16m56s - MaterializeTupleTime(*): 16m54s - ScannerThreadsSysTime: 593.905ms - ScannerThreadsUserTime: 10s027ms - ScannerThreadsVoluntaryContextSwitches: 121.83K (121834) - TotalRawHdfsReadTime(*): 125.725ms - TotalReadThroughput: 1.95 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d0 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m22s, % non-child: 84.25%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Filter 0 arrival: 42s427ms MemoryUsage(2s000ms): 70.00 MB, 139.88 MB, 139.90 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 139.91 MB, 140.25 MB, 141.08 MB, 141.05 MB, 141.00 MB, 141.08 MB, 141.12 MB, 141.09 MB, 141.13 MB, 99.22 MB, 53.35 MB, 53.37 MB, 81.86 MB, 91.57 MB, 91.51 MB, 91.48 MB, 91.50 MB, 77.49 MB, 35.67 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.40 MB (148268808) - PerHostPeakMemUsage: 11.31 GB (12144494656) - PrepareTime: 313.249us - RowsProduced: 124.58M (124581192) - TotalCpuTime: 17m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 217.249ms DataStreamSender (dst_id=4):(Total: 13s807ms, non-child: 13s807ms, % non-child: 100.00%) - BytesSent: 855.13 MB (896669278) - NetworkThroughput(*): 234.94 MB/sec - OverallThroughput: 61.93 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 10s142ms - TransmitDataRPCTime: 3s639ms - UncompressedRowBatchSize: 2.32 GB (2492110512) HDFS_SCAN_NODE (id=0):(Total: 1s576ms, non-child: 1s576ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 172.28 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 190.83 MB (200101820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101820) - DecompressionTime: 1s489ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 79.00 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.71K (5714) - ScannerThreadsTotalWallClockTime: 16m51s - MaterializeTupleTime(*): 16m49s - ScannerThreadsSysTime: 394.936ms - ScannerThreadsUserTime: 9s611ms - ScannerThreadsVoluntaryContextSwitches: 121.79K (121790) - TotalRawHdfsReadTime(*): 127.854ms - TotalReadThroughput: 1.95 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d5 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m22s, % non-child: 84.58%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Filter 0 arrival: 42s463ms MemoryUsage(2s000ms): 70.08 MB, 140.04 MB, 140.43 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.56 MB, 140.66 MB, 141.10 MB, 141.16 MB, 141.18 MB, 141.16 MB, 141.14 MB, 141.12 MB, 141.15 MB, 101.21 MB, 53.40 MB, 53.34 MB, 80.53 MB, 89.48 MB, 89.56 MB, 89.52 MB, 89.50 MB, 75.58 MB, 31.45 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.31 GB (12145176400) - PrepareTime: 627.285us - RowsProduced: 123.88M (123876716) - TotalCpuTime: 17m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 225.170ms DataStreamSender (dst_id=4):(Total: 13s410ms, non-child: 13s410ms, % non-child: 100.00%) - BytesSent: 850.98 MB (892313419) - NetworkThroughput(*): 215.99 MB/sec - OverallThroughput: 63.46 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 9s446ms - TransmitDataRPCTime: 3s939ms - UncompressedRowBatchSize: 2.31 GB (2478018236) HDFS_SCAN_NODE (id=0):(Total: 1s640ms, non-child: 1s640ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:99.49% 1:0.5102% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.32 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 163.84 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 189.79 MB (199012872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.79 MB (199012872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.79 MB (199012872) - DecompressionTime: 1s477ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 75.52 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.31K (6313) - ScannerThreadsTotalWallClockTime: 16m51s - MaterializeTupleTime(*): 16m49s - ScannerThreadsSysTime: 516.914ms - ScannerThreadsUserTime: 10s165ms - ScannerThreadsVoluntaryContextSwitches: 121.04K (121041) - TotalRawHdfsReadTime(*): 133.393ms - TotalReadThroughput: 1.94 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4cf (host=vb0216.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m24s, % non-child: 87.02%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Filter 0 arrival: 42s464ms MemoryUsage(2s000ms): 70.07 MB, 140.02 MB, 140.12 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.09 MB, 140.62 MB, 141.13 MB, 141.20 MB, 141.03 MB, 141.09 MB, 141.20 MB, 141.06 MB, 141.07 MB, 119.19 MB, 53.33 MB, 53.27 MB, 66.01 MB, 79.12 MB, 79.08 MB, 79.16 MB, 79.13 MB, 53.21 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.32 GB (12150126344) - PrepareTime: 282.382us - RowsProduced: 117.66M (117659985) - TotalCpuTime: 17m2s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m16s - TotalStorageWaitTime: 199.138ms DataStreamSender (dst_id=4):(Total: 11s062ms, non-child: 11s062ms, % non-child: 100.00%) - BytesSent: 803.93 MB (842977128) - NetworkThroughput(*): 240.35 MB/sec - OverallThroughput: 72.67 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 7s699ms - TransmitDataRPCTime: 3s344ms - UncompressedRowBatchSize: 2.19 GB (2353659332) HDFS_SCAN_NODE (id=0):(Total: 1s598ms, non-child: 1s598ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 148.43 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 180.25 MB (189002394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189002394) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189002394) - DecompressionTime: 1s350ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 73.59 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.72K (5717) - ScannerThreadsTotalWallClockTime: 16m41s - MaterializeTupleTime(*): 16m39s - ScannerThreadsSysTime: 459.926ms - ScannerThreadsUserTime: 9s032ms - ScannerThreadsVoluntaryContextSwitches: 115.08K (115078) - TotalRawHdfsReadTime(*): 125.952ms - TotalReadThroughput: 1.85 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d6 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m23s, % non-child: 85.77%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Filter 0 arrival: 42s462ms MemoryUsage(2s000ms): 70.04 MB, 139.96 MB, 140.01 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.34 MB, 141.14 MB, 141.22 MB, 141.13 MB, 141.17 MB, 141.08 MB, 141.17 MB, 141.11 MB, 75.26 MB, 53.32 MB, 56.26 MB, 88.24 MB, 88.04 MB, 88.00 MB, 88.03 MB, 88.04 MB, 71.81 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285200) - PerHostPeakMemUsage: 11.31 GB (12144616096) - PrepareTime: 312.241us - RowsProduced: 123.30M (123304062) - TotalCpuTime: 17m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 233.557ms DataStreamSender (dst_id=4):(Total: 12s255ms, non-child: 12s255ms, % non-child: 100.00%) - BytesSent: 845.93 MB (887023704) - NetworkThroughput(*): 234.18 MB/sec - OverallThroughput: 69.02 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 8s623ms - TransmitDataRPCTime: 3s612ms - UncompressedRowBatchSize: 2.30 GB (2466562928) HDFS_SCAN_NODE (id=0):(Total: 1s610ms, non-child: 1s610ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Runtime filters: Only following filters arrived: , waited 1s005ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 58.30 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 121.91 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 189.14 MB (198324470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.14 MB (198324470) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.14 MB (198324470) - DecompressionTime: 1s508ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 76.56 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.91K (6909) - ScannerThreadsTotalWallClockTime: 16m46s - MaterializeTupleTime(*): 16m44s - ScannerThreadsSysTime: 609.902ms - ScannerThreadsUserTime: 10s318ms - ScannerThreadsVoluntaryContextSwitches: 120.56K (120556) - TotalRawHdfsReadTime(*): 139.989ms - TotalReadThroughput: 1.94 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4c8 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m22s, % non-child: 84.92%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Filter 0 arrival: 42s465ms MemoryUsage(2s000ms): 61.37 MB, 122.62 MB, 131.52 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.51 MB, 134.67 MB, 135.00 MB, 135.03 MB, 135.13 MB, 135.11 MB, 135.11 MB, 135.09 MB, 136.05 MB, 61.36 MB, 64.34 MB, 74.83 MB, 91.46 MB, 91.50 MB, 91.52 MB, 87.53 MB, 81.52 MB, 52.29 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.54 MB (146317936) - PerHostPeakMemUsage: 11.31 GB (12138780056) - PrepareTime: 315.795us - RowsProduced: 122.21M (122205738) - TotalCpuTime: 17m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m15s - TotalStorageWaitTime: 214.051ms DataStreamSender (dst_id=4):(Total: 13s091ms, non-child: 13s091ms, % non-child: 100.00%) - BytesSent: 837.69 MB (878376597) - NetworkThroughput(*): 160.51 MB/sec - OverallThroughput: 63.99 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 7s852ms - TransmitDataRPCTime: 5s218ms - UncompressedRowBatchSize: 2.28 GB (2444592156) HDFS_SCAN_NODE (id=0):(Total: 1s601ms, non-child: 1s601ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 51.35 MB, 102.69 MB, 110.64 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 115.94 MB, 123.89 MB, 129.19 MB, 147.75 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 187.51 MB (196616751) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.51 MB (196616751) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.51 MB (196616751) - DecompressionTime: 1s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.15 MB (145912432) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 76.33 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5.12K (5122) - ScannerThreadsTotalWallClockTime: 16m42s - MaterializeTupleTime(*): 16m40s - ScannerThreadsSysTime: 352.940ms - ScannerThreadsUserTime: 7s951ms - ScannerThreadsVoluntaryContextSwitches: 119.44K (119442) - TotalRawHdfsReadTime(*): 114.709ms - TotalReadThroughput: 1.92 MB/sec Filter 0: - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) Instance fc4196b242ff8416:aac7ad511f2ba4ce (host=vb0226.halxg.cloudera.com:22000):(Total: 1m37s, non-child: 1m21s, % non-child: 84.11%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Filter 0 arrival: 42s464ms MemoryUsage(2s000ms): 70.10 MB, 140.07 MB, 140.22 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.47 MB, 141.18 MB, 141.13 MB, 141.20 MB, 141.11 MB, 141.14 MB, 141.14 MB, 141.20 MB, 109.18 MB, 53.32 MB, 53.34 MB, 66.16 MB, 79.14 MB, 79.11 MB, 79.11 MB, 79.11 MB, 43.27 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148326152) - PerHostPeakMemUsage: 11.31 GB (12144842296) - PrepareTime: 326.634us - RowsProduced: 117.66M (117660001) - TotalCpuTime: 17m3s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 204.490ms DataStreamSender (dst_id=4):(Total: 13s681ms, non-child: 13s681ms, % non-child: 100.00%) - BytesSent: 807.00 MB (846204485) - NetworkThroughput(*): 187.83 MB/sec - OverallThroughput: 58.98 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 9s360ms - TransmitDataRPCTime: 4s296ms - UncompressedRowBatchSize: 2.19 GB (2353659652) HDFS_SCAN_NODE (id=0):(Total: 1s736ms, non-child: 1s736ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 148.43 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 180.24 MB (188994044) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188994044) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188994044) - DecompressionTime: 1s305ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 67.75 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.83K (5835) - ScannerThreadsTotalWallClockTime: 16m37s - MaterializeTupleTime(*): 16m35s - ScannerThreadsSysTime: 453.924ms - ScannerThreadsUserTime: 8s551ms - ScannerThreadsVoluntaryContextSwitches: 115.14K (115141) - TotalRawHdfsReadTime(*): 128.971ms - TotalReadThroughput: 1.86 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d4 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 1m22s, % non-child: 85.70%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Filter 0 arrival: 42s433ms MemoryUsage(2s000ms): 70.08 MB, 140.04 MB, 140.09 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.10 MB, 140.31 MB, 141.11 MB, 141.11 MB, 141.05 MB, 141.05 MB, 141.15 MB, 141.22 MB, 141.10 MB, 119.22 MB, 53.33 MB, 53.36 MB, 68.30 MB, 79.15 MB, 79.12 MB, 79.15 MB, 79.13 MB, 31.23 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.31 GB (12144692256) - PrepareTime: 190.848us - RowsProduced: 117.66M (117659888) - TotalCpuTime: 16m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 212.638ms DataStreamSender (dst_id=4):(Total: 12s116ms, non-child: 12s116ms, % non-child: 100.00%) - BytesSent: 806.49 MB (845666258) - NetworkThroughput(*): 203.95 MB/sec - OverallThroughput: 66.56 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 8s140ms - TransmitDataRPCTime: 3s954ms - UncompressedRowBatchSize: 2.19 GB (2353657400) HDFS_SCAN_NODE (id=0):(Total: 1s690ms, non-child: 1s690ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.31 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 151.09 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 180.25 MB (189010714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010714) - DecompressionTime: 1s452ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 69.61 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.53K (6526) - ScannerThreadsTotalWallClockTime: 16m33s - MaterializeTupleTime(*): 16m31s - ScannerThreadsSysTime: 588.904ms - ScannerThreadsUserTime: 9s656ms - ScannerThreadsVoluntaryContextSwitches: 115.09K (115093) - TotalRawHdfsReadTime(*): 131.899ms - TotalReadThroughput: 1.87 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4c9 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m24s, % non-child: 88.08%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Filter 0 arrival: 42s465ms MemoryUsage(2s000ms): 70.07 MB, 140.02 MB, 140.15 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.43 MB, 141.09 MB, 141.14 MB, 141.13 MB, 141.12 MB, 141.13 MB, 141.15 MB, 141.15 MB, 97.26 MB, 53.41 MB, 53.35 MB, 78.81 MB, 79.14 MB, 79.09 MB, 79.20 MB, 65.17 MB, 31.22 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12144783552) - PrepareTime: 366.847us - RowsProduced: 117.66M (117659846) - TotalCpuTime: 16m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m17s - TotalStorageWaitTime: 186.603ms DataStreamSender (dst_id=4):(Total: 9s969ms, non-child: 9s969ms, % non-child: 100.00%) - BytesSent: 806.33 MB (845497506) - NetworkThroughput(*): 250.26 MB/sec - OverallThroughput: 80.88 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 6s729ms - TransmitDataRPCTime: 3s221ms - UncompressedRowBatchSize: 2.19 GB (2353656552) HDFS_SCAN_NODE (id=0):(Total: 1s473ms, non-child: 1s473ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 172.30 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 180.25 MB (189007782) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189007782) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189007782) - DecompressionTime: 1s061ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 79.85 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.70K (4697) - ScannerThreadsTotalWallClockTime: 16m26s - MaterializeTupleTime(*): 16m25s - ScannerThreadsSysTime: 262.954ms - ScannerThreadsUserTime: 6s981ms - ScannerThreadsVoluntaryContextSwitches: 114.98K (114984) - TotalRawHdfsReadTime(*): 119.383ms - TotalReadThroughput: 1.88 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d2 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m23s, % non-child: 87.75%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Filter 0 arrival: 42s463ms MemoryUsage(2s000ms): 70.02 MB, 139.92 MB, 140.43 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.60 MB, 140.72 MB, 141.09 MB, 141.08 MB, 141.03 MB, 141.04 MB, 141.12 MB, 141.08 MB, 141.01 MB, 89.23 MB, 53.32 MB, 53.35 MB, 79.69 MB, 75.13 MB, 75.11 MB, 75.16 MB, 59.10 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 6 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.32 GB (12149511944) - PrepareTime: 186.425us - RowsProduced: 116.10M (116100730) - TotalCpuTime: 16m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m16s - TotalStorageWaitTime: 219.119ms DataStreamSender (dst_id=4):(Total: 10s176ms, non-child: 10s176ms, % non-child: 100.00%) - BytesSent: 792.27 MB (830752181) - NetworkThroughput(*): 240.53 MB/sec - OverallThroughput: 77.85 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 6s866ms - TransmitDataRPCTime: 3s293ms - UncompressedRowBatchSize: 2.16 GB (2322468144) HDFS_SCAN_NODE (id=0):(Total: 1s535ms, non-child: 1s535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 178.14 MB, 178.14 MB, 178.14 MB, 178.14 MB, 178.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 178.14 MB (186788144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.14 MB (186788144) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.14 MB (186788144) - DecompressionTime: 1s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 75.62 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.27K (5267) - ScannerThreadsTotalWallClockTime: 16m22s - MaterializeTupleTime(*): 16m21s - ScannerThreadsSysTime: 473.922ms - ScannerThreadsUserTime: 8s050ms - ScannerThreadsVoluntaryContextSwitches: 113.58K (113576) - TotalRawHdfsReadTime(*): 104.661ms - TotalReadThroughput: 1.87 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4d3 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m21s, % non-child: 85.39%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Filter 0 arrival: 42s463ms MemoryUsage(2s000ms): 70.18 MB, 140.24 MB, 140.47 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.55 MB, 140.70 MB, 141.11 MB, 141.06 MB, 141.13 MB, 141.16 MB, 141.12 MB, 141.20 MB, 141.10 MB, 99.28 MB, 53.32 MB, 53.24 MB, 63.99 MB, 66.69 MB, 66.72 MB, 66.75 MB, 46.78 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6, 6 - AverageThreadTokens: 11.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.31 GB (12145194728) - PrepareTime: 178.461us - RowsProduced: 110.74M (110738953) - TotalCpuTime: 16m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 198.000ms DataStreamSender (dst_id=4):(Total: 12s264ms, non-child: 12s264ms, % non-child: 100.00%) - BytesSent: 757.20 MB (793977088) - NetworkThroughput(*): 192.90 MB/sec - OverallThroughput: 61.74 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 8s318ms - TransmitDataRPCTime: 3s925ms - UncompressedRowBatchSize: 2.06 GB (2215211668) HDFS_SCAN_NODE (id=0):(Total: 1s648ms, non-child: 1s648ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.32 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 148.45 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.23 - BytesRead: 169.66 MB (177902248) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177902248) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177902248) - DecompressionTime: 1s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 67.19 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 5.42K (5425) - ScannerThreadsTotalWallClockTime: 16m14s - MaterializeTupleTime(*): 16m12s - ScannerThreadsSysTime: 448.925ms - ScannerThreadsUserTime: 8s096ms - ScannerThreadsVoluntaryContextSwitches: 108.33K (108335) - TotalRawHdfsReadTime(*): 124.510ms - TotalReadThroughput: 1.78 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4cc (host=vb0212.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m21s, % non-child: 86.49%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Filter 0 arrival: 42s465ms MemoryUsage(2s000ms): 70.05 MB, 139.97 MB, 140.34 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.44 MB, 140.69 MB, 141.14 MB, 141.00 MB, 141.20 MB, 141.14 MB, 141.18 MB, 141.18 MB, 141.08 MB, 119.20 MB, 53.34 MB, 53.33 MB, 60.07 MB, 66.67 MB, 66.76 MB, 66.74 MB, 36.79 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6, 6 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.41 MB (148277000) - PerHostPeakMemUsage: 11.31 GB (12145046464) - PrepareTime: 248.458us - RowsProduced: 110.74M (110738660) - TotalCpuTime: 16m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 191.065ms DataStreamSender (dst_id=4):(Total: 11s148ms, non-child: 11s148ms, % non-child: 100.00%) - BytesSent: 756.78 MB (793537926) - NetworkThroughput(*): 205.45 MB/sec - OverallThroughput: 67.88 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 7s443ms - TransmitDataRPCTime: 3s683ms - UncompressedRowBatchSize: 2.06 GB (2215205796) HDFS_SCAN_NODE (id=0):(Total: 1s663ms, non-child: 1s663ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 143.12 MB, 169.63 MB, 169.63 MB, 169.63 MB, 169.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 169.63 MB (177871166) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.63 MB (177871166) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.63 MB (177871166) - DecompressionTime: 1s366ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.64 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 66.55 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.22K (6224) - ScannerThreadsTotalWallClockTime: 16m13s - MaterializeTupleTime(*): 16m11s - ScannerThreadsSysTime: 544.912ms - ScannerThreadsUserTime: 9s084ms - ScannerThreadsVoluntaryContextSwitches: 108.29K (108292) - TotalRawHdfsReadTime(*): 101.195ms - TotalReadThroughput: 1.79 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance fc4196b242ff8416:aac7ad511f2ba4cb (host=vb0214.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 84.07%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Filter 0 arrival: 38s259ms MemoryUsage(2s000ms): 69.15 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.18 MB, 138.19 MB, 138.44 MB, 139.07 MB, 139.08 MB, 139.11 MB, 139.16 MB, 139.08 MB, 139.14 MB, 139.10 MB, 73.21 MB, 51.32 MB, 63.39 MB, 91.51 MB, 91.63 MB, 91.52 MB, 91.50 MB, 89.59 MB, 47.69 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.42 MB (146196232) - PerHostPeakMemUsage: 11.31 GB (12142729352) - PrepareTime: 302.846us - RowsProduced: 124.06M (124059923) - TotalCpuTime: 16m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 240.672ms DataStreamSender (dst_id=4):(Total: 13s274ms, non-child: 13s274ms, % non-child: 100.00%) - BytesSent: 850.58 MB (891894667) - NetworkThroughput(*): 146.65 MB/sec - OverallThroughput: 64.08 MB/sec - PeakMemoryUsage: 516.00 KB (528384) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 7s455ms - TransmitDataRPCTime: 5s800ms - UncompressedRowBatchSize: 2.31 GB (2481683100) HDFS_SCAN_NODE (id=0):(Total: 1s551ms, non-child: 1s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.91 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 129.08 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 190.02 MB (199253188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.02 MB (199253188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.02 MB (199253188) - DecompressionTime: 1s225ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.98 MB (145733384) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 79.96 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 4.84K (4842) - ScannerThreadsTotalWallClockTime: 16m - MaterializeTupleTime(*): 15m58s - ScannerThreadsSysTime: 289.952ms - ScannerThreadsUserTime: 7s865ms - ScannerThreadsVoluntaryContextSwitches: 121.25K (121254) - TotalRawHdfsReadTime(*): 148.261ms - TotalReadThroughput: 2.04 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 341.25ms | 0ns | 341.25ms | 1 | 1 | | 06:EXCHANGE | 1 | 144.79us | 0ns | 144.79us | 15 | 1 | | 03:AGGREGATE | 15 | 855.28ms | 0ns | 969.97ms | 15 | 1 | | 02:HASH JOIN | 15 | 68.18s | 0ns | 71.86s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 8.31s | 0ns | 10.68s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 974.02ms | 0ns | 1.15s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 3.16s | 0ns | 3.53s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 1.61s | 0ns | 1.71s | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=234afa13a3a031e4:6f3d75e2508f578c): Summary: Session ID: 2842a9d28bcdec7d:ec3bf2f13ea9c8a1 Session Type: BEESWAX Start Time: 2016-04-26 17:24:32.475904000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 35713197462670a62625b3b36c9af3f24339abc5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50382 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 14.386ms - Analysis finished: 5.662ms (5.662ms) - Equivalence classes computed: 5.909ms (246.911us) - Single node plan created: 8.943ms (3.034ms) - Runtime filters computed: 9.087ms (143.675us) - Distributed plan created: 11.262ms (2.175ms) - Lineage info computed: 11.983ms (721.210us) - Planning finished: 14.386ms (2.402ms) Query Timeline: 1m37s - Start execution: 356.760us (356.760us) - Planning finished: 19.119ms (18.762ms) - Ready to start 45 remote fragments: 363.779ms (344.660ms) - All 45 remote fragments started: 411.933ms (48.154ms) - First dynamic filter received: 38s835ms (38s423ms) - Rows available: 1m37s (58s329ms) - First row fetched: 1m37s (20.234ms) ImpalaServer: - ClientFetchWaitTimer: 20.489ms - RowMaterializationTimer: 70.493us Execution Profile 234afa13a3a031e4:6f3d75e2508f578c:(Total: 1m37s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 15 (15) N/A N/A Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 3ms, 99.9th %-ile: 46ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 0 (15) 38s835ms 38s835ms Per Node Peak Memory Usage: vb0222.halxg.cloudera.com:22000(11.29 GB) vb0224.halxg.cloudera.com:22000(11.31 GB) vb0218.halxg.cloudera.com:22000(11.31 GB) vb0220.halxg.cloudera.com:22000(11.31 GB) vb0228.halxg.cloudera.com:22000(11.30 GB) vb0206.halxg.cloudera.com:22000(11.31 GB) vb0234.halxg.cloudera.com:22000(11.31 GB) vb0216.halxg.cloudera.com:22000(11.31 GB) vb0226.halxg.cloudera.com:22000(11.31 GB) vb0232.halxg.cloudera.com:22000(11.31 GB) vb0212.halxg.cloudera.com:22000(11.31 GB) vb0214.halxg.cloudera.com:22000(11.31 GB) vb0230.halxg.cloudera.com:22000(11.31 GB) vb0208.halxg.cloudera.com:22000(11.29 GB) vb0204.halxg.cloudera.com:22000(11.31 GB) - FiltersReceived: 1 (1) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 340.898ms - RowsProduced: 1 (1) - TotalCpuTime: 604.523ms - TotalNetworkReceiveTime: 1m36s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 530.933ms, non-child: 530.933ms, % non-child: 100.00%) - CodegenTime: 1.659ms - CompileTime: 1.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 189.626ms - PrepareTime: 337.610ms AGGREGATION_NODE (id=7):(Total: 1m36s, non-child: 341.252ms, % non-child: 0.35%) ExecOption: Codegen Enabled - BuildTime: 12.609us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m36s, non-child: 144.793us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 21.464us - DeserializeRowBatchTimer: 91.700us - FirstBatchArrivalWaitTime: 1m36s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m36s max:1m36s mean: 1m36s stddev:27.306ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994839176) - PerHostPeakMemUsage: 11.31 GB (12140518144) - PrepareTime: 146.520ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 21s112ms - TotalNetworkSendTime: 277.343us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.161ms, non-child: 490.161ms, % non-child: 100.00%) - CodegenTime: 171.206us - CompileTime: 57.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 289.012ms - PrepareTime: 141.763ms DataStreamSender (dst_id=6):(Total: 71.126us, non-child: 71.126us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 375.95 KB/sec - OverallThroughput: 225.63 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.442us - TransmitDataRPCTime: 43.822us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 855.279ms, % non-child: 0.89%) - BuildTime: 475.813ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.78 KB (48924) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m8s, % non-child: 71.38%) - BuildPartitionTime: 18s315ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 14s682ms - GetNewBlockTime: 8.689ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s001ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.448us EXCHANGE_NODE (id=5):(Total: 19s449ms, non-child: 19s449ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671948263) - ConvertRowBatchTime: 3s608ms - DeserializeRowBatchTimer: 10s129ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 6.20 M/sec - SendersBlockedTimer: 1s741ms - SendersBlockedTotalTimer(*): 17s115ms EXCHANGE_NODE (id=4):(Total: 8s130ms, non-child: 8s130ms, % non-child: 100.00%) - BytesReceived: 919.99 MB (964682049) - ConvertRowBatchTime: 2s321ms - DeserializeRowBatchTimer: 3s503ms - FirstBatchArrivalWaitTime: 525.679ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 15.15 M/sec - SendersBlockedTimer: 58s800ms - SendersBlockedTotalTimer(*): 12m31s Averaged Fragment F01:(Total: 36s222ms, non-child: 8s358ms, % non-child: 23.08%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:34s164ms max:38s477ms mean: 36s675ms stddev:1s263ms execution rates: min:116.28 MB/sec max:122.33 MB/sec mean:119.78 MB/sec stddev:1.69 MB/sec num instances: 15 - AverageThreadTokens: 10.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 998.50 MB (1047007256) - PerHostPeakMemUsage: 4.74 GB (5084821475) - PrepareTime: 143.650ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 6m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s984ms - TotalStorageWaitTime: 526.278ms CodeGen:(Total: 328.496ms, non-child: 328.496ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.390ms - PrepareTime: 140.829ms DataStreamSender (dst_id=5):(Total: 26s561ms, non-child: 26s561ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671948263) - NetworkThroughput(*): 336.04 MB/sec - OverallThroughput: 96.19 MB/sec - PeakMemoryUsage: 439.66 KB (450214) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 18s718ms - TransmitDataRPCTime: 7s796ms - UncompressedRowBatchSize: 4.92 GB (5281141619) HDFS_SCAN_NODE (id=1):(Total: 974.016ms, non-child: 974.016ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.36 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 7s324ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 998.12 MB (1046608425) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 124.35 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.05K (16054) - ScannerThreadsTotalWallClockTime: 5m40s - MaterializeTupleTime(*): 5m31s - ScannerThreadsSysTime: 1s023ms - ScannerThreadsUserTime: 30s647ms - ScannerThreadsVoluntaryContextSwitches: 117.45K (117452) - TotalRawHdfsReadTime(*): 965.983ms - TotalReadThroughput: 39.57 MB/sec Averaged Fragment F00:(Total: 1m34s, non-child: 1m18s, % non-child: 83.54%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:1m32s max:1m36s mean: 1m34s stddev:1s030ms execution rates: min:43.61 MB/sec max:48.34 MB/sec mean:46.53 MB/sec stddev:1.43 MB/sec num instances: 15 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.55 MB (147374158) - PerHostPeakMemUsage: 11.31 GB (12140518144) - PrepareTime: 251.789us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 16m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 207.912ms DataStreamSender (dst_id=4):(Total: 13s898ms, non-child: 13s898ms, % non-child: 100.00%) - BytesSent: 919.99 MB (964682049) - NetworkThroughput(*): 206.54 MB/sec - OverallThroughput: 66.34 MB/sec - PeakMemoryUsage: 536.80 KB (549683) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 9s323ms - TransmitDataRPCTime: 4s554ms - UncompressedRowBatchSize: 2.24 GB (2400454228) HDFS_SCAN_NODE (id=0):(Total: 1s608ms, non-child: 1s608ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s314ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.11 MB (146915681) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 74.68 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.49K (5493) - ScannerThreadsTotalWallClockTime: 16m9s - MaterializeTupleTime(*): 16m7s - ScannerThreadsSysTime: 427.862ms - ScannerThreadsUserTime: 8s590ms - ScannerThreadsVoluntaryContextSwitches: 117.30K (117299) - TotalRawHdfsReadTime(*): 124.548ms - TotalReadThroughput: 1.95 MB/sec Filter 0: - Rows processed: 181.31K (181305) - Rows rejected: 0 (0) - Rows total: 181.32K (181316) Fragment F02: Instance 234afa13a3a031e4:6f3d75e2508f5791 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 146.84 MB, 421.62 MB, 677.66 MB, 901.61 MB, 1.10 GB, 1.35 GB, 1.61 GB, 1.84 GB, 2.08 GB, 2.29 GB, 2.57 GB, 2.80 GB, 3.07 GB, 3.29 GB, 3.54 GB, 3.79 GB, 4.01 GB, 4.29 GB, 4.48 GB, 4.85 GB, 5.49 GB, 6.29 GB, 7.11 GB, 7.93 GB, 8.63 GB, 9.45 GB, 10.27 GB, 11.01 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.31 GB (12140281472) - PrepareTime: 146.653ms - RowsProduced: 1 (1) - TotalCpuTime: 2m11s - TotalNetworkReceiveTime: 20s354ms - TotalNetworkSendTime: 368.355us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 482.049ms, non-child: 482.049ms, % non-child: 100.00%) - CodegenTime: 160.401us - CompileTime: 53.361ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 284.762ms - PrepareTime: 142.717ms DataStreamSender (dst_id=6):(Total: 94.604us, non-child: 94.604us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 232.17 KB/sec - OverallThroughput: 165.16 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 8.852us - TransmitDataRPCTime: 67.299us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 850.118ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 474.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.61 KB (47728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m8s, % non-child: 71.83%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 20s544ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 13s218ms - GetNewBlockTime: 7.565ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s498ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.071us EXCHANGE_NODE (id=5):(Total: 17s196ms, non-child: 9s735ms, % non-child: 56.61%) BytesReceived(2s000ms): 44.13 MB, 191.24 MB, 329.68 MB, 455.08 MB, 580.22 MB, 711.87 MB, 861.56 MB, 994.94 MB, 1.11 GB, 1.24 GB, 1.38 GB, 1.52 GB, 1.66 GB, 1.78 GB, 1.91 GB, 2.05 GB, 2.18 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672141044) - ConvertRowBatchTime: 3s979ms - DeserializeRowBatchTimer: 10s974ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 6.98 M/sec - SendersBlockedTimer: 5s261ms - SendersBlockedTotalTimer(*): 51s788ms EXCHANGE_NODE (id=4):(Total: 10s000ms, non-child: 3s126ms, % non-child: 31.26%) BytesReceived(2s000ms): 4.05 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.16 MB, 39.20 MB, 99.21 MB, 151.70 MB, 202.48 MB, 252.91 MB, 302.39 MB, 351.97 MB, 401.66 MB, 451.36 MB, 501.37 MB, 551.70 MB, 602.49 MB, 653.81 MB, 705.32 MB, 756.92 MB, 807.98 MB, 859.04 MB, 907.03 MB - BytesReceived: 920.06 MB (964749374) - ConvertRowBatchTime: 2s285ms - DeserializeRowBatchTimer: 3s492ms - FirstBatchArrivalWaitTime: 537.165ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 12.00 M/sec - SendersBlockedTimer: 54s179ms - SendersBlockedTotalTimer(*): 10m50s Instance 234afa13a3a031e4:6f3d75e2508f5793 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 185.29 MB, 485.64 MB, 741.62 MB, 933.63 MB, 1.15 GB, 1.38 GB, 1.66 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.35 GB, 3.55 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.95 GB, 5.49 GB, 6.17 GB, 6.74 GB, 7.42 GB, 7.99 GB, 8.67 GB, 9.24 GB, 9.92 GB, 10.55 GB, 11.10 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.31 GB (12142259544) - PrepareTime: 148.768ms - RowsProduced: 1 (1) - TotalCpuTime: 2m18s - TotalNetworkReceiveTime: 17s046ms - TotalNetworkSendTime: 251.479us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 491.932ms, non-child: 491.932ms, % non-child: 100.00%) - CodegenTime: 235.114us - CompileTime: 68.813ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 277.023ms - PrepareTime: 144.864ms DataStreamSender (dst_id=6):(Total: 71.505us, non-child: 71.505us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 346.33 KB/sec - OverallThroughput: 218.52 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.817us - TransmitDataRPCTime: 45.116us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 847.616ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 470.695ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.69 KB (46784) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m11s, % non-child: 75.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s845ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 15s318ms - GetNewBlockTime: 8.939ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s325ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 878.000ns EXCHANGE_NODE (id=5):(Total: 17s915ms, non-child: 7s808ms, % non-child: 43.59%) BytesReceived(2s000ms): 64.19 MB, 214.07 MB, 349.35 MB, 474.98 MB, 600.39 MB, 734.79 MB, 883.49 MB, 1015.80 MB, 1.13 GB, 1.26 GB, 1.40 GB, 1.54 GB, 1.68 GB, 1.80 GB, 1.94 GB, 2.07 GB, 2.20 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672027286) - ConvertRowBatchTime: 4s047ms - DeserializeRowBatchTimer: 9s081ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 6.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s031ms, non-child: 3s086ms, % non-child: 51.17%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.14 MB, 10.16 MB, 49.20 MB, 108.16 MB, 159.79 MB, 210.56 MB, 260.77 MB, 310.26 MB, 359.71 MB, 409.41 MB, 459.20 MB, 509.22 MB, 559.68 MB, 610.62 MB, 662.14 MB, 713.67 MB, 765.17 MB, 816.11 MB, 867.29 MB, 911.86 MB - BytesReceived: 920.06 MB (964756349) - ConvertRowBatchTime: 2s290ms - DeserializeRowBatchTimer: 3s382ms - FirstBatchArrivalWaitTime: 528.060ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 19.90 M/sec - SendersBlockedTimer: 58s308ms - SendersBlockedTotalTimer(*): 12m44s Instance 234afa13a3a031e4:6f3d75e2508f5798 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.35 MB, 427.61 MB, 691.60 MB, 933.60 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.31 GB, 3.54 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.86 GB, 5.59 GB, 6.32 GB, 7.16 GB, 8.00 GB, 8.81 GB, 9.50 GB, 10.07 GB, 10.75 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.30 GB (12138027848) - PrepareTime: 145.023ms - RowsProduced: 1 (1) - TotalCpuTime: 2m11s - TotalNetworkReceiveTime: 21s922ms - TotalNetworkSendTime: 320.527us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.711ms, non-child: 472.711ms, % non-child: 100.00%) - CodegenTime: 147.897us - CompileTime: 60.015ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 270.609ms - PrepareTime: 139.233ms DataStreamSender (dst_id=6):(Total: 65.922us, non-child: 65.922us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 433.91 KB/sec - OverallThroughput: 237.02 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 13.293us - TransmitDataRPCTime: 36.010us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 863.898ms, % non-child: 0.90%) ExecOption: Codegen Enabled - BuildTime: 480.129ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.64 KB (48784) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m7s, % non-child: 70.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s571ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 13s810ms - GetNewBlockTime: 9.239ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s819ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.730us EXCHANGE_NODE (id=5):(Total: 19s228ms, non-child: 7s270ms, % non-child: 37.81%) BytesReceived(2s000ms): 52.00 MB, 200.31 MB, 337.87 MB, 463.56 MB, 588.84 MB, 722.21 MB, 871.82 MB, 1003.99 MB, 1.11 GB, 1.25 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.79 GB, 1.92 GB, 2.05 GB, 2.19 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671354549) - ConvertRowBatchTime: 3s725ms - DeserializeRowBatchTimer: 8s935ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 6.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 9s294ms, non-child: 3s085ms, % non-child: 33.20%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 10.18 MB, 43.34 MB, 102.88 MB, 154.99 MB, 205.77 MB, 256.14 MB, 305.65 MB, 355.09 MB, 404.77 MB, 454.51 MB, 504.53 MB, 554.83 MB, 605.68 MB, 657.07 MB, 708.59 MB, 760.12 MB, 811.06 MB, 862.16 MB, 908.96 MB - BytesReceived: 919.78 MB (964459012) - ConvertRowBatchTime: 2s352ms - DeserializeRowBatchTimer: 3s123ms - FirstBatchArrivalWaitTime: 546.793ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 12.91 M/sec - SendersBlockedTimer: 55s535ms - SendersBlockedTotalTimer(*): 12m2s Instance 234afa13a3a031e4:6f3d75e2508f579a (host=vb0218.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.36 MB, 421.61 MB, 677.62 MB, 933.60 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.29 GB, 3.54 GB, 3.79 GB, 4.03 GB, 4.29 GB, 4.50 GB, 4.86 GB, 5.51 GB, 6.33 GB, 7.12 GB, 7.75 GB, 8.37 GB, 8.93 GB, 9.60 GB, 10.16 GB, 10.84 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11997278208) - PerHostPeakMemUsage: 11.31 GB (12146521864) - PrepareTime: 145.179ms - RowsProduced: 1 (1) - TotalCpuTime: 2m14s - TotalNetworkReceiveTime: 20s217ms - TotalNetworkSendTime: 250.532us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 503.275ms, non-child: 503.275ms, % non-child: 100.00%) - CodegenTime: 166.040us - CompileTime: 55.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 304.917ms - PrepareTime: 141.069ms DataStreamSender (dst_id=6):(Total: 63.430us, non-child: 63.430us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 426.74 KB/sec - OverallThroughput: 246.33 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.289us - TransmitDataRPCTime: 36.615us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 836.027ms, % non-child: 0.87%) ExecOption: Codegen Enabled - BuildTime: 476.154ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.66 KB (47776) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m9s, % non-child: 72.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s282ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 15s041ms - GetNewBlockTime: 9.841ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s153ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.716us EXCHANGE_NODE (id=5):(Total: 19s475ms, non-child: 7s020ms, % non-child: 36.05%) BytesReceived(2s000ms): 49.37 MB, 197.21 MB, 335.23 MB, 460.67 MB, 585.81 MB, 718.44 MB, 868.16 MB, 999.84 MB, 1.11 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.66 GB, 1.79 GB, 1.92 GB, 2.05 GB, 2.18 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670534413) - ConvertRowBatchTime: 3s635ms - DeserializeRowBatchTimer: 8s707ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 6.16 M/sec - SendersBlockedTimer: 11.002ms - SendersBlockedTotalTimer(*): 129.528ms EXCHANGE_NODE (id=4):(Total: 7s257ms, non-child: 3s321ms, % non-child: 45.77%) BytesReceived(2s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 41.95 MB, 101.71 MB, 153.94 MB, 204.70 MB, 255.01 MB, 304.48 MB, 353.81 MB, 403.45 MB, 453.23 MB, 503.28 MB, 553.61 MB, 604.43 MB, 655.74 MB, 707.25 MB, 758.81 MB, 809.81 MB, 860.83 MB, 907.94 MB - BytesReceived: 919.52 MB (964182214) - ConvertRowBatchTime: 2s339ms - DeserializeRowBatchTimer: 3s943ms - FirstBatchArrivalWaitTime: 514.476ms - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 16.53 M/sec - SendersBlockedTimer: 57s314ms - SendersBlockedTotalTimer(*): 12m27s Instance 234afa13a3a031e4:6f3d75e2508f579c (host=vb0222.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.37 MB, 433.70 MB, 703.65 MB, 933.62 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.11 GB, 2.33 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.32 GB, 3.54 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.86 GB, 5.66 GB, 6.49 GB, 7.32 GB, 8.16 GB, 8.99 GB, 9.64 GB, 10.32 GB, 10.89 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.29 GB (12126427320) - PrepareTime: 145.246ms - RowsProduced: 1 (1) - TotalCpuTime: 2m6s - TotalNetworkReceiveTime: 26s008ms - TotalNetworkSendTime: 214.040us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.197ms, non-child: 490.197ms, % non-child: 100.00%) - CodegenTime: 169.074us - CompileTime: 54.911ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 293.154ms - PrepareTime: 139.648ms DataStreamSender (dst_id=6):(Total: 64.792us, non-child: 64.792us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 432.31 KB/sec - OverallThroughput: 241.16 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.928us - TransmitDataRPCTime: 36.143us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 881.726ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 500.600ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.58 KB (51792) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m3s, % non-child: 66.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s824ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 13s436ms - GetNewBlockTime: 8.468ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s196ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.820us EXCHANGE_NODE (id=5):(Total: 20s957ms, non-child: 9s059ms, % non-child: 43.23%) BytesReceived(2s000ms): 52.49 MB, 201.17 MB, 338.79 MB, 464.49 MB, 589.88 MB, 723.30 MB, 872.73 MB, 1004.90 MB, 1.12 GB, 1.25 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.79 GB, 1.92 GB, 2.06 GB, 2.19 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672116720) - ConvertRowBatchTime: 3s315ms - DeserializeRowBatchTimer: 11s581ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 5.73 M/sec - SendersBlockedTimer: 1s551ms - SendersBlockedTotalTimer(*): 15s609ms EXCHANGE_NODE (id=4):(Total: 11s483ms, non-child: 3s529ms, % non-child: 30.73%) BytesReceived(2s000ms): 5.07 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 10.19 MB, 43.64 MB, 103.15 MB, 155.33 MB, 206.17 MB, 256.56 MB, 306.02 MB, 355.43 MB, 405.12 MB, 454.85 MB, 504.87 MB, 555.23 MB, 606.04 MB, 657.44 MB, 709.04 MB, 760.61 MB, 811.60 MB, 862.74 MB, 909.36 MB - BytesReceived: 920.04 MB (964735322) - ConvertRowBatchTime: 2s588ms - DeserializeRowBatchTimer: 3s826ms - FirstBatchArrivalWaitTime: 528.935ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 10.45 M/sec - SendersBlockedTimer: 55s002ms - SendersBlockedTotalTimer(*): 13m44s Instance 234afa13a3a031e4:6f3d75e2508f579b (host=vb0224.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 147.90 MB, 421.64 MB, 677.66 MB, 901.66 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.10 GB, 2.32 GB, 2.57 GB, 2.83 GB, 3.07 GB, 3.29 GB, 3.54 GB, 3.75 GB, 4.01 GB, 4.29 GB, 4.49 GB, 4.85 GB, 5.50 GB, 6.30 GB, 7.13 GB, 7.85 GB, 8.40 GB, 9.08 GB, 9.63 GB, 10.25 GB, 10.87 GB, 11.15 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994230784) - PerHostPeakMemUsage: 11.31 GB (12140318448) - PrepareTime: 145.657ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 22s145ms - TotalNetworkSendTime: 307.604us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 513.378ms, non-child: 513.378ms, % non-child: 100.00%) - CodegenTime: 164.874us - CompileTime: 52.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 317.619ms - PrepareTime: 141.558ms DataStreamSender (dst_id=6):(Total: 85.006us, non-child: 85.006us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 272.00 KB/sec - OverallThroughput: 183.81 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 8.388us - TransmitDataRPCTime: 57.445us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 822.736ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 465.069ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.52 KB (51728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m7s, % non-child: 70.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s067ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 14s899ms - GetNewBlockTime: 9.062ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s993ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.171us EXCHANGE_NODE (id=5):(Total: 20s683ms, non-child: 9s099ms, % non-child: 43.99%) BytesReceived(2s000ms): 43.96 MB, 191.13 MB, 329.87 MB, 455.42 MB, 580.64 MB, 712.17 MB, 861.91 MB, 995.08 MB, 1.11 GB, 1.24 GB, 1.38 GB, 1.52 GB, 1.66 GB, 1.78 GB, 1.91 GB, 2.05 GB, 2.18 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672487659) - ConvertRowBatchTime: 3s382ms - DeserializeRowBatchTimer: 11s368ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 3s227ms - SendersBlockedTotalTimer(*): 31s372ms EXCHANGE_NODE (id=4):(Total: 7s719ms, non-child: 3s258ms, % non-child: 42.21%) BytesReceived(2s000ms): 4.01 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 10.14 MB, 39.12 MB, 99.17 MB, 151.71 MB, 202.44 MB, 252.90 MB, 302.41 MB, 351.87 MB, 401.62 MB, 451.36 MB, 501.32 MB, 551.60 MB, 602.40 MB, 653.80 MB, 705.39 MB, 756.95 MB, 808.05 MB, 859.13 MB, 907.11 MB - BytesReceived: 920.21 MB (964911035) - ConvertRowBatchTime: 2s330ms - DeserializeRowBatchTimer: 3s807ms - FirstBatchArrivalWaitTime: 504.929ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 15.55 M/sec - SendersBlockedTimer: 57s019ms - SendersBlockedTotalTimer(*): 10m29s Instance 234afa13a3a031e4:6f3d75e2508f5797 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 157.94 MB, 437.51 MB, 699.16 MB, 909.17 MB, 1.12 GB, 1.36 GB, 1.60 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.29 GB, 3.54 GB, 3.79 GB, 4.03 GB, 4.29 GB, 4.50 GB, 4.86 GB, 5.51 GB, 6.34 GB, 7.17 GB, 8.00 GB, 8.84 GB, 9.80 GB, 10.44 GB, 11.00 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.16 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11997515776) - PerHostPeakMemUsage: 11.31 GB (12146775816) - PrepareTime: 146.750ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 19s441ms - TotalNetworkSendTime: 208.316us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 479.641ms, non-child: 479.641ms, % non-child: 100.00%) - CodegenTime: 174.574us - CompileTime: 58.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 276.758ms - PrepareTime: 142.902ms DataStreamSender (dst_id=6):(Total: 63.171us, non-child: 63.171us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 395.28 KB/sec - OverallThroughput: 247.34 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.090us - TransmitDataRPCTime: 39.529us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 969.965ms, % non-child: 1.01%) ExecOption: Codegen Enabled - BuildTime: 507.681ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.61 KB (49776) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m9s, % non-child: 72.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s678ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 13s124ms - GetNewBlockTime: 8.829ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s890ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 6.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.160us EXCHANGE_NODE (id=5):(Total: 18s038ms, non-child: 9s722ms, % non-child: 53.90%) BytesReceived(2s000ms): 48.84 MB, 196.39 MB, 334.48 MB, 459.97 MB, 585.22 MB, 717.86 MB, 867.56 MB, 999.58 MB, 1.11 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.66 GB, 1.79 GB, 1.92 GB, 2.05 GB, 2.18 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671313531) - ConvertRowBatchTime: 3s885ms - DeserializeRowBatchTimer: 10s433ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 6.65 M/sec - SendersBlockedTimer: 7s430ms - SendersBlockedTotalTimer(*): 1m14s EXCHANGE_NODE (id=4):(Total: 8s047ms, non-child: 2s826ms, % non-child: 35.12%) BytesReceived(2s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 10.17 MB, 10.19 MB, 41.68 MB, 101.46 MB, 153.75 MB, 204.53 MB, 254.91 MB, 304.39 MB, 353.83 MB, 403.55 MB, 453.27 MB, 503.20 MB, 553.57 MB, 604.43 MB, 655.76 MB, 707.28 MB, 758.82 MB, 809.83 MB, 860.88 MB, 908.11 MB - BytesReceived: 919.83 MB (964507504) - ConvertRowBatchTime: 2s165ms - DeserializeRowBatchTimer: 2s484ms - FirstBatchArrivalWaitTime: 493.922ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 14.91 M/sec - SendersBlockedTimer: 1m25s - SendersBlockedTotalTimer(*): 19m32s Instance 234afa13a3a031e4:6f3d75e2508f5792 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.35 MB, 457.63 MB, 709.61 MB, 933.63 MB, 1.12 GB, 1.35 GB, 1.62 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.32 GB, 3.54 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.86 GB, 5.50 GB, 6.29 GB, 6.97 GB, 7.76 GB, 8.56 GB, 9.24 GB, 10.02 GB, 10.58 GB, 11.12 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994230784) - PerHostPeakMemUsage: 11.31 GB (12143400704) - PrepareTime: 151.753ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 20s967ms - TotalNetworkSendTime: 278.923us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 484.618ms, non-child: 484.618ms, % non-child: 100.00%) - CodegenTime: 157.779us - CompileTime: 55.396ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 280.575ms - PrepareTime: 145.318ms DataStreamSender (dst_id=6):(Total: 61.153us, non-child: 61.153us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 419.69 KB/sec - OverallThroughput: 255.51 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.093us - TransmitDataRPCTime: 37.230us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 850.162ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 474.752ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 43.33 KB (44368) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m8s, % non-child: 71.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s112ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 14s439ms - GetNewBlockTime: 8.792ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s962ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.681us EXCHANGE_NODE (id=5):(Total: 18s665ms, non-child: 7s413ms, % non-child: 39.72%) BytesReceived(2s000ms): 55.02 MB, 204.17 MB, 341.24 MB, 466.93 MB, 592.50 MB, 726.06 MB, 875.30 MB, 1007.87 MB, 1.12 GB, 1.25 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.80 GB, 1.93 GB, 2.06 GB, 2.19 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672758633) - ConvertRowBatchTime: 3s768ms - DeserializeRowBatchTimer: 8s996ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 6.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s955ms, non-child: 3s268ms, % non-child: 36.49%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 10.17 MB, 45.13 MB, 104.47 MB, 156.44 MB, 207.28 MB, 257.63 MB, 307.17 MB, 356.72 MB, 406.41 MB, 456.14 MB, 506.19 MB, 556.56 MB, 607.38 MB, 658.77 MB, 710.33 MB, 761.91 MB, 812.93 MB, 864.10 MB, 910.24 MB - BytesReceived: 920.22 MB (964923992) - ConvertRowBatchTime: 2s346ms - DeserializeRowBatchTimer: 3s766ms - FirstBatchArrivalWaitTime: 533.576ms - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 13.40 M/sec - SendersBlockedTimer: 55s747ms - SendersBlockedTotalTimer(*): 12m5s Instance 234afa13a3a031e4:6f3d75e2508f578f (host=vb0230.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.49 MB, 430.67 MB, 677.59 MB, 917.59 MB, 1.10 GB, 1.36 GB, 1.60 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.84 GB, 3.09 GB, 3.29 GB, 3.54 GB, 3.79 GB, 4.02 GB, 4.29 GB, 4.49 GB, 4.85 GB, 5.49 GB, 6.20 GB, 6.91 GB, 7.57 GB, 8.25 GB, 8.78 GB, 9.31 GB, 9.91 GB, 10.44 GB, 10.97 GB, 11.17 GB, 11.17 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11997220864) - PerHostPeakMemUsage: 11.31 GB (12146423552) - PrepareTime: 148.359ms - RowsProduced: 1 (1) - TotalCpuTime: 2m14s - TotalNetworkReceiveTime: 22s055ms - TotalNetworkSendTime: 210.126us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 483.087ms, non-child: 483.087ms, % non-child: 100.00%) - CodegenTime: 152.672us - CompileTime: 60.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 277.364ms - PrepareTime: 142.513ms DataStreamSender (dst_id=6):(Total: 66.448us, non-child: 66.448us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 387.74 KB/sec - OverallThroughput: 235.15 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.539us - TransmitDataRPCTime: 40.298us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 803.816ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 452.520ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.56 KB (47680) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m8s, % non-child: 71.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s518ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 16s531ms - GetNewBlockTime: 7.875ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s428ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.076us EXCHANGE_NODE (id=5):(Total: 21s258ms, non-child: 7s952ms, % non-child: 37.41%) BytesReceived(2s000ms): 46.15 MB, 193.54 MB, 331.91 MB, 457.64 MB, 583.07 MB, 715.05 MB, 864.76 MB, 997.50 MB, 1.11 GB, 1.24 GB, 1.38 GB, 1.52 GB, 1.66 GB, 1.79 GB, 1.92 GB, 2.05 GB, 2.18 GB, 2.33 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672353367) - ConvertRowBatchTime: 2s999ms - DeserializeRowBatchTimer: 10s560ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 5.65 M/sec - SendersBlockedTimer: 556.210ms - SendersBlockedTotalTimer(*): 5s555ms EXCHANGE_NODE (id=4):(Total: 6s507ms, non-child: 3s005ms, % non-child: 46.19%) BytesReceived(2s000ms): 4.50 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 40.28 MB, 100.19 MB, 152.64 MB, 203.42 MB, 253.83 MB, 303.34 MB, 352.85 MB, 402.52 MB, 452.30 MB, 502.30 MB, 552.66 MB, 603.47 MB, 654.82 MB, 706.36 MB, 757.91 MB, 808.90 MB, 859.95 MB, 907.64 MB - BytesReceived: 920.10 MB (964797505) - ConvertRowBatchTime: 2s194ms - DeserializeRowBatchTimer: 3s670ms - FirstBatchArrivalWaitTime: 536.193ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 18.44 M/sec - SendersBlockedTimer: 1m1s - SendersBlockedTotalTimer(*): 14m23s Instance 234afa13a3a031e4:6f3d75e2508f5795 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 185.36 MB, 486.98 MB, 741.63 MB, 933.69 MB, 1.15 GB, 1.39 GB, 1.66 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.35 GB, 3.55 GB, 3.79 GB, 4.04 GB, 4.30 GB, 4.51 GB, 4.94 GB, 5.59 GB, 6.33 GB, 7.13 GB, 7.93 GB, 8.51 GB, 9.18 GB, 9.73 GB, 10.33 GB, 10.88 GB, 11.15 GB, 11.15 GB, 11.16 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.31 GB (12142247936) - PrepareTime: 143.655ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 19s435ms - TotalNetworkSendTime: 272.986us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 487.378ms, non-child: 487.378ms, % non-child: 100.00%) - CodegenTime: 192.513us - CompileTime: 61.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 284.752ms - PrepareTime: 139.029ms DataStreamSender (dst_id=6):(Total: 103.495us, non-child: 103.495us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 224.16 KB/sec - OverallThroughput: 150.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.233us - TransmitDataRPCTime: 69.706us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 822.104ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 458.102ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.52 KB (48656) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m9s, % non-child: 72.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s407ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 15s337ms - GetNewBlockTime: 8.735ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s548ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.034us EXCHANGE_NODE (id=5):(Total: 18s356ms, non-child: 8s202ms, % non-child: 44.68%) BytesReceived(2s000ms): 64.28 MB, 214.21 MB, 349.47 MB, 475.15 MB, 600.49 MB, 735.09 MB, 884.02 MB, 1016.45 MB, 1.13 GB, 1.26 GB, 1.40 GB, 1.54 GB, 1.68 GB, 1.80 GB, 1.94 GB, 2.07 GB, 2.20 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672160156) - ConvertRowBatchTime: 3s824ms - DeserializeRowBatchTimer: 9s998ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 6.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s842ms, non-child: 3s417ms, % non-child: 43.58%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.15 MB, 49.12 MB, 108.07 MB, 159.72 MB, 210.38 MB, 260.63 MB, 310.14 MB, 359.69 MB, 409.43 MB, 459.26 MB, 509.24 MB, 559.65 MB, 610.56 MB, 662.04 MB, 713.59 MB, 765.08 MB, 816.05 MB, 867.24 MB, 911.80 MB - BytesReceived: 920.00 MB (964693191) - ConvertRowBatchTime: 2s391ms - DeserializeRowBatchTimer: 4s235ms - FirstBatchArrivalWaitTime: 531.166ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 15.30 M/sec - SendersBlockedTimer: 57s300ms - SendersBlockedTotalTimer(*): 11m28s Instance 234afa13a3a031e4:6f3d75e2508f5799 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 144.78 MB, 421.61 MB, 677.63 MB, 891.70 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.07 GB, 2.29 GB, 2.54 GB, 2.80 GB, 3.04 GB, 3.29 GB, 3.54 GB, 3.75 GB, 3.98 GB, 4.26 GB, 4.47 GB, 4.78 GB, 5.49 GB, 6.30 GB, 7.14 GB, 7.95 GB, 8.58 GB, 9.20 GB, 9.82 GB, 10.44 GB, 11.01 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.31 GB (12142260000) - PrepareTime: 144.500ms - RowsProduced: 1 (1) - TotalCpuTime: 2m10s - TotalNetworkReceiveTime: 23s299ms - TotalNetworkSendTime: 293.113us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 483.567ms, non-child: 483.567ms, % non-child: 100.00%) - CodegenTime: 154.164us - CompileTime: 56.756ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 285.195ms - PrepareTime: 140.408ms DataStreamSender (dst_id=6):(Total: 58.124us, non-child: 58.124us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 456.10 KB/sec - OverallThroughput: 268.82 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.959us - TransmitDataRPCTime: 34.258us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 900.416ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 488.798ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.30 KB (50480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m6s, % non-child: 69.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s058ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 14s332ms - GetNewBlockTime: 8.900ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s917ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 917.000ns EXCHANGE_NODE (id=5):(Total: 21s742ms, non-child: 8s543ms, % non-child: 39.30%) BytesReceived(2s000ms): 71.68 MB, 222.03 MB, 355.93 MB, 481.65 MB, 607.03 MB, 742.73 MB, 890.82 MB, 1022.70 MB, 1.13 GB, 1.27 GB, 1.41 GB, 1.55 GB, 1.68 GB, 1.81 GB, 1.94 GB, 2.07 GB, 2.21 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671662427) - ConvertRowBatchTime: 3s134ms - DeserializeRowBatchTimer: 11s513ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 5.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s360ms, non-child: 2s773ms, % non-child: 37.69%) BytesReceived(2s000ms): 5.53 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.14 MB, 10.66 MB, 52.35 MB, 110.92 MB, 162.38 MB, 213.20 MB, 263.42 MB, 312.84 MB, 362.33 MB, 412.01 MB, 461.79 MB, 511.84 MB, 562.27 MB, 613.25 MB, 664.66 MB, 716.23 MB, 767.69 MB, 818.60 MB, 869.87 MB, 912.99 MB - BytesReceived: 919.95 MB (964635495) - ConvertRowBatchTime: 2s189ms - DeserializeRowBatchTimer: 2s552ms - FirstBatchArrivalWaitTime: 535.098ms - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 16.30 M/sec - SendersBlockedTimer: 56s309ms - SendersBlockedTotalTimer(*): 11m20s Instance 234afa13a3a031e4:6f3d75e2508f5796 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 144.44 MB, 421.74 MB, 677.65 MB, 885.65 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.07 GB, 2.29 GB, 2.54 GB, 2.79 GB, 3.04 GB, 3.29 GB, 3.54 GB, 3.75 GB, 3.98 GB, 4.26 GB, 4.48 GB, 4.78 GB, 5.47 GB, 6.21 GB, 6.95 GB, 7.75 GB, 8.49 GB, 9.23 GB, 10.02 GB, 10.57 GB, 11.10 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994230784) - PerHostPeakMemUsage: 11.31 GB (12142294912) - PrepareTime: 142.023ms - RowsProduced: 1 (1) - TotalCpuTime: 2m13s - TotalNetworkReceiveTime: 20s383ms - TotalNetworkSendTime: 276.551us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 469.365ms, non-child: 469.365ms, % non-child: 100.00%) - CodegenTime: 215.673us - CompileTime: 60.339ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 269.760ms - PrepareTime: 138.095ms DataStreamSender (dst_id=6):(Total: 69.473us, non-child: 69.473us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 353.47 KB/sec - OverallThroughput: 224.91 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.561us - TransmitDataRPCTime: 44.204us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 786.646ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 448.142ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.22 KB (49376) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m8s, % non-child: 71.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s558ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 14s631ms - GetNewBlockTime: 9.627ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s810ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 6.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.027us EXCHANGE_NODE (id=5):(Total: 18s228ms, non-child: 7s678ms, % non-child: 42.12%) BytesReceived(2s000ms): 71.26 MB, 221.65 MB, 355.76 MB, 481.29 MB, 606.58 MB, 742.46 MB, 890.99 MB, 1022.72 MB, 1.13 GB, 1.27 GB, 1.41 GB, 1.55 GB, 1.68 GB, 1.81 GB, 1.94 GB, 2.07 GB, 2.21 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672019169) - ConvertRowBatchTime: 3s894ms - DeserializeRowBatchTimer: 9s132ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 6.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s980ms, non-child: 3s407ms, % non-child: 37.95%) BytesReceived(2s000ms): 5.46 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.16 MB, 10.66 MB, 52.21 MB, 110.85 MB, 162.26 MB, 213.01 MB, 263.26 MB, 312.76 MB, 362.22 MB, 411.94 MB, 461.69 MB, 511.72 MB, 562.15 MB, 613.05 MB, 664.56 MB, 716.17 MB, 767.63 MB, 818.59 MB, 869.84 MB, 912.97 MB - BytesReceived: 919.98 MB (964667652) - ConvertRowBatchTime: 2s359ms - DeserializeRowBatchTimer: 4s321ms - FirstBatchArrivalWaitTime: 550.117ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 13.36 M/sec - SendersBlockedTimer: 55s981ms - SendersBlockedTotalTimer(*): 13m3s Instance 234afa13a3a031e4:6f3d75e2508f5790 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 153.76 MB, 421.68 MB, 677.65 MB, 901.66 MB, 1.10 GB, 1.35 GB, 1.60 GB, 1.85 GB, 2.08 GB, 2.30 GB, 2.55 GB, 2.82 GB, 3.06 GB, 3.31 GB, 3.54 GB, 3.77 GB, 3.99 GB, 4.27 GB, 4.48 GB, 4.78 GB, 5.48 GB, 6.20 GB, 6.91 GB, 7.57 GB, 8.35 GB, 8.91 GB, 9.50 GB, 10.03 GB, 10.56 GB, 11.09 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994255360) - PerHostPeakMemUsage: 11.31 GB (12142115664) - PrepareTime: 153.384ms - RowsProduced: 1 (1) - TotalCpuTime: 2m16s - TotalNetworkReceiveTime: 19s033ms - TotalNetworkSendTime: 216.393us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 514.592ms, non-child: 514.592ms, % non-child: 100.00%) - CodegenTime: 160.737us - CompileTime: 54.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 309.230ms - PrepareTime: 147.651ms DataStreamSender (dst_id=6):(Total: 74.103us, non-child: 74.103us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 349.47 KB/sec - OverallThroughput: 210.85 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.886us - TransmitDataRPCTime: 44.710us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 832.756ms, % non-child: 0.86%) ExecOption: Codegen Enabled - BuildTime: 464.592ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.58 KB (46672) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m9s, % non-child: 73.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s981ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 16s196ms - GetNewBlockTime: 7.998ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s433ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 6.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.904us EXCHANGE_NODE (id=5):(Total: 18s727ms, non-child: 10s678ms, % non-child: 57.02%) BytesReceived(2s000ms): 74.74 MB, 224.79 MB, 358.20 MB, 484.11 MB, 609.55 MB, 745.73 MB, 893.96 MB, 1.00 GB, 1.14 GB, 1.27 GB, 1.41 GB, 1.55 GB, 1.69 GB, 1.81 GB, 1.95 GB, 2.08 GB, 2.21 GB, 2.36 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672696592) - ConvertRowBatchTime: 3s726ms - DeserializeRowBatchTimer: 12s092ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 6.41 M/sec - SendersBlockedTimer: 7s612ms - SendersBlockedTotalTimer(*): 1m13s EXCHANGE_NODE (id=4):(Total: 7s006ms, non-child: 3s323ms, % non-child: 47.43%) BytesReceived(2s000ms): 5.99 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.14 MB, 10.94 MB, 53.46 MB, 111.86 MB, 163.21 MB, 214.03 MB, 264.25 MB, 313.73 MB, 363.25 MB, 412.98 MB, 462.78 MB, 512.88 MB, 563.31 MB, 614.29 MB, 665.82 MB, 717.45 MB, 768.90 MB, 819.83 MB, 871.11 MB, 913.66 MB - BytesReceived: 920.18 MB (964881970) - ConvertRowBatchTime: 2s387ms - DeserializeRowBatchTimer: 3s922ms - FirstBatchArrivalWaitTime: 503.699ms - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 17.13 M/sec - SendersBlockedTimer: 58s229ms - SendersBlockedTotalTimer(*): 10m53s Instance 234afa13a3a031e4:6f3d75e2508f5794 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 150.03 MB, 485.68 MB, 709.64 MB, 933.61 MB, 1.13 GB, 1.36 GB, 1.63 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.32 GB, 3.54 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.87 GB, 5.52 GB, 6.33 GB, 7.14 GB, 7.95 GB, 8.76 GB, 9.42 GB, 10.02 GB, 10.57 GB, 11.10 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994206208) - PerHostPeakMemUsage: 11.31 GB (12142281984) - PrepareTime: 146.909ms - RowsProduced: 1 (1) - TotalCpuTime: 2m11s - TotalNetworkReceiveTime: 22s419ms - TotalNetworkSendTime: 304.945us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 501.229ms, non-child: 501.229ms, % non-child: 100.00%) - CodegenTime: 154.689us - CompileTime: 50.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 306.927ms - PrepareTime: 141.473ms DataStreamSender (dst_id=6):(Total: 66.353us, non-child: 66.353us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 438.83 KB/sec - OverallThroughput: 235.48 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.700us - TransmitDataRPCTime: 35.606us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 882.074ms, % non-child: 0.92%) ExecOption: Codegen Enabled - BuildTime: 485.558ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.62 KB (49792) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m7s, % non-child: 70.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s285ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 14s718ms - GetNewBlockTime: 7.426ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s131ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 6.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.267us EXCHANGE_NODE (id=5):(Total: 20s482ms, non-child: 7s813ms, % non-child: 38.15%) BytesReceived(2s000ms): 56.94 MB, 206.77 MB, 343.40 MB, 468.94 MB, 594.34 MB, 728.08 MB, 877.33 MB, 1009.46 MB, 1.12 GB, 1.25 GB, 1.40 GB, 1.53 GB, 1.67 GB, 1.80 GB, 1.93 GB, 2.06 GB, 2.19 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671343755) - ConvertRowBatchTime: 3s428ms - DeserializeRowBatchTimer: 9s857ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 473.656ms - SendersBlockedTotalTimer(*): 4s804ms EXCHANGE_NODE (id=4):(Total: 8s179ms, non-child: 3s080ms, % non-child: 37.66%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.15 MB, 46.10 MB, 105.36 MB, 157.23 MB, 208.01 MB, 258.28 MB, 307.72 MB, 357.24 MB, 406.89 MB, 456.63 MB, 506.67 MB, 557.07 MB, 607.98 MB, 659.41 MB, 710.96 MB, 762.47 MB, 813.44 MB, 864.53 MB, 910.30 MB - BytesReceived: 919.82 MB (964503314) - ConvertRowBatchTime: 2s305ms - DeserializeRowBatchTimer: 3s338ms - FirstBatchArrivalWaitTime: 516.079ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 14.67 M/sec - SendersBlockedTimer: 56s284ms - SendersBlockedTotalTimer(*): 12m11s Instance 234afa13a3a031e4:6f3d75e2508f578e (host=vb0208.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.34 MB, 455.63 MB, 709.57 MB, 933.58 MB, 1.11 GB, 1.35 GB, 1.61 GB, 1.85 GB, 2.10 GB, 2.35 GB, 2.60 GB, 2.85 GB, 3.10 GB, 3.32 GB, 3.54 GB, 3.79 GB, 4.04 GB, 4.29 GB, 4.51 GB, 4.87 GB, 5.59 GB, 6.34 GB, 7.14 GB, 7.83 GB, 8.37 GB, 9.00 GB, 9.61 GB, 10.17 GB, 10.84 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994181632) - PerHostPeakMemUsage: 11.29 GB (12126135104) - PrepareTime: 143.942ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 21s951ms - TotalNetworkSendTime: 386.257us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 495.397ms, non-child: 495.397ms, % non-child: 100.00%) - CodegenTime: 161.893us - CompileTime: 57.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 296.533ms - PrepareTime: 139.969ms DataStreamSender (dst_id=6):(Total: 59.314us, non-child: 59.314us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 471.01 KB/sec - OverallThroughput: 263.43 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 12.008us - TransmitDataRPCTime: 33.173us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m36s, non-child: 879.121ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 490.403ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.25 KB (52480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m35s, non-child: 1m7s, % non-child: 70.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s998ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 15s201ms - GetNewBlockTime: 9.035ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s913ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 6.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.277us EXCHANGE_NODE (id=5):(Total: 20s790ms, non-child: 6s722ms, % non-child: 32.33%) BytesReceived(2s000ms): 54.63 MB, 203.85 MB, 341.12 MB, 466.73 MB, 592.15 MB, 725.67 MB, 875.16 MB, 1007.39 MB, 1.12 GB, 1.25 GB, 1.39 GB, 1.53 GB, 1.67 GB, 1.79 GB, 1.93 GB, 2.06 GB, 2.19 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672254644) - ConvertRowBatchTime: 3s370ms - DeserializeRowBatchTimer: 8s704ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 5.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s284ms, non-child: 2s870ms, % non-child: 39.40%) BytesReceived(2s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 10.13 MB, 44.92 MB, 104.31 MB, 156.30 MB, 207.07 MB, 257.41 MB, 306.92 MB, 356.35 MB, 406.01 MB, 455.78 MB, 505.82 MB, 556.19 MB, 607.06 MB, 658.55 MB, 710.13 MB, 761.74 MB, 812.76 MB, 863.87 MB, 910.09 MB - BytesReceived: 920.13 MB (964826808) - ConvertRowBatchTime: 2s291ms - DeserializeRowBatchTimer: 2s692ms - FirstBatchArrivalWaitTime: 524.980ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 16.48 M/sec - SendersBlockedTimer: 57s401ms - SendersBlockedTotalTimer(*): 10m35s Fragment F01: Instance 234afa13a3a031e4:6f3d75e2508f57a2 (host=vb0232.halxg.cloudera.com:22000):(Total: 37s987ms, non-child: 10s268ms, % non-child: 27.03%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB MemoryUsage(1s000ms): 1001.86 MB, 1002.72 MB, 1002.73 MB, 1002.85 MB, 994.71 MB, 884.64 MB, 828.82 MB, 828.86 MB, 828.80 MB, 828.79 MB, 780.90 MB, 728.96 MB, 652.86 MB, 652.79 MB, 652.71 MB, 604.97 MB, 564.94 MB, 536.97 MB, 441.18 MB, 389.05 MB, 333.08 MB, 300.94 MB, 301.17 MB, 240.94 MB, 669.17 MB, 641.91 MB, 641.79 MB, 614.20 MB, 531.10 MB, 531.18 MB, 507.17 MB, 451.19 MB, 419.19 MB, 415.23 MB, 363.03 MB, 279.17 MB, 219.17 MB, 187.34 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052291096) - PerHostPeakMemUsage: 4.92 GB (5287890192) - PrepareTime: 147.199ms - RowsProduced: 124.58M (124581482) - TotalCpuTime: 6m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s676ms - TotalStorageWaitTime: 487.863ms CodeGen:(Total: 332.810ms, non-child: 332.810ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.553ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.961ms - PrepareTime: 145.089ms DataStreamSender (dst_id=5):(Total: 26s239ms, non-child: 26s239ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2774670763) - NetworkThroughput(*): 397.36 MB/sec - OverallThroughput: 100.85 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 19s529ms - TransmitDataRPCTime: 6s659ms - UncompressedRowBatchSize: 5.11 GB (5482803644) HDFS_SCAN_NODE (id=1):(Total: 1s146ms, non-child: 1s146ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.68% 1:1.316% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.46 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.57 - BytesRead: 1.47 GB (1576537578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537578) - DecompressionTime: 8s674ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877464) - PerReadThreadRawHdfsThroughput: 1.53 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 108.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 18.30K (18300) - ScannerThreadsTotalWallClockTime: 6m3s - MaterializeTupleTime(*): 5m53s - ScannerThreadsSysTime: 1s181ms - ScannerThreadsUserTime: 36s701ms - ScannerThreadsVoluntaryContextSwitches: 122.00K (121999) - TotalRawHdfsReadTime(*): 959.908ms - TotalReadThroughput: 39.57 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a5 (host=vb0234.halxg.cloudera.com:22000):(Total: 37s542ms, non-child: 9s765ms, % non-child: 26.01%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB MemoryUsage(1s000ms): 500.92 MB, 1003.00 MB, 1002.95 MB, 1002.84 MB, 1002.61 MB, 943.92 MB, 828.75 MB, 828.92 MB, 828.72 MB, 828.95 MB, 816.93 MB, 740.77 MB, 656.66 MB, 652.94 MB, 652.78 MB, 612.90 MB, 564.80 MB, 564.88 MB, 469.06 MB, 389.26 MB, 365.00 MB, 301.10 MB, 301.12 MB, 265.29 MB, 499.75 MB, 641.97 MB, 641.64 MB, 626.18 MB, 543.18 MB, 531.10 MB, 527.10 MB, 471.17 MB, 419.25 MB, 419.33 MB, 363.13 MB, 287.24 MB, 223.24 MB, 187.46 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.39 MB (1052127328) - PerHostPeakMemUsage: 4.87 GB (5224673504) - PrepareTime: 141.696ms - RowsProduced: 124.58M (124581192) - TotalCpuTime: 6m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s884ms - TotalStorageWaitTime: 475.199ms CodeGen:(Total: 326.786ms, non-child: 326.786ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.470ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.520ms - PrepareTime: 139.628ms DataStreamSender (dst_id=5):(Total: 26s373ms, non-child: 26s373ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773898817) - NetworkThroughput(*): 391.58 MB/sec - OverallThroughput: 100.30 MB/sec - PeakMemoryUsage: 467.93 KB (479160) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 19s570ms - TransmitDataRPCTime: 6s755ms - UncompressedRowBatchSize: 5.11 GB (5482790876) HDFS_SCAN_NODE (id=1):(Total: 1s076ms, non-child: 1s076ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 1002.30 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.57 - BytesRead: 1.47 GB (1576528335) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576528335) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576528335) - DecompressionTime: 8s578ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.02 MB (1051746552) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 115.76 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 18.14K (18141) - ScannerThreadsTotalWallClockTime: 5m59s - MaterializeTupleTime(*): 5m49s - ScannerThreadsSysTime: 1s109ms - ScannerThreadsUserTime: 36s213ms - ScannerThreadsVoluntaryContextSwitches: 122.01K (122009) - TotalRawHdfsReadTime(*): 994.421ms - TotalReadThroughput: 40.09 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a6 (host=vb0206.halxg.cloudera.com:22000):(Total: 37s441ms, non-child: 8s354ms, % non-child: 22.31%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB MemoryUsage(1s000ms): 500.71 MB, 1002.72 MB, 1002.74 MB, 1002.84 MB, 1002.77 MB, 916.21 MB, 828.87 MB, 829.00 MB, 829.07 MB, 828.89 MB, 784.88 MB, 740.96 MB, 652.76 MB, 652.82 MB, 652.75 MB, 604.84 MB, 564.95 MB, 520.77 MB, 432.97 MB, 389.01 MB, 316.89 MB, 301.14 MB, 301.05 MB, 240.80 MB, 641.49 MB, 641.74 MB, 641.74 MB, 590.50 MB, 531.22 MB, 531.25 MB, 503.33 MB, 435.19 MB, 419.14 MB, 395.44 MB, 346.93 MB, 255.45 MB, 195.33 MB, 167.26 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.49 MB (1052233832) - PerHostPeakMemUsage: 4.87 GB (5224541872) - PrepareTime: 143.506ms - RowsProduced: 124.58M (124580591) - TotalCpuTime: 6m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s024ms - TotalStorageWaitTime: 528.049ms CodeGen:(Total: 328.694ms, non-child: 328.694ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.819ms - PrepareTime: 141.279ms DataStreamSender (dst_id=5):(Total: 27s733ms, non-child: 27s733ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772555850) - NetworkThroughput(*): 317.61 MB/sec - OverallThroughput: 95.34 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 19s362ms - TransmitDataRPCTime: 8s324ms - UncompressedRowBatchSize: 5.11 GB (5482764428) HDFS_SCAN_NODE (id=1):(Total: 1s025ms, non-child: 1s025ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.67% 1:1.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.40 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 936.91 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.51 - BytesRead: 1.47 GB (1576536384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576536384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576536384) - DecompressionTime: 7s769ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 121.53 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 16.14K (16137) - ScannerThreadsTotalWallClockTime: 5m56s - MaterializeTupleTime(*): 5m47s - ScannerThreadsSysTime: 1s041ms - ScannerThreadsUserTime: 32s276ms - ScannerThreadsVoluntaryContextSwitches: 121.89K (121895) - TotalRawHdfsReadTime(*): 973.210ms - TotalReadThroughput: 39.57 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57aa (host=vb0224.halxg.cloudera.com:22000):(Total: 37s339ms, non-child: 7s290ms, % non-child: 19.53%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 497.07 MB, 994.70 MB, 994.75 MB, 994.96 MB, 994.91 MB, 931.96 MB, 820.95 MB, 820.81 MB, 820.86 MB, 820.88 MB, 776.87 MB, 732.94 MB, 644.60 MB, 644.82 MB, 644.80 MB, 600.81 MB, 556.71 MB, 520.80 MB, 432.84 MB, 380.89 MB, 333.10 MB, 293.22 MB, 365.07 MB, 308.76 MB, 641.46 MB, 641.90 MB, 630.07 MB, 602.28 MB, 531.20 MB, 527.36 MB, 499.09 MB, 443.11 MB, 415.30 MB, 407.16 MB, 351.11 MB, 271.06 MB, 203.24 MB, 144.86 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.43 MB (1043779704) - PerHostPeakMemUsage: 4.86 GB (5214243944) - PrepareTime: 143.393ms - RowsProduced: 123.88M (123876716) - TotalCpuTime: 6m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s065ms - TotalStorageWaitTime: 535.475ms CodeGen:(Total: 333.309ms, non-child: 333.309ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 188.362ms - PrepareTime: 141.299ms DataStreamSender (dst_id=5):(Total: 28s807ms, non-child: 28s807ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2759800043) - NetworkThroughput(*): 279.27 MB/sec - OverallThroughput: 91.36 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 19s338ms - TransmitDataRPCTime: 9s424ms - UncompressedRowBatchSize: 5.08 GB (5451787044) HDFS_SCAN_NODE (id=1):(Total: 907.755ms, non-child: 907.755ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 455.18 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 910.37 MB, 993.88 MB, 993.88 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.48 - BytesRead: 1.46 GB (1567668714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567668714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567668714) - DecompressionTime: 6s665ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.02 MB (1043357944) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 136.46 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.92K (14920) - ScannerThreadsTotalWallClockTime: 5m55s - MaterializeTupleTime(*): 5m47s - ScannerThreadsSysTime: 896.859ms - ScannerThreadsUserTime: 27s767ms - ScannerThreadsVoluntaryContextSwitches: 121.20K (121202) - TotalRawHdfsReadTime(*): 962.937ms - TotalReadThroughput: 39.34 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f579f (host=vb0204.halxg.cloudera.com:22000):(Total: 37s263ms, non-child: 6s098ms, % non-child: 16.37%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB MemoryUsage(1s000ms): 500.96 MB, 1002.90 MB, 1002.74 MB, 1002.89 MB, 1002.72 MB, 916.16 MB, 828.86 MB, 829.06 MB, 828.78 MB, 828.98 MB, 784.74 MB, 736.70 MB, 652.95 MB, 652.79 MB, 653.03 MB, 600.91 MB, 564.78 MB, 516.93 MB, 429.09 MB, 389.08 MB, 304.95 MB, 301.04 MB, 297.24 MB, 391.79 MB, 641.78 MB, 642.14 MB, 637.97 MB, 554.94 MB, 531.31 MB, 531.11 MB, 475.24 MB, 419.13 MB, 419.22 MB, 387.13 MB, 335.24 MB, 251.44 MB, 195.13 MB, 159.14 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.53 MB (1052274528) - PerHostPeakMemUsage: 4.87 GB (5224488640) - PrepareTime: 148.675ms - RowsProduced: 124.58M (124581324) - TotalCpuTime: 6m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s168ms - TotalStorageWaitTime: 528.040ms CodeGen:(Total: 335.232ms, non-child: 335.232ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 185.085ms - PrepareTime: 144.851ms DataStreamSender (dst_id=5):(Total: 29s945ms, non-child: 29s945ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772585921) - NetworkThroughput(*): 252.40 MB/sec - OverallThroughput: 88.30 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 19s422ms - TransmitDataRPCTime: 10s476ms - UncompressedRowBatchSize: 5.11 GB (5482796692) HDFS_SCAN_NODE (id=1):(Total: 884.354ms, non-child: 884.354ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.39 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.51 - BytesRead: 1.47 GB (1576541342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576541342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576541342) - DecompressionTime: 6s265ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812008) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 140.87 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.39K (14390) - ScannerThreadsTotalWallClockTime: 5m54s - MaterializeTupleTime(*): 5m47s - ScannerThreadsSysTime: 907.856ms - ScannerThreadsUserTime: 25s849ms - ScannerThreadsVoluntaryContextSwitches: 121.85K (121848) - TotalRawHdfsReadTime(*): 974.126ms - TotalReadThroughput: 40.09 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a0 (host=vb0214.halxg.cloudera.com:22000):(Total: 36s924ms, non-child: 7s208ms, % non-child: 19.52%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB MemoryUsage(1s000ms): 496.99 MB, 994.74 MB, 994.82 MB, 994.74 MB, 994.87 MB, 876.22 MB, 820.87 MB, 821.06 MB, 820.57 MB, 820.86 MB, 732.94 MB, 688.90 MB, 644.81 MB, 644.94 MB, 644.68 MB, 556.88 MB, 557.11 MB, 484.72 MB, 384.88 MB, 381.13 MB, 292.97 MB, 293.18 MB, 328.88 MB, 462.93 MB, 641.91 MB, 637.94 MB, 602.30 MB, 531.23 MB, 531.24 MB, 515.14 MB, 463.17 MB, 419.13 MB, 411.22 MB, 359.16 MB, 315.31 MB, 223.20 MB, 181.99 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.55 MB (1043910504) - PerHostPeakMemUsage: 4.84 GB (5194901472) - PrepareTime: 143.830ms - RowsProduced: 124.06M (124059923) - TotalCpuTime: 6m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s068ms - TotalStorageWaitTime: 533.975ms CodeGen:(Total: 329.393ms, non-child: 329.393ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.496ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.050ms - PrepareTime: 141.670ms DataStreamSender (dst_id=5):(Total: 28s470ms, non-child: 28s470ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2762086883) - NetworkThroughput(*): 285.88 MB/sec - OverallThroughput: 92.52 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 19s207ms - TransmitDataRPCTime: 9s214ms - UncompressedRowBatchSize: 5.08 GB (5459849940) HDFS_SCAN_NODE (id=1):(Total: 915.952ms, non-child: 915.952ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 456.26 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 996.04 MB, 1.22 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.46 GB (1569927832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1569927832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1569927832) - DecompressionTime: 6s915ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.21 MB (1043554224) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 135.44 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.56K (15561) - ScannerThreadsTotalWallClockTime: 5m50s - MaterializeTupleTime(*): 5m42s - ScannerThreadsSysTime: 931.853ms - ScannerThreadsUserTime: 28s659ms - ScannerThreadsVoluntaryContextSwitches: 121.38K (121382) - TotalRawHdfsReadTime(*): 1s068ms - TotalReadThroughput: 39.93 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57ab (host=vb0222.halxg.cloudera.com:22000):(Total: 36s704ms, non-child: 6s939ms, % non-child: 18.91%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB MemoryUsage(1s000ms): 450.01 MB, 985.14 MB, 985.10 MB, 985.33 MB, 981.56 MB, 874.85 MB, 811.36 MB, 811.39 MB, 811.27 MB, 811.23 MB, 743.37 MB, 691.32 MB, 635.23 MB, 635.39 MB, 631.31 MB, 559.36 MB, 547.36 MB, 479.40 MB, 383.39 MB, 428.74 MB, 364.75 MB, 364.93 MB, 332.84 MB, 530.59 MB, 626.02 MB, 625.88 MB, 598.40 MB, 527.23 MB, 515.12 MB, 511.11 MB, 455.07 MB, 407.19 MB, 395.12 MB, 343.26 MB, 303.04 MB, 193.89 MB, 156.91 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 986.01 MB (1033908232) - PerHostPeakMemUsage: 4.82 GB (5172469080) - PrepareTime: 141.578ms - RowsProduced: 123.30M (123304062) - TotalCpuTime: 6m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s994ms - TotalStorageWaitTime: 527.601ms CodeGen:(Total: 326.977ms, non-child: 326.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.016ms - PrepareTime: 138.257ms DataStreamSender (dst_id=5):(Total: 28s563ms, non-child: 28s563ms, % non-child: 100.00%) - BytesSent: 2.56 GB (2747991990) - NetworkThroughput(*): 281.24 MB/sec - OverallThroughput: 91.75 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 19s202ms - TransmitDataRPCTime: 9s318ms - UncompressedRowBatchSize: 5.05 GB (5426584668) HDFS_SCAN_NODE (id=1):(Total: 873.909ms, non-child: 873.909ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 410.14 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 903.81 MB, 987.34 MB, 987.34 MB, 987.34 MB, 987.34 MB, 1.29 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 1.45 GB (1560799796) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.45 GB (1560799796) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.45 GB (1560799796) - DecompressionTime: 6s437ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 985.65 MB (1033527296) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 141.09 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 14.71K (14710) - ScannerThreadsTotalWallClockTime: 5m48s - MaterializeTupleTime(*): 5m40s - ScannerThreadsSysTime: 869.863ms - ScannerThreadsUserTime: 26s789ms - ScannerThreadsVoluntaryContextSwitches: 120.64K (120637) - TotalRawHdfsReadTime(*): 974.501ms - TotalReadThroughput: 40.23 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a3 (host=vb0226.halxg.cloudera.com:22000):(Total: 36s578ms, non-child: 8s791ms, % non-child: 24.03%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB MemoryUsage(1s000ms): 702.24 MB, 1002.90 MB, 1002.65 MB, 1002.88 MB, 1002.78 MB, 923.95 MB, 828.85 MB, 828.95 MB, 828.87 MB, 828.71 MB, 800.64 MB, 740.86 MB, 652.72 MB, 652.86 MB, 652.97 MB, 612.80 MB, 564.87 MB, 540.80 MB, 440.98 MB, 389.03 MB, 349.08 MB, 301.26 MB, 300.73 MB, 248.77 MB, 561.50 MB, 551.62 MB, 551.54 MB, 480.63 MB, 456.59 MB, 456.69 MB, 384.83 MB, 360.68 MB, 336.74 MB, 312.69 MB, 240.89 MB, 168.73 MB, 144.80 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052282816) - PerHostPeakMemUsage: 4.79 GB (5146575376) - PrepareTime: 144.884ms - RowsProduced: 117.66M (117660001) - TotalCpuTime: 6m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s670ms - TotalStorageWaitTime: 459.821ms CodeGen:(Total: 328.995ms, non-child: 328.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.599ms - PrepareTime: 141.393ms DataStreamSender (dst_id=5):(Total: 26s415ms, non-child: 26s415ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2621187447) - NetworkThroughput(*): 341.77 MB/sec - OverallThroughput: 94.63 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 19s052ms - TransmitDataRPCTime: 7s314ms - UncompressedRowBatchSize: 4.82 GB (5178190780) HDFS_SCAN_NODE (id=1):(Total: 1s042ms, non-child: 1s042ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:98.65% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:1.351% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 606.07 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 9.26 - BytesRead: 1.39 GB (1488950230) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488950230) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488950230) - DecompressionTime: 7s602ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 112.81 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 17.52K (17518) - ScannerThreadsTotalWallClockTime: 5m39s - MaterializeTupleTime(*): 5m31s - ScannerThreadsSysTime: 1s100ms - ScannerThreadsUserTime: 31s916ms - ScannerThreadsVoluntaryContextSwitches: 115.35K (115353) - TotalRawHdfsReadTime(*): 1s018ms - TotalReadThroughput: 38.38 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f579d (host=vb0208.halxg.cloudera.com:22000):(Total: 36s115ms, non-child: 9s638ms, % non-child: 26.69%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB MemoryUsage(1s000ms): 491.14 MB, 981.50 MB, 981.34 MB, 981.39 MB, 934.19 MB, 831.16 MB, 807.48 MB, 807.34 MB, 807.49 MB, 779.25 MB, 719.39 MB, 647.48 MB, 631.66 MB, 631.43 MB, 567.34 MB, 543.20 MB, 499.43 MB, 468.76 MB, 444.71 MB, 384.92 MB, 364.92 MB, 360.94 MB, 312.82 MB, 620.50 MB, 617.99 MB, 614.25 MB, 550.97 MB, 507.13 MB, 507.28 MB, 463.29 MB, 410.94 MB, 387.05 MB, 355.24 MB, 331.16 MB, 238.02 MB, 155.53 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6 - AverageThreadTokens: 10.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 982.01 MB (1029713848) - PerHostPeakMemUsage: 4.69 GB (5038096144) - PrepareTime: 143.078ms - RowsProduced: 122.21M (122205738) - TotalCpuTime: 6m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s996ms - TotalStorageWaitTime: 588.058ms CodeGen:(Total: 326.893ms, non-child: 326.893ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.001ms - PrepareTime: 140.291ms DataStreamSender (dst_id=5):(Total: 25s115ms, non-child: 25s115ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2719187360) - NetworkThroughput(*): 397.70 MB/sec - OverallThroughput: 103.25 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 18s548ms - TransmitDataRPCTime: 6s520ms - UncompressedRowBatchSize: 5.01 GB (5378247676) HDFS_SCAN_NODE (id=1):(Total: 1s034ms, non-child: 1s034ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 448.52 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 897.04 MB, 980.58 MB, 980.58 MB, 980.58 MB, 980.58 MB, 980.58 MB, 1017.81 MB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.45 - BytesRead: 1.44 GB (1547015523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1547015523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1547015523) - DecompressionTime: 8s235ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 981.59 MB (1029267624) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 118.12 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 17.73K (17731) - ScannerThreadsTotalWallClockTime: 5m42s - MaterializeTupleTime(*): 5m32s - ScannerThreadsSysTime: 1s224ms - ScannerThreadsUserTime: 34s585ms - ScannerThreadsVoluntaryContextSwitches: 119.64K (119642) - TotalRawHdfsReadTime(*): 967.700ms - TotalReadThroughput: 40.42 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a9 (host=vb0218.halxg.cloudera.com:22000):(Total: 35s886ms, non-child: 9s694ms, % non-child: 27.01%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB MemoryUsage(1s000ms): 500.78 MB, 1002.87 MB, 1002.96 MB, 1002.92 MB, 1002.73 MB, 916.28 MB, 829.04 MB, 828.97 MB, 829.05 MB, 828.75 MB, 784.65 MB, 740.78 MB, 652.87 MB, 652.81 MB, 652.80 MB, 596.90 MB, 564.86 MB, 524.70 MB, 433.01 MB, 389.06 MB, 325.13 MB, 301.19 MB, 297.21 MB, 289.90 MB, 551.54 MB, 551.61 MB, 528.05 MB, 456.73 MB, 456.58 MB, 428.71 MB, 380.82 MB, 360.67 MB, 332.63 MB, 280.85 MB, 213.07 MB, 168.93 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299192) - PerHostPeakMemUsage: 4.72 GB (5062752120) - PrepareTime: 142.751ms - RowsProduced: 117.66M (117659888) - TotalCpuTime: 6m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s748ms - TotalStorageWaitTime: 439.809ms CodeGen:(Total: 328.214ms, non-child: 328.214ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.071ms - PrepareTime: 140.593ms DataStreamSender (dst_id=5):(Total: 24s803ms, non-child: 24s803ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619738300) - NetworkThroughput(*): 397.74 MB/sec - OverallThroughput: 100.73 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 18s475ms - TransmitDataRPCTime: 6s281ms - UncompressedRowBatchSize: 4.82 GB (5178185812) HDFS_SCAN_NODE (id=1):(Total: 1s060ms, non-child: 1s060ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1014.39 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.25 - BytesRead: 1.39 GB (1488962094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488962094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488962094) - DecompressionTime: 8s122ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 110.96 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 17.49K (17486) - ScannerThreadsTotalWallClockTime: 5m33s - MaterializeTupleTime(*): 5m24s - ScannerThreadsSysTime: 1s176ms - ScannerThreadsUserTime: 34s215ms - ScannerThreadsVoluntaryContextSwitches: 115.24K (115237) - TotalRawHdfsReadTime(*): 887.949ms - TotalReadThroughput: 38.90 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a4 (host=vb0216.halxg.cloudera.com:22000):(Total: 35s400ms, non-child: 8s241ms, % non-child: 23.28%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB MemoryUsage(1s000ms): 1000.77 MB, 1003.00 MB, 1002.81 MB, 1002.67 MB, 975.21 MB, 880.36 MB, 828.94 MB, 828.75 MB, 828.97 MB, 828.66 MB, 753.06 MB, 693.05 MB, 652.73 MB, 652.90 MB, 632.98 MB, 564.88 MB, 556.71 MB, 468.90 MB, 393.09 MB, 364.94 MB, 301.30 MB, 301.01 MB, 257.02 MB, 520.58 MB, 551.39 MB, 551.67 MB, 480.77 MB, 456.85 MB, 444.77 MB, 388.59 MB, 360.79 MB, 336.97 MB, 296.69 MB, 224.80 MB, 172.91 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.49 MB (1052233832) - PerHostPeakMemUsage: 4.68 GB (5023865920) - PrepareTime: 140.621ms - RowsProduced: 117.66M (117659985) - TotalCpuTime: 6m - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s139ms - TotalStorageWaitTime: 495.603ms CodeGen:(Total: 326.106ms, non-child: 326.106ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.087ms - PrepareTime: 138.508ms DataStreamSender (dst_id=5):(Total: 25s898ms, non-child: 25s898ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619621971) - NetworkThroughput(*): 333.60 MB/sec - OverallThroughput: 96.46 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 18s370ms - TransmitDataRPCTime: 7s488ms - UncompressedRowBatchSize: 4.82 GB (5178190084) HDFS_SCAN_NODE (id=1):(Total: 933.873ms, non-child: 933.873ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:97.18% 1:2.817% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 915.13 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 1.30 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.39 GB (1488939222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488939222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488939222) - DecompressionTime: 7s383ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 125.99 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 15.87K (15868) - ScannerThreadsTotalWallClockTime: 5m29s - MaterializeTupleTime(*): 5m20s - ScannerThreadsSysTime: 1s093ms - ScannerThreadsUserTime: 31s002ms - ScannerThreadsVoluntaryContextSwitches: 115.14K (115137) - TotalRawHdfsReadTime(*): 973.818ms - TotalReadThroughput: 40.00 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a7 (host=vb0228.halxg.cloudera.com:22000):(Total: 35s368ms, non-child: 9s772ms, % non-child: 27.63%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB MemoryUsage(1s000ms): 491.07 MB, 982.74 MB, 982.83 MB, 982.75 MB, 978.80 MB, 880.32 MB, 808.99 MB, 808.88 MB, 808.75 MB, 808.85 MB, 756.75 MB, 696.97 MB, 632.96 MB, 632.95 MB, 632.84 MB, 556.78 MB, 544.93 MB, 492.64 MB, 442.77 MB, 440.71 MB, 368.70 MB, 364.93 MB, 360.79 MB, 319.97 MB, 535.89 MB, 535.75 MB, 508.18 MB, 440.92 MB, 440.79 MB, 404.80 MB, 340.78 MB, 332.82 MB, 288.95 MB, 244.73 MB, 162.43 MB, 77.72 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 3 - AverageThreadTokens: 10.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 983.55 MB (1031327760) - PerHostPeakMemUsage: 4.65 GB (4996772272) - PrepareTime: 140.775ms - RowsProduced: 116.10M (116100730) - TotalCpuTime: 5m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s925ms - TotalStorageWaitTime: 687.804ms CodeGen:(Total: 325.665ms, non-child: 325.665ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.493ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.296ms - PrepareTime: 136.817ms DataStreamSender (dst_id=5):(Total: 24s247ms, non-child: 24s247ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2584029638) - NetworkThroughput(*): 395.01 MB/sec - OverallThroughput: 101.63 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 17s962ms - TransmitDataRPCTime: 6s238ms - UncompressedRowBatchSize: 4.76 GB (5109567616) HDFS_SCAN_NODE (id=1):(Total: 1s023ms, non-child: 1s023ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 450.23 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 900.47 MB, 942.23 MB, 984.00 MB, 984.00 MB, 984.00 MB, 984.00 MB, 1.06 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.15 - BytesRead: 1.37 GB (1469705850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469705850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469705850) - DecompressionTime: 7s878ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 983.15 MB (1030906032) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 113.49 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.93K (17929) - ScannerThreadsTotalWallClockTime: 5m28s - MaterializeTupleTime(*): 5m18s - ScannerThreadsSysTime: 1s075ms - ScannerThreadsUserTime: 33s187ms - ScannerThreadsVoluntaryContextSwitches: 113.61K (113611) - TotalRawHdfsReadTime(*): 867.773ms - TotalReadThroughput: 38.93 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f579e (host=vb0230.halxg.cloudera.com:22000):(Total: 34s942ms, non-child: 7s322ms, % non-child: 20.96%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 501.00 MB, 1002.59 MB, 1002.81 MB, 1002.68 MB, 987.07 MB, 872.57 MB, 828.77 MB, 829.01 MB, 828.83 MB, 828.73 MB, 740.96 MB, 696.93 MB, 652.84 MB, 652.98 MB, 644.96 MB, 564.77 MB, 564.81 MB, 456.91 MB, 389.07 MB, 345.21 MB, 301.17 MB, 301.22 MB, 233.16 MB, 562.15 MB, 551.69 MB, 528.07 MB, 456.84 MB, 456.75 MB, 432.90 MB, 360.78 MB, 360.64 MB, 312.85 MB, 241.05 MB, 192.85 MB, 168.85 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258416) - PerHostPeakMemUsage: 4.59 GB (4928214304) - PrepareTime: 144.568ms - RowsProduced: 117.66M (117659846) - TotalCpuTime: 5m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s639ms - TotalStorageWaitTime: 464.589ms CodeGen:(Total: 326.466ms, non-child: 326.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.362ms - PrepareTime: 140.794ms DataStreamSender (dst_id=5):(Total: 26s491ms, non-child: 26s491ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2621095936) - NetworkThroughput(*): 290.78 MB/sec - OverallThroughput: 94.36 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 17s851ms - TransmitDataRPCTime: 8s596ms - UncompressedRowBatchSize: 4.82 GB (5178183964) HDFS_SCAN_NODE (id=1):(Total: 802.040ms, non-child: 802.040ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.23 - BytesRead: 1.39 GB (1488963118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488963118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488963118) - DecompressionTime: 5s472ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 146.70 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.63K (11635) - ScannerThreadsTotalWallClockTime: 5m23s - MaterializeTupleTime(*): 5m17s - ScannerThreadsSysTime: 744.881ms - ScannerThreadsUserTime: 22s680ms - ScannerThreadsVoluntaryContextSwitches: 115.05K (115053) - TotalRawHdfsReadTime(*): 1s015ms - TotalReadThroughput: 40.00 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a1 (host=vb0212.halxg.cloudera.com:22000):(Total: 34s086ms, non-child: 9s409ms, % non-child: 27.60%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB MemoryUsage(1s000ms): 505.80 MB, 1002.97 MB, 1002.88 MB, 1002.80 MB, 1003.07 MB, 912.24 MB, 829.02 MB, 828.83 MB, 829.07 MB, 828.73 MB, 784.90 MB, 725.10 MB, 652.90 MB, 652.65 MB, 652.77 MB, 592.94 MB, 564.88 MB, 520.84 MB, 425.21 MB, 389.19 MB, 301.07 MB, 301.12 MB, 301.05 MB, 200.64 MB, 461.50 MB, 461.49 MB, 402.13 MB, 382.38 MB, 362.49 MB, 302.38 MB, 282.36 MB, 242.20 MB, 174.47 MB, 142.33 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.52 MB (1052266520) - PerHostPeakMemUsage: 4.44 GB (4766499912) - PrepareTime: 148.547ms - RowsProduced: 110.74M (110738660) - TotalCpuTime: 5m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s829ms - TotalStorageWaitTime: 516.256ms CodeGen:(Total: 331.411ms, non-child: 331.411ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.306ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.438ms - PrepareTime: 144.546ms DataStreamSender (dst_id=5):(Total: 23s313ms, non-child: 23s313ms, % non-child: 100.00%) - BytesSent: 2.30 GB (2465593819) - NetworkThroughput(*): 401.45 MB/sec - OverallThroughput: 100.86 MB/sec - PeakMemoryUsage: 467.93 KB (479160) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 17s410ms - TransmitDataRPCTime: 5s857ms - UncompressedRowBatchSize: 4.54 GB (4873584088) HDFS_SCAN_NODE (id=1):(Total: 1s032ms, non-child: 1s032ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.55% 1:0% 2:0% 3:1.449% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 459.69 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.17 - BytesRead: 1.31 GB (1401382482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401382482) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401382482) - DecompressionTime: 7s659ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877464) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 107.30 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 16.90K (16903) - ScannerThreadsTotalWallClockTime: 5m12s - MaterializeTupleTime(*): 5m3s - ScannerThreadsSysTime: 1s075ms - ScannerThreadsUserTime: 32s076ms - ScannerThreadsVoluntaryContextSwitches: 108.45K (108450) - TotalRawHdfsReadTime(*): 954.306ms - TotalReadThroughput: 38.74 MB/sec Instance 234afa13a3a031e4:6f3d75e2508f57a8 (host=vb0220.halxg.cloudera.com:22000):(Total: 33s753ms, non-child: 6s583ms, % non-child: 19.51%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB MemoryUsage(1s000ms): 500.83 MB, 1003.05 MB, 1002.91 MB, 1002.82 MB, 1002.95 MB, 904.31 MB, 828.75 MB, 828.86 MB, 828.86 MB, 828.76 MB, 772.90 MB, 716.92 MB, 653.23 MB, 652.84 MB, 652.79 MB, 568.84 MB, 564.99 MB, 496.90 MB, 392.99 MB, 389.15 MB, 301.08 MB, 300.73 MB, 277.19 MB, 336.81 MB, 461.39 MB, 441.47 MB, 382.44 MB, 382.40 MB, 342.33 MB, 302.17 MB, 282.47 MB, 242.42 MB, 162.49 MB, 142.52 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 9.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.46 MB (1052201232) - PerHostPeakMemUsage: 4.44 GB (4766337384) - PrepareTime: 139.652ms - RowsProduced: 110.74M (110738953) - TotalCpuTime: 5m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s938ms - TotalStorageWaitTime: 626.029ms CodeGen:(Total: 320.485ms, non-child: 320.485ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.545ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.188ms - PrepareTime: 137.426ms DataStreamSender (dst_id=5):(Total: 25s997ms, non-child: 25s997ms, % non-child: 100.00%) - BytesSent: 2.30 GB (2465179207) - NetworkThroughput(*): 277.19 MB/sec - OverallThroughput: 90.43 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 17s476ms - TransmitDataRPCTime: 8s481ms - UncompressedRowBatchSize: 4.54 GB (4873596984) HDFS_SCAN_NODE (id=1):(Total: 851.409ms, non-child: 851.409ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.04 - BytesRead: 1.31 GB (1401416952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401416952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401416952) - DecompressionTime: 6s208ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812184) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 130.07 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 13.59K (13589) - ScannerThreadsTotalWallClockTime: 5m7s - MaterializeTupleTime(*): 5m - ScannerThreadsSysTime: 918.857ms - ScannerThreadsUserTime: 25s785ms - ScannerThreadsVoluntaryContextSwitches: 108.33K (108335) - TotalRawHdfsReadTime(*): 896.701ms - TotalReadThroughput: 39.31 MB/sec Fragment F00: Instance 234afa13a3a031e4:6f3d75e2508f57b5 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m36s, non-child: 1m20s, % non-child: 83.19%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Filter 0 arrival: 38s416ms MemoryUsage(2s000ms): 70.08 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.04 MB, 140.09 MB, 140.16 MB, 141.02 MB, 141.08 MB, 141.08 MB, 141.16 MB, 141.17 MB, 141.08 MB, 141.05 MB, 141.12 MB, 141.15 MB, 93.23 MB, 53.29 MB, 53.33 MB, 81.82 MB, 91.46 MB, 91.47 MB, 91.50 MB, 91.52 MB, 49.62 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12146775816) - PrepareTime: 234.279us - RowsProduced: 124.58M (124580591) - TotalCpuTime: 17m8s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 213.198ms DataStreamSender (dst_id=4):(Total: 14s631ms, non-child: 14s631ms, % non-child: 100.00%) - BytesSent: 959.80 MB (1006425398) - NetworkThroughput(*): 263.16 MB/sec - OverallThroughput: 65.60 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 10s963ms - TransmitDataRPCTime: 3s647ms - UncompressedRowBatchSize: 2.32 GB (2492098492) HDFS_SCAN_NODE (id=0):(Total: 1s535ms, non-child: 1s535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 172.28 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.83 MB (200100815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200100815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200100815) - DecompressionTime: 1s434ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 81.11 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.84K (5836) - ScannerThreadsTotalWallClockTime: 16m40s - MaterializeTupleTime(*): 16m39s - ScannerThreadsSysTime: 392.934ms - ScannerThreadsUserTime: 9s259ms - ScannerThreadsVoluntaryContextSwitches: 121.75K (121750) - TotalRawHdfsReadTime(*): 137.998ms - TotalReadThroughput: 1.98 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57af (host=vb0214.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m18s, % non-child: 82.18%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Filter 0 arrival: 38s467ms MemoryUsage(2s000ms): 69.22 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.31 MB, 138.87 MB, 139.07 MB, 139.07 MB, 139.12 MB, 139.09 MB, 139.14 MB, 139.09 MB, 139.11 MB, 73.29 MB, 51.33 MB, 58.75 MB, 83.75 MB, 91.57 MB, 91.54 MB, 91.50 MB, 91.52 MB, 73.55 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.44 MB (146212616) - PerHostPeakMemUsage: 11.31 GB (12140281472) - PrepareTime: 201.171us - RowsProduced: 124.06M (124059923) - TotalCpuTime: 16m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 214.917ms DataStreamSender (dst_id=4):(Total: 15s324ms, non-child: 15s324ms, % non-child: 100.00%) - BytesSent: 952.76 MB (999040790) - NetworkThroughput(*): 211.54 MB/sec - OverallThroughput: 62.17 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 10s794ms - TransmitDataRPCTime: 4s503ms - UncompressedRowBatchSize: 2.31 GB (2481683100) HDFS_SCAN_NODE (id=0):(Total: 1s645ms, non-child: 1s645ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.91 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 123.78 MB, 174.12 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 190.02 MB (199253188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.02 MB (199253188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.02 MB (199253188) - DecompressionTime: 1s482ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.96 MB (145708808) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 75.41 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.29K (5295) - ScannerThreadsTotalWallClockTime: 16m25s - MaterializeTupleTime(*): 16m23s - ScannerThreadsSysTime: 447.927ms - ScannerThreadsUserTime: 9s337ms - ScannerThreadsVoluntaryContextSwitches: 121.30K (121295) - TotalRawHdfsReadTime(*): 132.043ms - TotalReadThroughput: 1.99 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b1 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m18s, % non-child: 82.44%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Filter 0 arrival: 38s466ms MemoryUsage(2s000ms): 70.18 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.19 MB, 140.19 MB, 141.16 MB, 141.11 MB, 141.16 MB, 141.06 MB, 141.12 MB, 141.07 MB, 141.11 MB, 141.12 MB, 53.33 MB, 53.23 MB, 62.63 MB, 91.52 MB, 91.54 MB, 91.53 MB, 91.44 MB, 91.53 MB, 63.56 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.44 MB (148309768) - PerHostPeakMemUsage: 11.31 GB (12142259544) - PrepareTime: 302.520us - RowsProduced: 124.58M (124581482) - TotalCpuTime: 16m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 206.489ms DataStreamSender (dst_id=4):(Total: 14s998ms, non-child: 14s998ms, % non-child: 100.00%) - BytesSent: 956.74 MB (1003209849) - NetworkThroughput(*): 219.47 MB/sec - OverallThroughput: 63.79 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 10s615ms - TransmitDataRPCTime: 4s359ms - UncompressedRowBatchSize: 2.32 GB (2492116308) HDFS_SCAN_NODE (id=0):(Total: 1s711ms, non-child: 1s711ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 135.17 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 190.84 MB (200107069) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200107069) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200107069) - DecompressionTime: 1s313ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 72.81 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.11K (6109) - ScannerThreadsTotalWallClockTime: 16m23s - MaterializeTupleTime(*): 16m21s - ScannerThreadsSysTime: 411.932ms - ScannerThreadsUserTime: 8s693ms - ScannerThreadsVoluntaryContextSwitches: 121.82K (121819) - TotalRawHdfsReadTime(*): 123.100ms - TotalReadThroughput: 2.01 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57ba (host=vb0222.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m18s, % non-child: 82.56%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 62.61 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 137.53 MB, 137.68 MB, 137.63 MB, 137.56 MB, 137.57 MB, 137.68 MB, 137.69 MB, 121.68 MB, 60.47 MB, 61.33 MB, 69.92 MB, 91.50 MB, 91.56 MB, 91.49 MB, 91.48 MB, 83.54 MB, 58.51 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.95 MB (144647944) - PerHostPeakMemUsage: 11.29 GB (12126427320) - PrepareTime: 179.759us - RowsProduced: 123.30M (123304062) - TotalCpuTime: 16m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 200.125ms DataStreamSender (dst_id=4):(Total: 14s881ms, non-child: 14s881ms, % non-child: 100.00%) - BytesSent: 947.41 MB (993435645) - NetworkThroughput(*): 187.82 MB/sec - OverallThroughput: 63.67 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 9s816ms - TransmitDataRPCTime: 5s044ms - UncompressedRowBatchSize: 2.30 GB (2466562928) HDFS_SCAN_NODE (id=0):(Total: 1s678ms, non-child: 1s678ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 52.16 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 104.32 MB, 114.91 MB, 114.91 MB, 114.91 MB, 114.91 MB, 114.91 MB, 114.91 MB, 114.91 MB, 114.91 MB, 122.87 MB, 125.52 MB, 141.42 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 189.14 MB (198324470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.14 MB (198324470) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.14 MB (198324470) - DecompressionTime: 1s325ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.48 MB (144160520) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 73.46 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5.92K (5925) - ScannerThreadsTotalWallClockTime: 16m19s - MaterializeTupleTime(*): 16m18s - ScannerThreadsSysTime: 460.925ms - ScannerThreadsUserTime: 8s755ms - ScannerThreadsVoluntaryContextSwitches: 120.52K (120518) - TotalRawHdfsReadTime(*): 122.760ms - TotalReadThroughput: 1.99 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b9 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m18s, % non-child: 82.65%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 69.17 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.32 MB, 138.97 MB, 139.05 MB, 139.12 MB, 139.21 MB, 139.18 MB, 139.05 MB, 139.16 MB, 133.19 MB, 51.35 MB, 56.35 MB, 70.68 MB, 91.52 MB, 91.59 MB, 91.56 MB, 91.50 MB, 89.56 MB, 57.61 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.42 MB (146196232) - PerHostPeakMemUsage: 11.31 GB (12140318448) - PrepareTime: 292.709us - RowsProduced: 123.88M (123876716) - TotalCpuTime: 16m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 221.408ms DataStreamSender (dst_id=4):(Total: 14s806ms, non-child: 14s806ms, % non-child: 100.00%) - BytesSent: 949.55 MB (995675113) - NetworkThroughput(*): 189.82 MB/sec - OverallThroughput: 64.13 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 9s781ms - TransmitDataRPCTime: 5s002ms - UncompressedRowBatchSize: 2.31 GB (2478018236) HDFS_SCAN_NODE (id=0):(Total: 1s648ms, non-child: 1s648ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.79 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 120.88 MB, 144.73 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 189.79 MB (199012872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.79 MB (199012872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.79 MB (199012872) - DecompressionTime: 1s323ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.02 MB (145774352) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 75.16 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.80K (5803) - ScannerThreadsTotalWallClockTime: 16m18s - MaterializeTupleTime(*): 16m16s - ScannerThreadsSysTime: 480.922ms - ScannerThreadsUserTime: 8s709ms - ScannerThreadsVoluntaryContextSwitches: 121.05K (121054) - TotalRawHdfsReadTime(*): 129.747ms - TotalReadThroughput: 2.00 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57ae (host=vb0204.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m18s, % non-child: 83.14%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 70.13 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.97 MB, 139.98 MB, 140.00 MB, 140.97 MB, 141.18 MB, 141.04 MB, 141.07 MB, 141.16 MB, 141.08 MB, 141.10 MB, 141.12 MB, 75.29 MB, 53.34 MB, 57.39 MB, 91.43 MB, 91.50 MB, 91.53 MB, 91.53 MB, 91.48 MB, 59.56 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12142115664) - PrepareTime: 275.337us - RowsProduced: 124.58M (124581324) - TotalCpuTime: 16m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 203.962ms DataStreamSender (dst_id=4):(Total: 14s315ms, non-child: 14s315ms, % non-child: 100.00%) - BytesSent: 957.23 MB (1003729832) - NetworkThroughput(*): 185.02 MB/sec - OverallThroughput: 66.87 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 9s121ms - TransmitDataRPCTime: 5s173ms - UncompressedRowBatchSize: 2.32 GB (2492113152) HDFS_SCAN_NODE (id=0):(Total: 1s669ms, non-child: 1s669ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 121.92 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 190.83 MB (200096771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200096771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200096771) - DecompressionTime: 1s359ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 74.62 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.71K (5707) - ScannerThreadsTotalWallClockTime: 16m20s - MaterializeTupleTime(*): 16m18s - ScannerThreadsSysTime: 545.910ms - ScannerThreadsUserTime: 8s951ms - ScannerThreadsVoluntaryContextSwitches: 121.77K (121774) - TotalRawHdfsReadTime(*): 131.532ms - TotalReadThroughput: 2.01 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57ac (host=vb0208.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m19s, % non-child: 84.08%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Filter 0 arrival: 38s467ms MemoryUsage(2s000ms): 62.48 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 124.84 MB, 137.04 MB, 137.07 MB, 137.19 MB, 137.08 MB, 137.11 MB, 137.18 MB, 137.11 MB, 137.65 MB, 65.38 MB, 59.33 MB, 67.31 MB, 89.53 MB, 89.50 MB, 89.56 MB, 85.45 MB, 80.27 MB, 47.19 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.63 MB (146416152) - PerHostPeakMemUsage: 11.29 GB (12126135104) - PrepareTime: 177.911us - RowsProduced: 122.21M (122205738) - TotalCpuTime: 16m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 231.239ms DataStreamSender (dst_id=4):(Total: 13s444ms, non-child: 13s444ms, % non-child: 100.00%) - BytesSent: 938.04 MB (983603248) - NetworkThroughput(*): 250.89 MB/sec - OverallThroughput: 69.77 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 9s684ms - TransmitDataRPCTime: 3s738ms - UncompressedRowBatchSize: 2.28 GB (2444592156) HDFS_SCAN_NODE (id=0):(Total: 1s624ms, non-child: 1s624ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 51.91 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 103.82 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 116.79 MB, 123.89 MB, 123.89 MB, 134.50 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 187.51 MB (196616751) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.51 MB (196616751) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.51 MB (196616751) - DecompressionTime: 1s476ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.22 MB (145977880) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 75.23 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.71K (6710) - ScannerThreadsTotalWallClockTime: 16m16s - MaterializeTupleTime(*): 16m14s - ScannerThreadsSysTime: 541.910ms - ScannerThreadsUserTime: 10s072ms - ScannerThreadsVoluntaryContextSwitches: 119.46K (119463) - TotalRawHdfsReadTime(*): 124.019ms - TotalReadThroughput: 1.98 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b4 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m19s, % non-child: 83.92%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Filter 0 arrival: 38s466ms MemoryUsage(2s000ms): 70.15 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.22 MB, 140.21 MB, 140.99 MB, 141.07 MB, 141.14 MB, 141.17 MB, 141.09 MB, 141.16 MB, 141.18 MB, 119.15 MB, 53.39 MB, 53.40 MB, 72.18 MB, 91.56 MB, 91.48 MB, 91.59 MB, 91.48 MB, 85.55 MB, 35.62 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148326160) - PerHostPeakMemUsage: 11.31 GB (12142294912) - PrepareTime: 184.786us - RowsProduced: 124.58M (124581192) - TotalCpuTime: 16m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 202.167ms DataStreamSender (dst_id=4):(Total: 13s656ms, non-child: 13s656ms, % non-child: 100.00%) - BytesSent: 954.68 MB (1001055538) - NetworkThroughput(*): 163.46 MB/sec - OverallThroughput: 69.91 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 7s799ms - TransmitDataRPCTime: 5s840ms - UncompressedRowBatchSize: 2.32 GB (2492110512) HDFS_SCAN_NODE (id=0):(Total: 1s502ms, non-child: 1s502ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 153.73 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 190.83 MB (200101820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101820) - DecompressionTime: 1s096ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 82.93 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 4.21K (4211) - ScannerThreadsTotalWallClockTime: 16m12s - MaterializeTupleTime(*): 16m11s - ScannerThreadsSysTime: 215.962ms - ScannerThreadsUserTime: 6s817ms - ScannerThreadsVoluntaryContextSwitches: 121.76K (121761) - TotalRawHdfsReadTime(*): 125.456ms - TotalReadThroughput: 2.02 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b2 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 84.09%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Filter 0 arrival: 38s466ms MemoryUsage(2s000ms): 70.19 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.24 MB, 140.21 MB, 140.19 MB, 141.02 MB, 141.18 MB, 141.16 MB, 141.07 MB, 141.17 MB, 140.96 MB, 141.15 MB, 131.05 MB, 53.36 MB, 53.35 MB, 67.69 MB, 79.12 MB, 79.11 MB, 79.16 MB, 79.17 MB, 55.22 MB, 29.23 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317960) - PerHostPeakMemUsage: 11.31 GB (12142281984) - PrepareTime: 309.593us - RowsProduced: 117.66M (117660001) - TotalCpuTime: 16m22s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 212.122ms DataStreamSender (dst_id=4):(Total: 13s381ms, non-child: 13s381ms, % non-child: 100.00%) - BytesSent: 900.37 MB (944108811) - NetworkThroughput(*): 207.09 MB/sec - OverallThroughput: 67.29 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 9s013ms - TransmitDataRPCTime: 4s347ms - UncompressedRowBatchSize: 2.19 GB (2353659652) HDFS_SCAN_NODE (id=0):(Total: 1s549ms, non-child: 1s549ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 143.14 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 180.24 MB (188994044) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188994044) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188994044) - DecompressionTime: 1s301ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 75.94 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.20K (5202) - ScannerThreadsTotalWallClockTime: 16m - MaterializeTupleTime(*): 15m58s - ScannerThreadsSysTime: 382.937ms - ScannerThreadsUserTime: 8s373ms - ScannerThreadsVoluntaryContextSwitches: 115.00K (115003) - TotalRawHdfsReadTime(*): 121.323ms - TotalReadThroughput: 1.92 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b8 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 83.71%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 70.19 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.27 MB, 140.30 MB, 140.29 MB, 141.14 MB, 141.08 MB, 141.07 MB, 141.14 MB, 141.22 MB, 141.02 MB, 141.16 MB, 139.15 MB, 53.29 MB, 53.32 MB, 63.11 MB, 79.11 MB, 79.17 MB, 79.15 MB, 79.11 MB, 55.23 MB, 29.22 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.31 GB (12146521864) - PrepareTime: 307.070us - RowsProduced: 117.66M (117659888) - TotalCpuTime: 16m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 200.006ms DataStreamSender (dst_id=4):(Total: 13s654ms, non-child: 13s654ms, % non-child: 100.00%) - BytesSent: 899.63 MB (943332628) - NetworkThroughput(*): 180.05 MB/sec - OverallThroughput: 65.88 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 8s639ms - TransmitDataRPCTime: 4s996ms - UncompressedRowBatchSize: 2.19 GB (2353657400) HDFS_SCAN_NODE (id=0):(Total: 1s609ms, non-child: 1s609ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 132.54 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.23 - BytesRead: 180.25 MB (189010714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010714) - DecompressionTime: 1s211ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 73.12 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.40K (5401) - ScannerThreadsTotalWallClockTime: 16m - MaterializeTupleTime(*): 15m58s - ScannerThreadsSysTime: 401.932ms - ScannerThreadsUserTime: 8s032ms - ScannerThreadsVoluntaryContextSwitches: 114.97K (114971) - TotalRawHdfsReadTime(*): 126.624ms - TotalReadThroughput: 1.92 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b6 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m19s, % non-child: 84.83%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 68.17 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.21 MB, 136.16 MB, 136.20 MB, 137.09 MB, 137.10 MB, 137.09 MB, 137.07 MB, 137.15 MB, 137.08 MB, 137.13 MB, 137.13 MB, 78.20 MB, 61.32 MB, 61.32 MB, 78.99 MB, 79.09 MB, 79.16 MB, 73.14 MB, 50.96 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.43 MB (144107272) - PerHostPeakMemUsage: 11.30 GB (12138027848) - PrepareTime: 166.500us - RowsProduced: 116.10M (116100730) - TotalCpuTime: 16m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 205.381ms DataStreamSender (dst_id=4):(Total: 12s548ms, non-child: 12s548ms, % non-child: 100.00%) - BytesSent: 889.64 MB (932856011) - NetworkThroughput(*): 219.44 MB/sec - OverallThroughput: 70.89 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 8s476ms - TransmitDataRPCTime: 4s054ms - UncompressedRowBatchSize: 2.16 GB (2322468144) HDFS_SCAN_NODE (id=0):(Total: 1s654ms, non-child: 1s654ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.26 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 114.53 MB, 122.47 MB, 125.12 MB, 125.12 MB, 178.14 MB, 178.14 MB, 178.14 MB, 178.14 MB, 178.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 178.14 MB (186788144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.14 MB (186788144) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.14 MB (186788144) - DecompressionTime: 1s423ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.02 MB (143677200) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 70.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.13K (6133) - ScannerThreadsTotalWallClockTime: 15m59s - MaterializeTupleTime(*): 15m57s - ScannerThreadsSysTime: 535.913ms - ScannerThreadsUserTime: 9s445ms - ScannerThreadsVoluntaryContextSwitches: 113.51K (113510) - TotalRawHdfsReadTime(*): 108.654ms - TotalReadThroughput: 1.91 MB/sec Filter 0: - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) Instance 234afa13a3a031e4:6f3d75e2508f57ad (host=vb0230.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m19s, % non-child: 84.83%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Filter 0 arrival: 38s468ms MemoryUsage(2s000ms): 70.18 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.02 MB, 140.01 MB, 140.00 MB, 141.10 MB, 141.07 MB, 141.17 MB, 141.09 MB, 141.19 MB, 141.14 MB, 141.16 MB, 141.13 MB, 55.43 MB, 53.35 MB, 59.70 MB, 79.16 MB, 79.14 MB, 79.13 MB, 79.11 MB, 43.20 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301584) - PerHostPeakMemUsage: 11.31 GB (12146423552) - PrepareTime: 204.878us - RowsProduced: 117.66M (117659846) - TotalCpuTime: 16m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 189.157ms DataStreamSender (dst_id=4):(Total: 12s596ms, non-child: 12s596ms, % non-child: 100.00%) - BytesSent: 901.45 MB (945238447) - NetworkThroughput(*): 185.28 MB/sec - OverallThroughput: 71.56 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 7s714ms - TransmitDataRPCTime: 4s865ms - UncompressedRowBatchSize: 2.19 GB (2353656552) HDFS_SCAN_NODE (id=0):(Total: 1s577ms, non-child: 1s577ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 132.55 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 180.25 MB (189007782) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189007782) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189007782) - DecompressionTime: 1s238ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 74.58 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.47K (4473) - ScannerThreadsTotalWallClockTime: 15m56s - MaterializeTupleTime(*): 15m55s - ScannerThreadsSysTime: 417.931ms - ScannerThreadsUserTime: 8s295ms - ScannerThreadsVoluntaryContextSwitches: 115.01K (115011) - TotalRawHdfsReadTime(*): 114.252ms - TotalReadThroughput: 1.93 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b3 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 83.79%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Filter 0 arrival: 38s467ms MemoryUsage(2s000ms): 70.20 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.18 MB, 140.18 MB, 141.05 MB, 141.02 MB, 141.11 MB, 141.13 MB, 141.13 MB, 141.14 MB, 141.12 MB, 107.19 MB, 53.36 MB, 53.34 MB, 72.55 MB, 79.15 MB, 79.10 MB, 79.11 MB, 79.13 MB, 31.23 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.44 MB (148309776) - PerHostPeakMemUsage: 11.31 GB (12142247936) - PrepareTime: 478.540us - RowsProduced: 117.66M (117659985) - TotalCpuTime: 16m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 195.187ms DataStreamSender (dst_id=4):(Total: 13s590ms, non-child: 13s590ms, % non-child: 100.00%) - BytesSent: 900.20 MB (943925578) - NetworkThroughput(*): 167.83 MB/sec - OverallThroughput: 66.24 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 8s209ms - TransmitDataRPCTime: 5s363ms - UncompressedRowBatchSize: 2.19 GB (2353659332) HDFS_SCAN_NODE (id=0):(Total: 1s546ms, non-child: 1s546ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.31 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 164.34 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.16 - BytesRead: 180.25 MB (189002394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189002394) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189002394) - DecompressionTime: 1s131ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 76.07 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.54K (4541) - ScannerThreadsTotalWallClockTime: 15m53s - MaterializeTupleTime(*): 15m51s - ScannerThreadsSysTime: 355.940ms - ScannerThreadsUserTime: 7s428ms - ScannerThreadsVoluntaryContextSwitches: 114.98K (114978) - TotalRawHdfsReadTime(*): 120.040ms - TotalReadThroughput: 1.93 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b0 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 1m17s, % non-child: 83.18%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Filter 0 arrival: 38s466ms MemoryUsage(2s000ms): 70.17 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.33 MB, 141.18 MB, 141.17 MB, 141.19 MB, 141.15 MB, 141.16 MB, 141.03 MB, 141.11 MB, 141.07 MB, 75.35 MB, 53.35 MB, 53.37 MB, 66.59 MB, 66.74 MB, 66.71 MB, 66.73 MB, 26.84 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12143400704) - PrepareTime: 288.097us - RowsProduced: 110.74M (110738660) - TotalCpuTime: 16m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 206.119ms DataStreamSender (dst_id=4):(Total: 13s985ms, non-child: 13s985ms, % non-child: 100.00%) - BytesSent: 845.98 MB (887075032) - NetworkThroughput(*): 202.02 MB/sec - OverallThroughput: 60.49 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 9s775ms - TransmitDataRPCTime: 4s187ms - UncompressedRowBatchSize: 2.06 GB (2215205796) HDFS_SCAN_NODE (id=0):(Total: 1s625ms, non-child: 1s625ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 169.63 MB, 169.63 MB, 169.63 MB, 169.63 MB, 169.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.17 - BytesRead: 169.63 MB (177871166) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.63 MB (177871166) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.63 MB (177871166) - DecompressionTime: 1s307ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 68.13 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 5.60K (5604) - ScannerThreadsTotalWallClockTime: 15m47s - MaterializeTupleTime(*): 15m45s - ScannerThreadsSysTime: 459.926ms - ScannerThreadsUserTime: 8s286ms - ScannerThreadsVoluntaryContextSwitches: 108.34K (108343) - TotalRawHdfsReadTime(*): 130.451ms - TotalReadThroughput: 1.82 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 234afa13a3a031e4:6f3d75e2508f57b7 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 1m18s, % non-child: 84.65%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Filter 0 arrival: 38s465ms MemoryUsage(2s000ms): 70.10 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.14 MB, 140.19 MB, 141.06 MB, 141.18 MB, 141.07 MB, 141.08 MB, 141.05 MB, 141.25 MB, 141.10 MB, 141.13 MB, 75.23 MB, 53.27 MB, 53.35 MB, 63.31 MB, 66.71 MB, 66.73 MB, 66.71 MB, 32.85 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 6, 6, 6, 6 - AverageThreadTokens: 11.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.31 GB (12142260000) - PrepareTime: 173.688us - RowsProduced: 110.74M (110738953) - TotalCpuTime: 16m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 217.205ms DataStreamSender (dst_id=4):(Total: 12s660ms, non-child: 12s660ms, % non-child: 100.00%) - BytesSent: 846.40 MB (887518817) - NetworkThroughput(*): 265.20 MB/sec - OverallThroughput: 66.86 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 9s448ms - TransmitDataRPCTime: 3s191ms - UncompressedRowBatchSize: 2.06 GB (2215211668) HDFS_SCAN_NODE (id=0):(Total: 1s549ms, non-child: 1s549ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.32 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 156.41 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.20 - BytesRead: 169.66 MB (177902248) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177902248) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177902248) - DecompressionTime: 1s294ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 71.46 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 5.45K (5452) - ScannerThreadsTotalWallClockTime: 15m45s - MaterializeTupleTime(*): 15m44s - ScannerThreadsSysTime: 364.939ms - ScannerThreadsUserTime: 8s401ms - ScannerThreadsVoluntaryContextSwitches: 108.24K (108242) - TotalRawHdfsReadTime(*): 120.229ms - TotalReadThroughput: 1.82 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 347.72ms | 0ns | 347.72ms | 1 | 1 | | 06:EXCHANGE | 1 | 172.56us | 0ns | 172.56us | 15 | 1 | | 03:AGGREGATE | 15 | 867.23ms | 0ns | 936.31ms | 15 | 1 | | 02:HASH JOIN | 15 | 67.66s | 0ns | 71.76s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 8.08s | 0ns | 12.86s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 1.00s | 0ns | 1.10s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 3.26s | 0ns | 3.63s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 1.63s | 0ns | 1.78s | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=43435c6d36c99c38:581697e88a6bedbe): Summary: Session ID: 654fbe4ed92d59de:89f3265ef40fd48a Session Type: BEESWAX Start Time: 2016-04-26 17:26:10.931004000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 35713197462670a62625b3b36c9af3f24339abc5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50494 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 24.452ms - Analysis finished: 4.710ms (4.710ms) - Equivalence classes computed: 5.121ms (411.061us) - Single node plan created: 13.312ms (8.190ms) - Runtime filters computed: 13.581ms (269.667us) - Distributed plan created: 18.796ms (5.214ms) - Lineage info computed: 20.146ms (1.350ms) - Planning finished: 24.452ms (4.306ms) Query Timeline: 1m36s - Start execution: 214.374us (214.374us) - Planning finished: 31.704ms (31.490ms) - Ready to start 45 remote fragments: 383.980ms (352.276ms) - All 45 remote fragments started: 390.286ms (6.305ms) - First dynamic filter received: 37s828ms (37s438ms) - Rows available: 1m36s (58s387ms) - First row fetched: 1m36s (5.552ms) ImpalaServer: - ClientFetchWaitTimer: 5.894ms - RowMaterializationTimer: 85.180us Execution Profile 43435c6d36c99c38:581697e88a6bedbe:(Total: 1m36s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 15 (15) N/A N/A Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 15 GLOBAL (Partition) false 0 (15) 37s828ms 37s828ms Per Node Peak Memory Usage: vb0222.halxg.cloudera.com:22000(11.30 GB) vb0224.halxg.cloudera.com:22000(11.31 GB) vb0218.halxg.cloudera.com:22000(11.31 GB) vb0220.halxg.cloudera.com:22000(11.31 GB) vb0228.halxg.cloudera.com:22000(11.31 GB) vb0206.halxg.cloudera.com:22000(11.31 GB) vb0234.halxg.cloudera.com:22000(11.31 GB) vb0216.halxg.cloudera.com:22000(11.31 GB) vb0226.halxg.cloudera.com:22000(11.31 GB) vb0232.halxg.cloudera.com:22000(11.31 GB) vb0212.halxg.cloudera.com:22000(11.31 GB) vb0214.halxg.cloudera.com:22000(11.31 GB) vb0230.halxg.cloudera.com:22000(11.31 GB) vb0208.halxg.cloudera.com:22000(11.29 GB) vb0204.halxg.cloudera.com:22000(11.31 GB) - FiltersReceived: 1 (1) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 9.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 347.167ms - RowsProduced: 1 (1) - TotalCpuTime: 560.164ms - TotalNetworkReceiveTime: 1m35s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 541.064ms, non-child: 541.064ms, % non-child: 100.00%) - CodegenTime: 1.674ms - CompileTime: 1.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 193.667ms - PrepareTime: 343.947ms AGGREGATION_NODE (id=7):(Total: 1m35s, non-child: 347.716ms, % non-child: 0.36%) ExecOption: Codegen Enabled - BuildTime: 11.385us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m35s, non-child: 172.557us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 28.694us - DeserializeRowBatchTimer: 66.670us - FirstBatchArrivalWaitTime: 1m35s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m35s max:1m35s mean: 1m35s stddev:29.825ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994714658) - PerHostPeakMemUsage: 11.31 GB (12140599915) - PrepareTime: 147.944ms - RowsProduced: 1 (1) - TotalCpuTime: 2m11s - TotalNetworkReceiveTime: 20s505ms - TotalNetworkSendTime: 552.065us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.012ms, non-child: 492.012ms, % non-child: 100.00%) - CodegenTime: 162.750us - CompileTime: 57.664ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 289.342ms - PrepareTime: 143.546ms DataStreamSender (dst_id=6):(Total: 56.585us, non-child: 56.585us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 567.19 KB/sec - OverallThroughput: 284.06 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.318us - TransmitDataRPCTime: 30.475us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 867.225ms, % non-child: 0.91%) - BuildTime: 483.367ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.95 KB (49099) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m7s, % non-child: 71.57%) - BuildPartitionTime: 18s479ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 14s654ms - GetNewBlockTime: 8.592ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s504ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.777us EXCHANGE_NODE (id=5):(Total: 18s263ms, non-child: 18s263ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671307037) - ConvertRowBatchTime: 3s653ms - DeserializeRowBatchTimer: 9s706ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 6.59 M/sec - SendersBlockedTimer: 1s645ms - SendersBlockedTotalTimer(*): 15s981ms EXCHANGE_NODE (id=4):(Total: 8s826ms, non-child: 8s826ms, % non-child: 100.00%) - BytesReceived: 962.24 MB (1008982243) - ConvertRowBatchTime: 2s391ms - DeserializeRowBatchTimer: 3s651ms - FirstBatchArrivalWaitTime: 528.669ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 14.36 M/sec - SendersBlockedTimer: 57s627ms - SendersBlockedTotalTimer(*): 11m40s Averaged Fragment F01:(Total: 35s658ms, non-child: 8s381ms, % non-child: 23.50%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:33s622ms max:37s449ms mean: 36s118ms stddev:1s180ms execution rates: min:119.15 MB/sec max:124.07 MB/sec mean:121.62 MB/sec stddev:1.39 MB/sec num instances: 15 - AverageThreadTokens: 10.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 999.04 MB (1047568102) - PerHostPeakMemUsage: 4.74 GB (5091344852) - PrepareTime: 143.475ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 6m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s609ms - TotalStorageWaitTime: 551.279ms CodeGen:(Total: 327.916ms, non-child: 327.916ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.907ms - PrepareTime: 141.075ms DataStreamSender (dst_id=5):(Total: 25s947ms, non-child: 25s947ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671307037) - NetworkThroughput(*): 355.26 MB/sec - OverallThroughput: 98.44 MB/sec - PeakMemoryUsage: 435.40 KB (445845) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 18s539ms - TransmitDataRPCTime: 7s362ms - UncompressedRowBatchSize: 4.92 GB (5281141619) HDFS_SCAN_NODE (id=1):(Total: 1s001ms, non-child: 1s001ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 7s623ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 998.67 MB (1047179622) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 120.56 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.99K (16987) - ScannerThreadsTotalWallClockTime: 5m33s - MaterializeTupleTime(*): 5m24s - ScannerThreadsSysTime: 1s095ms - ScannerThreadsUserTime: 31s935ms - ScannerThreadsVoluntaryContextSwitches: 117.47K (117470) - TotalRawHdfsReadTime(*): 998.958ms - TotalReadThroughput: 40.26 MB/sec Averaged Fragment F00:(Total: 1m33s, non-child: 1m17s, % non-child: 82.69%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 174.26 MB completion times: min:1m29s max:1m35s mean: 1m33s stddev:1s551ms execution rates: min:44.36 MB/sec max:48.74 MB/sec mean:46.94 MB/sec stddev:1.37 MB/sec num instances: 15 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.07 MB (147919774) - PerHostPeakMemUsage: 11.31 GB (12140599915) - PrepareTime: 342.459us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 16m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 224.600ms DataStreamSender (dst_id=4):(Total: 14s535ms, non-child: 14s535ms, % non-child: 100.00%) - BytesSent: 962.24 MB (1008982243) - NetworkThroughput(*): 211.74 MB/sec - OverallThroughput: 66.46 MB/sec - PeakMemoryUsage: 535.73 KB (548590) - RowsReturned: 120.00M (119999272) - SerializeBatchTime: 9s905ms - TransmitDataRPCTime: 4s609ms - UncompressedRowBatchSize: 2.24 GB (2400454228) HDFS_SCAN_NODE (id=0):(Total: 1s632ms, non-child: 1s632ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s317ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.62 MB (147455834) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 73.65 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.62K (5619) - ScannerThreadsTotalWallClockTime: 16m1s - MaterializeTupleTime(*): 15m59s - ScannerThreadsSysTime: 453.525ms - ScannerThreadsUserTime: 8s580ms - ScannerThreadsVoluntaryContextSwitches: 117.31K (117312) - TotalRawHdfsReadTime(*): 129.982ms - TotalReadThroughput: 1.97 MB/sec Filter 0: - Rows processed: 181.31K (181305) - Rows rejected: 0 (0) - Rows total: 181.32K (181316) Fragment F02: Instance 43435c6d36c99c38:581697e88a6bedca (host=vb0228.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 156.86 MB, 519.53 MB, 823.07 MB, 1.04 GB, 1.25 GB, 1.56 GB, 1.76 GB, 2.00 GB, 2.24 GB, 2.50 GB, 2.69 GB, 2.93 GB, 3.18 GB, 3.41 GB, 3.62 GB, 3.87 GB, 4.13 GB, 4.35 GB, 4.61 GB, 5.18 GB, 5.88 GB, 6.53 GB, 7.18 GB, 7.96 GB, 8.77 GB, 9.44 GB, 10.24 GB, 10.98 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB, 11.17 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11995918336) - PerHostPeakMemUsage: 11.31 GB (12145145600) - PrepareTime: 147.942ms - RowsProduced: 1 (1) - TotalCpuTime: 2m14s - TotalNetworkReceiveTime: 16s403ms - TotalNetworkSendTime: 171.831us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 508.490ms, non-child: 508.490ms, % non-child: 100.00%) - CodegenTime: 153.384us - CompileTime: 69.426ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 293.909ms - PrepareTime: 143.995ms DataStreamSender (dst_id=6):(Total: 39.662us, non-child: 39.662us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 393.95 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.223us - TransmitDataRPCTime: 13.300us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 916.275ms, % non-child: 0.96%) ExecOption: Codegen Enabled - BuildTime: 485.369ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.64 KB (48784) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m11s, % non-child: 75.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 20s203ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 14s547ms - GetNewBlockTime: 10.457ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32s313ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.807us EXCHANGE_NODE (id=5):(Total: 16s464ms, non-child: 12s863ms, % non-child: 78.13%) BytesReceived(2s000ms): 56.44 MB, 226.91 MB, 399.64 MB, 536.02 MB, 664.16 MB, 820.19 MB, 957.72 MB, 1.06 GB, 1.20 GB, 1.33 GB, 1.45 GB, 1.59 GB, 1.72 GB, 1.84 GB, 1.97 GB, 2.10 GB, 2.25 GB, 2.38 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670718140) - ConvertRowBatchTime: 3s901ms - DeserializeRowBatchTimer: 12s417ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 7.29 M/sec - SendersBlockedTimer: 19s569ms - SendersBlockedTotalTimer(*): 3m10s EXCHANGE_NODE (id=4):(Total: 6s606ms, non-child: 2s777ms, % non-child: 42.04%) BytesReceived(2s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.16 MB, 18.07 MB, 73.61 MB, 128.35 MB, 180.43 MB, 232.48 MB, 284.71 MB, 337.54 MB, 390.33 MB, 443.08 MB, 495.61 MB, 548.47 MB, 601.39 MB, 654.47 MB, 707.02 MB, 759.84 MB, 813.29 MB, 866.90 MB, 920.05 MB - BytesReceived: 962.08 MB (1008815106) - ConvertRowBatchTime: 2s129ms - DeserializeRowBatchTimer: 2s645ms - FirstBatchArrivalWaitTime: 513.742ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 18.16 M/sec - SendersBlockedTimer: 1m26s - SendersBlockedTotalTimer(*): 18m43s Instance 43435c6d36c99c38:581697e88a6bedc9 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.52 MB, 495.96 MB, 806.00 MB, 1.02 GB, 1.24 GB, 1.54 GB, 1.79 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.71 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.61 GB, 3.85 GB, 4.11 GB, 4.35 GB, 4.61 GB, 5.25 GB, 6.07 GB, 6.90 GB, 7.73 GB, 8.56 GB, 9.39 GB, 10.14 GB, 10.75 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 8.43 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994574848) - PerHostPeakMemUsage: 11.31 GB (12142417264) - PrepareTime: 153.832ms - RowsProduced: 1 (1) - TotalCpuTime: 2m4s - TotalNetworkReceiveTime: 25s177ms - TotalNetworkSendTime: 210.451us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 497.261ms, non-child: 497.261ms, % non-child: 100.00%) - CodegenTime: 175.278us - CompileTime: 53.233ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 293.031ms - PrepareTime: 149.925ms DataStreamSender (dst_id=6):(Total: 67.189us, non-child: 67.189us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 365.11 KB/sec - OverallThroughput: 232.55 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.945us - TransmitDataRPCTime: 42.795us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 924.570ms, % non-child: 0.97%) ExecOption: Codegen Enabled - BuildTime: 511.808ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.61 KB (49776) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m3s, % non-child: 66.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s038ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 13s091ms - GetNewBlockTime: 7.856ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s308ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.268us EXCHANGE_NODE (id=5):(Total: 19s724ms, non-child: 8s846ms, % non-child: 44.85%) BytesReceived(2s000ms): 52.87 MB, 222.21 MB, 395.81 MB, 532.79 MB, 660.22 MB, 816.28 MB, 954.18 MB, 1.06 GB, 1.19 GB, 1.32 GB, 1.45 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.97 GB, 2.10 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670722220) - ConvertRowBatchTime: 3s210ms - DeserializeRowBatchTimer: 11s215ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 6.08 M/sec - SendersBlockedTimer: 2s367ms - SendersBlockedTotalTimer(*): 24s470ms EXCHANGE_NODE (id=4):(Total: 11s790ms, non-child: 3s451ms, % non-child: 29.27%) BytesReceived(2s000ms): 5.07 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.17 MB, 10.21 MB, 17.23 MB, 72.11 MB, 127.02 MB, 179.05 MB, 231.14 MB, 283.34 MB, 336.20 MB, 388.94 MB, 441.75 MB, 494.30 MB, 547.18 MB, 600.09 MB, 653.15 MB, 705.68 MB, 758.45 MB, 811.90 MB, 865.46 MB, 918.51 MB, 959.01 MB - BytesReceived: 961.99 MB (1008715463) - ConvertRowBatchTime: 2s596ms - DeserializeRowBatchTimer: 3s472ms - FirstBatchArrivalWaitTime: 526.366ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 10.18 M/sec - SendersBlockedTimer: 53s499ms - SendersBlockedTotalTimer(*): 12m28s Instance 43435c6d36c99c38:581697e88a6bedc1 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.49 MB, 485.96 MB, 805.96 MB, 1.04 GB, 1.22 GB, 1.54 GB, 1.77 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.70 GB, 2.91 GB, 3.16 GB, 3.41 GB, 3.61 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.18 GB, 5.90 GB, 6.62 GB, 7.26 GB, 7.85 GB, 8.38 GB, 8.91 GB, 9.52 GB, 10.14 GB, 10.75 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.65 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994550272) - PerHostPeakMemUsage: 11.31 GB (12142561744) - PrepareTime: 150.067ms - RowsProduced: 1 (1) - TotalCpuTime: 2m14s - TotalNetworkReceiveTime: 20s020ms - TotalNetworkSendTime: 182.301us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 483.834ms, non-child: 483.834ms, % non-child: 100.00%) - CodegenTime: 157.552us - CompileTime: 53.764ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 282.879ms - PrepareTime: 146.037ms DataStreamSender (dst_id=6):(Total: 49.306us, non-child: 49.306us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 636.27 KB/sec - OverallThroughput: 316.90 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.239us - TransmitDataRPCTime: 24.557us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 834.043ms, % non-child: 0.87%) ExecOption: Codegen Enabled - BuildTime: 456.953ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.11 KB (47216) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m8s, % non-child: 72.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s846ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 16s053ms - GetNewBlockTime: 7.537ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s016ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.885us EXCHANGE_NODE (id=5):(Total: 19s918ms, non-child: 7s426ms, % non-child: 37.29%) BytesReceived(2s000ms): 49.87 MB, 218.37 MB, 392.40 MB, 530.03 MB, 656.94 MB, 813.30 MB, 951.61 MB, 1.06 GB, 1.19 GB, 1.32 GB, 1.45 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.97 GB, 2.10 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671722946) - ConvertRowBatchTime: 3s304ms - DeserializeRowBatchTimer: 9s766ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 6.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s192ms, non-child: 3s187ms, % non-child: 51.47%) BytesReceived(2s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 10.14 MB, 16.41 MB, 70.70 MB, 125.91 MB, 178.03 MB, 230.17 MB, 282.36 MB, 335.30 MB, 388.17 MB, 440.93 MB, 493.51 MB, 546.36 MB, 599.30 MB, 652.37 MB, 704.81 MB, 757.58 MB, 810.97 MB, 864.60 MB, 917.66 MB, 959.02 MB - BytesReceived: 962.36 MB (1009107878) - ConvertRowBatchTime: 2s303ms - DeserializeRowBatchTimer: 3s792ms - FirstBatchArrivalWaitTime: 538.925ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 19.38 M/sec - SendersBlockedTimer: 57s519ms - SendersBlockedTotalTimer(*): 9m49s Instance 43435c6d36c99c38:581697e88a6bedc7 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 113.50 MB, 425.19 MB, 741.92 MB, 998.11 MB, 1.22 GB, 1.47 GB, 1.72 GB, 1.97 GB, 2.22 GB, 2.43 GB, 2.66 GB, 2.91 GB, 3.16 GB, 3.35 GB, 3.60 GB, 3.85 GB, 4.11 GB, 4.31 GB, 4.57 GB, 5.08 GB, 5.86 GB, 6.54 GB, 7.33 GB, 8.07 GB, 8.76 GB, 9.31 GB, 9.91 GB, 10.45 GB, 11.00 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.48 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994525696) - PerHostPeakMemUsage: 11.31 GB (12142621568) - PrepareTime: 144.693ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 17s773ms - TotalNetworkSendTime: 199.559us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 474.742ms, non-child: 474.742ms, % non-child: 100.00%) - CodegenTime: 169.908us - CompileTime: 54.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 278.343ms - PrepareTime: 140.036ms DataStreamSender (dst_id=6):(Total: 58.093us, non-child: 58.093us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 558.23 KB/sec - OverallThroughput: 268.96 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.429us - TransmitDataRPCTime: 27.990us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 879.421ms, % non-child: 0.92%) ExecOption: Codegen Enabled - BuildTime: 486.739ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.91 KB (52128) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m10s, % non-child: 74.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 20s028ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 15s458ms - GetNewBlockTime: 8.325ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s360ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.839us EXCHANGE_NODE (id=5):(Total: 16s734ms, non-child: 7s995ms, % non-child: 47.78%) BytesReceived(2s000ms): 69.92 MB, 243.63 MB, 412.86 MB, 547.98 MB, 677.76 MB, 833.71 MB, 970.74 MB, 1.08 GB, 1.21 GB, 1.34 GB, 1.47 GB, 1.60 GB, 1.73 GB, 1.86 GB, 1.98 GB, 2.12 GB, 2.26 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671477830) - ConvertRowBatchTime: 3s891ms - DeserializeRowBatchTimer: 9s308ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 7.17 M/sec - SendersBlockedTimer: 1s940ms - SendersBlockedTotalTimer(*): 17s065ms EXCHANGE_NODE (id=4):(Total: 7s904ms, non-child: 3s300ms, % non-child: 41.76%) BytesReceived(2s000ms): 5.05 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.12 MB, 21.19 MB, 79.26 MB, 133.29 MB, 185.47 MB, 237.46 MB, 289.76 MB, 342.69 MB, 395.53 MB, 448.27 MB, 500.86 MB, 553.71 MB, 606.64 MB, 659.59 MB, 712.10 MB, 764.91 MB, 818.53 MB, 872.15 MB, 925.42 MB - BytesReceived: 962.27 MB (1009009724) - ConvertRowBatchTime: 2s418ms - DeserializeRowBatchTimer: 3s712ms - FirstBatchArrivalWaitTime: 547.194ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 15.18 M/sec - SendersBlockedTimer: 56s408ms - SendersBlockedTotalTimer(*): 8m35s Instance 43435c6d36c99c38:581697e88a6bedcd (host=vb0224.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 148.40 MB, 478.21 MB, 805.96 MB, 1.01 GB, 1.22 GB, 1.54 GB, 1.73 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.68 GB, 2.91 GB, 3.16 GB, 3.40 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.18 GB, 5.91 GB, 6.74 GB, 7.45 GB, 8.07 GB, 8.68 GB, 9.31 GB, 9.92 GB, 10.48 GB, 11.09 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.65 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994501120) - PerHostPeakMemUsage: 11.31 GB (12140548128) - PrepareTime: 146.530ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 19s797ms - TotalNetworkSendTime: 243.112us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.379ms, non-child: 480.379ms, % non-child: 100.00%) - CodegenTime: 170.786us - CompileTime: 57.899ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 279.073ms - PrepareTime: 140.590ms DataStreamSender (dst_id=6):(Total: 59.720us, non-child: 59.720us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 423.42 KB/sec - OverallThroughput: 261.64 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.030us - TransmitDataRPCTime: 36.902us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 871.268ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 479.286ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.66 KB (50848) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m8s, % non-child: 72.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s204ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 14s901ms - GetNewBlockTime: 9.440ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s834ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.159us EXCHANGE_NODE (id=5):(Total: 18s560ms, non-child: 7s088ms, % non-child: 38.19%) BytesReceived(2s000ms): 47.49 MB, 215.06 MB, 389.34 MB, 527.34 MB, 653.84 MB, 810.29 MB, 948.55 MB, 1.06 GB, 1.19 GB, 1.32 GB, 1.45 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.09 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671838019) - ConvertRowBatchTime: 3s601ms - DeserializeRowBatchTimer: 8s699ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 6.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s658ms, non-child: 3s036ms, % non-child: 39.65%) BytesReceived(2s000ms): 4.60 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.13 MB, 15.81 MB, 69.57 MB, 125.04 MB, 177.12 MB, 229.20 MB, 281.39 MB, 334.26 MB, 387.09 MB, 439.92 MB, 492.43 MB, 545.27 MB, 598.14 MB, 651.24 MB, 703.83 MB, 756.54 MB, 809.97 MB, 863.70 MB, 916.76 MB, 958.77 MB - BytesReceived: 962.44 MB (1009193222) - ConvertRowBatchTime: 2s315ms - DeserializeRowBatchTimer: 3s173ms - FirstBatchArrivalWaitTime: 541.259ms - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 15.67 M/sec - SendersBlockedTimer: 56s174ms - SendersBlockedTotalTimer(*): 10m21s Instance 43435c6d36c99c38:581697e88a6bedc0 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 181.81 MB, 518.14 MB, 805.95 MB, 1.04 GB, 1.26 GB, 1.54 GB, 1.79 GB, 2.01 GB, 2.22 GB, 2.47 GB, 2.72 GB, 2.97 GB, 3.16 GB, 3.41 GB, 3.65 GB, 3.85 GB, 4.14 GB, 4.35 GB, 4.61 GB, 5.25 GB, 5.92 GB, 6.72 GB, 7.53 GB, 8.27 GB, 9.02 GB, 9.82 GB, 10.57 GB, 11.11 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994501120) - PerHostPeakMemUsage: 11.29 GB (12124305928) - PrepareTime: 147.298ms - RowsProduced: 1 (1) - TotalCpuTime: 2m7s - TotalNetworkReceiveTime: 23s188ms - TotalNetworkSendTime: 4.898ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 498.834ms, non-child: 498.834ms, % non-child: 100.00%) - CodegenTime: 153.476us - CompileTime: 59.251ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 295.185ms - PrepareTime: 143.139ms DataStreamSender (dst_id=6):(Total: 64.650us, non-child: 64.650us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 404.72 KB/sec - OverallThroughput: 241.68 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.741us - TransmitDataRPCTime: 38.607us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 936.307ms, % non-child: 0.98%) ExecOption: Codegen Enabled - BuildTime: 505.545ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.25 KB (52480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m5s, % non-child: 69.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 17s275ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 14s067ms - GetNewBlockTime: 8.220ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s426ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.401us EXCHANGE_NODE (id=5):(Total: 19s447ms, non-child: 8s997ms, % non-child: 46.27%) BytesReceived(2s000ms): 59.74 MB, 231.25 MB, 403.03 MB, 539.18 MB, 667.87 MB, 823.60 MB, 960.88 MB, 1.07 GB, 1.20 GB, 1.33 GB, 1.46 GB, 1.59 GB, 1.72 GB, 1.85 GB, 1.98 GB, 2.11 GB, 2.25 GB, 2.38 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671619732) - ConvertRowBatchTime: 3s398ms - DeserializeRowBatchTimer: 11s506ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 6.17 M/sec - SendersBlockedTimer: 667.457ms - SendersBlockedTotalTimer(*): 6s243ms EXCHANGE_NODE (id=4):(Total: 10s049ms, non-child: 3s039ms, % non-child: 30.25%) BytesReceived(2s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.12 MB, 10.16 MB, 18.92 MB, 75.14 MB, 129.74 MB, 181.95 MB, 234.03 MB, 286.27 MB, 339.17 MB, 391.94 MB, 444.71 MB, 497.30 MB, 550.12 MB, 603.04 MB, 656.10 MB, 708.59 MB, 761.41 MB, 814.94 MB, 868.49 MB, 921.64 MB - BytesReceived: 962.33 MB (1009078436) - ConvertRowBatchTime: 2s376ms - DeserializeRowBatchTimer: 3s034ms - FirstBatchArrivalWaitTime: 497.860ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 11.94 M/sec - SendersBlockedTimer: 54s080ms - SendersBlockedTotalTimer(*): 9m1s Instance 43435c6d36c99c38:581697e88a6bedc4 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 181.95 MB, 520.20 MB, 806.10 MB, 1.04 GB, 1.27 GB, 1.54 GB, 1.79 GB, 2.02 GB, 2.23 GB, 2.47 GB, 2.72 GB, 2.97 GB, 3.16 GB, 3.41 GB, 3.65 GB, 3.88 GB, 4.14 GB, 4.35 GB, 4.61 GB, 5.19 GB, 5.91 GB, 6.70 GB, 7.37 GB, 8.16 GB, 8.83 GB, 9.62 GB, 10.35 GB, 10.98 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994525696) - PerHostPeakMemUsage: 11.31 GB (12142513384) - PrepareTime: 146.461ms - RowsProduced: 1 (1) - TotalCpuTime: 2m12s - TotalNetworkReceiveTime: 18s541ms - TotalNetworkSendTime: 519.474us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 499.294ms, non-child: 499.294ms, % non-child: 100.00%) - CodegenTime: 155.671us - CompileTime: 55.430ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 300.321ms - PrepareTime: 142.064ms DataStreamSender (dst_id=6):(Total: 64.473us, non-child: 64.473us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 379.13 KB/sec - OverallThroughput: 242.35 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.414us - TransmitDataRPCTime: 41.213us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 794.381ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 453.967ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 43.33 KB (44368) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m9s, % non-child: 73.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s874ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 14s733ms - GetNewBlockTime: 8.800ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s312ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.966us EXCHANGE_NODE (id=5):(Total: 16s860ms, non-child: 7s738ms, % non-child: 45.90%) BytesReceived(2s000ms): 60.18 MB, 231.70 MB, 403.39 MB, 539.48 MB, 668.25 MB, 824.07 MB, 961.69 MB, 1.07 GB, 1.20 GB, 1.33 GB, 1.46 GB, 1.59 GB, 1.72 GB, 1.85 GB, 1.98 GB, 2.11 GB, 2.25 GB, 2.38 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672105132) - ConvertRowBatchTime: 4s059ms - DeserializeRowBatchTimer: 8s888ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 7.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s582ms, non-child: 3s297ms, % non-child: 38.42%) BytesReceived(2s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.13 MB, 10.17 MB, 18.97 MB, 75.30 MB, 129.82 MB, 181.98 MB, 234.14 MB, 286.37 MB, 339.20 MB, 392.08 MB, 444.92 MB, 497.46 MB, 550.29 MB, 603.20 MB, 656.25 MB, 708.79 MB, 761.59 MB, 815.13 MB, 868.79 MB, 922.02 MB - BytesReceived: 962.56 MB (1009316386) - ConvertRowBatchTime: 2s278ms - DeserializeRowBatchTimer: 4s263ms - FirstBatchArrivalWaitTime: 525.691ms - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 13.99 M/sec - SendersBlockedTimer: 54s880ms - SendersBlockedTotalTimer(*): 11m1s Instance 43435c6d36c99c38:581697e88a6bedc6 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 182.93 MB, 521.46 MB, 805.97 MB, 1.04 GB, 1.28 GB, 1.54 GB, 1.79 GB, 2.02 GB, 2.23 GB, 2.47 GB, 2.72 GB, 2.97 GB, 3.17 GB, 3.41 GB, 3.66 GB, 3.88 GB, 4.15 GB, 4.35 GB, 4.61 GB, 5.28 GB, 6.13 GB, 7.03 GB, 7.67 GB, 8.35 GB, 8.92 GB, 9.60 GB, 10.17 GB, 10.86 GB, 11.15 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994550272) - PerHostPeakMemUsage: 11.31 GB (12142588408) - PrepareTime: 145.741ms - RowsProduced: 1 (1) - TotalCpuTime: 2m11s - TotalNetworkReceiveTime: 20s770ms - TotalNetworkSendTime: 412.523us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.666ms, non-child: 477.666ms, % non-child: 100.00%) - CodegenTime: 155.147us - CompileTime: 53.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 281.648ms - PrepareTime: 141.400ms DataStreamSender (dst_id=6):(Total: 54.038us, non-child: 54.038us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 572.78 KB/sec - OverallThroughput: 289.15 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.251us - TransmitDataRPCTime: 27.279us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 839.079ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 475.526ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.61 KB (48752) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m7s, % non-child: 71.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s330ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 14s193ms - GetNewBlockTime: 8.943ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s349ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.192us EXCHANGE_NODE (id=5):(Total: 18s428ms, non-child: 8s197ms, % non-child: 44.48%) BytesReceived(2s000ms): 62.61 MB, 234.68 MB, 405.54 MB, 541.24 MB, 670.25 MB, 825.50 MB, 962.92 MB, 1.07 GB, 1.20 GB, 1.33 GB, 1.46 GB, 1.59 GB, 1.72 GB, 1.85 GB, 1.98 GB, 2.11 GB, 2.25 GB, 2.38 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670737444) - ConvertRowBatchTime: 3s748ms - DeserializeRowBatchTimer: 10s118ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 6.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 9s055ms, non-child: 3s307ms, % non-child: 36.52%) BytesReceived(2s000ms): 5.07 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.17 MB, 19.55 MB, 76.26 MB, 130.59 MB, 182.74 MB, 234.80 MB, 287.01 MB, 339.88 MB, 392.67 MB, 445.35 MB, 497.94 MB, 550.82 MB, 603.80 MB, 656.84 MB, 709.34 MB, 762.09 MB, 815.64 MB, 869.19 MB, 922.45 MB - BytesReceived: 962.09 MB (1008829376) - ConvertRowBatchTime: 2s408ms - DeserializeRowBatchTimer: 3s766ms - FirstBatchArrivalWaitTime: 544.753ms - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 13.25 M/sec - SendersBlockedTimer: 55s318ms - SendersBlockedTotalTimer(*): 12m54s Instance 43435c6d36c99c38:581697e88a6bedc5 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 114.25 MB, 451.98 MB, 744.10 MB, 997.92 MB, 1.22 GB, 1.48 GB, 1.72 GB, 1.97 GB, 2.22 GB, 2.43 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.35 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.57 GB, 5.09 GB, 5.86 GB, 6.53 GB, 7.34 GB, 7.97 GB, 8.59 GB, 9.19 GB, 9.75 GB, 10.42 GB, 10.98 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.27 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994525696) - PerHostPeakMemUsage: 11.31 GB (12142613568) - PrepareTime: 147.950ms - RowsProduced: 1 (1) - TotalCpuTime: 2m14s - TotalNetworkReceiveTime: 18s315ms - TotalNetworkSendTime: 174.721us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 488.832ms, non-child: 488.832ms, % non-child: 100.00%) - CodegenTime: 166.844us - CompileTime: 57.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 286.124ms - PrepareTime: 143.770ms DataStreamSender (dst_id=6):(Total: 48.670us, non-child: 48.670us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 704.08 KB/sec - OverallThroughput: 321.04 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.742us - TransmitDataRPCTime: 22.192us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 794.263ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 451.724ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.23 KB (52464) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m10s, % non-child: 74.04%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s932ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 15s379ms - GetNewBlockTime: 8.859ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s260ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.812us EXCHANGE_NODE (id=5):(Total: 17s786ms, non-child: 7s507ms, % non-child: 42.21%) BytesReceived(2s000ms): 70.10 MB, 243.88 MB, 413.06 MB, 548.31 MB, 678.04 MB, 833.78 MB, 970.54 MB, 1.08 GB, 1.21 GB, 1.34 GB, 1.47 GB, 1.60 GB, 1.73 GB, 1.86 GB, 1.98 GB, 2.12 GB, 2.26 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671388936) - ConvertRowBatchTime: 3s620ms - DeserializeRowBatchTimer: 9s301ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 6.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s961ms, non-child: 3s340ms, % non-child: 47.98%) BytesReceived(2s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.15 MB, 21.19 MB, 79.26 MB, 133.27 MB, 185.47 MB, 237.51 MB, 289.80 MB, 342.66 MB, 395.51 MB, 448.29 MB, 500.89 MB, 553.72 MB, 606.70 MB, 659.76 MB, 712.27 MB, 765.03 MB, 818.55 MB, 872.08 MB, 925.38 MB - BytesReceived: 962.34 MB (1009082196) - ConvertRowBatchTime: 2s280ms - DeserializeRowBatchTimer: 4s362ms - FirstBatchArrivalWaitTime: 534.160ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 17.24 M/sec - SendersBlockedTimer: 56s561ms - SendersBlockedTotalTimer(*): 12m19s Instance 43435c6d36c99c38:581697e88a6bedcb (host=vb0220.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 148.61 MB, 454.30 MB, 806.03 MB, 1.01 GB, 1.22 GB, 1.49 GB, 1.72 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.66 GB, 2.91 GB, 3.16 GB, 3.38 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.18 GB, 5.91 GB, 6.70 GB, 7.27 GB, 7.86 GB, 8.40 GB, 8.93 GB, 9.52 GB, 10.06 GB, 10.60 GB, 11.12 GB, 11.17 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.96 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11995820032) - PerHostPeakMemUsage: 11.31 GB (12144981760) - PrepareTime: 147.252ms - RowsProduced: 1 (1) - TotalCpuTime: 2m17s - TotalNetworkReceiveTime: 17s160ms - TotalNetworkSendTime: 180.270us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 503.432ms, non-child: 503.432ms, % non-child: 100.00%) - CodegenTime: 149.929us - CompileTime: 55.314ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 303.612ms - PrepareTime: 143.337ms DataStreamSender (dst_id=6):(Total: 41.698us, non-child: 41.698us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 756.92 KB/sec - OverallThroughput: 374.72 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 8.109us - TransmitDataRPCTime: 20.643us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 789.485ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 448.195ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.23 KB (47344) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m10s, % non-child: 74.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 19s162ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 16s265ms - GetNewBlockTime: 9.308ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s454ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.719us EXCHANGE_NODE (id=5):(Total: 17s570ms, non-child: 7s744ms, % non-child: 44.08%) BytesReceived(2s000ms): 78.18 MB, 253.29 MB, 420.43 MB, 555.17 MB, 685.87 MB, 841.40 MB, 977.21 MB, 1.08 GB, 1.22 GB, 1.34 GB, 1.47 GB, 1.61 GB, 1.74 GB, 1.86 GB, 1.99 GB, 2.12 GB, 2.27 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671025959) - ConvertRowBatchTime: 3s954ms - DeserializeRowBatchTimer: 9s104ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 6.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s446ms, non-child: 3s368ms, % non-child: 52.25%) BytesReceived(2s000ms): 6.08 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.14 MB, 22.95 MB, 82.16 MB, 135.81 MB, 188.02 MB, 240.04 MB, 292.38 MB, 345.18 MB, 398.02 MB, 450.78 MB, 503.35 MB, 556.28 MB, 609.20 MB, 662.16 MB, 714.67 MB, 767.47 MB, 821.05 MB, 874.50 MB, 927.77 MB - BytesReceived: 962.06 MB (1008797865) - ConvertRowBatchTime: 2s347ms - DeserializeRowBatchTimer: 4s467ms - FirstBatchArrivalWaitTime: 519.551ms - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 18.61 M/sec - SendersBlockedTimer: 1m - SendersBlockedTotalTimer(*): 9m34s Instance 43435c6d36c99c38:581697e88a6bedcc (host=vb0218.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.63 MB, 507.97 MB, 805.97 MB, 1.04 GB, 1.23 GB, 1.54 GB, 1.78 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.71 GB, 2.91 GB, 3.16 GB, 3.41 GB, 3.62 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.61 GB, 5.25 GB, 5.94 GB, 6.74 GB, 7.55 GB, 8.36 GB, 9.18 GB, 9.93 GB, 10.57 GB, 11.11 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994550272) - PerHostPeakMemUsage: 11.31 GB (12142782712) - PrepareTime: 151.914ms - RowsProduced: 1 (1) - TotalCpuTime: 2m9s - TotalNetworkReceiveTime: 21s394ms - TotalNetworkSendTime: 253.106us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.101ms, non-child: 494.101ms, % non-child: 100.00%) - CodegenTime: 169.883us - CompileTime: 66.984ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 278.707ms - PrepareTime: 147.168ms DataStreamSender (dst_id=6):(Total: 55.908us, non-child: 55.908us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 522.66 KB/sec - OverallThroughput: 279.48 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 13.071us - TransmitDataRPCTime: 29.895us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 854.979ms, % non-child: 0.90%) ExecOption: Codegen Enabled - BuildTime: 481.451ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.33 KB (49488) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m7s, % non-child: 70.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s155ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 13s873ms - GetNewBlockTime: 9.781ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s431ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 6.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.867us EXCHANGE_NODE (id=5):(Total: 18s586ms, non-child: 6s842ms, % non-child: 36.81%) BytesReceived(2s000ms): 53.36 MB, 222.73 MB, 396.21 MB, 532.91 MB, 660.49 MB, 816.50 MB, 954.22 MB, 1.06 GB, 1.19 GB, 1.32 GB, 1.45 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.97 GB, 2.10 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2669887848) - ConvertRowBatchTime: 3s567ms - DeserializeRowBatchTimer: 8s462ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 6.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 9s163ms, non-child: 3s108ms, % non-child: 33.92%) BytesReceived(2s000ms): 5.05 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.13 MB, 10.17 MB, 17.33 MB, 72.31 MB, 127.19 MB, 179.25 MB, 231.29 MB, 283.46 MB, 336.23 MB, 388.90 MB, 441.68 MB, 494.21 MB, 547.15 MB, 600.08 MB, 653.16 MB, 705.66 MB, 758.48 MB, 811.96 MB, 865.55 MB, 918.59 MB - BytesReceived: 961.78 MB (1008503317) - ConvertRowBatchTime: 2s271ms - DeserializeRowBatchTimer: 3s582ms - FirstBatchArrivalWaitTime: 523.723ms - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 13.09 M/sec - SendersBlockedTimer: 54s101ms - SendersBlockedTotalTimer(*): 9m56s Instance 43435c6d36c99c38:581697e88a6bedc3 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 148.57 MB, 485.95 MB, 805.96 MB, 1.02 GB, 1.22 GB, 1.54 GB, 1.75 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.69 GB, 2.91 GB, 3.16 GB, 3.41 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.18 GB, 5.89 GB, 6.62 GB, 7.34 GB, 8.01 GB, 8.78 GB, 9.51 GB, 10.24 GB, 10.91 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.55 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994550272) - PerHostPeakMemUsage: 11.31 GB (12140426376) - PrepareTime: 148.495ms - RowsProduced: 1 (1) - TotalCpuTime: 2m8s - TotalNetworkReceiveTime: 22s620ms - TotalNetworkSendTime: 267.225us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.767ms, non-child: 490.767ms, % non-child: 100.00%) - CodegenTime: 170.748us - CompileTime: 60.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 285.001ms - PrepareTime: 144.379ms DataStreamSender (dst_id=6):(Total: 68.715us, non-child: 68.715us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 375.73 KB/sec - OverallThroughput: 227.39 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.138us - TransmitDataRPCTime: 41.586us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 934.374ms, % non-child: 0.98%) ExecOption: Codegen Enabled - BuildTime: 525.618ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.25 KB (50432) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m5s, % non-child: 68.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s802ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 14s385ms - GetNewBlockTime: 6.756ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s367ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.154us EXCHANGE_NODE (id=5):(Total: 17s949ms, non-child: 7s134ms, % non-child: 39.75%) BytesReceived(2s000ms): 47.65 MB, 215.57 MB, 389.84 MB, 527.99 MB, 654.49 MB, 810.79 MB, 949.40 MB, 1.06 GB, 1.19 GB, 1.32 GB, 1.45 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.09 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671477236) - ConvertRowBatchTime: 3s686ms - DeserializeRowBatchTimer: 8s747ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 6.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 11s591ms, non-child: 3s630ms, % non-child: 31.32%) BytesReceived(2s000ms): 4.67 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.19 MB, 15.86 MB, 69.62 MB, 124.97 MB, 176.99 MB, 229.09 MB, 281.20 MB, 334.05 MB, 386.87 MB, 439.63 MB, 492.24 MB, 545.09 MB, 597.98 MB, 651.03 MB, 703.60 MB, 756.33 MB, 809.83 MB, 863.54 MB, 916.67 MB, 958.65 MB - BytesReceived: 962.29 MB (1009034662) - ConvertRowBatchTime: 2s690ms - DeserializeRowBatchTimer: 3s836ms - FirstBatchArrivalWaitTime: 531.792ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 10.35 M/sec - SendersBlockedTimer: 54s635ms - SendersBlockedTotalTimer(*): 11m50s Instance 43435c6d36c99c38:581697e88a6bedc8 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.54 MB, 454.03 MB, 806.01 MB, 1.01 GB, 1.22 GB, 1.49 GB, 1.72 GB, 1.97 GB, 2.22 GB, 2.46 GB, 2.66 GB, 2.91 GB, 3.16 GB, 3.38 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.17 GB, 5.90 GB, 6.74 GB, 7.59 GB, 8.55 GB, 9.31 GB, 9.93 GB, 10.57 GB, 11.10 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.86 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994574848) - PerHostPeakMemUsage: 11.31 GB (12142470632) - PrepareTime: 146.608ms - RowsProduced: 1 (1) - TotalCpuTime: 2m5s - TotalNetworkReceiveTime: 25s343ms - TotalNetworkSendTime: 215.171us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 488.055ms, non-child: 488.055ms, % non-child: 100.00%) - CodegenTime: 155.303us - CompileTime: 58.364ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 285.905ms - PrepareTime: 140.961ms DataStreamSender (dst_id=6):(Total: 70.348us, non-child: 70.348us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 394.00 KB/sec - OverallThroughput: 222.11 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.289us - TransmitDataRPCTime: 39.657us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 889.907ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 504.143ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.61 KB (48752) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m2s, % non-child: 66.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 16s808ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 13s366ms - GetNewBlockTime: 7.763ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s872ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.729us EXCHANGE_NODE (id=5):(Total: 19s961ms, non-child: 8s339ms, % non-child: 41.78%) BytesReceived(2s000ms): 77.79 MB, 252.66 MB, 419.80 MB, 554.51 MB, 685.32 MB, 841.10 MB, 977.03 MB, 1.08 GB, 1.22 GB, 1.34 GB, 1.47 GB, 1.61 GB, 1.74 GB, 1.86 GB, 1.99 GB, 2.12 GB, 2.27 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671384946) - ConvertRowBatchTime: 3s348ms - DeserializeRowBatchTimer: 10s673ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 6.01 M/sec - SendersBlockedTimer: 140.327ms - SendersBlockedTotalTimer(*): 1s336ms EXCHANGE_NODE (id=4):(Total: 11s871ms, non-child: 3s512ms, % non-child: 29.59%) BytesReceived(2s000ms): 6.05 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.16 MB, 10.18 MB, 22.89 MB, 81.99 MB, 135.64 MB, 187.80 MB, 239.84 MB, 292.25 MB, 345.09 MB, 397.85 MB, 450.63 MB, 503.16 MB, 556.01 MB, 608.94 MB, 662.01 MB, 714.63 MB, 767.45 MB, 821.09 MB, 874.63 MB, 927.84 MB - BytesReceived: 962.25 MB (1008989535) - ConvertRowBatchTime: 2s621ms - DeserializeRowBatchTimer: 3s648ms - FirstBatchArrivalWaitTime: 534.926ms - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 10.11 M/sec - SendersBlockedTimer: 53s896ms - SendersBlockedTotalTimer(*): 12m34s Instance 43435c6d36c99c38:581697e88a6bedc2 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.29 MB, 455.08 MB, 806.03 MB, 1.01 GB, 1.22 GB, 1.51 GB, 1.72 GB, 1.97 GB, 2.22 GB, 2.47 GB, 2.67 GB, 2.91 GB, 3.16 GB, 3.39 GB, 3.60 GB, 3.85 GB, 4.10 GB, 4.35 GB, 4.60 GB, 5.09 GB, 5.79 GB, 6.44 GB, 7.13 GB, 7.77 GB, 8.41 GB, 9.11 GB, 9.75 GB, 10.43 GB, 10.97 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.65 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994525696) - PerHostPeakMemUsage: 11.31 GB (12142612112) - PrepareTime: 148.942ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 18s045ms - TotalNetworkSendTime: 142.475us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 497.924ms, non-child: 497.924ms, % non-child: 100.00%) - CodegenTime: 157.869us - CompileTime: 54.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 297.534ms - PrepareTime: 145.155ms DataStreamSender (dst_id=6):(Total: 50.868us, non-child: 50.868us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 650.07 KB/sec - OverallThroughput: 307.17 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 9.699us - TransmitDataRPCTime: 24.036us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 864.712ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 480.218ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.58 KB (46672) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m10s, % non-child: 74.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s787ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 16s284ms - GetNewBlockTime: 7.956ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s141ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.020us EXCHANGE_NODE (id=5):(Total: 17s952ms, non-child: 7s355ms, % non-child: 40.97%) BytesReceived(2s000ms): 44.96 MB, 211.75 MB, 386.27 MB, 524.84 MB, 651.58 MB, 808.05 MB, 946.55 MB, 1.05 GB, 1.19 GB, 1.32 GB, 1.44 GB, 1.58 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.09 GB, 2.24 GB, 2.37 GB, 2.47 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672025923) - ConvertRowBatchTime: 3s741ms - DeserializeRowBatchTimer: 8s842ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 6.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s619ms, non-child: 3s039ms, % non-child: 45.91%) BytesReceived(2s000ms): 4.07 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 10.14 MB, 15.22 MB, 68.40 MB, 123.95 MB, 176.04 MB, 228.20 MB, 280.30 MB, 333.22 MB, 386.05 MB, 438.86 MB, 491.43 MB, 544.30 MB, 597.18 MB, 650.28 MB, 702.81 MB, 755.62 MB, 809.05 MB, 862.71 MB, 915.79 MB, 958.47 MB - BytesReceived: 962.48 MB (1009238290) - ConvertRowBatchTime: 2s262ms - DeserializeRowBatchTimer: 3s425ms - FirstBatchArrivalWaitTime: 525.416ms - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 18.13 M/sec - SendersBlockedTimer: 56s913ms - SendersBlockedTotalTimer(*): 13m20s Instance 43435c6d36c99c38:581697e88a6bedce (host=vb0222.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 149.74 MB, 518.29 MB, 806.32 MB, 1.04 GB, 1.26 GB, 1.54 GB, 1.79 GB, 1.99 GB, 2.22 GB, 2.47 GB, 2.72 GB, 2.95 GB, 3.16 GB, 3.41 GB, 3.64 GB, 3.86 GB, 4.13 GB, 4.35 GB, 4.61 GB, 5.27 GB, 6.10 GB, 6.94 GB, 7.78 GB, 8.62 GB, 9.43 GB, 10.07 GB, 10.75 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 11.17 GB (11994525696) - PerHostPeakMemUsage: 11.30 GB (12130409544) - PrepareTime: 145.434ms - RowsProduced: 1 (1) - TotalCpuTime: 2m7s - TotalNetworkReceiveTime: 23s035ms - TotalNetworkSendTime: 210.089us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 496.571ms, non-child: 496.571ms, % non-child: 100.00%) - CodegenTime: 179.482us - CompileTime: 55.266ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 345 (345) - NumInstructions: 4.05K (4047) - OptimizationTime: 298.862ms - PrepareTime: 141.237ms DataStreamSender (dst_id=6):(Total: 55.450us, non-child: 55.450us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 589.96 KB/sec - OverallThroughput: 281.79 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.456us - TransmitDataRPCTime: 26.485us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m35s, non-child: 885.312ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 503.964ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.89 KB (46992) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m34s, non-child: 1m4s, % non-child: 68.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 18s739ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 13s221ms - GetNewBlockTime: 8.875ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s112ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 6.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.840us EXCHANGE_NODE (id=5):(Total: 17s999ms, non-child: 7s133ms, % non-child: 39.63%) BytesReceived(2s000ms): 56.98 MB, 227.74 MB, 400.53 MB, 537.10 MB, 665.51 MB, 821.37 MB, 958.86 MB, 1.07 GB, 1.20 GB, 1.33 GB, 1.46 GB, 1.59 GB, 1.72 GB, 1.85 GB, 1.97 GB, 2.10 GB, 2.25 GB, 2.38 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671473251) - ConvertRowBatchTime: 3s770ms - DeserializeRowBatchTimer: 8s551ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 6.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 11s903ms, non-child: 3s440ms, % non-child: 28.91%) BytesReceived(2s000ms): 5.07 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.15 MB, 10.20 MB, 18.22 MB, 73.94 MB, 128.69 MB, 180.77 MB, 232.98 MB, 285.23 MB, 338.05 MB, 390.83 MB, 443.61 MB, 496.13 MB, 548.95 MB, 601.82 MB, 654.88 MB, 707.45 MB, 760.28 MB, 813.74 MB, 867.34 MB, 920.49 MB - BytesReceived: 962.28 MB (1009022198) - ConvertRowBatchTime: 2s572ms - DeserializeRowBatchTimer: 3s592ms - FirstBatchArrivalWaitTime: 524.672ms - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 10.08 M/sec - SendersBlockedTimer: 53s634ms - SendersBlockedTotalTimer(*): 12m30s Fragment F01: Instance 43435c6d36c99c38:581697e88a6bedd8 (host=vb0206.halxg.cloudera.com:22000):(Total: 36s987ms, non-child: 7s048ms, % non-child: 19.06%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB MemoryUsage(1s000ms): 501.02 MB, 1002.92 MB, 1002.93 MB, 1002.59 MB, 872.63 MB, 828.83 MB, 828.81 MB, 829.05 MB, 828.80 MB, 740.92 MB, 684.47 MB, 652.91 MB, 652.73 MB, 624.61 MB, 564.60 MB, 564.62 MB, 480.78 MB, 389.13 MB, 389.10 MB, 305.31 MB, 301.21 MB, 300.92 MB, 241.04 MB, 652.48 MB, 641.78 MB, 642.15 MB, 614.66 MB, 531.19 MB, 531.11 MB, 519.09 MB, 463.32 MB, 419.14 MB, 411.20 MB, 363.26 MB, 311.20 MB, 227.36 MB, 195.19 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.50 MB (1052241848) - PerHostPeakMemUsage: 4.92 GB (5287916864) - PrepareTime: 143.037ms - RowsProduced: 124.58M (124580591) - TotalCpuTime: 6m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s678ms - TotalStorageWaitTime: 545.061ms CodeGen:(Total: 327.440ms, non-child: 327.440ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.994ms - PrepareTime: 140.883ms DataStreamSender (dst_id=5):(Total: 28s656ms, non-child: 28s656ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773980722) - NetworkThroughput(*): 287.16 MB/sec - OverallThroughput: 92.32 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 19s400ms - TransmitDataRPCTime: 9s212ms - UncompressedRowBatchSize: 5.11 GB (5482764428) HDFS_SCAN_NODE (id=1):(Total: 955.388ms, non-child: 955.388ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.43 - BytesRead: 1.47 GB (1576536384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576536384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576536384) - DecompressionTime: 6s965ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 130.40 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.66K (15656) - ScannerThreadsTotalWallClockTime: 5m50s - MaterializeTupleTime(*): 5m42s - ScannerThreadsSysTime: 983.844ms - ScannerThreadsUserTime: 28s964ms - ScannerThreadsVoluntaryContextSwitches: 121.88K (121884) - TotalRawHdfsReadTime(*): 986.094ms - TotalReadThroughput: 40.09 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd4 (host=vb0232.halxg.cloudera.com:22000):(Total: 36s975ms, non-child: 8s734ms, % non-child: 23.62%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB MemoryUsage(1s000ms): 500.61 MB, 1002.79 MB, 1002.66 MB, 1002.91 MB, 959.62 MB, 828.83 MB, 828.88 MB, 828.86 MB, 828.67 MB, 788.93 MB, 704.99 MB, 652.96 MB, 652.88 MB, 652.69 MB, 572.83 MB, 564.89 MB, 520.84 MB, 420.90 MB, 388.98 MB, 325.01 MB, 300.93 MB, 300.91 MB, 248.92 MB, 650.75 MB, 641.67 MB, 641.88 MB, 606.49 MB, 531.12 MB, 531.09 MB, 519.16 MB, 463.08 MB, 418.95 MB, 415.30 MB, 363.04 MB, 319.26 MB, 243.34 MB, 195.17 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052291000) - PerHostPeakMemUsage: 4.93 GB (5288260600) - PrepareTime: 142.900ms - RowsProduced: 124.58M (124581482) - TotalCpuTime: 6m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s533ms - TotalStorageWaitTime: 558.465ms CodeGen:(Total: 325.039ms, non-child: 325.039ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.703ms - PrepareTime: 140.744ms DataStreamSender (dst_id=5):(Total: 26s872ms, non-child: 26s872ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773224431) - NetworkThroughput(*): 350.05 MB/sec - OverallThroughput: 98.42 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 19s267ms - TransmitDataRPCTime: 7s555ms - UncompressedRowBatchSize: 5.11 GB (5482803644) HDFS_SCAN_NODE (id=1):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.65% 1:0% 2:1.351% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.17 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.47 GB (1576537578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537578) - DecompressionTime: 7s940ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877464) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 119.31 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 18.46K (18457) - ScannerThreadsTotalWallClockTime: 5m49s - MaterializeTupleTime(*): 5m40s - ScannerThreadsSysTime: 1s175ms - ScannerThreadsUserTime: 33s441ms - ScannerThreadsVoluntaryContextSwitches: 121.98K (121983) - TotalRawHdfsReadTime(*): 949.629ms - TotalReadThroughput: 40.64 MB/sec Instance 43435c6d36c99c38:581697e88a6beddc (host=vb0224.halxg.cloudera.com:22000):(Total: 36s882ms, non-child: 9s615ms, % non-child: 26.07%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 500.83 MB, 1002.78 MB, 1002.74 MB, 1003.06 MB, 955.67 MB, 832.85 MB, 828.99 MB, 828.90 MB, 828.81 MB, 780.74 MB, 721.04 MB, 652.62 MB, 652.88 MB, 653.15 MB, 592.78 MB, 564.73 MB, 528.94 MB, 424.81 MB, 388.86 MB, 333.08 MB, 301.19 MB, 300.98 MB, 256.85 MB, 526.56 MB, 633.71 MB, 634.00 MB, 610.25 MB, 531.12 MB, 522.89 MB, 523.19 MB, 467.12 MB, 411.27 MB, 411.31 MB, 355.22 MB, 327.23 MB, 227.27 MB, 178.28 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.56 MB (1052307560) - PerHostPeakMemUsage: 4.86 GB (5214498176) - PrepareTime: 143.384ms - RowsProduced: 123.88M (123876716) - TotalCpuTime: 6m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s699ms - TotalStorageWaitTime: 619.710ms CodeGen:(Total: 330.650ms, non-child: 330.650ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 185.698ms - PrepareTime: 139.651ms DataStreamSender (dst_id=5):(Total: 25s854ms, non-child: 25s854ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2758222009) - NetworkThroughput(*): 399.07 MB/sec - OverallThroughput: 101.74 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 19s212ms - TransmitDataRPCTime: 6s591ms - UncompressedRowBatchSize: 5.08 GB (5451787044) HDFS_SCAN_NODE (id=1):(Total: 1s081ms, non-child: 1s081ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.30 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.46 GB (1567668714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567668714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567668714) - DecompressionTime: 8s502ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 114.52 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 18.90K (18898) - ScannerThreadsTotalWallClockTime: 5m50s - MaterializeTupleTime(*): 5m40s - ScannerThreadsSysTime: 1s193ms - ScannerThreadsUserTime: 35s940ms - ScannerThreadsVoluntaryContextSwitches: 121.25K (121249) - TotalRawHdfsReadTime(*): 988.497ms - TotalReadThroughput: 39.87 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd7 (host=vb0234.halxg.cloudera.com:22000):(Total: 36s602ms, non-child: 7s727ms, % non-child: 21.11%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB MemoryUsage(1s000ms): 500.84 MB, 1002.69 MB, 1002.82 MB, 1002.86 MB, 939.60 MB, 828.98 MB, 828.84 MB, 828.90 MB, 829.00 MB, 772.79 MB, 692.88 MB, 652.55 MB, 652.68 MB, 645.05 MB, 564.98 MB, 564.97 MB, 481.08 MB, 389.11 MB, 384.96 MB, 301.22 MB, 301.09 MB, 297.18 MB, 252.84 MB, 641.86 MB, 641.85 MB, 642.03 MB, 558.89 MB, 531.19 MB, 531.11 MB, 495.31 MB, 443.12 MB, 419.13 MB, 391.04 MB, 359.28 MB, 279.22 MB, 223.44 MB, 183.38 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.60 MB (1052348360) - PerHostPeakMemUsage: 4.87 GB (5224724552) - PrepareTime: 141.867ms - RowsProduced: 124.58M (124581192) - TotalCpuTime: 6m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s712ms - TotalStorageWaitTime: 633.779ms CodeGen:(Total: 325.389ms, non-child: 325.389ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.341ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.057ms - PrepareTime: 138.125ms DataStreamSender (dst_id=5):(Total: 27s576ms, non-child: 27s576ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772548039) - NetworkThroughput(*): 314.53 MB/sec - OverallThroughput: 95.88 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 19s124ms - TransmitDataRPCTime: 8s406ms - UncompressedRowBatchSize: 5.11 GB (5482790876) HDFS_SCAN_NODE (id=1):(Total: 973.184ms, non-child: 973.184ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.22 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 1.47 GB (1576528335) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576528335) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576528335) - DecompressionTime: 7s505ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051943008) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 128.01 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.01K (17011) - ScannerThreadsTotalWallClockTime: 5m46s - MaterializeTupleTime(*): 5m37s - ScannerThreadsSysTime: 1s043ms - ScannerThreadsUserTime: 31s402ms - ScannerThreadsVoluntaryContextSwitches: 121.84K (121845) - TotalRawHdfsReadTime(*): 1s100ms - TotalReadThroughput: 41.19 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd1 (host=vb0204.halxg.cloudera.com:22000):(Total: 36s531ms, non-child: 9s263ms, % non-child: 25.36%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB MemoryUsage(1s000ms): 500.95 MB, 1002.90 MB, 1002.81 MB, 1002.63 MB, 959.58 MB, 828.93 MB, 828.74 MB, 829.01 MB, 828.99 MB, 784.90 MB, 716.93 MB, 652.90 MB, 652.82 MB, 652.86 MB, 568.85 MB, 565.02 MB, 508.85 MB, 405.08 MB, 389.08 MB, 317.02 MB, 301.09 MB, 301.08 MB, 233.19 MB, 641.09 MB, 642.01 MB, 641.98 MB, 602.43 MB, 531.23 MB, 531.19 MB, 511.30 MB, 451.19 MB, 419.18 MB, 391.23 MB, 359.10 MB, 275.24 MB, 219.26 MB, 175.32 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.59 MB (1052340160) - PerHostPeakMemUsage: 4.87 GB (5225001624) - PrepareTime: 148.949ms - RowsProduced: 124.58M (124581324) - TotalCpuTime: 6m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s658ms - TotalStorageWaitTime: 442.910ms CodeGen:(Total: 334.036ms, non-child: 334.036ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.645ms - PrepareTime: 147.000ms DataStreamSender (dst_id=5):(Total: 25s852ms, non-child: 25s852ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772188594) - NetworkThroughput(*): 383.83 MB/sec - OverallThroughput: 102.26 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 18s916ms - TransmitDataRPCTime: 6s887ms - UncompressedRowBatchSize: 5.11 GB (5482796692) HDFS_SCAN_NODE (id=1):(Total: 1s081ms, non-child: 1s081ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 1.47 GB (1576541342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576541342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576541342) - DecompressionTime: 8s425ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942920) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 115.22 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 18.19K (18188) - ScannerThreadsTotalWallClockTime: 5m46s - MaterializeTupleTime(*): 5m37s - ScannerThreadsSysTime: 1s291ms - ScannerThreadsUserTime: 35s406ms - ScannerThreadsVoluntaryContextSwitches: 122.05K (122052) - TotalRawHdfsReadTime(*): 1s093ms - TotalReadThroughput: 40.64 MB/sec Instance 43435c6d36c99c38:581697e88a6beddd (host=vb0222.halxg.cloudera.com:22000):(Total: 36s522ms, non-child: 9s678ms, % non-child: 26.50%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB MemoryUsage(1s000ms): 492.37 MB, 985.29 MB, 985.20 MB, 985.29 MB, 870.92 MB, 811.17 MB, 811.45 MB, 811.39 MB, 811.33 MB, 723.26 MB, 675.46 MB, 635.31 MB, 635.42 MB, 599.35 MB, 547.42 MB, 547.32 MB, 459.51 MB, 407.82 MB, 436.71 MB, 364.90 MB, 364.92 MB, 360.76 MB, 459.64 MB, 630.89 MB, 625.92 MB, 626.05 MB, 546.98 MB, 515.27 MB, 515.35 MB, 487.30 MB, 435.09 MB, 399.07 MB, 367.15 MB, 339.15 MB, 263.23 MB, 192.88 MB, 144.80 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 986.04 MB (1033932728) - PerHostPeakMemUsage: 4.83 GB (5185174896) - PrepareTime: 147.897ms - RowsProduced: 123.30M (123304062) - TotalCpuTime: 6m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s497ms - TotalStorageWaitTime: 473.873ms CodeGen:(Total: 338.993ms, non-child: 338.993ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 189.613ms - PrepareTime: 145.935ms DataStreamSender (dst_id=5):(Total: 25s404ms, non-child: 25s404ms, % non-child: 100.00%) - BytesSent: 2.56 GB (2745886136) - NetworkThroughput(*): 409.75 MB/sec - OverallThroughput: 103.08 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 18s968ms - TransmitDataRPCTime: 6s390ms - UncompressedRowBatchSize: 5.05 GB (5426584668) HDFS_SCAN_NODE (id=1):(Total: 1s100ms, non-child: 1s100ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 450.57 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 901.14 MB, 942.90 MB, 984.66 MB, 984.66 MB, 984.66 MB, 984.66 MB, 1.17 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.45 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.41 - BytesRead: 1.45 GB (1560799796) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.45 GB (1560799796) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.45 GB (1560799796) - DecompressionTime: 8s503ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 985.65 MB (1033527472) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 112.05 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 18.85K (18846) - ScannerThreadsTotalWallClockTime: 5m44s - MaterializeTupleTime(*): 5m35s - ScannerThreadsSysTime: 1s191ms - ScannerThreadsUserTime: 35s843ms - ScannerThreadsVoluntaryContextSwitches: 120.72K (120724) - TotalRawHdfsReadTime(*): 1s028ms - TotalReadThroughput: 40.23 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd2 (host=vb0214.halxg.cloudera.com:22000):(Total: 36s166ms, non-child: 9s401ms, % non-child: 25.99%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB MemoryUsage(1s000ms): 500.96 MB, 1002.72 MB, 1002.79 MB, 1002.88 MB, 959.70 MB, 833.03 MB, 828.63 MB, 829.02 MB, 828.89 MB, 784.85 MB, 720.82 MB, 653.00 MB, 652.90 MB, 652.87 MB, 564.83 MB, 564.79 MB, 496.90 MB, 393.04 MB, 389.05 MB, 300.93 MB, 300.89 MB, 296.97 MB, 369.85 MB, 633.93 MB, 633.77 MB, 614.19 MB, 527.21 MB, 523.17 MB, 519.24 MB, 463.15 MB, 411.25 MB, 403.12 MB, 355.27 MB, 283.24 MB, 239.33 MB, 187.21 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.58 MB (1052331880) - PerHostPeakMemUsage: 4.84 GB (5194965640) - PrepareTime: 139.742ms - RowsProduced: 124.06M (124059923) - TotalCpuTime: 6m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s586ms - TotalStorageWaitTime: 553.320ms CodeGen:(Total: 319.495ms, non-child: 319.495ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.523ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 178.166ms - PrepareTime: 137.570ms DataStreamSender (dst_id=5):(Total: 25s435ms, non-child: 25s435ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2762468148) - NetworkThroughput(*): 403.21 MB/sec - OverallThroughput: 103.58 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 18s852ms - TransmitDataRPCTime: 6s533ms - UncompressedRowBatchSize: 5.08 GB (5459849940) HDFS_SCAN_NODE (id=1):(Total: 1s009ms, non-child: 1s009ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:98.61% 1:1.389% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.40 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.09 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 1.46 GB (1569927832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1569927832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1569927832) - DecompressionTime: 8s275ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942832) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 122.85 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.95K (17949) - ScannerThreadsTotalWallClockTime: 5m42s - MaterializeTupleTime(*): 5m33s - ScannerThreadsSysTime: 1s207ms - ScannerThreadsUserTime: 34s654ms - ScannerThreadsVoluntaryContextSwitches: 121.46K (121459) - TotalRawHdfsReadTime(*): 1s012ms - TotalReadThroughput: 41.02 MB/sec Instance 43435c6d36c99c38:581697e88a6bedcf (host=vb0208.halxg.cloudera.com:22000):(Total: 35s916ms, non-child: 6s569ms, % non-child: 18.29%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB MemoryUsage(1s000ms): 640.73 MB, 973.31 MB, 973.45 MB, 973.07 MB, 843.13 MB, 799.28 MB, 799.09 MB, 799.44 MB, 799.20 MB, 711.50 MB, 643.20 MB, 623.42 MB, 623.47 MB, 587.46 MB, 535.47 MB, 535.26 MB, 454.05 MB, 437.06 MB, 408.79 MB, 356.67 MB, 428.48 MB, 413.01 MB, 489.76 MB, 625.94 MB, 614.19 MB, 594.33 MB, 530.96 MB, 510.95 MB, 499.15 MB, 451.17 MB, 395.27 MB, 383.12 MB, 327.16 MB, 295.15 MB, 208.77 MB, 151.60 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6 - AverageThreadTokens: 10.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 974.02 MB (1021333432) - PerHostPeakMemUsage: 4.76 GB (5109166616) - PrepareTime: 143.090ms - RowsProduced: 122.21M (122205738) - TotalCpuTime: 6m10s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s633ms - TotalStorageWaitTime: 639.003ms CodeGen:(Total: 327.587ms, non-child: 327.587ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.939ms - PrepareTime: 140.880ms DataStreamSender (dst_id=5):(Total: 28s113ms, non-child: 28s113ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2719641699) - NetworkThroughput(*): 281.72 MB/sec - OverallThroughput: 92.26 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 18s863ms - TransmitDataRPCTime: 9s206ms - UncompressedRowBatchSize: 5.01 GB (5378247676) HDFS_SCAN_NODE (id=1):(Total: 905.820ms, non-child: 905.820ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:98.61% 1:0% 2:0% 3:0% 4:0% 5:1.389% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 558.98 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 887.99 MB, 929.75 MB, 971.52 MB, 971.52 MB, 971.52 MB, 1.03 GB, 1.03 GB, 1.24 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 9.44 - BytesRead: 1.44 GB (1547015523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1547015523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1547015523) - DecompressionTime: 6s747ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 973.65 MB (1020944384) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 134.91 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 14.73K (14728) - ScannerThreadsTotalWallClockTime: 5m38s - MaterializeTupleTime(*): 5m30s - ScannerThreadsSysTime: 892.859ms - ScannerThreadsUserTime: 28s001ms - ScannerThreadsVoluntaryContextSwitches: 119.58K (119581) - TotalRawHdfsReadTime(*): 992.249ms - TotalReadThroughput: 40.98 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd5 (host=vb0226.halxg.cloudera.com:22000):(Total: 35s555ms, non-child: 8s361ms, % non-child: 23.52%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB MemoryUsage(1s000ms): 910.80 MB, 1002.78 MB, 1002.77 MB, 1002.83 MB, 912.31 MB, 828.75 MB, 828.84 MB, 828.69 MB, 828.95 MB, 764.97 MB, 696.83 MB, 653.00 MB, 652.92 MB, 652.77 MB, 564.77 MB, 564.73 MB, 500.84 MB, 404.90 MB, 389.17 MB, 312.77 MB, 301.14 MB, 300.78 MB, 241.15 MB, 580.91 MB, 551.75 MB, 551.56 MB, 480.46 MB, 456.75 MB, 452.70 MB, 396.83 MB, 360.73 MB, 336.78 MB, 288.70 MB, 217.03 MB, 168.85 MB, 128.32 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 10.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.37 MB (1052111112) - PerHostPeakMemUsage: 4.72 GB (5063128064) - PrepareTime: 141.584ms - RowsProduced: 117.66M (117660001) - TotalCpuTime: 6m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s628ms - TotalStorageWaitTime: 522.071ms CodeGen:(Total: 325.786ms, non-child: 325.786ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.758ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.322ms - PrepareTime: 139.225ms DataStreamSender (dst_id=5):(Total: 25s858ms, non-child: 25s858ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619265228) - NetworkThroughput(*): 338.68 MB/sec - OverallThroughput: 96.60 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 18s438ms - TransmitDataRPCTime: 7s375ms - UncompressedRowBatchSize: 4.82 GB (5178190780) HDFS_SCAN_NODE (id=1):(Total: 1s010ms, non-child: 1s010ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:98.61% 1:0% 2:0% 3:0% 4:0% 5:0% 6:1.389% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 821.04 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 9.21 - BytesRead: 1.39 GB (1488950230) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488950230) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488950230) - DecompressionTime: 7s584ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.07 MB (1051795440) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 116.49 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.78K (16784) - ScannerThreadsTotalWallClockTime: 5m29s - MaterializeTupleTime(*): 5m20s - ScannerThreadsSysTime: 1s060ms - ScannerThreadsUserTime: 31s774ms - ScannerThreadsVoluntaryContextSwitches: 115.19K (115188) - TotalRawHdfsReadTime(*): 1s042ms - TotalReadThroughput: 39.44 MB/sec Instance 43435c6d36c99c38:581697e88a6beddb (host=vb0218.halxg.cloudera.com:22000):(Total: 35s451ms, non-child: 9s534ms, % non-child: 26.90%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB MemoryUsage(1s000ms): 501.10 MB, 1002.81 MB, 1002.88 MB, 1002.76 MB, 916.06 MB, 828.77 MB, 829.06 MB, 828.95 MB, 828.90 MB, 776.76 MB, 701.01 MB, 652.84 MB, 652.98 MB, 652.78 MB, 572.65 MB, 564.79 MB, 517.03 MB, 429.21 MB, 388.91 MB, 341.07 MB, 301.07 MB, 301.17 MB, 253.14 MB, 552.00 MB, 551.62 MB, 551.54 MB, 480.66 MB, 456.75 MB, 456.74 MB, 392.74 MB, 360.80 MB, 336.69 MB, 292.81 MB, 220.85 MB, 172.90 MB, 144.85 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258320) - PerHostPeakMemUsage: 4.72 GB (5063100656) - PrepareTime: 147.657ms - RowsProduced: 117.66M (117659888) - TotalCpuTime: 5m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s522ms - TotalStorageWaitTime: 533.088ms CodeGen:(Total: 337.123ms, non-child: 337.123ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.372ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 188.047ms - PrepareTime: 145.395ms DataStreamSender (dst_id=5):(Total: 24s502ms, non-child: 24s502ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619806395) - NetworkThroughput(*): 401.83 MB/sec - OverallThroughput: 101.96 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 18s240ms - TransmitDataRPCTime: 6s217ms - UncompressedRowBatchSize: 4.82 GB (5178185812) HDFS_SCAN_NODE (id=1):(Total: 1s076ms, non-child: 1s076ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.41 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.34 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.24 - BytesRead: 1.39 GB (1488962094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488962094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488962094) - DecompressionTime: 8s101ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877464) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 109.31 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 17.39K (17393) - ScannerThreadsTotalWallClockTime: 5m28s - MaterializeTupleTime(*): 5m18s - ScannerThreadsSysTime: 1s182ms - ScannerThreadsUserTime: 34s081ms - ScannerThreadsVoluntaryContextSwitches: 115.24K (115237) - TotalRawHdfsReadTime(*): 1s035ms - TotalReadThroughput: 39.44 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd0 (host=vb0230.halxg.cloudera.com:22000):(Total: 35s274ms, non-child: 8s283ms, % non-child: 23.48%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 500.98 MB, 1002.75 MB, 1002.83 MB, 1002.61 MB, 959.60 MB, 828.93 MB, 829.05 MB, 828.90 MB, 829.08 MB, 776.71 MB, 700.99 MB, 652.75 MB, 652.81 MB, 648.64 MB, 568.87 MB, 564.69 MB, 504.74 MB, 401.35 MB, 389.13 MB, 308.97 MB, 301.09 MB, 300.97 MB, 359.75 MB, 551.55 MB, 551.59 MB, 531.99 MB, 456.76 MB, 456.69 MB, 432.84 MB, 384.86 MB, 360.71 MB, 336.69 MB, 284.86 MB, 216.92 MB, 169.00 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.46 MB (1052200968) - PerHostPeakMemUsage: 4.72 GB (5063064376) - PrepareTime: 143.393ms - RowsProduced: 117.66M (117659846) - TotalCpuTime: 5m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s748ms - TotalStorageWaitTime: 572.572ms CodeGen:(Total: 324.475ms, non-child: 324.475ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.222ms - PrepareTime: 141.303ms DataStreamSender (dst_id=5):(Total: 25s693ms, non-child: 25s693ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2618547263) - NetworkThroughput(*): 338.68 MB/sec - OverallThroughput: 97.19 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 18s272ms - TransmitDataRPCTime: 7s373ms - UncompressedRowBatchSize: 4.82 GB (5178183964) HDFS_SCAN_NODE (id=1):(Total: 972.637ms, non-child: 972.637ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.41 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.06 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.21 - BytesRead: 1.39 GB (1488963118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488963118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488963118) - DecompressionTime: 7s152ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812184) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 120.97 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.58K (16576) - ScannerThreadsTotalWallClockTime: 5m24s - MaterializeTupleTime(*): 5m16s - ScannerThreadsSysTime: 1s076ms - ScannerThreadsUserTime: 29s990ms - ScannerThreadsVoluntaryContextSwitches: 115.19K (115195) - TotalRawHdfsReadTime(*): 1s128ms - TotalReadThroughput: 40.00 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd6 (host=vb0216.halxg.cloudera.com:22000):(Total: 34s797ms, non-child: 8s737ms, % non-child: 25.11%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB MemoryUsage(1s000ms): 500.60 MB, 1002.72 MB, 1002.73 MB, 1002.82 MB, 959.53 MB, 828.76 MB, 829.06 MB, 828.95 MB, 828.78 MB, 780.76 MB, 697.00 MB, 653.15 MB, 653.03 MB, 628.93 MB, 564.54 MB, 564.69 MB, 468.96 MB, 389.25 MB, 372.91 MB, 301.23 MB, 300.98 MB, 281.10 MB, 403.65 MB, 551.65 MB, 551.67 MB, 516.29 MB, 456.77 MB, 456.83 MB, 416.82 MB, 360.76 MB, 360.88 MB, 312.83 MB, 252.75 MB, 196.95 MB, 168.77 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.43 MB (1052168288) - PerHostPeakMemUsage: 4.63 GB (4967260048) - PrepareTime: 141.086ms - RowsProduced: 117.66M (117659985) - TotalCpuTime: 5m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s683ms - TotalStorageWaitTime: 563.158ms CodeGen:(Total: 328.475ms, non-child: 328.475ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.307ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 185.924ms - PrepareTime: 138.643ms DataStreamSender (dst_id=5):(Total: 24s738ms, non-child: 24s738ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619088528) - NetworkThroughput(*): 376.49 MB/sec - OverallThroughput: 100.97 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 18s059ms - TransmitDataRPCTime: 6s634ms - UncompressedRowBatchSize: 4.82 GB (5178190084) HDFS_SCAN_NODE (id=1):(Total: 993.087ms, non-child: 993.087ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.57% 1:1.429% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.20 - BytesRead: 1.39 GB (1488939222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488939222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488939222) - DecompressionTime: 7s741ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812008) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 118.48 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 17.02K (17019) - ScannerThreadsTotalWallClockTime: 5m20s - MaterializeTupleTime(*): 5m11s - ScannerThreadsSysTime: 1s154ms - ScannerThreadsUserTime: 32s364ms - ScannerThreadsVoluntaryContextSwitches: 115.19K (115195) - TotalRawHdfsReadTime(*): 971.088ms - TotalReadThroughput: 40.57 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd9 (host=vb0228.halxg.cloudera.com:22000):(Total: 34s475ms, non-child: 4s829ms, % non-child: 14.01%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB MemoryUsage(1s000ms): 491.29 MB, 982.90 MB, 982.72 MB, 982.62 MB, 852.61 MB, 808.75 MB, 808.74 MB, 808.97 MB, 792.98 MB, 720.92 MB, 636.79 MB, 632.95 MB, 632.75 MB, 588.89 MB, 545.03 MB, 516.83 MB, 454.76 MB, 444.79 MB, 401.17 MB, 364.90 MB, 364.79 MB, 340.58 MB, 406.07 MB, 535.98 MB, 535.80 MB, 468.57 MB, 440.73 MB, 436.88 MB, 384.83 MB, 340.76 MB, 320.86 MB, 288.85 MB, 199.75 MB, 142.52 MB, 95.68 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 4 - AverageThreadTokens: 9.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 983.40 MB (1031172184) - PerHostPeakMemUsage: 4.56 GB (4901121784) - PrepareTime: 143.137ms - RowsProduced: 116.10M (116100730) - TotalCpuTime: 5m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s736ms - TotalStorageWaitTime: 586.004ms CodeGen:(Total: 325.781ms, non-child: 325.781ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.191ms - PrepareTime: 140.980ms DataStreamSender (dst_id=5):(Total: 28s535ms, non-child: 28s535ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2584542414) - NetworkThroughput(*): 237.26 MB/sec - OverallThroughput: 86.38 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 18s108ms - TransmitDataRPCTime: 10s388ms - UncompressedRowBatchSize: 4.76 GB (5109567616) HDFS_SCAN_NODE (id=1):(Total: 784.143ms, non-child: 784.143ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 450.23 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 900.46 MB, 942.23 MB, 983.99 MB, 983.99 MB, 983.99 MB, 983.99 MB, 983.99 MB, 1.16 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.07 - BytesRead: 1.37 GB (1469705850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469705850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469705850) - DecompressionTime: 5s633ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 983.02 MB (1030774944) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 148.06 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.33K (13326) - ScannerThreadsTotalWallClockTime: 5m16s - MaterializeTupleTime(*): 5m9s - ScannerThreadsSysTime: 811.871ms - ScannerThreadsUserTime: 23s182ms - ScannerThreadsVoluntaryContextSwitches: 113.56K (113555) - TotalRawHdfsReadTime(*): 889.275ms - TotalReadThroughput: 40.05 MB/sec Instance 43435c6d36c99c38:581697e88a6bedda (host=vb0220.halxg.cloudera.com:22000):(Total: 33s564ms, non-child: 8s979ms, % non-child: 26.75%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB MemoryUsage(1s000ms): 500.95 MB, 1002.62 MB, 1002.86 MB, 1002.91 MB, 959.56 MB, 832.92 MB, 828.64 MB, 828.92 MB, 828.67 MB, 784.88 MB, 708.94 MB, 652.85 MB, 652.86 MB, 652.81 MB, 568.72 MB, 564.95 MB, 516.86 MB, 404.87 MB, 389.02 MB, 324.87 MB, 300.97 MB, 301.09 MB, 249.16 MB, 473.25 MB, 461.44 MB, 441.74 MB, 382.32 MB, 382.24 MB, 322.35 MB, 302.28 MB, 270.39 MB, 222.37 MB, 162.44 MB, 130.56 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 9.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.52 MB (1052266520) - PerHostPeakMemUsage: 4.49 GB (4816087256) - PrepareTime: 141.855ms - RowsProduced: 110.74M (110738953) - TotalCpuTime: 5m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s449ms - TotalStorageWaitTime: 538.884ms CodeGen:(Total: 324.968ms, non-child: 324.968ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.450ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.573ms - PrepareTime: 139.635ms DataStreamSender (dst_id=5):(Total: 23s237ms, non-child: 23s237ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2463833801) - NetworkThroughput(*): 399.18 MB/sec - OverallThroughput: 101.11 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 17s308ms - TransmitDataRPCTime: 5s886ms - UncompressedRowBatchSize: 4.54 GB (4873596984) HDFS_SCAN_NODE (id=1):(Total: 1s021ms, non-child: 1s021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 918.85 MB, 1.10 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.04 - BytesRead: 1.31 GB (1401416952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401416952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401416952) - DecompressionTime: 7s602ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877552) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 108.40 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 16.55K (16553) - ScannerThreadsTotalWallClockTime: 5m4s - MaterializeTupleTime(*): 4m55s - ScannerThreadsSysTime: 1s063ms - ScannerThreadsUserTime: 31s836ms - ScannerThreadsVoluntaryContextSwitches: 108.48K (108484) - TotalRawHdfsReadTime(*): 857.540ms - TotalReadThroughput: 39.90 MB/sec Instance 43435c6d36c99c38:581697e88a6bedd3 (host=vb0212.halxg.cloudera.com:22000):(Total: 33s175ms, non-child: 8s958ms, % non-child: 27.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB MemoryUsage(1s000ms): 747.12 MB, 1003.04 MB, 1003.01 MB, 1002.90 MB, 888.43 MB, 828.78 MB, 828.86 MB, 828.87 MB, 828.72 MB, 753.04 MB, 684.72 MB, 652.81 MB, 652.66 MB, 624.85 MB, 564.76 MB, 564.94 MB, 464.88 MB, 389.16 MB, 368.88 MB, 301.10 MB, 301.12 MB, 293.15 MB, 356.24 MB, 461.61 MB, 461.48 MB, 390.38 MB, 382.40 MB, 350.17 MB, 302.25 MB, 282.24 MB, 246.30 MB, 174.48 MB, 142.56 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.06 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.47 MB (1052217184) - PerHostPeakMemUsage: 4.44 GB (4766701632) - PrepareTime: 142.550ms - RowsProduced: 110.74M (110738660) - TotalCpuTime: 5m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s368ms - TotalStorageWaitTime: 487.294ms CodeGen:(Total: 323.507ms, non-child: 323.507ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1571812) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.511ms - PrepareTime: 140.154ms DataStreamSender (dst_id=5):(Total: 22s881ms, non-child: 22s881ms, % non-child: 100.00%) - BytesSent: 2.30 GB (2466362155) - NetworkThroughput(*): 407.44 MB/sec - OverallThroughput: 102.80 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 17s061ms - TransmitDataRPCTime: 5s772ms - UncompressedRowBatchSize: 4.54 GB (4873584088) HDFS_SCAN_NODE (id=1):(Total: 1s012ms, non-child: 1s012ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.493% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(1s000ms): 648.00 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.10 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 9.06 - BytesRead: 1.31 GB (1401382482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401382482) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401382482) - DecompressionTime: 7s670ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811744) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 109.41 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 17.43K (17432) - ScannerThreadsTotalWallClockTime: 5m1s - MaterializeTupleTime(*): 4m52s - ScannerThreadsSysTime: 1s095ms - ScannerThreadsUserTime: 32s144ms - ScannerThreadsVoluntaryContextSwitches: 108.43K (108431) - TotalRawHdfsReadTime(*): 907.518ms - TotalReadThroughput: 39.89 MB/sec Fragment F00: Instance 43435c6d36c99c38:581697e88a6bede8 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 1m20s, % non-child: 84.07%) Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Filter 0 arrival: 37s439ms MemoryUsage(2s000ms): 70.16 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.16 MB, 140.61 MB, 141.16 MB, 141.13 MB, 141.13 MB, 141.20 MB, 141.14 MB, 141.18 MB, 141.14 MB, 141.14 MB, 141.03 MB, 57.34 MB, 53.39 MB, 53.37 MB, 71.16 MB, 75.09 MB, 75.10 MB, 75.13 MB, 75.16 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.31 GB (12145145600) - PrepareTime: 283.192us - RowsProduced: 116.10M (116100730) - TotalCpuTime: 16m49s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 225.432ms DataStreamSender (dst_id=4):(Total: 13s637ms, non-child: 13s637ms, % non-child: 100.00%) - BytesSent: 931.05 MB (976276301) - NetworkThroughput(*): 268.91 MB/sec - OverallThroughput: 68.27 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 116.10M (116100730) - SerializeBatchTime: 10s155ms - TransmitDataRPCTime: 3s462ms - UncompressedRowBatchSize: 2.16 GB (2322468144) HDFS_SCAN_NODE (id=0):(Total: 1s529ms, non-child: 1s529ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:3/698.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 8:3/760.21 MB 10:6/1.48 GB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.52 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 157.56 MB, 178.14 MB, 178.14 MB, 178.14 MB, 178.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 178.14 MB (186788144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.14 MB (186788144) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.14 MB (186788144) - DecompressionTime: 1s333ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100730) - RowsReturned: 116.10M (116100730) - RowsReturnedRate: 75.89 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.34K (5338) - ScannerThreadsTotalWallClockTime: 16m24s - MaterializeTupleTime(*): 16m22s - ScannerThreadsSysTime: 421.928ms - ScannerThreadsUserTime: 8s904ms - ScannerThreadsVoluntaryContextSwitches: 113.49K (113491) - TotalRawHdfsReadTime(*): 105.519ms - TotalReadThroughput: 1.88 MB/sec Filter 0: - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) Instance 43435c6d36c99c38:581697e88a6bede7 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m17s, % non-child: 81.67%) Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Filter 0 arrival: 37s438ms MemoryUsage(2s000ms): 70.06 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 140.01 MB, 140.10 MB, 140.38 MB, 140.99 MB, 141.18 MB, 141.15 MB, 141.13 MB, 141.17 MB, 141.14 MB, 141.18 MB, 119.11 MB, 53.37 MB, 53.41 MB, 62.68 MB, 91.44 MB, 91.53 MB, 91.49 MB, 91.51 MB, 91.52 MB, 49.66 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317968) - PerHostPeakMemUsage: 11.31 GB (12142417264) - PrepareTime: 323.870us - RowsProduced: 124.58M (124580591) - TotalCpuTime: 16m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 217.508ms DataStreamSender (dst_id=4):(Total: 15s562ms, non-child: 15s562ms, % non-child: 100.00%) - BytesSent: 1001.12 MB (1049754664) - NetworkThroughput(*): 221.82 MB/sec - OverallThroughput: 64.33 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124580591) - SerializeBatchTime: 11s025ms - TransmitDataRPCTime: 4s513ms - UncompressedRowBatchSize: 2.32 GB (2492098492) HDFS_SCAN_NODE (id=0):(Total: 1s777ms, non-child: 1s777ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 1:2/506.78 MB 8:2/506.79 MB 2:3/760.21 MB 0:1/253.38 MB 9:1/253.37 MB 6:2/506.81 MB 10:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s005ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 135.17 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 190.83 MB (200100815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200100815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200100815) - DecompressionTime: 1s481ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580591) - RowsReturned: 124.58M (124580591) - RowsReturnedRate: 70.09 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.43K (6427) - ScannerThreadsTotalWallClockTime: 16m18s - MaterializeTupleTime(*): 16m16s - ScannerThreadsSysTime: 583.904ms - ScannerThreadsUserTime: 9s631ms - ScannerThreadsVoluntaryContextSwitches: 121.89K (121886) - TotalRawHdfsReadTime(*): 149.096ms - TotalReadThroughput: 2.02 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede6 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m17s, % non-child: 81.57%) Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Filter 0 arrival: 37s439ms MemoryUsage(2s000ms): 70.16 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 139.99 MB, 140.02 MB, 140.02 MB, 140.40 MB, 141.17 MB, 141.20 MB, 141.08 MB, 141.10 MB, 141.05 MB, 141.09 MB, 141.05 MB, 141.06 MB, 53.32 MB, 53.36 MB, 62.71 MB, 91.52 MB, 91.51 MB, 91.55 MB, 91.46 MB, 91.60 MB, 49.60 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12142470632) - PrepareTime: 319.084us - RowsProduced: 124.58M (124581192) - TotalCpuTime: 16m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 250.407ms DataStreamSender (dst_id=4):(Total: 15s665ms, non-child: 15s665ms, % non-child: 100.00%) - BytesSent: 1002.94 MB (1051659034) - NetworkThroughput(*): 216.22 MB/sec - OverallThroughput: 64.02 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581192) - SerializeBatchTime: 11s002ms - TransmitDataRPCTime: 4s638ms - UncompressedRowBatchSize: 2.32 GB (2492110512) HDFS_SCAN_NODE (id=0):(Total: 1s749ms, non-child: 1s749ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:1/253.40 MB 6:2/506.81 MB 10:2/506.78 MB 9:1/253.41 MB 4:2/506.77 MB 8:2/506.77 MB 3:2/506.77 MB 1:4/1013.59 MB 7:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 135.17 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 190.83 MB (200101820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101820) - DecompressionTime: 1s407ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581192) - RowsReturned: 124.58M (124581192) - RowsReturnedRate: 71.19 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.42K (6423) - ScannerThreadsTotalWallClockTime: 16m16s - MaterializeTupleTime(*): 16m15s - ScannerThreadsSysTime: 462.925ms - ScannerThreadsUserTime: 9s218ms - ScannerThreadsVoluntaryContextSwitches: 121.83K (121832) - TotalRawHdfsReadTime(*): 153.560ms - TotalReadThroughput: 2.01 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede0 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m17s, % non-child: 82.22%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 70.19 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.23 MB, 140.22 MB, 140.20 MB, 140.43 MB, 141.09 MB, 141.07 MB, 141.10 MB, 141.13 MB, 141.10 MB, 141.15 MB, 141.08 MB, 141.08 MB, 53.36 MB, 53.33 MB, 53.42 MB, 91.34 MB, 91.52 MB, 91.54 MB, 91.50 MB, 91.48 MB, 49.64 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317968) - PerHostPeakMemUsage: 11.31 GB (12142612112) - PrepareTime: 325.295us - RowsProduced: 124.58M (124581324) - TotalCpuTime: 16m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 180.647ms DataStreamSender (dst_id=4):(Total: 15s075ms, non-child: 15s075ms, % non-child: 100.00%) - BytesSent: 999.53 MB (1048085724) - NetworkThroughput(*): 222.79 MB/sec - OverallThroughput: 66.30 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581324) - SerializeBatchTime: 10s565ms - TransmitDataRPCTime: 4s486ms - UncompressedRowBatchSize: 2.32 GB (2492113152) HDFS_SCAN_NODE (id=0):(Total: 1s708ms, non-child: 1s708ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.39 MB 5:1/253.41 MB 9:2/506.80 MB 3:1/253.39 MB 1:3/760.15 MB 2:2/506.78 MB 7:2/506.78 MB 0:2/506.82 MB 4:2/506.79 MB 8:1/253.41 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 190.83 MB (200096771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200096771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200096771) - DecompressionTime: 1s317ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581324) - RowsReturned: 124.58M (124581324) - RowsReturnedRate: 72.93 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.02K (6017) - ScannerThreadsTotalWallClockTime: 16m18s - MaterializeTupleTime(*): 16m16s - ScannerThreadsSysTime: 490.920ms - ScannerThreadsUserTime: 8s876ms - ScannerThreadsVoluntaryContextSwitches: 121.85K (121847) - TotalRawHdfsReadTime(*): 127.766ms - TotalReadThroughput: 2.02 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede1 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m16s, % non-child: 81.24%) Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 69.17 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.09 MB, 138.40 MB, 139.15 MB, 139.16 MB, 139.14 MB, 139.09 MB, 139.15 MB, 139.09 MB, 139.09 MB, 117.18 MB, 51.39 MB, 50.84 MB, 70.78 MB, 91.65 MB, 91.55 MB, 91.46 MB, 91.55 MB, 89.60 MB, 47.66 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.43 MB (146204424) - PerHostPeakMemUsage: 11.31 GB (12140426376) - PrepareTime: 294.983us - RowsProduced: 124.06M (124059923) - TotalCpuTime: 16m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 194.996ms DataStreamSender (dst_id=4):(Total: 16s069ms, non-child: 16s069ms, % non-child: 100.00%) - BytesSent: 997.23 MB (1045667515) - NetworkThroughput(*): 205.07 MB/sec - OverallThroughput: 62.06 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.06M (124059923) - SerializeBatchTime: 11s181ms - TransmitDataRPCTime: 4s862ms - UncompressedRowBatchSize: 2.31 GB (2481683100) HDFS_SCAN_NODE (id=0):(Total: 1s636ms, non-child: 1s636ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.40 MB 3:3/760.19 MB 0:1/253.42 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 7:2/506.81 MB 9:1/253.39 MB 8:1/253.38 MB 4:4/1013.56 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.91 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 115.83 MB, 144.98 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB, 190.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 190.02 MB (199253188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.02 MB (199253188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.02 MB (199253188) - DecompressionTime: 1s486ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.96 MB (145708808) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.06M (124059923) - RowsReturned: 124.06M (124059923) - RowsReturnedRate: 75.83 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.53K (5525) - ScannerThreadsTotalWallClockTime: 16m15s - MaterializeTupleTime(*): 16m13s - ScannerThreadsSysTime: 512.918ms - ScannerThreadsUserTime: 9s203ms - ScannerThreadsVoluntaryContextSwitches: 121.28K (121285) - TotalRawHdfsReadTime(*): 129.694ms - TotalReadThroughput: 2.01 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bedeb (host=vb0224.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m17s, % non-child: 81.92%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Filter 0 arrival: 37s438ms MemoryUsage(2s000ms): 69.15 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.29 MB, 138.53 MB, 139.19 MB, 139.11 MB, 139.13 MB, 139.07 MB, 139.15 MB, 139.16 MB, 139.15 MB, 117.16 MB, 51.34 MB, 56.26 MB, 76.26 MB, 91.51 MB, 91.51 MB, 91.49 MB, 91.55 MB, 87.45 MB, 41.62 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.43 MB (146204424) - PerHostPeakMemUsage: 11.31 GB (12140548128) - PrepareTime: 163.780us - RowsProduced: 123.88M (123876716) - TotalCpuTime: 16m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 245.051ms DataStreamSender (dst_id=4):(Total: 15s407ms, non-child: 15s407ms, % non-child: 100.00%) - BytesSent: 995.08 MB (1043413223) - NetworkThroughput(*): 239.07 MB/sec - OverallThroughput: 64.58 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.88M (123876716) - SerializeBatchTime: 11s220ms - TransmitDataRPCTime: 4s162ms - UncompressedRowBatchSize: 2.31 GB (2478018236) HDFS_SCAN_NODE (id=0):(Total: 1s651ms, non-child: 1s651ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.41 MB 6:1/253.40 MB 8:1/253.38 MB 1:5/1.24 GB 0:1/253.40 MB 5:4/987.82 MB 3:4/1013.57 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 57.79 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 115.58 MB, 120.88 MB, 157.99 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB, 189.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 189.79 MB (199012872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.79 MB (199012872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.79 MB (199012872) - DecompressionTime: 1s420ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.98 MB (145733384) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876716) - RowsReturned: 123.88M (123876716) - RowsReturnedRate: 75.01 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.76K (5760) - ScannerThreadsTotalWallClockTime: 16m14s - MaterializeTupleTime(*): 16m12s - ScannerThreadsSysTime: 484.921ms - ScannerThreadsUserTime: 9s235ms - ScannerThreadsVoluntaryContextSwitches: 121.08K (121080) - TotalRawHdfsReadTime(*): 137.423ms - TotalReadThroughput: 2.01 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bedec (host=vb0222.halxg.cloudera.com:22000):(Total: 1m34s, non-child: 1m16s, % non-child: 81.57%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Filter 0 arrival: 37s438ms MemoryUsage(2s000ms): 64.36 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.59 MB, 128.57 MB, 132.01 MB, 141.08 MB, 141.08 MB, 141.14 MB, 141.15 MB, 141.17 MB, 141.12 MB, 141.10 MB, 121.12 MB, 53.26 MB, 53.33 MB, 71.58 MB, 88.06 MB, 88.07 MB, 88.02 MB, 88.04 MB, 88.08 MB, 35.43 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.66 MB (148539480) - PerHostPeakMemUsage: 11.30 GB (12130409544) - PrepareTime: 327.499us - RowsProduced: 123.30M (123304062) - TotalCpuTime: 16m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 218.594ms DataStreamSender (dst_id=4):(Total: 15s627ms, non-child: 15s627ms, % non-child: 100.00%) - BytesSent: 990.91 MB (1039047634) - NetworkThroughput(*): 214.45 MB/sec - OverallThroughput: 63.41 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 123.30M (123304062) - SerializeBatchTime: 10s982ms - TransmitDataRPCTime: 4s620ms - UncompressedRowBatchSize: 2.30 GB (2466562928) HDFS_SCAN_NODE (id=0):(Total: 1s741ms, non-child: 1s741ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 9:3/760.19 MB 3:4/1013.58 MB 0:3/514.26 MB 6:1/253.39 MB 1:1/253.41 MB 7:2/506.81 MB 5:2/453.09 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 53.27 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 109.19 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 117.13 MB, 153.13 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB, 189.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 189.14 MB (198324470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.14 MB (198324470) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.14 MB (198324470) - DecompressionTime: 1s428ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.26 MB (148117592) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123304062) - RowsReturned: 123.30M (123304062) - RowsReturnedRate: 70.81 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.72K (6719) - ScannerThreadsTotalWallClockTime: 16m13s - MaterializeTupleTime(*): 16m11s - ScannerThreadsSysTime: 578.905ms - ScannerThreadsUserTime: 9s303ms - ScannerThreadsVoluntaryContextSwitches: 120.53K (120527) - TotalRawHdfsReadTime(*): 126.837ms - TotalReadThroughput: 2.00 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bedde (host=vb0208.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 84.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 61.46 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.79 MB, 122.78 MB, 122.73 MB, 128.79 MB, 135.11 MB, 135.19 MB, 135.18 MB, 135.01 MB, 135.12 MB, 135.11 MB, 135.06 MB, 111.24 MB, 59.27 MB, 66.73 MB, 80.34 MB, 91.52 MB, 91.53 MB, 91.52 MB, 85.47 MB, 77.53 MB, 30.07 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.60 MB (146383448) - PerHostPeakMemUsage: 11.29 GB (12124305928) - PrepareTime: 335.251us - RowsProduced: 122.21M (122205738) - TotalCpuTime: 16m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 254.730ms DataStreamSender (dst_id=4):(Total: 13s441ms, non-child: 13s441ms, % non-child: 100.00%) - BytesSent: 981.25 MB (1028919119) - NetworkThroughput(*): 248.03 MB/sec - OverallThroughput: 73.00 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 122.21M (122205738) - SerializeBatchTime: 9s466ms - TransmitDataRPCTime: 3s956ms - UncompressedRowBatchSize: 2.28 GB (2444592156) HDFS_SCAN_NODE (id=0):(Total: 1s588ms, non-child: 1s588ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:4/1013.56 MB 7:3/486.60 MB 4:2/506.78 MB 10:1/187.22 MB 0:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 51.35 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 102.69 MB, 107.99 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 113.29 MB, 118.59 MB, 123.89 MB, 131.84 MB, 161.00 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB, 187.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 187.51 MB (196616751) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.51 MB (196616751) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.51 MB (196616751) - DecompressionTime: 1s461ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.15 MB (145912408) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205738) - RowsReturned: 122.21M (122205738) - RowsReturnedRate: 76.94 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.19K (6188) - ScannerThreadsTotalWallClockTime: 16m9s - MaterializeTupleTime(*): 16m7s - ScannerThreadsSysTime: 574.907ms - ScannerThreadsUserTime: 9s823ms - ScannerThreadsVoluntaryContextSwitches: 119.53K (119525) - TotalRawHdfsReadTime(*): 131.308ms - TotalReadThroughput: 1.99 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede3 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m18s, % non-child: 83.49%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Filter 0 arrival: 37s439ms MemoryUsage(2s000ms): 45.32 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.27 MB, 140.26 MB, 140.23 MB, 140.44 MB, 141.07 MB, 141.14 MB, 141.10 MB, 141.17 MB, 141.06 MB, 141.11 MB, 141.02 MB, 91.30 MB, 53.42 MB, 53.33 MB, 94.81 MB, 91.51 MB, 91.54 MB, 91.55 MB, 91.50 MB, 61.55 MB, 31.57 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.47 MB (148342544) - PerHostPeakMemUsage: 11.31 GB (12142613568) - PrepareTime: 303.635us - RowsProduced: 124.58M (124581482) - TotalCpuTime: 16m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 224.295ms DataStreamSender (dst_id=4):(Total: 13s894ms, non-child: 13s894ms, % non-child: 100.00%) - BytesSent: 997.54 MB (1045993263) - NetworkThroughput(*): 171.86 MB/sec - OverallThroughput: 71.79 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 124.58M (124581482) - SerializeBatchTime: 8s073ms - TransmitDataRPCTime: 5s804ms - UncompressedRowBatchSize: 2.32 GB (2492116308) HDFS_SCAN_NODE (id=0):(Total: 1s534ms, non-child: 1s534ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:1/253.39 MB 3:1/253.40 MB 6:2/506.80 MB 9:4/1013.56 MB 1:2/506.78 MB 7:3/760.15 MB 5:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 29.35 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 190.84 MB (200107069) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200107069) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200107069) - DecompressionTime: 1s149ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581482) - RowsReturned: 124.58M (124581482) - RowsReturnedRate: 81.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 4.94K (4937) - ScannerThreadsTotalWallClockTime: 16m3s - MaterializeTupleTime(*): 16m2s - ScannerThreadsSysTime: 319.945ms - ScannerThreadsUserTime: 7s413ms - ScannerThreadsVoluntaryContextSwitches: 121.73K (121727) - TotalRawHdfsReadTime(*): 130.541ms - TotalReadThroughput: 2.03 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede5 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m16s, % non-child: 81.98%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 49.28 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.27 MB, 140.25 MB, 140.36 MB, 141.15 MB, 141.08 MB, 141.07 MB, 141.13 MB, 141.07 MB, 141.11 MB, 141.08 MB, 139.09 MB, 53.42 MB, 53.38 MB, 61.76 MB, 79.13 MB, 79.11 MB, 79.14 MB, 79.20 MB, 55.22 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.31 GB (12142621568) - PrepareTime: 171.840us - RowsProduced: 117.66M (117659985) - TotalCpuTime: 16m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 223.408ms DataStreamSender (dst_id=4):(Total: 15s144ms, non-child: 15s144ms, % non-child: 100.00%) - BytesSent: 943.40 MB (989224669) - NetworkThroughput(*): 216.44 MB/sec - OverallThroughput: 62.29 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659985) - SerializeBatchTime: 10s763ms - TransmitDataRPCTime: 4s358ms - UncompressedRowBatchSize: 2.19 GB (2353659332) HDFS_SCAN_NODE (id=0):(Total: 1s671ms, non-child: 1s671ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 10:3/760.20 MB 4:2/506.79 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.80 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 29.37 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 135.18 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 180.25 MB (189002394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189002394) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189002394) - DecompressionTime: 1s315ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659985) - RowsReturned: 117.66M (117659985) - RowsReturnedRate: 70.38 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.88K (5880) - ScannerThreadsTotalWallClockTime: 15m55s - MaterializeTupleTime(*): 15m53s - ScannerThreadsSysTime: 545.911ms - ScannerThreadsUserTime: 8s706ms - ScannerThreadsVoluntaryContextSwitches: 114.99K (114989) - TotalRawHdfsReadTime(*): 121.963ms - TotalReadThroughput: 1.93 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bedea (host=vb0218.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m16s, % non-child: 81.92%) Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Filter 0 arrival: 37s439ms MemoryUsage(2s000ms): 70.20 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.28 MB, 140.32 MB, 140.40 MB, 140.72 MB, 141.16 MB, 141.07 MB, 141.13 MB, 141.19 MB, 141.16 MB, 141.18 MB, 141.11 MB, 119.07 MB, 53.32 MB, 53.34 MB, 66.09 MB, 79.13 MB, 79.12 MB, 79.16 MB, 79.09 MB, 43.20 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12142782712) - PrepareTime: 307.344us - RowsProduced: 117.66M (117659888) - TotalCpuTime: 16m22s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 216.183ms DataStreamSender (dst_id=4):(Total: 15s167ms, non-child: 15s167ms, % non-child: 100.00%) - BytesSent: 942.24 MB (988011905) - NetworkThroughput(*): 216.25 MB/sec - OverallThroughput: 62.12 MB/sec - PeakMemoryUsage: 508.00 KB (520192) - RowsReturned: 117.66M (117659888) - SerializeBatchTime: 10s787ms - TransmitDataRPCTime: 4s357ms - UncompressedRowBatchSize: 2.19 GB (2353657400) HDFS_SCAN_NODE (id=0):(Total: 1s698ms, non-child: 1s698ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.77 MB 8:3/760.20 MB 6:2/506.78 MB 3:1/253.39 MB 4:1/253.40 MB 9:2/506.80 MB 2:2/506.77 MB 10:2/506.79 MB 1:2/506.77 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 148.45 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 180.25 MB (189010714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010714) - DecompressionTime: 1s363ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659888) - RowsReturned: 117.66M (117659888) - RowsReturnedRate: 69.26 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.03K (6032) - ScannerThreadsTotalWallClockTime: 15m55s - MaterializeTupleTime(*): 15m53s - ScannerThreadsSysTime: 504.919ms - ScannerThreadsUserTime: 8s826ms - ScannerThreadsVoluntaryContextSwitches: 115.04K (115036) - TotalRawHdfsReadTime(*): 119.956ms - TotalReadThroughput: 1.93 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede4 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m33s, non-child: 1m16s, % non-child: 82.12%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Filter 0 arrival: 37s439ms MemoryUsage(2s000ms): 70.19 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.22 MB, 140.18 MB, 140.65 MB, 141.15 MB, 141.18 MB, 141.15 MB, 141.19 MB, 141.07 MB, 141.11 MB, 141.06 MB, 97.19 MB, 53.38 MB, 53.34 MB, 75.03 MB, 79.13 MB, 79.15 MB, 79.07 MB, 79.10 MB, 43.23 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293392) - PerHostPeakMemUsage: 11.31 GB (12142588408) - PrepareTime: 1.186ms - RowsProduced: 117.66M (117660001) - TotalCpuTime: 16m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 229.160ms DataStreamSender (dst_id=4):(Total: 14s975ms, non-child: 14s975ms, % non-child: 100.00%) - BytesSent: 943.10 MB (988909805) - NetworkThroughput(*): 200.94 MB/sec - OverallThroughput: 62.97 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117660001) - SerializeBatchTime: 10s259ms - TransmitDataRPCTime: 4s693ms - UncompressedRowBatchSize: 2.19 GB (2353659652) HDFS_SCAN_NODE (id=0):(Total: 1s690ms, non-child: 1s690ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:1/253.39 MB 8:1/253.41 MB 5:2/506.78 MB 7:1/253.41 MB 2:2/506.81 MB 0:2/506.77 MB 4:2/506.77 MB 1:2/506.82 MB 10:1/253.40 MB 9:3/760.21 MB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 164.34 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.22 - BytesRead: 180.24 MB (188994044) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188994044) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188994044) - DecompressionTime: 1s334ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660001) - RowsReturned: 117.66M (117660001) - RowsReturnedRate: 69.60 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.82K (5817) - ScannerThreadsTotalWallClockTime: 15m53s - MaterializeTupleTime(*): 15m51s - ScannerThreadsSysTime: 479.921ms - ScannerThreadsUserTime: 8s667ms - ScannerThreadsVoluntaryContextSwitches: 115.05K (115046) - TotalRawHdfsReadTime(*): 126.503ms - TotalReadThroughput: 1.94 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6beddf (host=vb0230.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 1m17s, % non-child: 83.89%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 70.18 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.15 MB, 140.71 MB, 141.04 MB, 141.11 MB, 141.15 MB, 141.15 MB, 141.16 MB, 141.14 MB, 141.14 MB, 53.40 MB, 53.44 MB, 59.70 MB, 79.13 MB, 79.17 MB, 79.14 MB, 79.13 MB, 55.22 MB, 31.21 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148326160) - PerHostPeakMemUsage: 11.31 GB (12142561744) - PrepareTime: 312.196us - RowsProduced: 117.66M (117659846) - TotalCpuTime: 15m58s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 224.868ms DataStreamSender (dst_id=4):(Total: 13s261ms, non-child: 13s261ms, % non-child: 100.00%) - BytesSent: 939.71 MB (985354518) - NetworkThroughput(*): 191.58 MB/sec - OverallThroughput: 70.86 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 117.66M (117659846) - SerializeBatchTime: 8s337ms - TransmitDataRPCTime: 4s905ms - UncompressedRowBatchSize: 2.19 GB (2353656552) HDFS_SCAN_NODE (id=0):(Total: 1s535ms, non-child: 1s535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:2/506.78 MB 10:2/506.77 MB 1:1/253.41 MB 5:1/253.38 MB 9:2/506.83 MB 6:1/253.40 MB 0:1/253.40 MB 2:2/506.80 MB 4:4/1013.59 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 58.32 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 116.65 MB, 132.55 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.20 - BytesRead: 180.25 MB (189007782) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189007782) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189007782) - DecompressionTime: 1s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659846) - RowsReturned: 117.66M (117659846) - RowsReturnedRate: 76.61 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.86K (4858) - ScannerThreadsTotalWallClockTime: 15m37s - MaterializeTupleTime(*): 15m36s - ScannerThreadsSysTime: 355.940ms - ScannerThreadsUserTime: 7s857ms - ScannerThreadsVoluntaryContextSwitches: 114.98K (114980) - TotalRawHdfsReadTime(*): 138.756ms - TotalReadThroughput: 1.96 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede2 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 1m16s, % non-child: 84.47%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Filter 0 arrival: 37s440ms MemoryUsage(2s000ms): 70.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.13 MB, 140.74 MB, 141.13 MB, 141.14 MB, 141.12 MB, 141.13 MB, 141.08 MB, 141.05 MB, 141.08 MB, 87.25 MB, 53.31 MB, 53.35 MB, 66.54 MB, 66.66 MB, 66.72 MB, 66.76 MB, 26.75 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.48 MB (148350736) - PerHostPeakMemUsage: 11.31 GB (12142513384) - PrepareTime: 202.443us - RowsProduced: 110.74M (110738660) - TotalCpuTime: 15m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 199.901ms DataStreamSender (dst_id=4):(Total: 12s551ms, non-child: 12s551ms, % non-child: 100.00%) - BytesSent: 883.48 MB (926398792) - NetworkThroughput(*): 172.46 MB/sec - OverallThroughput: 70.39 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - RowsReturned: 110.74M (110738660) - SerializeBatchTime: 7s412ms - TransmitDataRPCTime: 5s122ms - UncompressedRowBatchSize: 2.06 GB (2215205796) HDFS_SCAN_NODE (id=0):(Total: 1s489ms, non-child: 1s489ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 8:3/760.17 MB 1:1/253.40 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 5:2/506.81 MB 4:4/1013.61 MB 2:1/253.40 MB Runtime filters: Only following filters arrived: , waited 1s004ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.31 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 169.63 MB, 169.63 MB, 169.63 MB, 169.63 MB, 169.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.18 - BytesRead: 169.63 MB (177871166) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.63 MB (177871166) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.63 MB (177871166) - DecompressionTime: 988.984ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738660) - RowsReturned: 110.74M (110738660) - RowsReturnedRate: 74.33 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 4.17K (4168) - ScannerThreadsTotalWallClockTime: 15m22s - MaterializeTupleTime(*): 15m21s - ScannerThreadsSysTime: 279.951ms - ScannerThreadsUserTime: 6s436ms - ScannerThreadsVoluntaryContextSwitches: 108.22K (108216) - TotalRawHdfsReadTime(*): 113.429ms - TotalReadThroughput: 1.87 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Instance 43435c6d36c99c38:581697e88a6bede9 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 1m15s, % non-child: 84.38%) Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Filter 0 arrival: 37s436ms MemoryUsage(2s000ms): 70.19 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.22 MB, 140.47 MB, 141.14 MB, 141.14 MB, 141.20 MB, 141.02 MB, 141.16 MB, 141.14 MB, 141.22 MB, 81.28 MB, 53.27 MB, 57.27 MB, 66.78 MB, 66.72 MB, 66.66 MB, 56.75 MB, 26.77 MB ThreadUsage(2s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.47 MB (148342544) - PerHostPeakMemUsage: 11.31 GB (12144981760) - PrepareTime: 279.534us - RowsProduced: 110.74M (110738953) - TotalCpuTime: 15m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 263.820ms DataStreamSender (dst_id=4):(Total: 12s557ms, non-child: 12s557ms, % non-child: 100.00%) - BytesSent: 885.03 MB (928017488) - NetworkThroughput(*): 170.20 MB/sec - OverallThroughput: 70.48 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - RowsReturned: 110.74M (110738953) - SerializeBatchTime: 7s342ms - TransmitDataRPCTime: 5s199ms - UncompressedRowBatchSize: 2.06 GB (2215211668) HDFS_SCAN_NODE (id=0):(Total: 1s481ms, non-child: 1s481ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/253.37 MB 1:2/506.79 MB 7:2/506.82 MB 10:2/506.77 MB 4:1/253.40 MB 5:1/253.38 MB 0:2/506.79 MB 2:5/1.24 GB Runtime filters: Only following filters arrived: , waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.32 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 121.94 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 169.66 MB (177902248) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177902248) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177902248) - DecompressionTime: 1s055ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738953) - RowsReturned: 110.74M (110738953) - RowsReturnedRate: 74.73 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 4.20K (4202) - ScannerThreadsTotalWallClockTime: 15m17s - MaterializeTupleTime(*): 15m16s - ScannerThreadsSysTime: 204.964ms - ScannerThreadsUserTime: 6s605ms - ScannerThreadsVoluntaryContextSwitches: 108.22K (108219) - TotalRawHdfsReadTime(*): 137.382ms - TotalReadThroughput: 1.89 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) ================================================================================