================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 371.72ms | 0ns | 371.72ms | 1 | 1 | | 06:EXCHANGE | 1 | 208.66us | 0ns | 208.66us | 15 | 1 | | 03:AGGREGATE | 15 | 2.55s | 0ns | 2.90s | 15 | 1 | | 02:HASH JOIN | 15 | 59.02s | 0ns | 63.00s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 8.62s | 0ns | 12.13s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 930.97ms | 0ns | 1.03s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 3.28s | 0ns | 3.88s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 664.42ms | 0ns | 818.46ms | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=114de16649df4a15:6dee5cbe29b6a992): Summary: Session ID: d54e4e83a3722622:e3a101720dc11a8b Session Type: BEESWAX Start Time: 2016-04-21 21:25:09.968237000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:47292 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 11.169ms - Analysis finished: 3.342ms (3.342ms) - Equivalence classes computed: 3.559ms (217.110us) - Single node plan created: 6.310ms (2.750ms) - Runtime filters computed: 6.443ms (133.051us) - Distributed plan created: 8.712ms (2.269ms) - Lineage info computed: 9.276ms (564.088us) - Planning finished: 11.169ms (1.893ms) Query Timeline: 1m33s - Start execution: 292.469us (292.469us) - Planning finished: 14.698ms (14.406ms) - Ready to start 45 remote fragments: 390.142ms (375.444ms) - All 45 remote fragments started: 3s789ms (3s399ms) - Rows available: 1m32s (1m29s) - First row fetched: 1m32s (36.958ms) ImpalaServer: - ClientFetchWaitTimer: 37.356ms - RowMaterializationTimer: 158.291us Execution Profile 114de16649df4a15:6dee5cbe29b6a992:(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 55ms, 95th %-ile: 3s340ms, 99.9th %-ile: 3s394ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(11.31 GB) vb0222.halxg.cloudera.com:22000(11.31 GB) vb0224.halxg.cloudera.com:22000(11.31 GB) vb0208.halxg.cloudera.com:22000(11.31 GB) vb0230.halxg.cloudera.com:22000(11.31 GB) vb0228.halxg.cloudera.com:22000(11.31 GB) vb0220.halxg.cloudera.com:22000(11.31 GB) vb0206.halxg.cloudera.com:22000(11.31 GB) vb0232.halxg.cloudera.com:22000(11.30 GB) vb0216.halxg.cloudera.com:22000(11.31 GB) vb0226.halxg.cloudera.com:22000(11.31 GB) vb0234.halxg.cloudera.com:22000(11.31 GB) vb0214.halxg.cloudera.com:22000(11.31 GB) vb0212.halxg.cloudera.com:22000(11.31 GB) vb0204.halxg.cloudera.com:22000(11.32 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 371.402ms - RowsProduced: 1 (1) - TotalCpuTime: 4s018ms - TotalNetworkReceiveTime: 1m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 576.289ms, non-child: 576.289ms, % non-child: 100.00%) - CodegenTime: 1.782ms - CompileTime: 1.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 204.956ms - PrepareTime: 367.843ms AGGREGATION_NODE (id=7):(Total: 1m29s, non-child: 371.722ms, % non-child: 0.42%) ExecOption: Codegen Enabled - BuildTime: 7.446us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m28s, non-child: 208.656us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 29.872us - DeserializeRowBatchTimer: 103.506us - FirstBatchArrivalWaitTime: 1m28s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m29s max:1m32s mean: 1m32s stddev:836.870ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11998334976) - PerHostPeakMemUsage: 11.31 GB (12144065741) - PrepareTime: 157.690ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 23s424ms - TotalNetworkSendTime: 341.390us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 429.252ms, non-child: 429.252ms, % non-child: 100.00%) - CodegenTime: 181.847us - CompileTime: 45.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 228.431ms - PrepareTime: 153.519ms DataStreamSender (dst_id=6):(Total: 42.314us, non-child: 42.314us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 53.96 KB/sec - OverallThroughput: 374.64 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.249us - ThriftTransmitTime(*): 295.785us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s553ms, % non-child: 2.78%) - BuildTime: 2s150ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.54 KB (49705) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s024ms, % non-child: 66.11%) - BuildPartitionTime: 11s200ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 13s234ms - GetNewBlockTime: 6.862ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s997ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 6.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.497us EXCHANGE_NODE (id=5):(Total: 22s572ms, non-child: 22s572ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671914158) - ConvertRowBatchTime: 3s761ms - DeserializeRowBatchTimer: 9s084ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 5.34 M/sec - SendersBlockedTimer: 949.335ms - SendersBlockedTotalTimer(*): 7s474ms EXCHANGE_NODE (id=4):(Total: 7s682ms, non-child: 7s682ms, % non-child: 100.00%) - BytesReceived: 796.61 MB (835305659) - ConvertRowBatchTime: 2s535ms - DeserializeRowBatchTimer: 3s055ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 17.09 M/sec - SendersBlockedTimer: 50s395ms - SendersBlockedTotalTimer(*): 10m53s Averaged Fragment F01:(Total: 32s498ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:28s188ms max:34s588ms mean: 32s941ms stddev:1s602ms execution rates: min:128.72 MB/sec max:150.91 MB/sec mean:133.55 MB/sec stddev:5.00 MB/sec num instances: 15 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1000.41 MB (1049010929) - PerHostPeakMemUsage: 4.75 GB (5102434743) - PrepareTime: 153.257ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 5m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s207ms - TotalStorageWaitTime: 426.236ms CodeGen:(Total: 337.263ms, non-child: 337.263ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.440ms - PrepareTime: 150.941ms DataStreamSender (dst_id=5):(Total: 31s608ms, non-child: 31s608ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671914158) - NetworkThroughput(*): 40.72 MB/sec - OverallThroughput: 80.73 MB/sec - PeakMemoryUsage: 433.26 KB (443661) - SerializeBatchTime: 16s517ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 4.92 GB (5281141614) HDFS_SCAN_NODE (id=1):(Total: 930.968ms, non-child: 930.968ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.48 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 7s126ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1000.02 MB (1048600618) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 130.07 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 14.21K (14207) - ScannerThreadsTotalWallClockTime: 5m9s - MaterializeTupleTime(*): 5m1s - ScannerThreadsSysTime: 946.050ms - ScannerThreadsUserTime: 29s406ms - ScannerThreadsVoluntaryContextSwitches: 117.45K (117455) - TotalRawHdfsReadTime(*): 965.585ms - TotalReadThroughput: 44.17 MB/sec Averaged Fragment F00:(Total: 1m30s, non-child: 130.446ms, % non-child: 0.14%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:1m26s max:1m31s mean: 1m30s stddev:1s521ms execution rates: min:46.17 MB/sec max:49.75 MB/sec mean:48.50 MB/sec stddev:1.18 MB/sec num instances: 15 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.94 MB (147787668) - PerHostPeakMemUsage: 11.31 GB (12144065741) - PrepareTime: 261.791us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 15m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 200.954ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 796.61 MB (835305659) - NetworkThroughput(*): 1.18 MB/sec - OverallThroughput: 8.89 MB/sec - PeakMemoryUsage: 532.53 KB (545314) - SerializeBatchTime: 9s106ms - ThriftTransmitTime(*): 11m21s - UncompressedRowBatchSize: 2.24 GB (2400454232) HDFS_SCAN_NODE (id=0):(Total: 664.423ms, non-child: 664.423ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s463ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.51 MB (147335745) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 182.91 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.89K (5895) - ScannerThreadsTotalWallClockTime: 15m34s - MaterializeTupleTime(*): 15m32s - ScannerThreadsSysTime: 552.044ms - ScannerThreadsUserTime: 9s441ms - ScannerThreadsVoluntaryContextSwitches: 117.33K (117331) - TotalRawHdfsReadTime(*): 125.439ms - TotalReadThroughput: 2.03 MB/sec Fragment F02: Instance 114de16649df4a15:6dee5cbe29b6a998 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.13 MB, 43.52 MB, 297.89 MB, 604.56 MB, 898.36 MB, 1.17 GB, 1.51 GB, 1.79 GB, 2.10 GB, 2.41 GB, 2.69 GB, 3.01 GB, 3.29 GB, 3.63 GB, 3.91 GB, 4.19 GB, 4.48 GB, 4.78 GB, 5.49 GB, 6.28 GB, 6.95 GB, 7.74 GB, 8.41 GB, 9.19 GB, 9.86 GB, 10.65 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.16 GB, 11.17 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.17 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12000071680) - PerHostPeakMemUsage: 11.31 GB (12142296856) - PrepareTime: 160.180ms - RowsProduced: 1 (1) - TotalCpuTime: 2m4s - TotalNetworkReceiveTime: 20s410ms - TotalNetworkSendTime: 321.340us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 442.374ms, non-child: 442.374ms, % non-child: 100.00%) - CodegenTime: 205.682us - CompileTime: 48.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 236.178ms - PrepareTime: 154.409ms DataStreamSender (dst_id=6):(Total: 45.382us, non-child: 45.382us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 55.27 KB/sec - OverallThroughput: 344.30 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.563us - ThriftTransmitTime(*): 282.683us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s207ms, % non-child: 2.39%) ExecOption: Codegen Enabled - BuildTime: 1s814ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.52 KB (49680) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m30s, non-child: 1m3s, % non-child: 69.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s330ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 14s135ms - GetNewBlockTime: 6.896ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32s803ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 6.66 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.400us EXCHANGE_NODE (id=5):(Total: 22s654ms, non-child: 9s548ms, % non-child: 42.15%) BytesReceived(2s000ms): 149.58 KB, 2.70 MB, 114.03 MB, 289.33 MB, 453.55 MB, 622.31 MB, 805.97 MB, 974.63 MB, 1.13 GB, 1.29 GB, 1.45 GB, 1.62 GB, 1.79 GB, 1.96 GB, 2.12 GB, 2.28 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672721625) - ConvertRowBatchTime: 3s844ms - DeserializeRowBatchTimer: 9s537ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 5.30 M/sec - SendersBlockedTimer: 3s381ms - SendersBlockedTotalTimer(*): 26s082ms EXCHANGE_NODE (id=4):(Total: 4s414ms, non-child: 2s855ms, % non-child: 64.67%) BytesReceived(2s000ms): 144.74 KB, 2.41 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.14 MB, 31.22 MB, 76.43 MB, 119.10 MB, 158.80 MB, 198.52 MB, 239.37 MB, 280.88 MB, 321.64 MB, 362.09 MB, 403.23 MB, 445.09 MB, 487.04 MB, 529.28 MB, 571.45 MB, 612.37 MB, 653.25 MB, 694.32 MB, 735.84 MB, 778.73 MB - BytesReceived: 796.85 MB (835558786) - ConvertRowBatchTime: 2s280ms - DeserializeRowBatchTimer: 2s378ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 27.19 M/sec - SendersBlockedTimer: 59s453ms - SendersBlockedTotalTimer(*): 13m40s Instance 114de16649df4a15:6dee5cbe29b6a999 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.95 MB, 2.61 MB, 264.81 MB, 584.79 MB, 872.79 MB, 1.16 GB, 1.45 GB, 1.79 GB, 2.07 GB, 2.36 GB, 2.66 GB, 2.95 GB, 3.29 GB, 3.57 GB, 3.88 GB, 4.16 GB, 4.45 GB, 4.70 GB, 5.45 GB, 6.12 GB, 6.92 GB, 7.60 GB, 8.39 GB, 9.19 GB, 9.93 GB, 10.67 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997523968) - PerHostPeakMemUsage: 11.31 GB (12144732320) - PrepareTime: 154.627ms - RowsProduced: 1 (1) - TotalCpuTime: 2m3s - TotalNetworkReceiveTime: 20s683ms - TotalNetworkSendTime: 369.747us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 418.294ms, non-child: 418.294ms, % non-child: 100.00%) - CodegenTime: 183.578us - CompileTime: 44.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 222.151ms - PrepareTime: 150.576ms DataStreamSender (dst_id=6):(Total: 52.491us, non-child: 52.491us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 47.38 KB/sec - OverallThroughput: 297.67 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.728us - ThriftTransmitTime(*): 329.802us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s447ms, % non-child: 2.65%) ExecOption: Codegen Enabled - BuildTime: 2s075ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.89 KB (50064) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m1s, % non-child: 68.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s505ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 14s036ms - GetNewBlockTime: 8.109ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s672ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 6.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.502us EXCHANGE_NODE (id=5):(Total: 21s513ms, non-child: 7s910ms, % non-child: 36.77%) BytesReceived(2s000ms): 162.39 KB, 7.04 MB, 139.05 MB, 313.39 MB, 476.59 MB, 647.73 MB, 830.87 MB, 998.30 MB, 1.15 GB, 1.31 GB, 1.47 GB, 1.64 GB, 1.81 GB, 1.98 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672011412) - ConvertRowBatchTime: 4s251ms - DeserializeRowBatchTimer: 7s954ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 5.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s392ms, non-child: 3s174ms, % non-child: 49.65%) BytesReceived(2s000ms): 138.92 KB, 2.63 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.19 MB, 38.01 MB, 82.63 MB, 124.84 MB, 164.42 MB, 204.25 MB, 245.22 MB, 286.61 MB, 327.21 MB, 367.68 MB, 408.97 MB, 450.90 MB, 492.89 MB, 535.19 MB, 577.17 MB, 617.98 MB, 658.80 MB, 699.89 MB, 741.67 MB, 783.57 MB - BytesReceived: 796.64 MB (835338778) - ConvertRowBatchTime: 2s409ms - DeserializeRowBatchTimer: 3s264ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 18.77 M/sec - SendersBlockedTimer: 48s657ms - SendersBlockedTotalTimer(*): 12m9s Instance 114de16649df4a15:6dee5cbe29b6a99d (host=vb0228.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.05 MB, 44.11 MB, 296.80 MB, 616.81 MB, 932.80 MB, 1.17 GB, 1.51 GB, 1.79 GB, 2.12 GB, 2.41 GB, 2.70 GB, 3.01 GB, 3.30 GB, 3.63 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.78 GB, 5.50 GB, 6.32 GB, 7.14 GB, 7.95 GB, 8.78 GB, 9.60 GB, 10.43 GB, 11.10 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997548544) - PerHostPeakMemUsage: 11.31 GB (12144382160) - PrepareTime: 153.675ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 24s158ms - TotalNetworkSendTime: 322.634us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 425.003ms, non-child: 425.003ms, % non-child: 100.00%) - CodegenTime: 179.868us - CompileTime: 41.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 232.419ms - PrepareTime: 149.945ms DataStreamSender (dst_id=6):(Total: 48.957us, non-child: 48.957us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 55.26 KB/sec - OverallThroughput: 319.16 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.632us - ThriftTransmitTime(*): 282.759us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s264ms, % non-child: 2.46%) ExecOption: Codegen Enabled - BuildTime: 1s873ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.53 KB (49696) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s086ms, % non-child: 65.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s141ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 13s017ms - GetNewBlockTime: 6.621ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s481ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 6.68 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.263us EXCHANGE_NODE (id=5):(Total: 22s882ms, non-child: 7s204ms, % non-child: 31.48%) BytesReceived(2s000ms): 142.18 KB, 2.69 MB, 116.48 MB, 291.66 MB, 455.74 MB, 624.41 MB, 808.02 MB, 976.19 MB, 1.13 GB, 1.29 GB, 1.45 GB, 1.62 GB, 1.79 GB, 1.96 GB, 2.13 GB, 2.29 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671307735) - ConvertRowBatchTime: 3s661ms - DeserializeRowBatchTimer: 7s925ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 5.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s896ms, non-child: 3s225ms, % non-child: 40.84%) BytesReceived(2s000ms): 126.91 KB, 2.62 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.17 MB, 31.84 MB, 77.00 MB, 119.62 MB, 159.30 MB, 198.99 MB, 239.81 MB, 281.26 MB, 321.99 MB, 362.39 MB, 403.53 MB, 445.38 MB, 487.37 MB, 529.65 MB, 571.83 MB, 612.67 MB, 653.45 MB, 694.49 MB, 736.09 MB, 778.88 MB - BytesReceived: 796.46 MB (835149388) - ConvertRowBatchTime: 2s447ms - DeserializeRowBatchTimer: 3s268ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 15.19 M/sec - SendersBlockedTimer: 47s517ms - SendersBlockedTotalTimer(*): 10m18s Instance 114de16649df4a15:6dee5cbe29b6a99e (host=vb0230.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.95 MB, 40.60 MB, 296.80 MB, 584.79 MB, 904.80 MB, 1.16 GB, 1.51 GB, 1.79 GB, 2.10 GB, 2.40 GB, 2.66 GB, 3.00 GB, 3.29 GB, 3.60 GB, 3.91 GB, 4.16 GB, 4.48 GB, 4.78 GB, 5.47 GB, 6.13 GB, 6.91 GB, 7.56 GB, 8.28 GB, 9.01 GB, 9.75 GB, 10.57 GB, 11.13 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997523968) - PerHostPeakMemUsage: 11.31 GB (12144879104) - PrepareTime: 193.799ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 25s551ms - TotalNetworkSendTime: 321.738us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 452.902ms, non-child: 452.902ms, % non-child: 100.00%) - CodegenTime: 235.055us - CompileTime: 33.319ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 229.428ms - PrepareTime: 188.691ms DataStreamSender (dst_id=6):(Total: 37.986us, non-child: 37.986us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 55.79 KB/sec - OverallThroughput: 411.33 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.063us - ThriftTransmitTime(*): 280.081us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s517ms, % non-child: 2.73%) ExecOption: Codegen Enabled - BuildTime: 2s063ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.64 KB (51856) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 58s404ms, % non-child: 65.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 8s639ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 14s070ms - GetNewBlockTime: 6.004ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s993ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 6.70 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.056us EXCHANGE_NODE (id=5):(Total: 25s383ms, non-child: 5s993ms, % non-child: 23.61%) BytesReceived(2s000ms): 207.91 KB, 12.36 MB, 151.85 MB, 325.74 MB, 488.46 MB, 661.23 MB, 843.80 MB, 1011.17 MB, 1.16 GB, 1.32 GB, 1.48 GB, 1.65 GB, 1.83 GB, 2.00 GB, 2.16 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671339557) - ConvertRowBatchTime: 2s855ms - DeserializeRowBatchTimer: 7s190ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 4.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s778ms, non-child: 2s937ms, % non-child: 50.84%) BytesReceived(2s000ms): 138.21 KB, 3.87 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.35 MB, 41.36 MB, 85.79 MB, 127.68 MB, 167.16 MB, 207.10 MB, 248.19 MB, 289.51 MB, 330.08 MB, 370.59 MB, 411.95 MB, 453.89 MB, 495.88 MB, 538.21 MB, 580.08 MB, 620.88 MB, 661.73 MB, 702.78 MB, 744.67 MB, 785.75 MB - BytesReceived: 796.45 MB (835137608) - ConvertRowBatchTime: 2s324ms - DeserializeRowBatchTimer: 2s654ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 20.76 M/sec - SendersBlockedTimer: 48s911ms - SendersBlockedTotalTimer(*): 12m13s Instance 114de16649df4a15:6dee5cbe29b6a99c (host=vb0220.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.51 MB, 44.10 MB, 328.85 MB, 676.83 MB, 936.84 MB, 1.22 GB, 1.55 GB, 1.83 GB, 2.18 GB, 2.44 GB, 2.72 GB, 3.05 GB, 3.33 GB, 3.66 GB, 3.94 GB, 4.23 GB, 4.50 GB, 4.87 GB, 5.69 GB, 6.53 GB, 7.38 GB, 8.29 GB, 9.19 GB, 10.03 GB, 10.88 GB, 11.14 GB, 11.14 GB, 11.16 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.10 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997573120) - PerHostPeakMemUsage: 11.31 GB (12144597208) - PrepareTime: 156.813ms - RowsProduced: 1 (1) - TotalCpuTime: 2m - TotalNetworkReceiveTime: 21s542ms - TotalNetworkSendTime: 386.646us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 450.588ms, non-child: 450.588ms, % non-child: 100.00%) - CodegenTime: 190.444us - CompileTime: 48.052ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 248.249ms - PrepareTime: 152.996ms DataStreamSender (dst_id=6):(Total: 42.348us, non-child: 42.348us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 45.10 KB/sec - OverallThroughput: 368.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.034us - ThriftTransmitTime(*): 346.431us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s358ms, % non-child: 2.56%) ExecOption: Codegen Enabled - BuildTime: 2s005ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.02 KB (51216) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m, % non-child: 67.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s996ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 11s854ms - GetNewBlockTime: 7.708ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s425ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 6.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.249us EXCHANGE_NODE (id=5):(Total: 20s909ms, non-child: 12s131ms, % non-child: 58.02%) BytesReceived(2s000ms): 190.13 KB, 6.81 MB, 138.09 MB, 312.57 MB, 475.68 MB, 646.62 MB, 830.11 MB, 997.58 MB, 1.15 GB, 1.31 GB, 1.47 GB, 1.64 GB, 1.81 GB, 1.98 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671988891) - ConvertRowBatchTime: 4s340ms - DeserializeRowBatchTimer: 10s977ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 5.74 M/sec - SendersBlockedTimer: 9s991ms - SendersBlockedTotalTimer(*): 1m18s EXCHANGE_NODE (id=4):(Total: 7s981ms, non-child: 3s218ms, % non-child: 40.32%) BytesReceived(2s000ms): 114.77 KB, 2.61 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 10.16 MB, 37.76 MB, 82.37 MB, 124.59 MB, 164.11 MB, 203.96 MB, 244.99 MB, 286.32 MB, 326.93 MB, 367.44 MB, 408.67 MB, 450.59 MB, 492.51 MB, 534.79 MB, 576.83 MB, 617.68 MB, 658.58 MB, 699.69 MB, 741.52 MB, 783.42 MB - BytesReceived: 796.66 MB (835356796) - ConvertRowBatchTime: 2s368ms - DeserializeRowBatchTimer: 3s561ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 15.03 M/sec - SendersBlockedTimer: 46s415ms - SendersBlockedTotalTimer(*): 8m30s Instance 114de16649df4a15:6dee5cbe29b6a99f (host=vb0208.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.09 MB, 43.33 MB, 297.05 MB, 616.87 MB, 904.84 MB, 1.17 GB, 1.51 GB, 1.79 GB, 2.10 GB, 2.41 GB, 2.69 GB, 3.01 GB, 3.29 GB, 3.62 GB, 3.91 GB, 4.19 GB, 4.48 GB, 4.78 GB, 5.49 GB, 6.29 GB, 7.04 GB, 7.79 GB, 8.60 GB, 9.40 GB, 10.16 GB, 10.91 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997573120) - PerHostPeakMemUsage: 11.31 GB (12144350560) - PrepareTime: 161.757ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 25s354ms - TotalNetworkSendTime: 347.308us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 442.640ms, non-child: 442.640ms, % non-child: 100.00%) - CodegenTime: 173.602us - CompileTime: 47.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 235.897ms - PrepareTime: 157.720ms DataStreamSender (dst_id=6):(Total: 36.889us, non-child: 36.889us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 55.73 KB/sec - OverallThroughput: 423.57 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.067us - ThriftTransmitTime(*): 280.362us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s466ms, % non-child: 2.68%) ExecOption: Codegen Enabled - BuildTime: 2s089ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.52 KB (50704) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 58s010ms, % non-child: 64.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 9s594ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 13s596ms - GetNewBlockTime: 6.794ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s422ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 6.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.143us EXCHANGE_NODE (id=5):(Total: 24s434ms, non-child: 10s726ms, % non-child: 43.90%) BytesReceived(2s000ms): 135.77 KB, 2.68 MB, 113.62 MB, 288.97 MB, 453.11 MB, 621.71 MB, 805.40 MB, 973.74 MB, 1.12 GB, 1.28 GB, 1.45 GB, 1.62 GB, 1.79 GB, 1.96 GB, 2.12 GB, 2.28 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671630540) - ConvertRowBatchTime: 3s247ms - DeserializeRowBatchTimer: 11s896ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 4.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s156ms, non-child: 3s295ms, % non-child: 46.04%) BytesReceived(2s000ms): 132.58 KB, 2.34 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.14 MB, 31.08 MB, 76.31 MB, 119.01 MB, 158.73 MB, 198.42 MB, 239.23 MB, 280.68 MB, 321.40 MB, 361.80 MB, 402.99 MB, 444.87 MB, 486.79 MB, 529.02 MB, 571.21 MB, 612.08 MB, 652.88 MB, 693.87 MB, 735.42 MB, 778.29 MB - BytesReceived: 796.50 MB (835187815) - ConvertRowBatchTime: 2s475ms - DeserializeRowBatchTimer: 3s362ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 16.77 M/sec - SendersBlockedTimer: 48s119ms - SendersBlockedTotalTimer(*): 8m49s Instance 114de16649df4a15:6dee5cbe29b6a994 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.02 MB, 44.08 MB, 296.74 MB, 616.76 MB, 936.79 MB, 1.19 GB, 1.51 GB, 1.79 GB, 2.13 GB, 2.41 GB, 2.70 GB, 3.01 GB, 3.31 GB, 3.63 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.50 GB, 6.31 GB, 7.13 GB, 7.94 GB, 8.77 GB, 9.46 GB, 10.28 GB, 11.02 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997499392) - PerHostPeakMemUsage: 11.31 GB (12144525144) - PrepareTime: 163.060ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 23s771ms - TotalNetworkSendTime: 405.847us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 427.003ms, non-child: 427.003ms, % non-child: 100.00%) - CodegenTime: 156.121us - CompileTime: 47.127ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 219.257ms - PrepareTime: 159.422ms DataStreamSender (dst_id=6):(Total: 38.191us, non-child: 38.191us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 44.30 KB/sec - OverallThroughput: 409.13 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.294us - ThriftTransmitTime(*): 352.691us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s600ms, % non-child: 2.82%) ExecOption: Codegen Enabled - BuildTime: 2s168ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.17 KB (51376) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s203ms, % non-child: 66.19%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s874ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 13s125ms - GetNewBlockTime: 7.175ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s726ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 6.71 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.308us EXCHANGE_NODE (id=5):(Total: 23s149ms, non-child: 7s034ms, % non-child: 30.39%) BytesReceived(2s000ms): 156.40 KB, 2.70 MB, 117.82 MB, 293.05 MB, 457.31 MB, 626.35 MB, 810.11 MB, 978.20 MB, 1.13 GB, 1.29 GB, 1.45 GB, 1.62 GB, 1.79 GB, 1.97 GB, 2.13 GB, 2.29 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672242524) - ConvertRowBatchTime: 3s578ms - DeserializeRowBatchTimer: 7s786ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 5.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s090ms, non-child: 3s039ms, % non-child: 42.86%) BytesReceived(2s000ms): 119.90 KB, 2.61 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.15 MB, 32.23 MB, 77.39 MB, 120.06 MB, 159.74 MB, 199.49 MB, 240.35 MB, 281.80 MB, 322.47 MB, 362.84 MB, 404.04 MB, 445.92 MB, 487.87 MB, 530.10 MB, 572.26 MB, 613.12 MB, 653.97 MB, 695.04 MB, 736.59 MB, 779.39 MB - BytesReceived: 796.67 MB (835374235) - ConvertRowBatchTime: 2s399ms - DeserializeRowBatchTimer: 2s774ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 16.93 M/sec - SendersBlockedTimer: 47s717ms - SendersBlockedTotalTimer(*): 11m7s Instance 114de16649df4a15:6dee5cbe29b6a995 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.92 MB, 4.89 MB, 296.79 MB, 584.76 MB, 872.78 MB, 1.16 GB, 1.48 GB, 1.79 GB, 2.07 GB, 2.38 GB, 2.66 GB, 2.95 GB, 3.29 GB, 3.60 GB, 3.89 GB, 4.16 GB, 4.48 GB, 4.71 GB, 5.47 GB, 6.29 GB, 7.14 GB, 7.99 GB, 8.90 GB, 9.81 GB, 10.45 GB, 11.02 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997499392) - PerHostPeakMemUsage: 11.31 GB (12144415136) - PrepareTime: 152.708ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 23s611ms - TotalNetworkSendTime: 303.578us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 411.354ms, non-child: 411.354ms, % non-child: 100.00%) - CodegenTime: 155.517us - CompileTime: 39.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 221.833ms - PrepareTime: 148.881ms DataStreamSender (dst_id=6):(Total: 45.978us, non-child: 45.978us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 61.54 KB/sec - OverallThroughput: 339.84 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.814us - ThriftTransmitTime(*): 253.915us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s669ms, % non-child: 2.90%) ExecOption: Codegen Enabled - BuildTime: 2s285ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.77 KB (51984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 58s098ms, % non-child: 65.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s459ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 12s726ms - GetNewBlockTime: 6.813ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s054ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 6.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.071us EXCHANGE_NODE (id=5):(Total: 21s554ms, non-child: 8s098ms, % non-child: 37.57%) BytesReceived(2s000ms): 181.54 KB, 8.36 MB, 143.70 MB, 317.81 MB, 480.78 MB, 652.32 MB, 835.38 MB, 1002.80 MB, 1.15 GB, 1.31 GB, 1.47 GB, 1.65 GB, 1.82 GB, 1.99 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672280066) - ConvertRowBatchTime: 4s268ms - DeserializeRowBatchTimer: 8s116ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 5.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 9s700ms, non-child: 3s708ms, % non-child: 38.23%) BytesReceived(2s000ms): 120.59 KB, 2.69 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.16 MB, 39.21 MB, 83.74 MB, 125.81 MB, 165.33 MB, 205.18 MB, 246.19 MB, 287.56 MB, 328.15 MB, 368.66 MB, 409.90 MB, 451.82 MB, 493.78 MB, 536.13 MB, 578.20 MB, 619.00 MB, 659.84 MB, 701.01 MB, 742.90 MB, 784.55 MB - BytesReceived: 796.79 MB (835498944) - ConvertRowBatchTime: 2s797ms - DeserializeRowBatchTimer: 3s698ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 12.37 M/sec - SendersBlockedTimer: 47s701ms - SendersBlockedTotalTimer(*): 10m20s Instance 114de16649df4a15:6dee5cbe29b6a996 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.89 MB, 2.53 MB, 296.78 MB, 584.80 MB, 872.80 MB, 1.16 GB, 1.48 GB, 1.79 GB, 2.07 GB, 2.38 GB, 2.66 GB, 2.95 GB, 3.29 GB, 3.59 GB, 3.88 GB, 4.16 GB, 4.47 GB, 4.71 GB, 5.48 GB, 6.32 GB, 7.16 GB, 8.01 GB, 8.97 GB, 9.81 GB, 10.65 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997523968) - PerHostPeakMemUsage: 11.31 GB (12144726496) - PrepareTime: 155.237ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 26s905ms - TotalNetworkSendTime: 353.028us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 410.066ms, non-child: 410.066ms, % non-child: 100.00%) - CodegenTime: 163.073us - CompileTime: 41.654ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 215.856ms - PrepareTime: 151.327ms DataStreamSender (dst_id=6):(Total: 41.863us, non-child: 41.863us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 49.82 KB/sec - OverallThroughput: 373.24 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.712us - ThriftTransmitTime(*): 313.598us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s828ms, % non-child: 3.07%) ExecOption: Codegen Enabled - BuildTime: 2s420ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.95 KB (52176) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 54s997ms, % non-child: 61.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s205ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 12s087ms - GetNewBlockTime: 6.975ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s358ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 6.73 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.330us EXCHANGE_NODE (id=5):(Total: 22s820ms, non-child: 7s560ms, % non-child: 33.13%) BytesReceived(2s000ms): 199.18 KB, 7.82 MB, 141.88 MB, 316.21 MB, 479.40 MB, 650.82 MB, 833.82 MB, 1001.28 MB, 1.15 GB, 1.31 GB, 1.47 GB, 1.64 GB, 1.82 GB, 1.99 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672606228) - ConvertRowBatchTime: 3s828ms - DeserializeRowBatchTimer: 8s066ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 5.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 11s373ms, non-child: 3s744ms, % non-child: 32.92%) BytesReceived(2s000ms): 114.14 KB, 2.61 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.12 MB, 10.18 MB, 38.78 MB, 83.32 MB, 125.45 MB, 165.02 MB, 204.91 MB, 245.94 MB, 287.28 MB, 327.90 MB, 368.42 MB, 409.72 MB, 451.66 MB, 493.65 MB, 535.98 MB, 578.00 MB, 618.79 MB, 659.66 MB, 700.79 MB, 742.62 MB, 784.32 MB - BytesReceived: 796.86 MB (835567010) - ConvertRowBatchTime: 2s911ms - DeserializeRowBatchTimer: 3s323ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 10.55 M/sec - SendersBlockedTimer: 46s561ms - SendersBlockedTotalTimer(*): 10m51s Instance 114de16649df4a15:6dee5cbe29b6a99a (host=vb0232.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.07 MB, 42.87 MB, 297.57 MB, 619.11 MB, 904.86 MB, 1.17 GB, 1.51 GB, 1.79 GB, 2.10 GB, 2.41 GB, 2.68 GB, 3.01 GB, 3.29 GB, 3.61 GB, 3.91 GB, 4.19 GB, 4.48 GB, 4.78 GB, 5.51 GB, 6.34 GB, 7.16 GB, 7.99 GB, 8.82 GB, 9.64 GB, 10.47 GB, 11.12 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997523968) - PerHostPeakMemUsage: 11.30 GB (12132996864) - PrepareTime: 155.004ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 23s399ms - TotalNetworkSendTime: 358.009us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 439.053ms, non-child: 439.053ms, % non-child: 100.00%) - CodegenTime: 180.204us - CompileTime: 65.042ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 222.089ms - PrepareTime: 149.147ms DataStreamSender (dst_id=6):(Total: 44.184us, non-child: 44.184us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 54.60 KB/sec - OverallThroughput: 353.63 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.192us - ThriftTransmitTime(*): 286.192us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s455ms, % non-child: 2.67%) ExecOption: Codegen Enabled - BuildTime: 2s078ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.30 KB (48432) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s417ms, % non-child: 66.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s525ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 12s602ms - GetNewBlockTime: 7.319ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s821ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 6.70 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.054us EXCHANGE_NODE (id=5):(Total: 22s392ms, non-child: 11s409ms, % non-child: 50.95%) BytesReceived(2s000ms): 121.50 KB, 2.68 MB, 112.79 MB, 288.21 MB, 452.39 MB, 620.76 MB, 804.25 MB, 972.69 MB, 1.12 GB, 1.28 GB, 1.44 GB, 1.61 GB, 1.79 GB, 1.96 GB, 2.12 GB, 2.28 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671327308) - ConvertRowBatchTime: 3s732ms - DeserializeRowBatchTimer: 12s176ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 5.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s739ms, non-child: 3s247ms, % non-child: 41.96%) BytesReceived(2s000ms): 132.51 KB, 2.20 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.16 MB, 30.88 MB, 76.17 MB, 118.86 MB, 158.60 MB, 198.24 MB, 239.02 MB, 280.51 MB, 321.21 MB, 361.55 MB, 402.66 MB, 444.55 MB, 486.54 MB, 528.76 MB, 570.95 MB, 611.78 MB, 652.54 MB, 693.54 MB, 735.09 MB, 777.99 MB - BytesReceived: 796.42 MB (835104102) - ConvertRowBatchTime: 2s433ms - DeserializeRowBatchTimer: 3s342ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 15.50 M/sec - SendersBlockedTimer: 47s137ms - SendersBlockedTotalTimer(*): 10m12s Instance 114de16649df4a15:6dee5cbe29b6a9a0 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.98 MB, 41.31 MB, 311.52 MB, 589.49 MB, 904.80 MB, 1.17 GB, 1.51 GB, 1.79 GB, 2.10 GB, 2.41 GB, 2.66 GB, 3.01 GB, 3.29 GB, 3.60 GB, 3.91 GB, 4.17 GB, 4.48 GB, 4.78 GB, 5.48 GB, 6.20 GB, 6.93 GB, 7.75 GB, 8.57 GB, 9.40 GB, 10.22 GB, 10.99 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.17 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.15 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12002258944) - PerHostPeakMemUsage: 11.31 GB (12148365064) - PrepareTime: 153.133ms - RowsProduced: 1 (1) - TotalCpuTime: 2m1s - TotalNetworkReceiveTime: 22s069ms - TotalNetworkSendTime: 366.720us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 425.913ms, non-child: 425.913ms, % non-child: 100.00%) - CodegenTime: 172.092us - CompileTime: 46.035ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 229.329ms - PrepareTime: 149.271ms DataStreamSender (dst_id=6):(Total: 47.918us, non-child: 47.918us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 46.87 KB/sec - OverallThroughput: 326.08 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.818us - ThriftTransmitTime(*): 333.358us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m32s, non-child: 2s427ms, % non-child: 2.64%) ExecOption: Codegen Enabled - BuildTime: 2s000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 42.59 KB (43616) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m1s, % non-child: 68.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s656ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 13s320ms - GetNewBlockTime: 5.996ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32s711ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 6.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.252us EXCHANGE_NODE (id=5):(Total: 23s351ms, non-child: 11s691ms, % non-child: 50.07%) BytesReceived(2s000ms): 142.90 KB, 2.52 MB, 109.40 MB, 284.85 MB, 449.19 MB, 617.00 MB, 800.62 MB, 968.98 MB, 1.12 GB, 1.28 GB, 1.44 GB, 1.61 GB, 1.78 GB, 1.96 GB, 2.12 GB, 2.28 GB, 2.43 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670516908) - ConvertRowBatchTime: 3s584ms - DeserializeRowBatchTimer: 12s517ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 5.14 M/sec - SendersBlockedTimer: 738.003ms - SendersBlockedTotalTimer(*): 5s614ms EXCHANGE_NODE (id=4):(Total: 5s114ms, non-child: 2s867ms, % non-child: 56.07%) BytesReceived(2s000ms): 107.82 KB, 1.64 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.16 MB, 30.00 MB, 75.24 MB, 117.96 MB, 157.64 MB, 197.30 MB, 238.12 MB, 279.57 MB, 320.19 MB, 360.57 MB, 401.69 MB, 443.54 MB, 485.48 MB, 527.72 MB, 569.99 MB, 610.85 MB, 651.61 MB, 692.61 MB, 734.15 MB, 777.06 MB - BytesReceived: 796.22 MB (834894437) - ConvertRowBatchTime: 2s301ms - DeserializeRowBatchTimer: 2s125ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 23.45 M/sec - SendersBlockedTimer: 1m10s - SendersBlockedTotalTimer(*): 16m15s Instance 114de16649df4a15:6dee5cbe29b6a99b (host=vb0206.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.58 MB, 44.15 MB, 328.80 MB, 648.76 MB, 936.85 MB, 1.20 GB, 1.54 GB, 1.82 GB, 2.16 GB, 2.41 GB, 2.73 GB, 3.04 GB, 3.33 GB, 3.66 GB, 3.92 GB, 4.23 GB, 4.48 GB, 4.87 GB, 5.60 GB, 6.42 GB, 7.32 GB, 8.16 GB, 9.00 GB, 9.84 GB, 10.68 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997523968) - PerHostPeakMemUsage: 11.31 GB (12144501488) - PrepareTime: 155.714ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 26s802ms - TotalNetworkSendTime: 353.964us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 445.855ms, non-child: 445.855ms, % non-child: 100.00%) - CodegenTime: 218.076us - CompileTime: 40.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 252.682ms - PrepareTime: 152.013ms DataStreamSender (dst_id=6):(Total: 42.571us, non-child: 42.571us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 49.58 KB/sec - OverallThroughput: 367.03 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.286us - ThriftTransmitTime(*): 315.158us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s865ms, % non-child: 3.11%) ExecOption: Codegen Enabled - BuildTime: 2s455ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.05 KB (48176) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 54s969ms, % non-child: 61.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s205ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 12s303ms - GetNewBlockTime: 5.372ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s055ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 6.73 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.632us EXCHANGE_NODE (id=5):(Total: 22s797ms, non-child: 7s256ms, % non-child: 31.83%) BytesReceived(2s000ms): 190.34 KB, 5.92 MB, 134.64 MB, 309.07 MB, 472.33 MB, 642.63 MB, 826.27 MB, 993.77 MB, 1.14 GB, 1.30 GB, 1.47 GB, 1.64 GB, 1.81 GB, 1.98 GB, 2.14 GB, 2.30 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672098876) - ConvertRowBatchTime: 3s823ms - DeserializeRowBatchTimer: 7s843ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 5.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 11s358ms, non-child: 3s866ms, % non-child: 34.04%) BytesReceived(2s000ms): 131.95 KB, 2.62 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.16 MB, 36.82 MB, 81.49 MB, 123.71 MB, 163.28 MB, 203.10 MB, 244.07 MB, 285.45 MB, 326.11 MB, 366.60 MB, 407.83 MB, 449.74 MB, 491.69 MB, 533.97 MB, 576.12 MB, 616.92 MB, 657.78 MB, 698.88 MB, 740.67 MB, 782.82 MB - BytesReceived: 796.65 MB (835343645) - ConvertRowBatchTime: 2s984ms - DeserializeRowBatchTimer: 3s547ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 10.57 M/sec - SendersBlockedTimer: 46s845ms - SendersBlockedTotalTimer(*): 11m42s Instance 114de16649df4a15:6dee5cbe29b6a9a2 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.09 MB, 44.14 MB, 296.84 MB, 616.86 MB, 936.83 MB, 1.20 GB, 1.52 GB, 1.79 GB, 2.13 GB, 2.41 GB, 2.70 GB, 3.01 GB, 3.32 GB, 3.63 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.85 GB, 5.52 GB, 6.31 GB, 7.11 GB, 7.79 GB, 8.59 GB, 9.39 GB, 10.08 GB, 10.98 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997548544) - PerHostPeakMemUsage: 11.31 GB (12144385696) - PrepareTime: 157.287ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 24s616ms - TotalNetworkSendTime: 311.905us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.758ms, non-child: 434.758ms, % non-child: 100.00%) - CodegenTime: 167.587us - CompileTime: 48.084ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 231.869ms - PrepareTime: 153.568ms DataStreamSender (dst_id=6):(Total: 40.117us, non-child: 40.117us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 57.40 KB/sec - OverallThroughput: 389.49 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.678us - ThriftTransmitTime(*): 272.226us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s898ms, % non-child: 3.15%) ExecOption: Codegen Enabled - BuildTime: 2s484ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.42 KB (46512) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 56s791ms, % non-child: 63.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s916ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 13s205ms - GetNewBlockTime: 7.322ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s021ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.326us EXCHANGE_NODE (id=5):(Total: 22s086ms, non-child: 7s789ms, % non-child: 35.27%) BytesReceived(2s000ms): 156.97 KB, 2.73 MB, 120.16 MB, 295.20 MB, 459.15 MB, 628.41 MB, 811.98 MB, 979.82 MB, 1.13 GB, 1.29 GB, 1.45 GB, 1.62 GB, 1.80 GB, 1.97 GB, 2.13 GB, 2.29 GB, 2.44 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672094553) - ConvertRowBatchTime: 4s097ms - DeserializeRowBatchTimer: 8s001ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 5.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s204ms, non-child: 3s877ms, % non-child: 37.99%) BytesReceived(2s000ms): 137.59 KB, 2.62 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.16 MB, 32.78 MB, 77.85 MB, 120.46 MB, 160.10 MB, 199.87 MB, 240.72 MB, 282.16 MB, 322.86 MB, 363.25 MB, 404.40 MB, 446.28 MB, 488.27 MB, 530.50 MB, 572.70 MB, 613.62 MB, 654.46 MB, 695.51 MB, 737.11 MB, 779.85 MB - BytesReceived: 796.64 MB (835341752) - ConvertRowBatchTime: 3s000ms - DeserializeRowBatchTimer: 3s395ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 11.76 M/sec - SendersBlockedTimer: 47s985ms - SendersBlockedTotalTimer(*): 11m13s Instance 114de16649df4a15:6dee5cbe29b6a997 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.96 MB, 5.46 MB, 296.76 MB, 584.84 MB, 872.77 MB, 1.16 GB, 1.49 GB, 1.79 GB, 2.07 GB, 2.38 GB, 2.66 GB, 2.96 GB, 3.29 GB, 3.60 GB, 3.90 GB, 4.16 GB, 4.48 GB, 4.71 GB, 5.46 GB, 6.13 GB, 6.93 GB, 7.74 GB, 8.49 GB, 9.10 GB, 9.66 GB, 10.33 GB, 10.88 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12002258944) - PerHostPeakMemUsage: 11.32 GB (12150474504) - PrepareTime: 146.873ms - RowsProduced: 1 (1) - TotalCpuTime: 2m4s - TotalNetworkReceiveTime: 21s281ms - TotalNetworkSendTime: 228.776us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 409.213ms, non-child: 409.213ms, % non-child: 100.00%) - CodegenTime: 184.338us - CompileTime: 43.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 221.281ms - PrepareTime: 143.086ms DataStreamSender (dst_id=6):(Total: 33.613us, non-child: 33.613us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 81.19 KB/sec - OverallThroughput: 464.85 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.739us - ThriftTransmitTime(*): 192.446us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s539ms, % non-child: 2.76%) ExecOption: Codegen Enabled - BuildTime: 2s108ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.12 KB (47232) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m1s, % non-child: 69.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s668ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 14s913ms - GetNewBlockTime: 7.261ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s841ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 6.71 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.136us EXCHANGE_NODE (id=5):(Total: 23s306ms, non-child: 7s118ms, % non-child: 30.54%) BytesReceived(2s000ms): 181.24 KB, 8.97 MB, 144.93 MB, 319.15 MB, 481.98 MB, 653.74 MB, 836.62 MB, 1004.47 MB, 1.15 GB, 1.31 GB, 1.48 GB, 1.65 GB, 1.82 GB, 1.99 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672108075) - ConvertRowBatchTime: 3s550ms - DeserializeRowBatchTimer: 7s828ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s320ms, non-child: 2s917ms, % non-child: 67.52%) BytesReceived(2s000ms): 132.41 KB, 2.83 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 39.56 MB, 84.09 MB, 126.11 MB, 165.60 MB, 205.47 MB, 246.52 MB, 287.95 MB, 328.58 MB, 369.08 MB, 410.37 MB, 452.31 MB, 494.25 MB, 536.54 MB, 578.57 MB, 619.37 MB, 660.21 MB, 701.27 MB, 743.16 MB, 784.68 MB - BytesReceived: 796.64 MB (835334431) - ConvertRowBatchTime: 2s304ms - DeserializeRowBatchTimer: 2s483ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 27.77 M/sec - SendersBlockedTimer: 54s588ms - SendersBlockedTotalTimer(*): 8m39s Instance 114de16649df4a15:6dee5cbe29b6a9a1 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 192.92 MB, 520.84 MB, 808.86 MB, 1.07 GB, 1.41 GB, 1.71 GB, 2.01 GB, 2.29 GB, 2.60 GB, 2.90 GB, 3.20 GB, 3.54 GB, 3.80 GB, 4.10 GB, 4.41 GB, 4.61 GB, 5.27 GB, 6.08 GB, 6.83 GB, 7.58 GB, 8.38 GB, 9.19 GB, 9.94 GB, 10.69 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 GB (11997573120) - PerHostPeakMemUsage: 11.31 GB (12141357520) - PrepareTime: 145.479ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 21s202ms - TotalNetworkSendTime: 369.615us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 403.763ms, non-child: 403.763ms, % non-child: 100.00%) - CodegenTime: 162.476us - CompileTime: 52.944ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 207.945ms - PrepareTime: 141.738ms DataStreamSender (dst_id=6):(Total: 36.231us, non-child: 36.231us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 49.59 KB/sec - OverallThroughput: 431.26 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.128us - ThriftTransmitTime(*): 315.081us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m28s, non-child: 2s758ms, % non-child: 3.11%) ExecOption: Codegen Enabled - BuildTime: 2s332ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.62 KB (52864) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m25s, non-child: 57s860ms, % non-child: 67.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s291ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 13s520ms - GetNewBlockTime: 6.563ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s566ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 6.98 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.735us EXCHANGE_NODE (id=5):(Total: 19s357ms, non-child: 7s822ms, % non-child: 40.41%) BytesReceived(2s000ms): 60.52 MB, 233.36 MB, 401.11 MB, 565.24 MB, 746.94 MB, 921.20 MB, 1.07 GB, 1.23 GB, 1.39 GB, 1.56 GB, 1.73 GB, 1.91 GB, 2.07 GB, 2.23 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672438073) - ConvertRowBatchTime: 3s761ms - DeserializeRowBatchTimer: 8s454ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 6.20 M/sec - SendersBlockedTimer: 129.533ms - SendersBlockedTotalTimer(*): 1s825ms EXCHANGE_NODE (id=4):(Total: 8s713ms, non-child: 3s171ms, % non-child: 36.40%) BytesReceived(2s000ms): 7.85 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.09 MB, 19.27 MB, 62.17 MB, 105.78 MB, 146.15 MB, 185.57 MB, 226.11 MB, 267.50 MB, 308.53 MB, 348.94 MB, 389.75 MB, 431.48 MB, 473.43 MB, 515.42 MB, 557.87 MB, 599.13 MB, 639.90 MB, 680.86 MB, 722.10 MB, 764.80 MB - BytesReceived: 796.70 MB (835397164) - ConvertRowBatchTime: 2s589ms - DeserializeRowBatchTimer: 2s651ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 13.78 M/sec - SendersBlockedTimer: 48s046ms - SendersBlockedTotalTimer(*): 7m13s Fragment F01: Instance 114de16649df4a15:6dee5cbe29b6a9a5 (host=vb0234.halxg.cloudera.com:22000):(Total: 34s120ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(1s000ms): 499.61 MB, 999.22 MB, 999.22 MB, 999.22 MB, 1002.27 MB, 1002.94 MB, 1002.91 MB, 991.11 MB, 872.65 MB, 828.86 MB, 828.68 MB, 824.93 MB, 740.72 MB, 653.04 MB, 652.80 MB, 648.77 MB, 564.80 MB, 528.72 MB, 421.12 MB, 389.14 MB, 301.14 MB, 301.12 MB, 249.23 MB, 641.30 MB, 642.05 MB, 614.35 MB, 531.22 MB, 531.08 MB, 475.10 MB, 419.23 MB, 403.39 MB, 363.21 MB, 263.21 MB, 195.37 MB, 114.88 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.61 MB (1052356544) - PerHostPeakMemUsage: 4.87 GB (5227109936) - PrepareTime: 151.465ms - RowsProduced: 124.58M (124581107) - TotalCpuTime: 5m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s410ms - TotalStorageWaitTime: 434.138ms CodeGen:(Total: 332.802ms, non-child: 332.802ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.479ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.790ms - PrepareTime: 149.328ms DataStreamSender (dst_id=5):(Total: 33s121ms, non-child: 33s121ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773622432) - NetworkThroughput(*): 41.14 MB/sec - OverallThroughput: 79.86 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 17s137ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 5.11 GB (5482787140) HDFS_SCAN_NODE (id=1):(Total: 1s018ms, non-child: 1s018ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 1.18 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 1.47 GB (1576539207) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576539207) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576539207) - DecompressionTime: 8s243ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008464) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 122.26 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.56K (15559) - ScannerThreadsTotalWallClockTime: 5m29s - MaterializeTupleTime(*): 5m20s - ScannerThreadsSysTime: 1s024ms - ScannerThreadsUserTime: 33s930ms - ScannerThreadsVoluntaryContextSwitches: 121.92K (121917) - TotalRawHdfsReadTime(*): 941.350ms - TotalReadThroughput: 43.58 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a6 (host=vb0204.halxg.cloudera.com:22000):(Total: 34s084ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(1s000ms): 499.63 MB, 999.25 MB, 999.25 MB, 999.31 MB, 1002.43 MB, 1002.78 MB, 1002.93 MB, 959.38 MB, 852.52 MB, 828.70 MB, 828.89 MB, 820.89 MB, 740.74 MB, 652.92 MB, 652.85 MB, 648.88 MB, 564.94 MB, 524.92 MB, 405.12 MB, 360.96 MB, 304.91 MB, 301.17 MB, 290.10 MB, 641.88 MB, 641.83 MB, 566.76 MB, 531.31 MB, 507.16 MB, 447.19 MB, 419.09 MB, 387.15 MB, 335.31 MB, 247.42 MB, 195.41 MB, 111.80 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.44 MB (1052184760) - PerHostPeakMemUsage: 4.93 GB (5290206656) - PrepareTime: 146.107ms - RowsProduced: 124.58M (124581263) - TotalCpuTime: 5m58s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s336ms - TotalStorageWaitTime: 386.344ms CodeGen:(Total: 329.667ms, non-child: 329.667ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 181.927ms - PrepareTime: 144.214ms DataStreamSender (dst_id=5):(Total: 33s069ms, non-child: 33s069ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773288634) - NetworkThroughput(*): 41.69 MB/sec - OverallThroughput: 79.98 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s230ms - ThriftTransmitTime(*): 1m3s - UncompressedRowBatchSize: 5.11 GB (5482794004) HDFS_SCAN_NODE (id=1):(Total: 1s030ms, non-child: 1s030ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.55% 1:0% 2:1.449% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.26 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 1.47 GB (1576547565) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576547565) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576547565) - DecompressionTime: 8s146ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812096) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 120.85 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.01K (17014) - ScannerThreadsTotalWallClockTime: 5m28s - MaterializeTupleTime(*): 5m19s - ScannerThreadsSysTime: 1s144ms - ScannerThreadsUserTime: 33s632ms - ScannerThreadsVoluntaryContextSwitches: 121.92K (121922) - TotalRawHdfsReadTime(*): 883.561ms - TotalReadThroughput: 43.58 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9af (host=vb0224.halxg.cloudera.com:22000):(Total: 33s986ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(1s000ms): 499.79 MB, 999.53 MB, 999.53 MB, 1000.61 MB, 1003.06 MB, 1002.75 MB, 1002.64 MB, 975.20 MB, 868.47 MB, 828.76 MB, 828.80 MB, 816.80 MB, 740.76 MB, 652.80 MB, 652.76 MB, 652.85 MB, 564.96 MB, 524.82 MB, 421.08 MB, 389.25 MB, 301.14 MB, 300.81 MB, 249.01 MB, 633.22 MB, 633.74 MB, 594.44 MB, 523.00 MB, 523.08 MB, 443.05 MB, 411.08 MB, 383.36 MB, 327.13 MB, 243.55 MB, 178.03 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052282728) - PerHostPeakMemUsage: 4.86 GB (5216274216) - PrepareTime: 151.538ms - RowsProduced: 123.88M (123876516) - TotalCpuTime: 5m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s532ms - TotalStorageWaitTime: 477.679ms CodeGen:(Total: 336.504ms, non-child: 336.504ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 183.591ms - PrepareTime: 149.373ms DataStreamSender (dst_id=5):(Total: 33s236ms, non-child: 33s236ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2758781154) - NetworkThroughput(*): 37.59 MB/sec - OverallThroughput: 79.16 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s480ms - ThriftTransmitTime(*): 1m9s - UncompressedRowBatchSize: 5.08 GB (5451778236) HDFS_SCAN_NODE (id=1):(Total: 801.546ms, non-child: 801.546ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.40 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.62 - BytesRead: 1.46 GB (1567627792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567627792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567627792) - DecompressionTime: 5s525ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811832) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 154.55 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.61K (11610) - ScannerThreadsTotalWallClockTime: 5m27s - MaterializeTupleTime(*): 5m21s - ScannerThreadsSysTime: 757.879ms - ScannerThreadsUserTime: 22s553ms - ScannerThreadsVoluntaryContextSwitches: 121.21K (121210) - TotalRawHdfsReadTime(*): 1s015ms - TotalReadThroughput: 43.33 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9ae (host=vb0208.halxg.cloudera.com:22000):(Total: 33s319ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(1s000ms): 499.63 MB, 999.22 MB, 999.22 MB, 1000.44 MB, 1002.72 MB, 1002.75 MB, 1002.90 MB, 959.28 MB, 828.77 MB, 828.89 MB, 828.77 MB, 785.11 MB, 696.61 MB, 652.64 MB, 652.62 MB, 608.93 MB, 564.95 MB, 444.81 MB, 388.88 MB, 340.96 MB, 300.94 MB, 289.15 MB, 427.35 MB, 642.00 MB, 622.15 MB, 531.31 MB, 531.09 MB, 475.15 MB, 419.35 MB, 411.06 MB, 363.18 MB, 259.22 MB, 195.34 MB, 99.79 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.59 MB (1052340080) - PerHostPeakMemUsage: 4.87 GB (5226674728) - PrepareTime: 156.488ms - RowsProduced: 124.58M (124581487) - TotalCpuTime: 5m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s534ms - TotalStorageWaitTime: 497.179ms CodeGen:(Total: 342.950ms, non-child: 342.950ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.773ms - PrepareTime: 154.573ms DataStreamSender (dst_id=5):(Total: 32s545ms, non-child: 32s545ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773584207) - NetworkThroughput(*): 38.50 MB/sec - OverallThroughput: 81.27 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s002ms - ThriftTransmitTime(*): 1m8s - UncompressedRowBatchSize: 5.11 GB (5482803856) HDFS_SCAN_NODE (id=1):(Total: 831.492ms, non-child: 831.492ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.40 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.18 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 1.47 GB (1576530636) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576530636) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576530636) - DecompressionTime: 5s792ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 149.83 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.32K (11318) - ScannerThreadsTotalWallClockTime: 5m21s - MaterializeTupleTime(*): 5m14s - ScannerThreadsSysTime: 683.889ms - ScannerThreadsUserTime: 23s360ms - ScannerThreadsVoluntaryContextSwitches: 121.91K (121905) - TotalRawHdfsReadTime(*): 1s047ms - TotalReadThroughput: 44.22 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b1 (host=vb0218.halxg.cloudera.com:22000):(Total: 33s245ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(1s000ms): 500.00 MB, 999.95 MB, 999.95 MB, 1000.71 MB, 1002.77 MB, 1002.71 MB, 1002.87 MB, 939.86 MB, 828.75 MB, 828.83 MB, 828.89 MB, 744.78 MB, 668.73 MB, 652.59 MB, 648.68 MB, 564.72 MB, 528.81 MB, 416.98 MB, 381.02 MB, 300.85 MB, 301.14 MB, 252.91 MB, 641.67 MB, 641.93 MB, 586.69 MB, 531.29 MB, 515.23 MB, 447.12 MB, 419.09 MB, 379.24 MB, 335.22 MB, 247.23 MB, 195.21 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299200) - PerHostPeakMemUsage: 4.87 GB (5226624528) - PrepareTime: 154.790ms - RowsProduced: 124.58M (124581252) - TotalCpuTime: 5m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s470ms - TotalStorageWaitTime: 450.551ms CodeGen:(Total: 339.002ms, non-child: 339.002ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.696ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.404ms - PrepareTime: 152.730ms DataStreamSender (dst_id=5):(Total: 32s307ms, non-child: 32s307ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773466893) - NetworkThroughput(*): 41.90 MB/sec - OverallThroughput: 81.87 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s791ms - ThriftTransmitTime(*): 1m3s - UncompressedRowBatchSize: 5.11 GB (5482793504) HDFS_SCAN_NODE (id=1):(Total: 975.182ms, non-child: 975.182ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.40 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 936.91 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.61 - BytesRead: 1.47 GB (1576543414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576543414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576543414) - DecompressionTime: 8s258ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 127.75 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.98K (15981) - ScannerThreadsTotalWallClockTime: 5m20s - MaterializeTupleTime(*): 5m10s - ScannerThreadsSysTime: 1s093ms - ScannerThreadsUserTime: 34s240ms - ScannerThreadsVoluntaryContextSwitches: 121.92K (121922) - TotalRawHdfsReadTime(*): 1s154ms - TotalReadThroughput: 44.88 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a7 (host=vb0226.halxg.cloudera.com:22000):(Total: 33s186ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(1s000ms): 485.20 MB, 970.34 MB, 970.34 MB, 971.28 MB, 973.33 MB, 973.23 MB, 973.41 MB, 929.94 MB, 799.19 MB, 799.31 MB, 799.26 MB, 755.60 MB, 667.29 MB, 623.54 MB, 623.39 MB, 567.42 MB, 535.30 MB, 454.10 MB, 436.78 MB, 388.93 MB, 392.67 MB, 416.52 MB, 495.19 MB, 622.05 MB, 602.29 MB, 518.95 MB, 507.32 MB, 467.18 MB, 399.21 MB, 383.26 MB, 327.15 MB, 246.13 MB, 176.78 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 974.12 MB (1021439944) - PerHostPeakMemUsage: 4.81 GB (5169029800) - PrepareTime: 156.952ms - RowsProduced: 122.02M (122016989) - TotalCpuTime: 5m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s380ms - TotalStorageWaitTime: 424.052ms CodeGen:(Total: 343.217ms, non-child: 343.217ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.531ms - PrepareTime: 153.269ms DataStreamSender (dst_id=5):(Total: 32s288ms, non-child: 32s288ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2716117948) - NetworkThroughput(*): 40.41 MB/sec - OverallThroughput: 80.22 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 16s792ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 5.00 GB (5369940860) HDFS_SCAN_NODE (id=1):(Total: 948.045ms, non-child: 948.045ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 444.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 888.01 MB, 929.77 MB, 971.53 MB, 971.53 MB, 1013.29 MB, 1.03 GB, 1.25 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.59 - BytesRead: 1.44 GB (1544225999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1544225999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1544225999) - DecompressionTime: 7s383ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 973.71 MB (1021009928) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 128.70 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.53K (14531) - ScannerThreadsTotalWallClockTime: 5m18s - MaterializeTupleTime(*): 5m9s - ScannerThreadsSysTime: 874.863ms - ScannerThreadsUserTime: 30s609ms - ScannerThreadsVoluntaryContextSwitches: 119.34K (119336) - TotalRawHdfsReadTime(*): 965.322ms - TotalReadThroughput: 43.96 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9aa (host=vb0206.halxg.cloudera.com:22000):(Total: 33s171ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(1s000ms): 981.52 MB, 999.52 MB, 999.52 MB, 1000.58 MB, 1002.91 MB, 1002.90 MB, 1002.76 MB, 884.09 MB, 828.75 MB, 828.90 MB, 828.80 MB, 744.86 MB, 661.00 MB, 652.78 MB, 644.99 MB, 564.88 MB, 512.82 MB, 396.83 MB, 357.08 MB, 301.08 MB, 297.12 MB, 467.62 MB, 641.99 MB, 641.91 MB, 562.90 MB, 531.12 MB, 507.31 MB, 447.21 MB, 419.14 MB, 371.22 MB, 331.11 MB, 227.28 MB, 195.23 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.56 MB (1052307392) - PerHostPeakMemUsage: 4.86 GB (5218126528) - PrepareTime: 148.518ms - RowsProduced: 124.58M (124580622) - TotalCpuTime: 5m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s452ms - TotalStorageWaitTime: 436.063ms CodeGen:(Total: 329.536ms, non-child: 329.536ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 179.560ms - PrepareTime: 146.472ms DataStreamSender (dst_id=5):(Total: 32s271ms, non-child: 32s271ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773712838) - NetworkThroughput(*): 42.59 MB/sec - OverallThroughput: 81.97 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 16s763ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 5.11 GB (5482765788) HDFS_SCAN_NODE (id=1):(Total: 937.396ms, non-child: 937.396ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 899.51 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.18 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.60 - BytesRead: 1.47 GB (1576533591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576533591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576533591) - DecompressionTime: 8s148ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 132.90 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.48K (15484) - ScannerThreadsTotalWallClockTime: 5m19s - MaterializeTupleTime(*): 5m9s - ScannerThreadsSysTime: 1s006ms - ScannerThreadsUserTime: 33s628ms - ScannerThreadsVoluntaryContextSwitches: 121.94K (121939) - TotalRawHdfsReadTime(*): 1s088ms - TotalReadThroughput: 44.88 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a4 (host=vb0214.halxg.cloudera.com:22000):(Total: 32s846ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(1s000ms): 499.65 MB, 999.30 MB, 999.30 MB, 999.30 MB, 1002.62 MB, 1002.79 MB, 1002.72 MB, 959.49 MB, 856.74 MB, 828.76 MB, 828.78 MB, 808.75 MB, 724.79 MB, 652.80 MB, 653.01 MB, 624.75 MB, 564.71 MB, 516.77 MB, 404.95 MB, 376.93 MB, 305.00 MB, 301.19 MB, 257.01 MB, 580.36 MB, 543.73 MB, 500.22 MB, 448.75 MB, 424.84 MB, 368.81 MB, 352.80 MB, 304.86 MB, 224.81 MB, 160.89 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258408) - PerHostPeakMemUsage: 4.80 GB (5154190440) - PrepareTime: 148.089ms - RowsProduced: 117.14M (117138819) - TotalCpuTime: 5m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s336ms - TotalStorageWaitTime: 417.074ms CodeGen:(Total: 330.157ms, non-child: 330.157ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.507ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.467ms - PrepareTime: 145.927ms DataStreamSender (dst_id=5):(Total: 31s868ms, non-child: 31s868ms, % non-child: 100.00%) - BytesSent: 2.43 GB (2607996487) - NetworkThroughput(*): 41.75 MB/sec - OverallThroughput: 78.05 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s535ms - ThriftTransmitTime(*): 59s566ms - UncompressedRowBatchSize: 4.80 GB (5155253676) HDFS_SCAN_NODE (id=1):(Total: 997.630ms, non-child: 997.630ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.14 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.45 - BytesRead: 1.38 GB (1482361679) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.38 GB (1482361679) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.38 GB (1482361679) - DecompressionTime: 7s813ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.02 MB (1051746472) - PerReadThreadRawHdfsThroughput: 1.57 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 117.42 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.89K (16885) - ScannerThreadsTotalWallClockTime: 5m10s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 1s162ms - ScannerThreadsUserTime: 33s280ms - ScannerThreadsVoluntaryContextSwitches: 114.82K (114822) - TotalRawHdfsReadTime(*): 877.661ms - TotalReadThroughput: 42.84 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9ad (host=vb0230.halxg.cloudera.com:22000):(Total: 32s566ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(1s000ms): 499.90 MB, 999.81 MB, 999.81 MB, 1000.15 MB, 1003.01 MB, 1002.83 MB, 1003.14 MB, 979.03 MB, 868.57 MB, 829.01 MB, 828.79 MB, 812.76 MB, 733.14 MB, 652.59 MB, 652.57 MB, 621.06 MB, 564.73 MB, 512.87 MB, 393.06 MB, 360.97 MB, 301.06 MB, 301.23 MB, 268.72 MB, 551.68 MB, 551.73 MB, 476.61 MB, 456.86 MB, 404.73 MB, 360.69 MB, 332.74 MB, 276.79 MB, 192.92 MB, 152.84 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.45 MB (1052192776) - PerHostPeakMemUsage: 4.72 GB (5065355464) - PrepareTime: 157.669ms - RowsProduced: 117.66M (117659841) - TotalCpuTime: 5m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s340ms - TotalStorageWaitTime: 466.243ms CodeGen:(Total: 345.178ms, non-child: 345.178ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 186.027ms - PrepareTime: 155.559ms DataStreamSender (dst_id=5):(Total: 31s608ms, non-child: 31s608ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2620485116) - NetworkThroughput(*): 42.26 MB/sec - OverallThroughput: 79.06 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s397ms - ThriftTransmitTime(*): 59s133ms - UncompressedRowBatchSize: 4.82 GB (5178183740) HDFS_SCAN_NODE (id=1):(Total: 996.398ms, non-child: 996.398ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.18 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488949167) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488949167) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488949167) - DecompressionTime: 5s715ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811920) - PerReadThreadRawHdfsThroughput: 1.61 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 118.09 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.67K (11670) - ScannerThreadsTotalWallClockTime: 5m8s - MaterializeTupleTime(*): 5m1s - ScannerThreadsSysTime: 846.868ms - ScannerThreadsUserTime: 24s120ms - ScannerThreadsVoluntaryContextSwitches: 115.28K (115278) - TotalRawHdfsReadTime(*): 860.701ms - TotalReadThroughput: 43.69 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a3 (host=vb0212.halxg.cloudera.com:22000):(Total: 32s493ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(1s000ms): 499.71 MB, 999.37 MB, 999.37 MB, 1000.50 MB, 1002.77 MB, 1002.84 MB, 1002.85 MB, 963.45 MB, 848.65 MB, 828.91 MB, 828.74 MB, 800.64 MB, 740.93 MB, 653.10 MB, 653.07 MB, 628.96 MB, 564.79 MB, 516.72 MB, 396.98 MB, 361.20 MB, 301.14 MB, 301.10 MB, 363.00 MB, 551.73 MB, 551.64 MB, 480.55 MB, 456.79 MB, 384.67 MB, 360.88 MB, 328.79 MB, 252.74 MB, 193.16 MB, 144.94 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.49 MB (1052233568) - PerHostPeakMemUsage: 4.72 GB (5064908552) - PrepareTime: 157.437ms - RowsProduced: 117.66M (117659734) - TotalCpuTime: 5m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s475ms - TotalStorageWaitTime: 350.182ms CodeGen:(Total: 340.035ms, non-child: 340.035ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.800ms - PrepareTime: 155.311ms DataStreamSender (dst_id=5):(Total: 31s533ms, non-child: 31s533ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619730279) - NetworkThroughput(*): 41.62 MB/sec - OverallThroughput: 79.23 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - SerializeBatchTime: 16s244ms - ThriftTransmitTime(*): 1m - UncompressedRowBatchSize: 4.82 GB (5178179036) HDFS_SCAN_NODE (id=1):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 459.40 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.06 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488945170) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488945170) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488945170) - DecompressionTime: 7s987ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812008) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 117.31 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.02K (16024) - ScannerThreadsTotalWallClockTime: 5m8s - MaterializeTupleTime(*): 4m59s - ScannerThreadsSysTime: 1s089ms - ScannerThreadsUserTime: 33s037ms - ScannerThreadsVoluntaryContextSwitches: 115.12K (115119) - TotalRawHdfsReadTime(*): 1s016ms - TotalReadThroughput: 43.03 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a8 (host=vb0216.halxg.cloudera.com:22000):(Total: 32s479ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(1s000ms): 499.71 MB, 999.41 MB, 999.41 MB, 999.41 MB, 1002.48 MB, 1003.02 MB, 1002.67 MB, 967.36 MB, 868.44 MB, 828.86 MB, 828.92 MB, 808.86 MB, 740.88 MB, 652.78 MB, 652.91 MB, 640.97 MB, 564.83 MB, 524.80 MB, 404.93 MB, 381.12 MB, 301.04 MB, 301.13 MB, 252.84 MB, 551.59 MB, 551.64 MB, 472.73 MB, 456.69 MB, 408.64 MB, 360.80 MB, 336.77 MB, 280.84 MB, 192.84 MB, 164.80 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.65 MB (1052405704) - PerHostPeakMemUsage: 4.72 GB (5065192048) - PrepareTime: 151.229ms - RowsProduced: 117.66M (117660154) - TotalCpuTime: 5m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s355ms - TotalStorageWaitTime: 408.556ms CodeGen:(Total: 333.285ms, non-child: 333.285ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 180.425ms - PrepareTime: 149.203ms DataStreamSender (dst_id=5):(Total: 31s506ms, non-child: 31s506ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2620247319) - NetworkThroughput(*): 41.67 MB/sec - OverallThroughput: 79.31 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s246ms - ThriftTransmitTime(*): 59s974ms - UncompressedRowBatchSize: 4.82 GB (5178197516) HDFS_SCAN_NODE (id=1):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(1s000ms): 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.14 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 1.39 GB (1488932448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488932448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488932448) - DecompressionTime: 8s128ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008464) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 117.28 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 16.65K (16654) - ScannerThreadsTotalWallClockTime: 5m7s - MaterializeTupleTime(*): 4m58s - ScannerThreadsSysTime: 1s137ms - ScannerThreadsUserTime: 33s424ms - ScannerThreadsVoluntaryContextSwitches: 115.17K (115169) - TotalRawHdfsReadTime(*): 888.141ms - TotalReadThroughput: 43.69 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9a9 (host=vb0232.halxg.cloudera.com:22000):(Total: 32s291ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(1s000ms): 457.79 MB, 915.53 MB, 915.53 MB, 916.25 MB, 1002.84 MB, 1002.70 MB, 1002.81 MB, 963.23 MB, 832.90 MB, 828.88 MB, 829.04 MB, 788.57 MB, 700.93 MB, 652.91 MB, 652.92 MB, 592.93 MB, 565.15 MB, 472.90 MB, 388.92 MB, 344.97 MB, 301.04 MB, 284.99 MB, 385.80 MB, 551.57 MB, 528.03 MB, 456.66 MB, 456.95 MB, 384.90 MB, 360.76 MB, 312.86 MB, 244.86 MB, 188.91 MB, 90.34 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 7, 7, 4 - AverageThreadTokens: 10.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.63 MB (1052380864) - PerHostPeakMemUsage: 4.71 GB (5052754288) - PrepareTime: 152.805ms - RowsProduced: 118.04M (118040847) - TotalCpuTime: 5m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s438ms - TotalStorageWaitTime: 430.071ms CodeGen:(Total: 339.675ms, non-child: 339.675ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 185.235ms - PrepareTime: 149.097ms DataStreamSender (dst_id=5):(Total: 31s582ms, non-child: 31s582ms, % non-child: 100.00%) - BytesSent: 2.45 GB (2629534262) - NetworkThroughput(*): 37.86 MB/sec - OverallThroughput: 79.40 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 16s440ms - ThriftTransmitTime(*): 1m6s - UncompressedRowBatchSize: 4.84 GB (5194951728) HDFS_SCAN_NODE (id=1):(Total: 765.798ms, non-child: 765.798ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(1s000ms): 418.99 MB, 837.98 MB, 837.98 MB, 837.98 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 921.50 MB, 1.15 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.39 GB (1494524606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1494524606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1494524606) - DecompressionTime: 5s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.27 MB (1052008376) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 154.14 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.90K (10901) - ScannerThreadsTotalWallClockTime: 5m4s - MaterializeTupleTime(*): 4m58s - ScannerThreadsSysTime: 688.890ms - ScannerThreadsUserTime: 21s128ms - ScannerThreadsVoluntaryContextSwitches: 115.51K (115506) - TotalRawHdfsReadTime(*): 990.316ms - TotalReadThroughput: 43.19 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9ac (host=vb0228.halxg.cloudera.com:22000):(Total: 31s697ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(1s000ms): 499.73 MB, 999.40 MB, 999.40 MB, 1000.48 MB, 1002.84 MB, 1002.86 MB, 1002.77 MB, 967.22 MB, 844.72 MB, 829.01 MB, 828.71 MB, 792.97 MB, 709.02 MB, 652.67 MB, 652.78 MB, 608.68 MB, 564.91 MB, 492.92 MB, 392.94 MB, 349.07 MB, 301.21 MB, 292.99 MB, 375.24 MB, 531.65 MB, 500.10 MB, 436.81 MB, 412.85 MB, 348.83 MB, 324.59 MB, 276.73 MB, 178.41 MB, 138.41 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.61 MB (1052356464) - PerHostPeakMemUsage: 4.60 GB (4938942520) - PrepareTime: 152.326ms - RowsProduced: 116.10M (116100605) - TotalCpuTime: 5m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s547ms - TotalStorageWaitTime: 438.907ms CodeGen:(Total: 335.748ms, non-child: 335.748ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.046ms - PrepareTime: 150.126ms DataStreamSender (dst_id=5):(Total: 30s800ms, non-child: 30s800ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2585589267) - NetworkThroughput(*): 40.78 MB/sec - OverallThroughput: 80.06 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 15s812ms - ThriftTransmitTime(*): 1m - UncompressedRowBatchSize: 4.76 GB (5109562104) HDFS_SCAN_NODE (id=1):(Total: 942.639ms, non-child: 942.639ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(1s000ms): 459.41 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 1.13 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.44 - BytesRead: 1.37 GB (1469733723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469733723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469733723) - DecompressionTime: 7s565ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942832) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 123.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.46K (14456) - ScannerThreadsTotalWallClockTime: 4m59s - MaterializeTupleTime(*): 4m51s - ScannerThreadsSysTime: 1s027ms - ScannerThreadsUserTime: 31s137ms - ScannerThreadsVoluntaryContextSwitches: 113.66K (113659) - TotalRawHdfsReadTime(*): 923.999ms - TotalReadThroughput: 43.80 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9ab (host=vb0220.halxg.cloudera.com:22000):(Total: 30s208ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(500.000ms): 999.22 MB, 999.22 MB, 999.22 MB, 999.22 MB, 999.22 MB, 999.22 MB, 999.22 MB, 1001.73 MB, 1002.70 MB, 1003.10 MB, 1002.93 MB, 1002.72 MB, 1002.57 MB, 1002.70 MB, 971.24 MB, 900.46 MB, 828.82 MB, 828.78 MB, 828.37 MB, 828.73 MB, 828.84 MB, 828.91 MB, 812.57 MB, 741.04 MB, 725.08 MB, 652.93 MB, 652.84 MB, 652.82 MB, 652.90 MB, 644.85 MB, 564.55 MB, 565.12 MB, 564.87 MB, 524.92 MB, 469.03 MB, 389.13 MB, 388.88 MB, 381.02 MB, 301.17 MB, 301.13 MB, 301.07 MB, 301.11 MB, 276.96 MB, 196.62 MB, 461.31 MB, 461.13 MB, 461.46 MB, 414.11 MB, 382.48 MB, 382.44 MB, 358.26 MB, 310.50 MB, 302.43 MB, 302.57 MB, 262.29 MB, 254.18 MB, 182.41 MB, 174.52 MB, 142.48 MB, 142.59 MB, 85.99 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.44 MB (1052184584) - PerHostPeakMemUsage: 4.40 GB (4729759560) - PrepareTime: 155.339ms - RowsProduced: 110.74M (110738805) - TotalCpuTime: 5m8s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s336ms - TotalStorageWaitTime: 390.487ms CodeGen:(Total: 338.779ms, non-child: 338.779ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.092ms - PrepareTime: 152.943ms DataStreamSender (dst_id=5):(Total: 29s488ms, non-child: 29s488ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2463957434) - NetworkThroughput(*): 37.71 MB/sec - OverallThroughput: 79.69 MB/sec - PeakMemoryUsage: 467.93 KB (479160) - SerializeBatchTime: 15s295ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 4.54 GB (4873590468) HDFS_SCAN_NODE (id=1):(Total: 776.528ms, non-child: 776.528ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.31 GB (1401399791) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401399791) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401399791) - DecompressionTime: 5s275ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811920) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 142.61 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.70K (10703) - ScannerThreadsTotalWallClockTime: 4m42s - MaterializeTupleTime(*): 4m36s - ScannerThreadsSysTime: 680.891ms - ScannerThreadsUserTime: 21s329ms - ScannerThreadsVoluntaryContextSwitches: 108.37K (108374) - TotalRawHdfsReadTime(*): 895.390ms - TotalReadThroughput: 43.82 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b0 (host=vb0222.halxg.cloudera.com:22000):(Total: 27s776ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(500.000ms): 55.93 KB, 984.61 MB, 985.53 MB, 985.45 MB, 985.34 MB, 985.37 MB, 985.15 MB, 985.32 MB, 898.71 MB, 890.66 MB, 811.07 MB, 811.16 MB, 811.44 MB, 811.48 MB, 811.60 MB, 811.51 MB, 747.63 MB, 723.49 MB, 659.22 MB, 635.55 MB, 635.37 MB, 635.64 MB, 635.26 MB, 635.35 MB, 547.53 MB, 547.22 MB, 547.24 MB, 467.35 MB, 427.31 MB, 357.05 MB, 444.82 MB, 412.83 MB, 364.53 MB, 365.35 MB, 364.93 MB, 364.88 MB, 340.75 MB, 277.06 MB, 535.65 MB, 535.50 MB, 535.77 MB, 520.18 MB, 448.93 MB, 440.83 MB, 440.86 MB, 416.74 MB, 384.71 MB, 344.86 MB, 336.74 MB, 320.72 MB, 288.95 MB, 280.77 MB, 224.84 MB, 182.45 MB, 142.59 MB, 142.43 MB, 46.34 KB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 1 - AverageThreadTokens: 9.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 986.04 MB (1033940928) - PerHostPeakMemUsage: 4.56 GB (4891371888) - PrepareTime: 158.100ms - RowsProduced: 116.19M (116191050) - TotalCpuTime: 4m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s166ms - TotalStorageWaitTime: 386.017ms CodeGen:(Total: 342.415ms, non-child: 342.415ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.339ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.935ms - PrepareTime: 155.990ms DataStreamSender (dst_id=5):(Total: 26s897ms, non-child: 26s897ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2588598101) - NetworkThroughput(*): 43.37 MB/sec - OverallThroughput: 91.78 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 15s594ms - ThriftTransmitTime(*): 56s926ms - UncompressedRowBatchSize: 4.76 GB (5113542568) HDFS_SCAN_NODE (id=1):(Total: 935.829ms, non-child: 935.829ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 901.16 MB, 984.70 MB, 984.70 MB, 984.70 MB, 984.70 MB, 984.70 MB, 984.70 MB, 984.70 MB, 984.70 MB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 1.37 GB (1470480664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1470480664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1470480664) - DecompressionTime: 7s692ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 985.71 MB (1033592840) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 124.16 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 14.32K (14325) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m9s - ScannerThreadsSysTime: 968.847ms - ScannerThreadsUserTime: 31s675ms - ScannerThreadsVoluntaryContextSwitches: 113.75K (113749) - TotalRawHdfsReadTime(*): 934.511ms - TotalReadThroughput: 50.08 MB/sec Fragment F00: Instance 114de16649df4a15:6dee5cbe29b6a9c0 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 165.895ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(2s000ms): 139.98 MB, 139.99 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.03 MB, 140.00 MB, 141.05 MB, 141.12 MB, 141.09 MB, 141.03 MB, 141.15 MB, 141.18 MB, 141.12 MB, 141.14 MB, 141.09 MB, 55.36 MB, 53.35 MB, 53.40 MB, 91.27 MB, 91.51 MB, 91.53 MB, 91.49 MB, 91.58 MB, 91.55 MB, 35.67 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317960) - PerHostPeakMemUsage: 11.31 GB (12144385696) - PrepareTime: 166.874us - RowsProduced: 124.58M (124581252) - TotalCpuTime: 16m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 200.450ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 830.41 MB (870749435) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 9.14 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s811ms - ThriftTransmitTime(*): 10m37s - UncompressedRowBatchSize: 2.32 GB (2492111716) HDFS_SCAN_NODE (id=0):(Total: 738.998ms, non-child: 738.998ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.86 MB (200126121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.86 MB (200126121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.86 MB (200126121) - DecompressionTime: 1s731ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 168.58 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.14K (6140) - ScannerThreadsTotalWallClockTime: 15m56s - MaterializeTupleTime(*): 15m54s - ScannerThreadsSysTime: 599.904ms - ScannerThreadsUserTime: 10s905ms - ScannerThreadsVoluntaryContextSwitches: 121.84K (121838) - TotalRawHdfsReadTime(*): 146.914ms - TotalReadThroughput: 2.07 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b5 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 125.698ms, % non-child: 0.14%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(2s000ms): 123.11 MB, 140.04 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.22 MB, 140.22 MB, 140.93 MB, 141.18 MB, 141.16 MB, 141.14 MB, 141.15 MB, 141.14 MB, 141.11 MB, 141.12 MB, 141.07 MB, 53.33 MB, 53.40 MB, 53.28 MB, 91.33 MB, 91.57 MB, 91.48 MB, 91.58 MB, 91.53 MB, 91.56 MB, 39.69 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12150474504) - PrepareTime: 631.436us - RowsProduced: 124.58M (124581263) - TotalCpuTime: 16m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 226.070ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 831.88 MB (872290824) - NetworkThroughput(*): 1.13 MB/sec - OverallThroughput: 9.15 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s047ms - ThriftTransmitTime(*): 12m13s - UncompressedRowBatchSize: 2.32 GB (2492111940) HDFS_SCAN_NODE (id=0):(Total: 645.913ms, non-child: 645.913ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:99.46% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0.5435% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 87.73 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.82 MB (200084917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200084917) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200084917) - DecompressionTime: 1s546ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 192.88 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.46K (6460) - ScannerThreadsTotalWallClockTime: 15m54s - MaterializeTupleTime(*): 15m52s - ScannerThreadsSysTime: 645.896ms - ScannerThreadsUserTime: 10s294ms - ScannerThreadsVoluntaryContextSwitches: 121.80K (121795) - TotalRawHdfsReadTime(*): 130.959ms - TotalReadThroughput: 2.07 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b9 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 144.156ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(2s000ms): 139.99 MB, 140.04 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.17 MB, 140.15 MB, 141.10 MB, 141.18 MB, 141.22 MB, 141.14 MB, 141.11 MB, 141.06 MB, 141.13 MB, 141.12 MB, 119.12 MB, 53.40 MB, 53.37 MB, 66.84 MB, 91.52 MB, 91.52 MB, 91.53 MB, 91.57 MB, 91.56 MB, 77.53 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.46 MB (148334352) - PerHostPeakMemUsage: 11.31 GB (12144501488) - PrepareTime: 212.678us - RowsProduced: 124.58M (124580622) - TotalCpuTime: 16m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m5s - TotalStorageWaitTime: 190.456ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 829.67 MB (869969180) - NetworkThroughput(*): 1.06 MB/sec - OverallThroughput: 9.14 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s230ms - ThriftTransmitTime(*): 13m2s - UncompressedRowBatchSize: 2.32 GB (2492099116) HDFS_SCAN_NODE (id=0):(Total: 709.440ms, non-child: 709.440ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 140.46 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.81 MB (200077615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.81 MB (200077615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.81 MB (200077615) - DecompressionTime: 1s572ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 175.60 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.29K (6291) - ScannerThreadsTotalWallClockTime: 15m53s - MaterializeTupleTime(*): 15m51s - ScannerThreadsSysTime: 584.905ms - ScannerThreadsUserTime: 10s020ms - ScannerThreadsVoluntaryContextSwitches: 121.79K (121789) - TotalRawHdfsReadTime(*): 132.943ms - TotalReadThroughput: 2.09 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9be (host=vb0224.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 127.861ms, % non-child: 0.14%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(2s000ms): 137.97 MB, 138.01 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.09 MB, 138.08 MB, 138.90 MB, 139.11 MB, 139.11 MB, 139.14 MB, 139.15 MB, 139.16 MB, 139.07 MB, 139.07 MB, 139.12 MB, 51.36 MB, 53.77 MB, 61.38 MB, 91.96 MB, 91.51 MB, 91.50 MB, 91.49 MB, 91.55 MB, 85.56 MB, 33.55 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.45 MB (146229000) - PerHostPeakMemUsage: 11.31 GB (12148365064) - PrepareTime: 291.263us - RowsProduced: 123.88M (123876516) - TotalCpuTime: 16m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 178.798ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 824.34 MB (864382138) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 9.07 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s770ms - ThriftTransmitTime(*): 11m24s - UncompressedRowBatchSize: 2.31 GB (2478014240) HDFS_SCAN_NODE (id=0):(Total: 597.596ms, non-child: 597.596ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 115.55 MB, 118.20 MB, 126.15 MB, 184.47 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 189.77 MB (198987845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.77 MB (198987845) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.77 MB (198987845) - DecompressionTime: 1s555ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.97 MB (145717000) - PerReadThreadRawHdfsThroughput: 1.61 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 207.29 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.16K (6155) - ScannerThreadsTotalWallClockTime: 15m54s - MaterializeTupleTime(*): 15m52s - ScannerThreadsSysTime: 556.909ms - ScannerThreadsUserTime: 9s919ms - ScannerThreadsVoluntaryContextSwitches: 121.06K (121057) - TotalRawHdfsReadTime(*): 115.233ms - TotalReadThroughput: 2.06 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b4 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 162.926ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(2s000ms): 140.12 MB, 140.12 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.38 MB, 140.36 MB, 140.98 MB, 141.13 MB, 141.09 MB, 141.12 MB, 141.10 MB, 141.09 MB, 140.99 MB, 141.20 MB, 139.21 MB, 53.29 MB, 53.34 MB, 61.19 MB, 91.43 MB, 91.51 MB, 91.45 MB, 91.51 MB, 91.55 MB, 91.54 MB, 35.64 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.31 GB (12144726496) - PrepareTime: 192.742us - RowsProduced: 124.58M (124581107) - TotalCpuTime: 16m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 194.273ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 830.30 MB (870634629) - NetworkThroughput(*): 1.40 MB/sec - OverallThroughput: 9.17 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 10s633ms - ThriftTransmitTime(*): 9m51s - UncompressedRowBatchSize: 2.32 GB (2492108820) HDFS_SCAN_NODE (id=0):(Total: 818.464ms, non-child: 818.464ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 124.63 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.84 MB (200108797) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108797) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108797) - DecompressionTime: 1s593ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 152.21 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.80K (6801) - ScannerThreadsTotalWallClockTime: 15m52s - MaterializeTupleTime(*): 15m50s - ScannerThreadsSysTime: 681.892ms - ScannerThreadsUserTime: 10s487ms - ScannerThreadsVoluntaryContextSwitches: 121.75K (121752) - TotalRawHdfsReadTime(*): 125.723ms - TotalReadThroughput: 2.07 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9bd (host=vb0208.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 152.132ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(2s000ms): 140.01 MB, 140.11 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 139.95 MB, 140.00 MB, 140.92 MB, 141.13 MB, 141.14 MB, 141.15 MB, 141.11 MB, 141.09 MB, 141.15 MB, 141.09 MB, 127.19 MB, 53.36 MB, 53.39 MB, 62.67 MB, 91.48 MB, 91.56 MB, 91.58 MB, 91.55 MB, 91.54 MB, 77.53 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.31 GB (12144350560) - PrepareTime: 284.730us - RowsProduced: 124.58M (124581487) - TotalCpuTime: 16m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 230.271ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 829.36 MB (869650955) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 9.15 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s645ms - ThriftTransmitTime(*): 10m39s - UncompressedRowBatchSize: 2.32 GB (2492116416) HDFS_SCAN_NODE (id=0):(Total: 739.904ms, non-child: 739.904ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 135.18 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 190.84 MB (200108048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108048) - DecompressionTime: 1s534ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 168.38 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.91K (5906) - ScannerThreadsTotalWallClockTime: 15m51s - MaterializeTupleTime(*): 15m49s - ScannerThreadsSysTime: 561.909ms - ScannerThreadsUserTime: 9s714ms - ScannerThreadsVoluntaryContextSwitches: 121.83K (121826) - TotalRawHdfsReadTime(*): 141.911ms - TotalReadThroughput: 2.09 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9bc (host=vb0230.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 128.287ms, % non-child: 0.14%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(2s000ms): 140.22 MB, 140.15 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.53 MB, 140.42 MB, 140.92 MB, 141.08 MB, 141.13 MB, 141.14 MB, 141.11 MB, 141.03 MB, 141.11 MB, 141.19 MB, 141.15 MB, 65.38 MB, 53.27 MB, 53.38 MB, 81.39 MB, 79.12 MB, 79.15 MB, 79.17 MB, 79.13 MB, 43.21 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.44 MB (148309776) - PerHostPeakMemUsage: 11.31 GB (12144879104) - PrepareTime: 270.635us - RowsProduced: 117.66M (117659841) - TotalCpuTime: 15m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 229.871ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 781.31 MB (819259003) - NetworkThroughput(*): 1.14 MB/sec - OverallThroughput: 8.69 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 8s003ms - ThriftTransmitTime(*): 11m25s - UncompressedRowBatchSize: 2.19 GB (2353656452) HDFS_SCAN_NODE (id=0):(Total: 722.235ms, non-child: 722.235ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 180.24 MB (188993466) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188993466) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188993466) - DecompressionTime: 1s513ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 162.91 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.70K (6698) - ScannerThreadsTotalWallClockTime: 15m36s - MaterializeTupleTime(*): 15m33s - ScannerThreadsSysTime: 703.887ms - ScannerThreadsUserTime: 10s500ms - ScannerThreadsVoluntaryContextSwitches: 115.08K (115075) - TotalRawHdfsReadTime(*): 136.642ms - TotalReadThroughput: 1.98 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b2 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 111.452ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(2s000ms): 140.06 MB, 140.10 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.22 MB, 141.06 MB, 141.09 MB, 141.11 MB, 141.08 MB, 141.04 MB, 141.16 MB, 141.10 MB, 141.11 MB, 101.18 MB, 53.32 MB, 53.33 MB, 66.90 MB, 79.12 MB, 79.11 MB, 79.14 MB, 79.16 MB, 79.11 MB, 31.29 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.47 MB (148342544) - PerHostPeakMemUsage: 11.31 GB (12144525144) - PrepareTime: 314.472us - RowsProduced: 117.66M (117659734) - TotalCpuTime: 15m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 196.889ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 779.42 MB (817282554) - NetworkThroughput(*): 1.32 MB/sec - OverallThroughput: 8.67 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 8s005ms - ThriftTransmitTime(*): 9m50s - UncompressedRowBatchSize: 2.19 GB (2353654312) HDFS_SCAN_NODE (id=0):(Total: 621.128ms, non-child: 621.128ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.5495% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 140.52 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 180.25 MB (189010408) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010408) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010408) - DecompressionTime: 1s391ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 189.43 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.65K (5652) - ScannerThreadsTotalWallClockTime: 15m32s - MaterializeTupleTime(*): 15m30s - ScannerThreadsSysTime: 517.917ms - ScannerThreadsUserTime: 9s035ms - ScannerThreadsVoluntaryContextSwitches: 115.21K (115214) - TotalRawHdfsReadTime(*): 127.529ms - TotalReadThroughput: 1.98 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b8 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 163.957ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(2s000ms): 128.67 MB, 128.67 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.64 MB, 128.58 MB, 128.64 MB, 138.01 MB, 141.12 MB, 141.07 MB, 141.13 MB, 141.13 MB, 141.17 MB, 141.11 MB, 141.12 MB, 141.05 MB, 55.29 MB, 53.30 MB, 55.42 MB, 79.09 MB, 79.13 MB, 79.13 MB, 79.16 MB, 79.17 MB, 31.24 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.41 MB (148277000) - PerHostPeakMemUsage: 11.30 GB (12132996864) - PrepareTime: 210.891us - RowsProduced: 118.04M (118040847) - TotalCpuTime: 16m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 211.190ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 783.24 MB (821290609) - NetworkThroughput(*): 1.07 MB/sec - OverallThroughput: 8.74 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s432ms - ThriftTransmitTime(*): 12m13s - UncompressedRowBatchSize: 2.20 GB (2361278064) HDFS_SCAN_NODE (id=0):(Total: 787.283ms, non-child: 787.283ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 106.54 MB, 114.49 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 117.14 MB, 122.57 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 181.27 MB (190074309) - BytesReadDataNodeCache: 0 - BytesReadLocal: 181.27 MB (190074309) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181.27 MB (190074309) - DecompressionTime: 1s416ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 149.93 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.40K (6401) - ScannerThreadsTotalWallClockTime: 15m34s - MaterializeTupleTime(*): 15m32s - ScannerThreadsSysTime: 628.900ms - ScannerThreadsUserTime: 9s327ms - ScannerThreadsVoluntaryContextSwitches: 115.42K (115424) - TotalRawHdfsReadTime(*): 118.052ms - TotalReadThroughput: 1.99 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9bb (host=vb0228.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 132.639ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(2s000ms): 128.45 MB, 131.35 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.04 MB, 140.05 MB, 141.06 MB, 141.12 MB, 141.09 MB, 141.15 MB, 141.08 MB, 141.09 MB, 141.06 MB, 141.19 MB, 125.15 MB, 53.28 MB, 53.38 MB, 60.42 MB, 75.09 MB, 75.11 MB, 75.12 MB, 75.13 MB, 75.10 MB, 26.79 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.44 MB (148309776) - PerHostPeakMemUsage: 11.31 GB (12144382160) - PrepareTime: 186.073us - RowsProduced: 116.10M (116100605) - TotalCpuTime: 15m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 206.750ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 770.33 MB (807749934) - NetworkThroughput(*): 1.12 MB/sec - OverallThroughput: 8.60 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 9s379ms - ThriftTransmitTime(*): 11m27s - UncompressedRowBatchSize: 2.16 GB (2322465648) HDFS_SCAN_NODE (id=0):(Total: 662.196ms, non-child: 662.196ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 106.47 MB, 109.12 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 117.07 MB, 134.99 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 178.15 MB (186808443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.15 MB (186808443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.15 MB (186808443) - DecompressionTime: 1s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 175.33 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.73K (5731) - ScannerThreadsTotalWallClockTime: 15m28s - MaterializeTupleTime(*): 15m26s - ScannerThreadsSysTime: 557.909ms - ScannerThreadsUserTime: 9s131ms - ScannerThreadsVoluntaryContextSwitches: 113.51K (113508) - TotalRawHdfsReadTime(*): 108.914ms - TotalReadThroughput: 1.97 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b6 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 106.287ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(2s000ms): 137.91 MB, 138.00 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.96 MB, 137.97 MB, 138.02 MB, 138.94 MB, 139.12 MB, 139.07 MB, 139.07 MB, 139.16 MB, 139.10 MB, 139.16 MB, 139.07 MB, 95.26 MB, 51.34 MB, 61.42 MB, 81.90 MB, 87.49 MB, 87.55 MB, 87.50 MB, 87.56 MB, 79.48 MB, 30.12 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 7, 6 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.43 MB (146204424) - PerHostPeakMemUsage: 11.31 GB (12142296856) - PrepareTime: 294.045us - RowsProduced: 122.02M (122016989) - TotalCpuTime: 15m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 192.691ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 805.16 MB (844274830) - NetworkThroughput(*): 1.10 MB/sec - OverallThroughput: 8.98 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 6s940ms - ThriftTransmitTime(*): 12m12s - UncompressedRowBatchSize: 2.27 GB (2440816436) HDFS_SCAN_NODE (id=0):(Total: 556.980ms, non-child: 556.980ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 126.08 MB, 171.76 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 186.98 MB (196063396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 186.98 MB (196063396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 186.98 MB (196063396) - DecompressionTime: 1s426ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.02 MB (145774352) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 219.07 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.81K (5806) - ScannerThreadsTotalWallClockTime: 15m35s - MaterializeTupleTime(*): 15m33s - ScannerThreadsSysTime: 524.914ms - ScannerThreadsUserTime: 9s233ms - ScannerThreadsVoluntaryContextSwitches: 119.35K (119346) - TotalRawHdfsReadTime(*): 120.759ms - TotalReadThroughput: 2.07 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b3 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 97.102ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(2s000ms): 140.01 MB, 139.99 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.10 MB, 140.85 MB, 141.09 MB, 141.07 MB, 141.13 MB, 141.07 MB, 141.10 MB, 141.05 MB, 141.13 MB, 119.23 MB, 53.28 MB, 53.31 MB, 60.03 MB, 77.12 MB, 77.16 MB, 77.12 MB, 77.13 MB, 65.13 MB, 28.66 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.41 MB (148277000) - PerHostPeakMemUsage: 11.31 GB (12144415136) - PrepareTime: 173.589us - RowsProduced: 117.14M (117138819) - TotalCpuTime: 15m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 204.536ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 777.34 MB (815104072) - NetworkThroughput(*): 1.13 MB/sec - OverallThroughput: 8.71 MB/sec - PeakMemoryUsage: 516.00 KB (528384) - SerializeBatchTime: 7s343ms - ThriftTransmitTime(*): 11m26s - UncompressedRowBatchSize: 2.18 GB (2343233996) HDFS_SCAN_NODE (id=0):(Total: 574.222ms, non-child: 574.222ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:99.44% 1:0.5556% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 132.34 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 179.43 MB (188149319) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188149319) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188149319) - DecompressionTime: 1s244ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 204.00 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.59K (4592) - ScannerThreadsTotalWallClockTime: 15m25s - MaterializeTupleTime(*): 15m24s - ScannerThreadsSysTime: 356.940ms - ScannerThreadsUserTime: 7s567ms - ScannerThreadsVoluntaryContextSwitches: 114.51K (114508) - TotalRawHdfsReadTime(*): 131.965ms - TotalReadThroughput: 1.99 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9b7 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 99.511ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(2s000ms): 139.95 MB, 140.06 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.39 MB, 140.31 MB, 141.11 MB, 141.04 MB, 141.16 MB, 141.12 MB, 141.14 MB, 141.18 MB, 141.07 MB, 141.21 MB, 81.28 MB, 53.36 MB, 53.31 MB, 72.46 MB, 79.13 MB, 79.12 MB, 79.09 MB, 79.10 MB, 41.29 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.49 MB (148367128) - PerHostPeakMemUsage: 11.31 GB (12144732320) - PrepareTime: 194.219us - RowsProduced: 117.66M (117660154) - TotalCpuTime: 15m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 199.794ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 778.69 MB (816510712) - NetworkThroughput(*): 1.06 MB/sec - OverallThroughput: 8.77 MB/sec - PeakMemoryUsage: 516.00 KB (528384) - SerializeBatchTime: 7s090ms - ThriftTransmitTime(*): 12m12s - UncompressedRowBatchSize: 2.19 GB (2353662724) HDFS_SCAN_NODE (id=0):(Total: 585.105ms, non-child: 585.105ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 164.34 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 180.24 MB (188999805) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188999805) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188999805) - DecompressionTime: 1s388ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.08 MB (147937048) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 201.09 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.57K (5569) - ScannerThreadsTotalWallClockTime: 15m21s - MaterializeTupleTime(*): 15m19s - ScannerThreadsSysTime: 455.926ms - ScannerThreadsUserTime: 8s744ms - ScannerThreadsVoluntaryContextSwitches: 115.02K (115016) - TotalRawHdfsReadTime(*): 113.862ms - TotalReadThroughput: 2.01 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9ba (host=vb0220.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 103.994ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(2s000ms): 139.88 MB, 139.96 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.21 MB, 140.14 MB, 141.14 MB, 141.17 MB, 141.12 MB, 141.11 MB, 141.06 MB, 141.03 MB, 141.17 MB, 141.09 MB, 73.24 MB, 53.38 MB, 55.34 MB, 72.33 MB, 66.67 MB, 66.67 MB, 66.77 MB, 38.80 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 6, 6, 6, 6 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317968) - PerHostPeakMemUsage: 11.31 GB (12144597208) - PrepareTime: 173.630us - RowsProduced: 110.74M (110738805) - TotalCpuTime: 15m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 183.036ms DataStreamSender (dst_id=4):(Total: 1m27s, non-child: 1m27s, % non-child: 100.00%) - BytesSent: 730.80 MB (766294854) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 8.40 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s139ms - ThriftTransmitTime(*): 10m34s - UncompressedRowBatchSize: 2.06 GB (2215208704) HDFS_SCAN_NODE (id=0):(Total: 565.959ms, non-child: 565.959ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:99.43% 1:0.5714% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 119.29 MB, 167.03 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 169.66 MB (177900986) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177900986) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177900986) - DecompressionTime: 1s077ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 195.67 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 4.21K (4214) - ScannerThreadsTotalWallClockTime: 14m58s - MaterializeTupleTime(*): 14m56s - ScannerThreadsSysTime: 368.939ms - ScannerThreadsUserTime: 6s859ms - ScannerThreadsVoluntaryContextSwitches: 108.26K (108262) - TotalRawHdfsReadTime(*): 120.430ms - TotalReadThroughput: 1.94 MB/sec Instance 114de16649df4a15:6dee5cbe29b6a9bf (host=vb0222.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 134.794ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(2s000ms): 136.98 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.12 MB, 137.14 MB, 137.39 MB, 137.65 MB, 137.56 MB, 137.69 MB, 137.66 MB, 137.51 MB, 137.68 MB, 137.58 MB, 131.62 MB, 58.31 MB, 61.34 MB, 65.52 MB, 79.16 MB, 79.12 MB, 79.10 MB, 75.12 MB, 69.18 MB, 26.84 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.93 MB (144631560) - PerHostPeakMemUsage: 11.31 GB (12141357520) - PrepareTime: 329.594us - RowsProduced: 116.19M (116191050) - TotalCpuTime: 15m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m - TotalStorageWaitTime: 169.241ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 766.89 MB (804141162) - NetworkThroughput(*): 1.13 MB/sec - OverallThroughput: 8.96 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 10s117ms - ThriftTransmitTime(*): 11m17s - UncompressedRowBatchSize: 2.16 GB (2324274896) HDFS_SCAN_NODE (id=0):(Total: 640.922ms, non-child: 640.922ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 114.43 MB, 122.38 MB, 125.03 MB, 138.29 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.22 - BytesRead: 178.05 MB (186696773) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.05 MB (186696773) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.05 MB (186696773) - DecompressionTime: 1s525ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.47 MB (144144136) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 181.29 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.01K (6009) - ScannerThreadsTotalWallClockTime: 14m44s - MaterializeTupleTime(*): 14m42s - ScannerThreadsSysTime: 533.913ms - ScannerThreadsUserTime: 9s877ms - ScannerThreadsVoluntaryContextSwitches: 113.57K (113569) - TotalRawHdfsReadTime(*): 109.744ms - TotalReadThroughput: 2.06 MB/sec ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 349.17ms | 0ns | 349.17ms | 1 | 1 | | 06:EXCHANGE | 1 | 249.90us | 0ns | 249.90us | 15 | 1 | | 03:AGGREGATE | 15 | 2.49s | 0ns | 2.74s | 15 | 1 | | 02:HASH JOIN | 15 | 58.55s | 0ns | 62.20s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 9.54s | 0ns | 11.89s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 869.11ms | 0ns | 1.01s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 3.27s | 0ns | 3.74s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 656.51ms | 0ns | 745.07ms | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=794eeaf500330be1:1d3f0940bab855bf): Summary: Session ID: 294c5465143d0822:6940e4a8f60fd387 Session Type: BEESWAX Start Time: 2016-04-21 21:26:44.058546000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:47396 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 13.050ms - Analysis finished: 3.173ms (3.173ms) - Equivalence classes computed: 3.481ms (308.646us) - Single node plan created: 8.178ms (4.697ms) - Runtime filters computed: 8.322ms (143.360us) - Distributed plan created: 10.391ms (2.069ms) - Lineage info computed: 11.016ms (624.811us) - Planning finished: 13.050ms (2.033ms) Query Timeline: 1m27s - Start execution: 166.978us (166.978us) - Planning finished: 16.790ms (16.623ms) - Ready to start 45 remote fragments: 369.799ms (353.009ms) - All 45 remote fragments started: 395.661ms (25.861ms) - Rows available: 1m27s (1m27s) - First row fetched: 1m27s (52.945ms) ImpalaServer: - ClientFetchWaitTimer: 53.351ms - RowMaterializationTimer: 99.035us Execution Profile 794eeaf500330be1:1d3f0940bab855bf:(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 22ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(11.32 GB) vb0222.halxg.cloudera.com:22000(11.32 GB) vb0224.halxg.cloudera.com:22000(11.32 GB) vb0208.halxg.cloudera.com:22000(11.32 GB) vb0230.halxg.cloudera.com:22000(11.32 GB) vb0228.halxg.cloudera.com:22000(11.32 GB) vb0220.halxg.cloudera.com:22000(11.32 GB) vb0206.halxg.cloudera.com:22000(11.32 GB) vb0232.halxg.cloudera.com:22000(11.31 GB) vb0216.halxg.cloudera.com:22000(11.32 GB) vb0226.halxg.cloudera.com:22000(11.32 GB) vb0234.halxg.cloudera.com:22000(11.32 GB) vb0214.halxg.cloudera.com:22000(11.32 GB) vb0212.halxg.cloudera.com:22000(11.32 GB) vb0204.halxg.cloudera.com:22000(11.32 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 348.695ms - RowsProduced: 1 (1) - TotalCpuTime: 631.824ms - TotalNetworkReceiveTime: 1m27s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 545.200ms, non-child: 545.200ms, % non-child: 100.00%) - CodegenTime: 1.781ms - CompileTime: 1.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 196.576ms - PrepareTime: 345.187ms AGGREGATION_NODE (id=7):(Total: 1m27s, non-child: 349.170ms, % non-child: 0.40%) ExecOption: Codegen Enabled - BuildTime: 16.386us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m27s, non-child: 249.898us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 32.796us - DeserializeRowBatchTimer: 151.794us - FirstBatchArrivalWaitTime: 1m26s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m27s max:1m27s mean: 1m27s stddev:39.620ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006872678) - PerHostPeakMemUsage: 11.32 GB (12153156617) - PrepareTime: 156.364ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 19s232ms - TotalNetworkSendTime: 280.053us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 452.465ms, non-child: 452.465ms, % non-child: 100.00%) - CodegenTime: 190.339us - CompileTime: 53.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 245.703ms - PrepareTime: 152.036ms DataStreamSender (dst_id=6):(Total: 39.379us, non-child: 39.379us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 69.07 KB/sec - OverallThroughput: 400.89 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.305us - ThriftTransmitTime(*): 234.233us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s491ms, % non-child: 2.87%) - BuildTime: 2s107ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.86 KB (50029) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 58s553ms, % non-child: 69.42%) - BuildPartitionTime: 10s667ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 13s546ms - GetNewBlockTime: 6.381ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s742ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 7.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.473us EXCHANGE_NODE (id=5):(Total: 19s388ms, non-child: 19s388ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671501161) - ConvertRowBatchTime: 3s552ms - DeserializeRowBatchTimer: 10s194ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 6.22 M/sec - SendersBlockedTimer: 438.918ms - SendersBlockedTotalTimer(*): 3s439ms EXCHANGE_NODE (id=4):(Total: 6s401ms, non-child: 6s401ms, % non-child: 100.00%) - BytesReceived: 779.15 MB (816995800) - ConvertRowBatchTime: 2s476ms - DeserializeRowBatchTimer: 3s174ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 20.12 M/sec - SendersBlockedTimer: 50s031ms - SendersBlockedTotalTimer(*): 10m23s Averaged Fragment F01:(Total: 28s358ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:26s465ms max:30s699ms mean: 28s799ms stddev:1s163ms execution rates: min:148.57 MB/sec max:157.19 MB/sec mean:152.61 MB/sec stddev:2.65 MB/sec num instances: 15 - AverageThreadTokens: 10.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 999.96 MB (1048534187) - PerHostPeakMemUsage: 4.76 GB (5106684462) - PrepareTime: 152.925ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 4m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 606.372ms - TotalStorageWaitTime: 465.207ms CodeGen:(Total: 354.670ms, non-child: 354.670ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.557ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 200.069ms - PrepareTime: 150.561ms DataStreamSender (dst_id=5):(Total: 27s537ms, non-child: 27s537ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671501161) - NetworkThroughput(*): 40.76 MB/sec - OverallThroughput: 92.55 MB/sec - PeakMemoryUsage: 438.60 KB (449122) - SerializeBatchTime: 16s297ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 4.92 GB (5281141614) HDFS_SCAN_NODE (id=1):(Total: 869.106ms, non-child: 869.106ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.35 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 6s464ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 999.59 MB (1048141860) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 139.93 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.81K (12814) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m18s - ScannerThreadsSysTime: 825.336ms - ScannerThreadsUserTime: 26s526ms - ScannerThreadsVoluntaryContextSwitches: 117.45K (117455) - TotalRawHdfsReadTime(*): 1s033ms - TotalReadThroughput: 50.55 MB/sec Averaged Fragment F00:(Total: 1m25s, non-child: 130.090ms, % non-child: 0.15%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:1m23s max:1m26s mean: 1m25s stddev:934.603ms execution rates: min:48.15 MB/sec max:53.07 MB/sec mean:51.33 MB/sec stddev:1.34 MB/sec num instances: 15 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.94 MB (147786051) - PerHostPeakMemUsage: 11.32 GB (12153156617) - PrepareTime: 273.593us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 15m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 206.696ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 779.15 MB (816995800) - NetworkThroughput(*): 1.28 MB/sec - OverallThroughput: 9.21 MB/sec - PeakMemoryUsage: 532.53 KB (545314) - SerializeBatchTime: 8s748ms - ThriftTransmitTime(*): 10m50s - UncompressedRowBatchSize: 2.24 GB (2400454232) HDFS_SCAN_NODE (id=0):(Total: 656.510ms, non-child: 656.510ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s407ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.51 MB (147337405) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 185.25 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.75K (5747) - ScannerThreadsTotalWallClockTime: 14m42s - MaterializeTupleTime(*): 14m40s - ScannerThreadsSysTime: 525.648ms - ScannerThreadsUserTime: 9s066ms - ScannerThreadsVoluntaryContextSwitches: 117.32K (117318) - TotalRawHdfsReadTime(*): 127.710ms - TotalReadThroughput: 2.15 MB/sec Fragment F02: Instance 794eeaf500330be1:1d3f0940bab855c5 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.46 MB, 497.71 MB, 817.74 MB, 1.13 GB, 1.43 GB, 1.76 GB, 2.05 GB, 2.36 GB, 2.67 GB, 3.02 GB, 3.31 GB, 3.64 GB, 3.95 GB, 4.27 GB, 4.50 GB, 4.72 GB, 5.48 GB, 6.21 GB, 6.93 GB, 7.60 GB, 8.38 GB, 9.11 GB, 9.83 GB, 10.49 GB, 11.11 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.16 GB, 11.17 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154355792) - PrepareTime: 159.719ms - RowsProduced: 1 (1) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 18s352ms - TotalNetworkSendTime: 386.304us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 447.491ms, non-child: 447.491ms, % non-child: 100.00%) - CodegenTime: 293.806us - CompileTime: 68.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 222.142ms - PrepareTime: 155.684ms DataStreamSender (dst_id=6):(Total: 46.336us, non-child: 46.336us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 48.66 KB/sec - OverallThroughput: 337.21 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.574us - ThriftTransmitTime(*): 321.127us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s622ms, % non-child: 3.02%) ExecOption: Codegen Enabled - BuildTime: 2s217ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.53 KB (48672) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 59s258ms, % non-child: 70.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s277ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 14s597ms - GetNewBlockTime: 6.304ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s677ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 7.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.544us EXCHANGE_NODE (id=5):(Total: 18s786ms, non-child: 7s027ms, % non-child: 37.41%) BytesReceived(2s000ms): 50.52 MB, 224.59 MB, 401.60 MB, 578.51 MB, 763.72 MB, 937.80 MB, 1.09 GB, 1.26 GB, 1.43 GB, 1.61 GB, 1.79 GB, 1.97 GB, 2.15 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672291512) - ConvertRowBatchTime: 3s558ms - DeserializeRowBatchTimer: 7s629ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 6.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s300ms, non-child: 3s506ms, % non-child: 55.65%) BytesReceived(2s000ms): 7.60 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 31.49 MB, 71.38 MB, 111.81 MB, 152.24 MB, 192.11 MB, 232.52 MB, 274.19 MB, 316.65 MB, 359.27 MB, 401.90 MB, 444.64 MB, 487.75 MB, 530.85 MB, 574.19 MB, 617.02 MB, 660.05 MB, 703.32 MB, 746.00 MB - BytesReceived: 779.38 MB (817237553) - ConvertRowBatchTime: 2s670ms - DeserializeRowBatchTimer: 3s220ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 19.05 M/sec - SendersBlockedTimer: 48s831ms - SendersBlockedTotalTimer(*): 9m48s Instance 794eeaf500330be1:1d3f0940bab855c7 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.39 MB, 497.69 MB, 817.69 MB, 1.12 GB, 1.42 GB, 1.75 GB, 2.05 GB, 2.36 GB, 2.67 GB, 3.01 GB, 3.30 GB, 3.64 GB, 3.95 GB, 4.27 GB, 4.49 GB, 4.72 GB, 5.46 GB, 6.14 GB, 6.93 GB, 7.60 GB, 8.40 GB, 9.20 GB, 9.88 GB, 10.68 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.31 GB (12142490424) - PrepareTime: 150.851ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 16s284ms - TotalNetworkSendTime: 279.572us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 445.387ms, non-child: 445.387ms, % non-child: 100.00%) - CodegenTime: 200.760us - CompileTime: 62.949ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 234.371ms - PrepareTime: 146.798ms DataStreamSender (dst_id=6):(Total: 38.090us, non-child: 38.090us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 66.21 KB/sec - OverallThroughput: 410.21 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.280us - ThriftTransmitTime(*): 235.994us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s412ms, % non-child: 2.78%) ExecOption: Codegen Enabled - BuildTime: 2s063ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.91 KB (50080) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 1m1s, % non-child: 72.24%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s236ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 14s140ms - GetNewBlockTime: 7.630ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s074ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.745us EXCHANGE_NODE (id=5):(Total: 17s814ms, non-child: 7s931ms, % non-child: 44.52%) BytesReceived(2s000ms): 49.57 MB, 223.37 MB, 400.50 MB, 577.10 MB, 762.12 MB, 936.15 MB, 1.09 GB, 1.26 GB, 1.43 GB, 1.61 GB, 1.79 GB, 1.96 GB, 2.15 GB, 2.31 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670916370) - ConvertRowBatchTime: 4s203ms - DeserializeRowBatchTimer: 7s886ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 6.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s638ms, non-child: 3s192ms, % non-child: 56.62%) BytesReceived(2s000ms): 7.59 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.13 MB, 31.18 MB, 71.10 MB, 111.55 MB, 151.92 MB, 191.71 MB, 232.08 MB, 273.64 MB, 315.97 MB, 358.52 MB, 401.11 MB, 443.82 MB, 486.97 MB, 530.09 MB, 573.43 MB, 616.27 MB, 659.25 MB, 702.60 MB, 745.27 MB - BytesReceived: 779.02 MB (816858148) - ConvertRowBatchTime: 2s390ms - DeserializeRowBatchTimer: 3s287ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 21.28 M/sec - SendersBlockedTimer: 48s141ms - SendersBlockedTotalTimer(*): 11m14s Instance 794eeaf500330be1:1d3f0940bab855ce (host=vb0222.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.27 MB, 465.69 MB, 817.68 MB, 1.08 GB, 1.42 GB, 1.73 GB, 2.05 GB, 2.33 GB, 2.65 GB, 2.95 GB, 3.30 GB, 3.60 GB, 3.93 GB, 4.24 GB, 4.49 GB, 4.71 GB, 5.38 GB, 6.13 GB, 6.93 GB, 7.68 GB, 8.41 GB, 9.21 GB, 10.02 GB, 10.70 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12150688864) - PrepareTime: 154.999ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 15s366ms - TotalNetworkSendTime: 239.840us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 456.651ms, non-child: 456.651ms, % non-child: 100.00%) - CodegenTime: 180.107us - CompileTime: 52.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 251.916ms - PrepareTime: 148.863ms DataStreamSender (dst_id=6):(Total: 36.776us, non-child: 36.776us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 79.15 KB/sec - OverallThroughput: 424.87 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.043us - ThriftTransmitTime(*): 197.397us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s313ms, % non-child: 2.66%) ExecOption: Codegen Enabled - BuildTime: 1s972ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.70 KB (50896) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 1m2s, % non-child: 73.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s144ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 13s956ms - GetNewBlockTime: 6.833ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s684ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.967us EXCHANGE_NODE (id=5):(Total: 17s904ms, non-child: 8s021ms, % non-child: 44.80%) BytesReceived(2s000ms): 77.21 MB, 256.28 MB, 433.19 MB, 611.65 MB, 796.24 MB, 969.94 MB, 1.12 GB, 1.29 GB, 1.46 GB, 1.64 GB, 1.82 GB, 2.00 GB, 2.18 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672050158) - ConvertRowBatchTime: 4s190ms - DeserializeRowBatchTimer: 8s122ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 6.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s466ms, non-child: 3s111ms, % non-child: 69.65%) BytesReceived(2s000ms): 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.08 MB, 10.95 MB, 38.63 MB, 78.55 MB, 119.16 MB, 159.28 MB, 199.17 MB, 239.77 MB, 281.62 MB, 324.17 MB, 366.78 MB, 409.34 MB, 452.09 MB, 495.17 MB, 538.31 MB, 581.63 MB, 624.44 MB, 667.59 MB, 710.80 MB, 753.44 MB - BytesReceived: 779.33 MB (817182497) - ConvertRowBatchTime: 2s247ms - DeserializeRowBatchTimer: 3s538ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 26.87 M/sec - SendersBlockedTimer: 47s828ms - SendersBlockedTotalTimer(*): 9m35s Instance 794eeaf500330be1:1d3f0940bab855c6 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 211.72 MB, 542.09 MB, 863.01 MB, 1.18 GB, 1.48 GB, 1.80 GB, 2.10 GB, 2.42 GB, 2.70 GB, 3.05 GB, 3.36 GB, 3.67 GB, 4.02 GB, 4.30 GB, 4.52 GB, 4.87 GB, 5.51 GB, 6.31 GB, 7.12 GB, 7.80 GB, 8.60 GB, 9.41 GB, 10.16 GB, 10.90 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12154146896) - PrepareTime: 155.476ms - RowsProduced: 1 (1) - TotalCpuTime: 1m56s - TotalNetworkReceiveTime: 18s542ms - TotalNetworkSendTime: 302.031us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 464.913ms, non-child: 464.913ms, % non-child: 100.00%) - CodegenTime: 183.408us - CompileTime: 48.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 263.542ms - PrepareTime: 151.485ms DataStreamSender (dst_id=6):(Total: 42.977us, non-child: 42.977us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 59.54 KB/sec - OverallThroughput: 363.57 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.466us - ThriftTransmitTime(*): 262.449us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s392ms, % non-child: 2.75%) ExecOption: Codegen Enabled - BuildTime: 2s025ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.92 KB (53168) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 59s477ms, % non-child: 70.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s555ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 13s829ms - GetNewBlockTime: 7.061ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s576ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.665us EXCHANGE_NODE (id=5):(Total: 19s450ms, non-child: 9s812ms, % non-child: 50.45%) BytesReceived(2s000ms): 70.52 MB, 249.43 MB, 426.31 MB, 604.82 MB, 788.96 MB, 962.63 MB, 1.11 GB, 1.29 GB, 1.46 GB, 1.64 GB, 1.81 GB, 1.99 GB, 2.17 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671585807) - ConvertRowBatchTime: 3s590ms - DeserializeRowBatchTimer: 10s362ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 6.17 M/sec - SendersBlockedTimer: 682.252ms - SendersBlockedTotalTimer(*): 5s432ms EXCHANGE_NODE (id=4):(Total: 5s564ms, non-child: 3s090ms, % non-child: 55.54%) BytesReceived(2s000ms): 10.07 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.57 MB, 37.15 MB, 77.04 MB, 117.64 MB, 157.87 MB, 197.76 MB, 238.24 MB, 280.06 MB, 322.49 MB, 365.11 MB, 407.68 MB, 450.48 MB, 493.62 MB, 536.70 MB, 580.00 MB, 622.75 MB, 665.80 MB, 709.05 MB, 751.72 MB - BytesReceived: 779.14 MB (816988797) - ConvertRowBatchTime: 2s342ms - DeserializeRowBatchTimer: 3s120ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 21.57 M/sec - SendersBlockedTimer: 47s741ms - SendersBlockedTotalTimer(*): 10m22s Instance 794eeaf500330be1:1d3f0940bab855ca (host=vb0228.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 166.15 MB, 521.72 MB, 817.72 MB, 1.14 GB, 1.44 GB, 1.77 GB, 2.05 GB, 2.36 GB, 2.67 GB, 3.02 GB, 3.32 GB, 3.64 GB, 3.95 GB, 4.27 GB, 4.50 GB, 4.79 GB, 5.50 GB, 6.34 GB, 7.18 GB, 8.01 GB, 8.85 GB, 9.81 GB, 10.64 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154875544) - PrepareTime: 155.442ms - RowsProduced: 1 (1) - TotalCpuTime: 1m50s - TotalNetworkReceiveTime: 22s547ms - TotalNetworkSendTime: 300.737us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 438.035ms, non-child: 438.035ms, % non-child: 100.00%) - CodegenTime: 204.410us - CompileTime: 63.917ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 221.161ms - PrepareTime: 151.640ms DataStreamSender (dst_id=6):(Total: 36.237us, non-child: 36.237us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 60.32 KB/sec - OverallThroughput: 431.19 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.893us - ThriftTransmitTime(*): 259.031us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s400ms, % non-child: 2.76%) ExecOption: Codegen Enabled - BuildTime: 2s024ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.88 KB (51072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 56s281ms, % non-child: 66.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 8s861ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 12s303ms - GetNewBlockTime: 5.314ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s706ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.165us EXCHANGE_NODE (id=5):(Total: 21s238ms, non-child: 6s006ms, % non-child: 28.28%) BytesReceived(2s000ms): 52.40 MB, 227.16 MB, 404.06 MB, 581.13 MB, 766.29 MB, 940.15 MB, 1.09 GB, 1.26 GB, 1.43 GB, 1.61 GB, 1.79 GB, 1.97 GB, 2.15 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670891456) - ConvertRowBatchTime: 2s876ms - DeserializeRowBatchTimer: 7s386ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 5.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 6s956ms, non-child: 3s116ms, % non-child: 44.80%) BytesReceived(2s000ms): 7.79 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.13 MB, 32.02 MB, 71.91 MB, 112.36 MB, 152.76 MB, 192.63 MB, 233.03 MB, 274.65 MB, 317.08 MB, 359.68 MB, 402.26 MB, 444.94 MB, 488.09 MB, 531.19 MB, 574.49 MB, 617.24 MB, 660.24 MB, 703.55 MB, 746.17 MB - BytesReceived: 778.98 MB (816814538) - ConvertRowBatchTime: 2s330ms - DeserializeRowBatchTimer: 3s251ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 17.25 M/sec - SendersBlockedTimer: 46s200ms - SendersBlockedTotalTimer(*): 11m32s Instance 794eeaf500330be1:1d3f0940bab855c2 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.29 MB, 465.69 MB, 817.70 MB, 1.08 GB, 1.43 GB, 1.71 GB, 2.05 GB, 2.34 GB, 2.65 GB, 2.95 GB, 3.30 GB, 3.59 GB, 3.92 GB, 4.24 GB, 4.49 GB, 4.71 GB, 5.39 GB, 6.14 GB, 6.96 GB, 7.77 GB, 8.59 GB, 9.41 GB, 10.23 GB, 10.99 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12152623624) - PrepareTime: 153.401ms - RowsProduced: 1 (1) - TotalCpuTime: 1m54s - TotalNetworkReceiveTime: 19s786ms - TotalNetworkSendTime: 249.742us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 431.497ms, non-child: 431.497ms, % non-child: 100.00%) - CodegenTime: 183.276us - CompileTime: 57.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 222.954ms - PrepareTime: 149.666ms DataStreamSender (dst_id=6):(Total: 37.282us, non-child: 37.282us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 76.43 KB/sec - OverallThroughput: 419.10 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.891us - ThriftTransmitTime(*): 204.422us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s344ms, % non-child: 2.70%) ExecOption: Codegen Enabled - BuildTime: 1s984ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.55 KB (48688) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 58s654ms, % non-child: 69.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 9s675ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 13s259ms - GetNewBlockTime: 6.011ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s344ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.116us EXCHANGE_NODE (id=5):(Total: 20s399ms, non-child: 10s745ms, % non-child: 52.68%) BytesReceived(2s000ms): 75.21 MB, 254.29 MB, 431.17 MB, 609.68 MB, 793.99 MB, 967.59 MB, 1.12 GB, 1.29 GB, 1.46 GB, 1.64 GB, 1.82 GB, 2.00 GB, 2.18 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671915237) - ConvertRowBatchTime: 3s254ms - DeserializeRowBatchTimer: 11s445ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 5.88 M/sec - SendersBlockedTimer: 2s461ms - SendersBlockedTotalTimer(*): 19s166ms EXCHANGE_NODE (id=4):(Total: 5s453ms, non-child: 3s107ms, % non-child: 56.97%) BytesReceived(2s000ms): 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.82 MB, 38.18 MB, 78.07 MB, 118.70 MB, 158.87 MB, 198.76 MB, 239.29 MB, 281.16 MB, 323.56 MB, 366.17 MB, 408.74 MB, 451.57 MB, 494.70 MB, 537.88 MB, 581.18 MB, 623.95 MB, 667.09 MB, 710.34 MB, 752.91 MB - BytesReceived: 779.27 MB (817125381) - ConvertRowBatchTime: 2s288ms - DeserializeRowBatchTimer: 3s400ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 22.01 M/sec - SendersBlockedTimer: 47s118ms - SendersBlockedTotalTimer(*): 8m38s Instance 794eeaf500330be1:1d3f0940bab855cd (host=vb0224.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.28 MB, 497.70 MB, 818.05 MB, 1.09 GB, 1.43 GB, 1.74 GB, 2.05 GB, 2.36 GB, 2.67 GB, 2.98 GB, 3.32 GB, 3.64 GB, 3.95 GB, 4.25 GB, 4.49 GB, 4.71 GB, 5.47 GB, 6.22 GB, 6.95 GB, 7.76 GB, 8.57 GB, 9.26 GB, 10.07 GB, 10.88 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12151761792) - PrepareTime: 158.091ms - RowsProduced: 1 (1) - TotalCpuTime: 1m53s - TotalNetworkReceiveTime: 20s935ms - TotalNetworkSendTime: 299.079us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 450.773ms, non-child: 450.773ms, % non-child: 100.00%) - CodegenTime: 195.253us - CompileTime: 48.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 246.806ms - PrepareTime: 153.539ms DataStreamSender (dst_id=6):(Total: 37.888us, non-child: 37.888us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 61.95 KB/sec - OverallThroughput: 412.40 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.256us - ThriftTransmitTime(*): 252.202us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s428ms, % non-child: 2.80%) ExecOption: Codegen Enabled - BuildTime: 2s038ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.61 KB (51824) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 57s664ms, % non-child: 68.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 8s978ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 13s572ms - GetNewBlockTime: 4.989ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s684ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 7.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.169us EXCHANGE_NODE (id=5):(Total: 21s122ms, non-child: 11s512ms, % non-child: 54.50%) BytesReceived(2s000ms): 85.54 MB, 264.11 MB, 440.40 MB, 619.03 MB, 803.27 MB, 976.84 MB, 1.12 GB, 1.30 GB, 1.47 GB, 1.65 GB, 1.83 GB, 2.00 GB, 2.19 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670107348) - ConvertRowBatchTime: 2s973ms - DeserializeRowBatchTimer: 12s762ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 5.68 M/sec - SendersBlockedTimer: 657.060ms - SendersBlockedTotalTimer(*): 5s455ms EXCHANGE_NODE (id=4):(Total: 5s633ms, non-child: 3s132ms, % non-child: 55.60%) BytesReceived(2s000ms): 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 11.41 MB, 40.52 MB, 80.34 MB, 120.97 MB, 161.04 MB, 200.98 MB, 241.60 MB, 283.41 MB, 325.84 MB, 368.48 MB, 411.02 MB, 453.87 MB, 496.94 MB, 540.10 MB, 583.31 MB, 626.10 MB, 669.16 MB, 712.29 MB, 754.72 MB - BytesReceived: 778.71 MB (816534010) - ConvertRowBatchTime: 2s356ms - DeserializeRowBatchTimer: 3s182ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 21.29 M/sec - SendersBlockedTimer: 47s535ms - SendersBlockedTotalTimer(*): 11m6s Instance 794eeaf500330be1:1d3f0940bab855c4 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 135.70 MB, 465.72 MB, 804.66 MB, 1.08 GB, 1.42 GB, 1.72 GB, 2.04 GB, 2.33 GB, 2.65 GB, 2.95 GB, 3.30 GB, 3.59 GB, 3.92 GB, 4.24 GB, 4.49 GB, 4.71 GB, 5.46 GB, 6.29 GB, 7.12 GB, 7.87 GB, 8.50 GB, 9.11 GB, 9.73 GB, 10.35 GB, 10.91 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154624624) - PrepareTime: 163.471ms - RowsProduced: 1 (1) - TotalCpuTime: 2m - TotalNetworkReceiveTime: 16s184ms - TotalNetworkSendTime: 184.067us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 506.998ms, non-child: 506.998ms, % non-child: 100.00%) - CodegenTime: 169.816us - CompileTime: 41.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 305.477ms - PrepareTime: 158.510ms DataStreamSender (dst_id=6):(Total: 44.142us, non-child: 44.142us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 103.72 KB/sec - OverallThroughput: 353.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.882us - ThriftTransmitTime(*): 150.641us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s486ms, % non-child: 2.86%) ExecOption: Codegen Enabled - BuildTime: 2s026ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.12 KB (47232) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 1m1s, % non-child: 73.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s487ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 14s560ms - GetNewBlockTime: 6.617ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s426ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 7.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.528us EXCHANGE_NODE (id=5):(Total: 19s499ms, non-child: 11s836ms, % non-child: 60.70%) BytesReceived(2s000ms): 76.59 MB, 255.65 MB, 432.30 MB, 610.82 MB, 795.20 MB, 968.92 MB, 1.12 GB, 1.29 GB, 1.46 GB, 1.64 GB, 1.82 GB, 2.00 GB, 2.18 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671667562) - ConvertRowBatchTime: 3s436ms - DeserializeRowBatchTimer: 12s326ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 6.15 M/sec - SendersBlockedTimer: 2s000ms - SendersBlockedTotalTimer(*): 15s558ms EXCHANGE_NODE (id=4):(Total: 2s976ms, non-child: 2s976ms, % non-child: 100.00%) BytesReceived(2s000ms): 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.86 MB, 38.45 MB, 78.36 MB, 118.97 MB, 159.13 MB, 199.07 MB, 239.62 MB, 281.57 MB, 323.98 MB, 366.66 MB, 409.28 MB, 452.10 MB, 495.19 MB, 538.28 MB, 581.56 MB, 624.30 MB, 667.40 MB, 710.64 MB, 753.21 MB - BytesReceived: 779.20 MB (817048943) - ConvertRowBatchTime: 2s319ms - DeserializeRowBatchTimer: 2s088ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 40.32 M/sec - SendersBlockedTimer: 1m25s - SendersBlockedTotalTimer(*): 15m25s Instance 794eeaf500330be1:1d3f0940bab855c1 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 166.85 MB, 529.70 MB, 817.69 MB, 1.14 GB, 1.45 GB, 1.77 GB, 2.05 GB, 2.37 GB, 2.67 GB, 3.02 GB, 3.33 GB, 3.64 GB, 3.95 GB, 4.28 GB, 4.51 GB, 4.79 GB, 5.52 GB, 6.43 GB, 7.32 GB, 8.08 GB, 8.79 GB, 9.44 GB, 10.16 GB, 10.87 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12155007552) - PrepareTime: 152.436ms - RowsProduced: 1 (1) - TotalCpuTime: 1m56s - TotalNetworkReceiveTime: 18s083ms - TotalNetworkSendTime: 316.672us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 428.300ms, non-child: 428.300ms, % non-child: 100.00%) - CodegenTime: 176.949us - CompileTime: 52.388ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 226.186ms - PrepareTime: 148.464ms DataStreamSender (dst_id=6):(Total: 42.377us, non-child: 42.377us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 62.45 KB/sec - OverallThroughput: 368.71 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.746us - ThriftTransmitTime(*): 250.195us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s431ms, % non-child: 2.80%) ExecOption: Codegen Enabled - BuildTime: 2s044ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.27 KB (52496) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 59s626ms, % non-child: 70.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s219ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 13s640ms - GetNewBlockTime: 7.172ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s172ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 7.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.194us EXCHANGE_NODE (id=5):(Total: 18s867ms, non-child: 7s260ms, % non-child: 38.48%) BytesReceived(2s000ms): 53.44 MB, 228.58 MB, 405.89 MB, 583.05 MB, 768.06 MB, 941.71 MB, 1.09 GB, 1.27 GB, 1.43 GB, 1.61 GB, 1.79 GB, 1.97 GB, 2.15 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671793268) - ConvertRowBatchTime: 3s781ms - DeserializeRowBatchTimer: 7s733ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 6.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s909ms, non-child: 3s119ms, % non-child: 52.78%) BytesReceived(2s000ms): 7.98 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.08 MB, 10.12 MB, 32.37 MB, 72.31 MB, 112.81 MB, 153.14 MB, 193.02 MB, 233.51 MB, 275.14 MB, 317.51 MB, 360.13 MB, 402.80 MB, 445.54 MB, 488.67 MB, 531.72 MB, 575.04 MB, 617.92 MB, 660.96 MB, 704.22 MB, 746.82 MB - BytesReceived: 779.28 MB (817137975) - ConvertRowBatchTime: 2s392ms - DeserializeRowBatchTimer: 2s965ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 20.31 M/sec - SendersBlockedTimer: 47s732ms - SendersBlockedTotalTimer(*): 9m34s Instance 794eeaf500330be1:1d3f0940bab855cb (host=vb0230.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.29 MB, 497.71 MB, 817.68 MB, 1.08 GB, 1.43 GB, 1.74 GB, 2.05 GB, 2.34 GB, 2.67 GB, 2.96 GB, 3.30 GB, 3.64 GB, 3.95 GB, 4.25 GB, 4.49 GB, 4.72 GB, 5.48 GB, 6.29 GB, 6.96 GB, 7.76 GB, 8.50 GB, 9.24 GB, 10.03 GB, 10.78 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.15 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12154149344) - PrepareTime: 156.322ms - RowsProduced: 1 (1) - TotalCpuTime: 1m51s - TotalNetworkReceiveTime: 23s494ms - TotalNetworkSendTime: 297.381us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 423.948ms, non-child: 423.948ms, % non-child: 100.00%) - CodegenTime: 205.656us - CompileTime: 41.545ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 228.793ms - PrepareTime: 152.537ms DataStreamSender (dst_id=6):(Total: 41.854us, non-child: 41.854us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 60.83 KB/sec - OverallThroughput: 373.32 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.641us - ThriftTransmitTime(*): 256.856us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s629ms, % non-child: 3.03%) ExecOption: Codegen Enabled - BuildTime: 2s231ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.06 KB (50240) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 54s764ms, % non-child: 65.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 8s168ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 13s607ms - GetNewBlockTime: 5.589ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s361ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 7.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.260us EXCHANGE_NODE (id=5):(Total: 21s972ms, non-child: 10s850ms, % non-child: 49.38%) BytesReceived(2s000ms): 83.65 MB, 262.19 MB, 438.77 MB, 617.57 MB, 802.12 MB, 975.68 MB, 1.12 GB, 1.30 GB, 1.47 GB, 1.65 GB, 1.83 GB, 2.00 GB, 2.19 GB, 2.35 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670905481) - ConvertRowBatchTime: 2s773ms - DeserializeRowBatchTimer: 12s507ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 5.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s449ms, non-child: 3s419ms, % non-child: 45.90%) BytesReceived(2s000ms): 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 11.33 MB, 40.07 MB, 79.92 MB, 120.57 MB, 160.72 MB, 200.65 MB, 241.25 MB, 283.04 MB, 325.44 MB, 368.06 MB, 410.64 MB, 453.49 MB, 496.57 MB, 539.69 MB, 582.93 MB, 625.70 MB, 668.87 MB, 712.09 MB, 754.57 MB - BytesReceived: 778.98 MB (816818843) - ConvertRowBatchTime: 2s678ms - DeserializeRowBatchTimer: 2s918ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 16.11 M/sec - SendersBlockedTimer: 47s802ms - SendersBlockedTotalTimer(*): 11m56s Instance 794eeaf500330be1:1d3f0940bab855c3 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 241.69 MB, 561.73 MB, 881.72 MB, 1.17 GB, 1.49 GB, 1.80 GB, 2.11 GB, 2.42 GB, 2.70 GB, 3.05 GB, 3.36 GB, 3.67 GB, 4.01 GB, 4.31 GB, 4.52 GB, 4.87 GB, 5.60 GB, 6.33 GB, 7.12 GB, 7.80 GB, 8.59 GB, 9.33 GB, 10.06 GB, 10.85 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12154622592) - PrepareTime: 156.930ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 20s073ms - TotalNetworkSendTime: 260.517us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 442.334ms, non-child: 442.334ms, % non-child: 100.00%) - CodegenTime: 165.928us - CompileTime: 58.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 229.788ms - PrepareTime: 153.044ms DataStreamSender (dst_id=6):(Total: 39.487us, non-child: 39.487us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 72.20 KB/sec - OverallThroughput: 395.70 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.097us - ThriftTransmitTime(*): 216.406us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s638ms, % non-child: 3.04%) ExecOption: Codegen Enabled - BuildTime: 2s243ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.28 KB (49440) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 56s929ms, % non-child: 67.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s046ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 13s909ms - GetNewBlockTime: 7.135ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s268ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 7.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.106us EXCHANGE_NODE (id=5):(Total: 19s008ms, non-child: 9s980ms, % non-child: 52.51%) BytesReceived(2s000ms): 73.37 MB, 252.18 MB, 429.05 MB, 607.47 MB, 791.79 MB, 965.45 MB, 1.11 GB, 1.29 GB, 1.46 GB, 1.64 GB, 1.82 GB, 1.99 GB, 2.18 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672221858) - ConvertRowBatchTime: 3s769ms - DeserializeRowBatchTimer: 10s334ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 6.31 M/sec - SendersBlockedTimer: 782.383ms - SendersBlockedTotalTimer(*): 5s981ms EXCHANGE_NODE (id=4):(Total: 8s207ms, non-child: 3s712ms, % non-child: 45.23%) BytesReceived(2s000ms): 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 10.74 MB, 37.79 MB, 77.67 MB, 118.27 MB, 158.50 MB, 198.39 MB, 238.94 MB, 280.75 MB, 323.20 MB, 365.90 MB, 408.52 MB, 451.28 MB, 494.40 MB, 537.51 MB, 580.82 MB, 623.67 MB, 666.79 MB, 710.01 MB, 752.63 MB - BytesReceived: 779.33 MB (817189008) - ConvertRowBatchTime: 2s802ms - DeserializeRowBatchTimer: 3s589ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 14.62 M/sec - SendersBlockedTimer: 48s138ms - SendersBlockedTotalTimer(*): 10m29s Instance 794eeaf500330be1:1d3f0940bab855c8 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 207.25 MB, 561.79 MB, 850.12 MB, 1.15 GB, 1.45 GB, 1.79 GB, 2.08 GB, 2.42 GB, 2.71 GB, 3.05 GB, 3.35 GB, 3.67 GB, 4.02 GB, 4.30 GB, 4.52 GB, 4.87 GB, 5.68 GB, 6.53 GB, 7.38 GB, 8.23 GB, 9.20 GB, 10.04 GB, 10.89 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154722592) - PrepareTime: 154.650ms - RowsProduced: 1 (1) - TotalCpuTime: 1m54s - TotalNetworkReceiveTime: 17s719ms - TotalNetworkSendTime: 233.209us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 476.718ms, non-child: 476.718ms, % non-child: 100.00%) - CodegenTime: 197.781us - CompileTime: 43.823ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 280.801ms - PrepareTime: 150.918ms DataStreamSender (dst_id=6):(Total: 38.253us, non-child: 38.253us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 78.70 KB/sec - OverallThroughput: 408.46 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.381us - ThriftTransmitTime(*): 198.544us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s406ms, % non-child: 2.77%) ExecOption: Codegen Enabled - BuildTime: 2s037ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.33 KB (48464) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 59s603ms, % non-child: 70.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s951ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 11s752ms - GetNewBlockTime: 6.099ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s483ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 7.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.711us EXCHANGE_NODE (id=5):(Total: 17s020ms, non-child: 11s692ms, % non-child: 68.69%) BytesReceived(2s000ms): 66.44 MB, 244.87 MB, 421.80 MB, 599.75 MB, 784.11 MB, 957.92 MB, 1.11 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.81 GB, 1.99 GB, 2.17 GB, 2.33 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671683170) - ConvertRowBatchTime: 4s142ms - DeserializeRowBatchTimer: 12s024ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 7.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s737ms, non-child: 3s083ms, % non-child: 39.85%) BytesReceived(2s000ms): 9.97 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.29 MB, 36.12 MB, 75.97 MB, 116.54 MB, 156.76 MB, 196.58 MB, 237.10 MB, 278.89 MB, 321.35 MB, 363.96 MB, 406.52 MB, 449.26 MB, 492.31 MB, 535.44 MB, 578.77 MB, 621.58 MB, 664.74 MB, 708.02 MB, 750.70 MB - BytesReceived: 779.18 MB (817029035) - ConvertRowBatchTime: 2s333ms - DeserializeRowBatchTimer: 3s157ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 15.51 M/sec - SendersBlockedTimer: 45s644ms - SendersBlockedTotalTimer(*): 6m50s Instance 794eeaf500330be1:1d3f0940bab855c9 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 210.05 MB, 565.74 MB, 849.71 MB, 1.17 GB, 1.47 GB, 1.80 GB, 2.09 GB, 2.42 GB, 2.71 GB, 3.05 GB, 3.36 GB, 3.67 GB, 4.02 GB, 4.30 GB, 4.52 GB, 4.87 GB, 5.53 GB, 6.32 GB, 7.11 GB, 7.78 GB, 8.58 GB, 9.25 GB, 10.03 GB, 10.77 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006862848) - PerHostPeakMemUsage: 11.32 GB (12154036392) - PrepareTime: 157.649ms - RowsProduced: 1 (1) - TotalCpuTime: 1m52s - TotalNetworkReceiveTime: 22s469ms - TotalNetworkSendTime: 329.507us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 444.258ms, non-child: 444.258ms, % non-child: 100.00%) - CodegenTime: 182.847us - CompileTime: 48.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 241.126ms - PrepareTime: 151.253ms DataStreamSender (dst_id=6):(Total: 42.414us, non-child: 42.414us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 56.54 KB/sec - OverallThroughput: 368.39 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.837us - ThriftTransmitTime(*): 276.346us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s728ms, % non-child: 3.14%) ExecOption: Codegen Enabled - BuildTime: 2s325ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.19 KB (52416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 55s135ms, % non-child: 65.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 9s337ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 13s924ms - GetNewBlockTime: 5.513ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s109ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 7.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.960us EXCHANGE_NODE (id=5):(Total: 20s752ms, non-child: 11s453ms, % non-child: 55.19%) BytesReceived(2s000ms): 69.53 MB, 248.32 MB, 425.22 MB, 603.57 MB, 788.08 MB, 961.77 MB, 1.11 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.81 GB, 1.99 GB, 2.17 GB, 2.34 GB, 2.46 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671583942) - ConvertRowBatchTime: 3s098ms - DeserializeRowBatchTimer: 12s579ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 5.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s150ms, non-child: 3s671ms, % non-child: 45.05%) BytesReceived(2s000ms): 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.52 MB, 36.91 MB, 76.79 MB, 117.37 MB, 157.57 MB, 197.49 MB, 238.02 MB, 279.79 MB, 322.25 MB, 364.87 MB, 407.45 MB, 450.22 MB, 493.27 MB, 536.39 MB, 579.75 MB, 622.59 MB, 665.70 MB, 708.92 MB, 751.53 MB - BytesReceived: 779.17 MB (817022113) - ConvertRowBatchTime: 2s812ms - DeserializeRowBatchTimer: 3s340ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 14.72 M/sec - SendersBlockedTimer: 48s236ms - SendersBlockedTotalTimer(*): 10m29s Instance 794eeaf500330be1:1d3f0940bab855cc (host=vb0208.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.41 MB, 497.74 MB, 817.70 MB, 1.12 GB, 1.42 GB, 1.76 GB, 2.05 GB, 2.36 GB, 2.67 GB, 3.02 GB, 3.30 GB, 3.64 GB, 3.95 GB, 4.27 GB, 4.49 GB, 4.72 GB, 5.48 GB, 6.21 GB, 6.93 GB, 7.67 GB, 8.39 GB, 9.12 GB, 9.84 GB, 10.58 GB, 11.13 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154614776) - PrepareTime: 158.302ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 20s022ms - TotalNetworkSendTime: 293.864us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 446.481ms, non-child: 446.481ms, % non-child: 100.00%) - CodegenTime: 158.694us - CompileTime: 61.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 229.483ms - PrepareTime: 154.400ms DataStreamSender (dst_id=6):(Total: 30.337us, non-child: 30.337us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 61.58 KB/sec - OverallThroughput: 515.05 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.188us - ThriftTransmitTime(*): 253.737us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s742ms, % non-child: 3.16%) ExecOption: Codegen Enabled - BuildTime: 2s351ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.66 KB (48800) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 56s913ms, % non-child: 67.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s066ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 14s176ms - GetNewBlockTime: 6.547ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s953ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 7.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.592us EXCHANGE_NODE (id=5):(Total: 19s003ms, non-child: 7s117ms, % non-child: 37.46%) BytesReceived(2s000ms): 50.18 MB, 224.13 MB, 401.24 MB, 578.06 MB, 763.30 MB, 937.09 MB, 1.09 GB, 1.26 GB, 1.43 GB, 1.61 GB, 1.79 GB, 1.96 GB, 2.15 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671200136) - ConvertRowBatchTime: 3s702ms - DeserializeRowBatchTimer: 7s591ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 6.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s106ms, non-child: 3s738ms, % non-child: 46.12%) BytesReceived(2s000ms): 7.57 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.10 MB, 31.39 MB, 71.31 MB, 111.76 MB, 152.14 MB, 192.00 MB, 232.40 MB, 273.94 MB, 316.32 MB, 358.90 MB, 401.58 MB, 444.33 MB, 487.40 MB, 530.44 MB, 573.79 MB, 616.59 MB, 659.57 MB, 702.91 MB, 745.56 MB - BytesReceived: 779.08 MB (816922049) - ConvertRowBatchTime: 2s854ms - DeserializeRowBatchTimer: 3s366ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 14.80 M/sec - SendersBlockedTimer: 48s444ms - SendersBlockedTotalTimer(*): 7m20s Instance 794eeaf500330be1:1d3f0940bab855cf (host=vb0218.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 180.03 MB, 535.51 MB, 818.36 MB, 1.14 GB, 1.46 GB, 1.77 GB, 2.05 GB, 2.39 GB, 2.67 GB, 3.02 GB, 3.33 GB, 3.64 GB, 3.95 GB, 4.28 GB, 4.52 GB, 4.79 GB, 5.52 GB, 6.49 GB, 7.33 GB, 8.17 GB, 9.02 GB, 9.86 GB, 10.71 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006887424) - PerHostPeakMemUsage: 11.32 GB (12154628456) - PrepareTime: 157.724ms - RowsProduced: 1 (1) - TotalCpuTime: 1m54s - TotalNetworkReceiveTime: 18s621ms - TotalNetworkSendTime: 228.275us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 483.198ms, non-child: 483.198ms, % non-child: 100.00%) - CodegenTime: 156.403us - CompileTime: 47.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 281.000ms - PrepareTime: 153.738ms DataStreamSender (dst_id=6):(Total: 36.238us, non-child: 36.238us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 87.71 KB/sec - OverallThroughput: 431.18 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.402us - ThriftTransmitTime(*): 178.148us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m26s, non-child: 2s394ms, % non-child: 2.76%) ExecOption: Codegen Enabled - BuildTime: 2s029ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.86 KB (46960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m24s, non-child: 58s889ms, % non-child: 69.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s001ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 11s958ms - GetNewBlockTime: 6.902ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s611ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 7.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.376us EXCHANGE_NODE (id=5):(Total: 17s980ms, non-child: 11s889ms, % non-child: 66.12%) BytesReceived(2s000ms): 55.10 MB, 230.74 MB, 407.83 MB, 584.95 MB, 770.01 MB, 943.84 MB, 1.09 GB, 1.27 GB, 1.44 GB, 1.62 GB, 1.80 GB, 1.97 GB, 2.15 GB, 2.32 GB, 2.45 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671704116) - ConvertRowBatchTime: 3s937ms - DeserializeRowBatchTimer: 12s224ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 6.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 7s472ms, non-child: 3s108ms, % non-child: 41.60%) BytesReceived(2s000ms): 8.26 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.15 MB, 32.84 MB, 72.76 MB, 113.26 MB, 153.62 MB, 193.50 MB, 233.92 MB, 275.55 MB, 317.92 MB, 360.49 MB, 403.07 MB, 445.79 MB, 488.87 MB, 531.97 MB, 575.31 MB, 618.13 MB, 661.23 MB, 704.55 MB, 747.20 MB - BytesReceived: 779.18 MB (817028121) - ConvertRowBatchTime: 2s331ms - DeserializeRowBatchTimer: 3s186ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 16.06 M/sec - SendersBlockedTimer: 45s801ms - SendersBlockedTotalTimer(*): 11m26s Fragment F01: Instance 794eeaf500330be1:1d3f0940bab855d3 (host=vb0204.halxg.cloudera.com:22000):(Total: 30s234ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(500.000ms): 0, 1001.66 MB, 1002.85 MB, 1002.82 MB, 1002.67 MB, 1003.04 MB, 1002.88 MB, 1003.03 MB, 923.99 MB, 900.26 MB, 828.81 MB, 828.78 MB, 829.03 MB, 828.61 MB, 828.67 MB, 829.23 MB, 772.67 MB, 740.80 MB, 732.92 MB, 652.41 MB, 652.92 MB, 652.54 MB, 652.73 MB, 652.84 MB, 564.68 MB, 564.65 MB, 564.84 MB, 556.61 MB, 468.99 MB, 389.15 MB, 389.39 MB, 381.34 MB, 301.29 MB, 301.33 MB, 300.87 MB, 301.20 MB, 284.97 MB, 284.37 MB, 641.51 MB, 641.73 MB, 641.65 MB, 641.67 MB, 641.97 MB, 578.90 MB, 531.21 MB, 531.19 MB, 530.95 MB, 531.09 MB, 475.14 MB, 443.09 MB, 419.06 MB, 418.97 MB, 419.24 MB, 362.97 MB, 362.97 MB, 315.28 MB, 251.30 MB, 251.24 MB, 195.22 MB, 195.20 MB, 195.30 MB, 120.79 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.49 MB (1052233696) - PerHostPeakMemUsage: 4.92 GB (5286952384) - PrepareTime: 151.511ms - RowsProduced: 124.58M (124581263) - TotalCpuTime: 5m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 598.696ms - TotalStorageWaitTime: 495.983ms CodeGen:(Total: 339.310ms, non-child: 339.310ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 186.424ms - PrepareTime: 149.350ms DataStreamSender (dst_id=5):(Total: 29s443ms, non-child: 29s443ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2774632642) - NetworkThroughput(*): 38.87 MB/sec - OverallThroughput: 89.87 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s498ms - ThriftTransmitTime(*): 1m8s - UncompressedRowBatchSize: 5.11 GB (5482794004) HDFS_SCAN_NODE (id=1):(Total: 826.189ms, non-child: 826.189ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1002.34 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.41 - BytesRead: 1.47 GB (1576547565) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576547565) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576547565) - DecompressionTime: 5s814ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811872) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 150.79 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.85K (12849) - ScannerThreadsTotalWallClockTime: 4m45s - MaterializeTupleTime(*): 4m38s - ScannerThreadsSysTime: 809.872ms - ScannerThreadsUserTime: 24s010ms - ScannerThreadsVoluntaryContextSwitches: 121.89K (121887) - TotalRawHdfsReadTime(*): 1s022ms - TotalReadThroughput: 49.30 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d2 (host=vb0234.halxg.cloudera.com:22000):(Total: 30s216ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(500.000ms): 888.04 MB, 1002.65 MB, 1002.89 MB, 1002.71 MB, 1002.93 MB, 1002.90 MB, 1002.67 MB, 1002.68 MB, 916.22 MB, 836.96 MB, 828.64 MB, 828.79 MB, 828.71 MB, 828.80 MB, 829.32 MB, 828.89 MB, 748.70 MB, 740.56 MB, 660.95 MB, 652.65 MB, 652.87 MB, 653.01 MB, 652.64 MB, 612.63 MB, 572.66 MB, 564.77 MB, 565.14 MB, 492.72 MB, 437.17 MB, 389.04 MB, 389.11 MB, 364.88 MB, 309.12 MB, 300.87 MB, 300.81 MB, 301.26 MB, 253.05 MB, 428.13 MB, 641.73 MB, 641.77 MB, 641.83 MB, 641.72 MB, 626.02 MB, 539.27 MB, 531.31 MB, 531.32 MB, 531.16 MB, 499.09 MB, 475.21 MB, 419.29 MB, 419.26 MB, 419.11 MB, 387.20 MB, 363.22 MB, 347.09 MB, 275.31 MB, 251.31 MB, 203.31 MB, 195.06 MB, 194.92 MB, 139.51 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258368) - PerHostPeakMemUsage: 4.94 GB (5300306488) - PrepareTime: 151.767ms - RowsProduced: 124.58M (124581107) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 558.078ms - TotalStorageWaitTime: 484.400ms CodeGen:(Total: 366.934ms, non-child: 366.934ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.856ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 213.222ms - PrepareTime: 149.523ms DataStreamSender (dst_id=5):(Total: 29s334ms, non-child: 29s334ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772803180) - NetworkThroughput(*): 40.71 MB/sec - OverallThroughput: 90.15 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 17s327ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 5.11 GB (5482787140) HDFS_SCAN_NODE (id=1):(Total: 918.223ms, non-child: 918.223ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:0% 2:0% 3:0% 4:1.639% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 796.38 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.16 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 1.47 GB (1576539207) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576539207) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576539207) - DecompressionTime: 6s846ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811976) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 135.68 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.71K (15712) - ScannerThreadsTotalWallClockTime: 4m47s - MaterializeTupleTime(*): 4m39s - ScannerThreadsSysTime: 935.854ms - ScannerThreadsUserTime: 28s177ms - ScannerThreadsVoluntaryContextSwitches: 121.83K (121832) - TotalRawHdfsReadTime(*): 969.259ms - TotalReadThroughput: 49.30 MB/sec Instance 794eeaf500330be1:1d3f0940bab855de (host=vb0218.halxg.cloudera.com:22000):(Total: 29s300ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(500.000ms): 55.93 KB, 1002.05 MB, 1002.74 MB, 1003.09 MB, 1003.00 MB, 1002.63 MB, 1002.86 MB, 1002.98 MB, 916.21 MB, 828.95 MB, 828.45 MB, 828.71 MB, 829.03 MB, 829.00 MB, 829.02 MB, 828.75 MB, 741.23 MB, 740.99 MB, 668.71 MB, 652.69 MB, 653.07 MB, 652.43 MB, 652.80 MB, 652.90 MB, 564.95 MB, 564.88 MB, 565.05 MB, 492.74 MB, 453.15 MB, 389.03 MB, 389.14 MB, 349.13 MB, 301.29 MB, 301.12 MB, 301.07 MB, 301.35 MB, 213.28 MB, 640.88 MB, 641.64 MB, 641.73 MB, 641.91 MB, 610.27 MB, 531.27 MB, 531.12 MB, 531.24 MB, 531.18 MB, 475.25 MB, 443.22 MB, 419.27 MB, 419.24 MB, 418.84 MB, 363.30 MB, 363.08 MB, 307.14 MB, 251.24 MB, 251.41 MB, 195.53 MB, 195.56 MB, 187.07 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.50 MB (1052241848) - PerHostPeakMemUsage: 4.88 GB (5237043608) - PrepareTime: 156.240ms - RowsProduced: 124.58M (124581252) - TotalCpuTime: 5m6s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 620.490ms - TotalStorageWaitTime: 488.711ms CodeGen:(Total: 356.806ms, non-child: 356.806ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 199.092ms - PrepareTime: 154.157ms DataStreamSender (dst_id=5):(Total: 28s557ms, non-child: 28s557ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2774172089) - NetworkThroughput(*): 38.62 MB/sec - OverallThroughput: 92.64 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 16s994ms - ThriftTransmitTime(*): 1m8s - UncompressedRowBatchSize: 5.11 GB (5482793504) HDFS_SCAN_NODE (id=1):(Total: 786.521ms, non-child: 786.521ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.48 - BytesRead: 1.47 GB (1576543414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576543414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576543414) - DecompressionTime: 5s307ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877288) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 158.40 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.05K (11048) - ScannerThreadsTotalWallClockTime: 4m38s - MaterializeTupleTime(*): 4m31s - ScannerThreadsSysTime: 715.885ms - ScannerThreadsUserTime: 21s427ms - ScannerThreadsVoluntaryContextSwitches: 121.94K (121935) - TotalRawHdfsReadTime(*): 1s019ms - TotalReadThroughput: 50.97 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d7 (host=vb0206.halxg.cloudera.com:22000):(Total: 29s198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(500.000ms): 433.79 MB, 1002.80 MB, 1002.38 MB, 1002.62 MB, 1002.61 MB, 1002.77 MB, 1002.98 MB, 1002.71 MB, 916.51 MB, 828.98 MB, 829.05 MB, 829.20 MB, 828.86 MB, 828.82 MB, 828.76 MB, 756.43 MB, 740.77 MB, 741.29 MB, 652.82 MB, 652.90 MB, 652.83 MB, 652.68 MB, 652.65 MB, 564.93 MB, 564.68 MB, 564.69 MB, 564.94 MB, 476.78 MB, 389.16 MB, 389.22 MB, 389.33 MB, 301.23 MB, 301.11 MB, 301.15 MB, 301.06 MB, 213.01 MB, 298.28 MB, 641.59 MB, 641.59 MB, 641.94 MB, 641.94 MB, 586.65 MB, 531.02 MB, 531.15 MB, 531.07 MB, 531.16 MB, 475.09 MB, 419.11 MB, 419.09 MB, 419.28 MB, 410.90 MB, 363.26 MB, 363.46 MB, 307.22 MB, 251.20 MB, 195.23 MB, 195.21 MB, 195.16 MB, 139.26 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.63 MB (1052381032) - PerHostPeakMemUsage: 4.88 GB (5237136544) - PrepareTime: 154.934ms - RowsProduced: 124.58M (124580622) - TotalCpuTime: 5m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 621.967ms - TotalStorageWaitTime: 477.733ms CodeGen:(Total: 347.919ms, non-child: 347.919ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.616ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 191.251ms - PrepareTime: 152.902ms DataStreamSender (dst_id=5):(Total: 28s507ms, non-child: 28s507ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773326057) - NetworkThroughput(*): 38.86 MB/sec - OverallThroughput: 92.78 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s924ms - ThriftTransmitTime(*): 1m8s - UncompressedRowBatchSize: 5.11 GB (5482765788) HDFS_SCAN_NODE (id=1):(Total: 750.480ms, non-child: 750.480ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:96.61% 1:0% 2:0% 3:0% 4:1.695% 5:0% 6:0% 7:0% 8:0% 9:1.695% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 321.22 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.00 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 9.51 - BytesRead: 1.47 GB (1576533591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576533591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576533591) - DecompressionTime: 4s995ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942832) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 166.00 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.59K (10592) - ScannerThreadsTotalWallClockTime: 4m36s - MaterializeTupleTime(*): 4m30s - ScannerThreadsSysTime: 583.907ms - ScannerThreadsUserTime: 20s032ms - ScannerThreadsVoluntaryContextSwitches: 121.89K (121892) - TotalRawHdfsReadTime(*): 1s107ms - TotalReadThroughput: 50.97 MB/sec Instance 794eeaf500330be1:1d3f0940bab855db (host=vb0208.halxg.cloudera.com:22000):(Total: 29s086ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(500.000ms): 55.93 KB, 1002.02 MB, 1002.87 MB, 1002.61 MB, 1003.02 MB, 1003.08 MB, 1002.82 MB, 1002.67 MB, 931.81 MB, 860.73 MB, 828.87 MB, 828.95 MB, 828.90 MB, 829.14 MB, 828.64 MB, 828.76 MB, 748.75 MB, 740.76 MB, 660.65 MB, 652.62 MB, 652.73 MB, 652.84 MB, 653.15 MB, 580.69 MB, 564.80 MB, 564.89 MB, 565.01 MB, 492.68 MB, 405.22 MB, 388.83 MB, 388.98 MB, 317.08 MB, 300.95 MB, 300.99 MB, 301.30 MB, 277.13 MB, 220.92 MB, 660.10 MB, 642.12 MB, 641.93 MB, 641.79 MB, 626.51 MB, 539.22 MB, 531.07 MB, 531.21 MB, 531.25 MB, 491.16 MB, 466.94 MB, 419.31 MB, 419.43 MB, 411.12 MB, 363.18 MB, 362.79 MB, 299.39 MB, 251.32 MB, 243.40 MB, 195.35 MB, 195.23 MB, 162.95 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052315760) - PerHostPeakMemUsage: 4.88 GB (5236734520) - PrepareTime: 152.306ms - RowsProduced: 124.58M (124581487) - TotalCpuTime: 5m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 591.833ms - TotalStorageWaitTime: 445.505ms CodeGen:(Total: 360.203ms, non-child: 360.203ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 206.231ms - PrepareTime: 150.170ms DataStreamSender (dst_id=5):(Total: 28s207ms, non-child: 28s207ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773737546) - NetworkThroughput(*): 43.28 MB/sec - OverallThroughput: 93.78 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s919ms - ThriftTransmitTime(*): 1m1s - UncompressedRowBatchSize: 5.11 GB (5482803856) HDFS_SCAN_NODE (id=1):(Total: 927.781ms, non-child: 927.781ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.50 - BytesRead: 1.47 GB (1576530636) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576530636) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576530636) - DecompressionTime: 7s716ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051943096) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 134.28 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.06K (15064) - ScannerThreadsTotalWallClockTime: 4m35s - MaterializeTupleTime(*): 4m26s - ScannerThreadsSysTime: 1s049ms - ScannerThreadsUserTime: 31s578ms - ScannerThreadsVoluntaryContextSwitches: 122.13K (122129) - TotalRawHdfsReadTime(*): 1s148ms - TotalReadThroughput: 50.97 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d4 (host=vb0226.halxg.cloudera.com:22000):(Total: 28s916ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(500.000ms): 55.93 KB, 1002.06 MB, 1002.82 MB, 1002.67 MB, 1002.87 MB, 1003.08 MB, 1002.74 MB, 1002.74 MB, 979.39 MB, 892.24 MB, 829.17 MB, 828.66 MB, 828.67 MB, 828.96 MB, 828.96 MB, 828.73 MB, 741.02 MB, 740.84 MB, 652.98 MB, 653.08 MB, 652.49 MB, 653.02 MB, 653.14 MB, 612.98 MB, 565.04 MB, 564.98 MB, 564.94 MB, 484.99 MB, 428.92 MB, 389.12 MB, 389.04 MB, 365.22 MB, 301.21 MB, 300.87 MB, 301.21 MB, 301.03 MB, 229.37 MB, 548.86 MB, 612.43 MB, 612.13 MB, 612.42 MB, 612.19 MB, 557.40 MB, 501.74 MB, 501.75 MB, 501.65 MB, 501.67 MB, 445.78 MB, 405.71 MB, 389.91 MB, 389.62 MB, 389.59 MB, 333.66 MB, 333.81 MB, 256.87 MB, 208.77 MB, 160.75 MB, 142.25 MB, 110.44 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.62 MB (1052372840) - PerHostPeakMemUsage: 4.83 GB (5181039816) - PrepareTime: 156.533ms - RowsProduced: 122.02M (122016989) - TotalCpuTime: 5m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 573.721ms - TotalStorageWaitTime: 452.109ms CodeGen:(Total: 378.020ms, non-child: 378.020ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 219.436ms - PrepareTime: 154.534ms DataStreamSender (dst_id=5):(Total: 27s948ms, non-child: 27s948ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2715340087) - NetworkThroughput(*): 43.06 MB/sec - OverallThroughput: 92.65 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s397ms - ThriftTransmitTime(*): 1m - UncompressedRowBatchSize: 5.00 GB (5369940860) HDFS_SCAN_NODE (id=1):(Total: 1s011ms, non-child: 1s011ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.31 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.43 - BytesRead: 1.44 GB (1544225999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1544225999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1544225999) - DecompressionTime: 8s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942832) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 120.66 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.29K (15290) - ScannerThreadsTotalWallClockTime: 4m33s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 1s000ms - ScannerThreadsUserTime: 34s990ms - ScannerThreadsVoluntaryContextSwitches: 119.45K (119454) - TotalRawHdfsReadTime(*): 995.781ms - TotalReadThroughput: 49.92 MB/sec Instance 794eeaf500330be1:1d3f0940bab855dc (host=vb0224.halxg.cloudera.com:22000):(Total: 28s657ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(500.000ms): 0, 993.96 MB, 994.64 MB, 995.04 MB, 995.10 MB, 994.87 MB, 994.55 MB, 994.81 MB, 907.85 MB, 820.80 MB, 820.88 MB, 821.03 MB, 821.11 MB, 820.98 MB, 820.64 MB, 820.66 MB, 732.82 MB, 732.77 MB, 644.88 MB, 645.29 MB, 645.03 MB, 645.00 MB, 645.01 MB, 556.86 MB, 556.79 MB, 556.91 MB, 556.96 MB, 468.76 MB, 380.99 MB, 381.33 MB, 381.41 MB, 293.11 MB, 293.52 MB, 365.15 MB, 365.18 MB, 308.94 MB, 284.77 MB, 641.67 MB, 641.92 MB, 634.12 MB, 626.21 MB, 579.10 MB, 530.87 MB, 531.27 MB, 523.19 MB, 514.89 MB, 467.10 MB, 435.29 MB, 411.40 MB, 411.16 MB, 387.32 MB, 347.15 MB, 347.32 MB, 283.26 MB, 243.41 MB, 195.26 MB, 168.71 MB, 168.86 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.52 MB (1043877736) - PerHostPeakMemUsage: 4.80 GB (5155970816) - PrepareTime: 153.034ms - RowsProduced: 123.88M (123876516) - TotalCpuTime: 4m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 655.297ms - TotalStorageWaitTime: 563.368ms CodeGen:(Total: 347.079ms, non-child: 347.079ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 192.557ms - PrepareTime: 150.417ms DataStreamSender (dst_id=5):(Total: 27s949ms, non-child: 27s949ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2758723665) - NetworkThroughput(*): 38.79 MB/sec - OverallThroughput: 94.13 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 16s728ms - ThriftTransmitTime(*): 1m7s - UncompressedRowBatchSize: 5.08 GB (5451778236) HDFS_SCAN_NODE (id=1):(Total: 762.028ms, non-child: 762.028ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 910.34 MB, 993.86 MB, 993.86 MB, 993.86 MB, 993.86 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 1.46 GB (1567627792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567627792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567627792) - DecompressionTime: 4s990ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.15 MB (1043488768) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 162.56 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.91K (9915) - ScannerThreadsTotalWallClockTime: 4m31s - MaterializeTupleTime(*): 4m25s - ScannerThreadsSysTime: 595.905ms - ScannerThreadsUserTime: 20s099ms - ScannerThreadsVoluntaryContextSwitches: 121.18K (121184) - TotalRawHdfsReadTime(*): 1s094ms - TotalReadThroughput: 52.46 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d6 (host=vb0232.halxg.cloudera.com:22000):(Total: 28s306ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(500.000ms): 55.93 KB, 1001.66 MB, 1002.74 MB, 1002.93 MB, 1002.81 MB, 1002.35 MB, 1002.68 MB, 1002.75 MB, 1002.97 MB, 916.18 MB, 828.85 MB, 828.84 MB, 828.94 MB, 829.03 MB, 828.67 MB, 828.93 MB, 756.90 MB, 741.04 MB, 676.94 MB, 652.86 MB, 652.83 MB, 652.99 MB, 652.85 MB, 652.79 MB, 564.83 MB, 564.76 MB, 565.01 MB, 533.11 MB, 468.70 MB, 389.14 MB, 389.03 MB, 389.17 MB, 301.34 MB, 301.15 MB, 301.45 MB, 301.20 MB, 244.56 MB, 189.11 MB, 551.47 MB, 551.63 MB, 551.54 MB, 551.63 MB, 504.37 MB, 456.75 MB, 457.07 MB, 456.97 MB, 408.89 MB, 384.70 MB, 360.82 MB, 360.83 MB, 312.74 MB, 312.71 MB, 264.87 MB, 216.98 MB, 208.86 MB, 169.09 MB, 169.12 MB, 104.27 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 10.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052291008) - PerHostPeakMemUsage: 4.73 GB (5075933872) - PrepareTime: 151.079ms - RowsProduced: 118.04M (118040847) - TotalCpuTime: 4m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 570.701ms - TotalStorageWaitTime: 439.338ms CodeGen:(Total: 362.901ms, non-child: 362.901ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 210.175ms - PrepareTime: 149.094ms DataStreamSender (dst_id=5):(Total: 27s348ms, non-child: 27s348ms, % non-child: 100.00%) - BytesSent: 2.45 GB (2627867088) - NetworkThroughput(*): 42.90 MB/sec - OverallThroughput: 91.64 MB/sec - PeakMemoryUsage: 467.93 KB (479160) - SerializeBatchTime: 15s994ms - ThriftTransmitTime(*): 58s416ms - UncompressedRowBatchSize: 4.84 GB (5194951728) HDFS_SCAN_NODE (id=1):(Total: 996.678ms, non-child: 996.678ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(500.000ms): 0, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 924.12 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.23 - BytesRead: 1.39 GB (1494524606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1494524606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1494524606) - DecompressionTime: 8s144ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942920) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 118.43 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 15.13K (15131) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m14s - ScannerThreadsSysTime: 988.845ms - ScannerThreadsUserTime: 33s615ms - ScannerThreadsVoluntaryContextSwitches: 115.64K (115645) - TotalRawHdfsReadTime(*): 1s059ms - TotalReadThroughput: 49.15 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d9 (host=vb0228.halxg.cloudera.com:22000):(Total: 28s047ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(500.000ms): 55.93 KB, 981.66 MB, 982.85 MB, 982.82 MB, 982.64 MB, 982.74 MB, 982.89 MB, 982.63 MB, 982.89 MB, 896.01 MB, 824.83 MB, 808.83 MB, 809.12 MB, 808.70 MB, 808.91 MB, 808.98 MB, 784.83 MB, 720.72 MB, 713.00 MB, 632.70 MB, 633.02 MB, 632.97 MB, 632.99 MB, 632.78 MB, 560.82 MB, 545.02 MB, 545.02 MB, 520.97 MB, 476.63 MB, 444.94 MB, 444.90 MB, 420.87 MB, 364.58 MB, 364.61 MB, 364.95 MB, 364.99 MB, 324.85 MB, 473.95 MB, 535.96 MB, 535.90 MB, 535.88 MB, 527.78 MB, 456.78 MB, 440.57 MB, 440.84 MB, 440.79 MB, 400.70 MB, 360.69 MB, 336.63 MB, 336.50 MB, 296.98 MB, 288.81 MB, 248.75 MB, 182.66 MB, 150.31 MB, 142.36 MB, 118.39 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 10.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 983.47 MB (1031245832) - PerHostPeakMemUsage: 4.70 GB (5047505440) - PrepareTime: 155.234ms - RowsProduced: 116.10M (116100605) - TotalCpuTime: 4m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 574.361ms - TotalStorageWaitTime: 402.628ms CodeGen:(Total: 371.921ms, non-child: 371.921ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.873ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 214.687ms - PrepareTime: 153.172ms DataStreamSender (dst_id=5):(Total: 27s089ms, non-child: 27s089ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2584064901) - NetworkThroughput(*): 42.28 MB/sec - OverallThroughput: 90.97 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 15s875ms - ThriftTransmitTime(*): 58s291ms - UncompressedRowBatchSize: 4.76 GB (5109562104) HDFS_SCAN_NODE (id=1):(Total: 994.122ms, non-child: 994.122ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:96.43% 1:3.571% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 900.49 MB, 936.71 MB, 984.01 MB, 984.01 MB, 984.01 MB, 984.01 MB, 984.01 MB, 984.01 MB, 984.01 MB, 984.01 MB, 1.19 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.23 - BytesRead: 1.37 GB (1469733723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469733723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469733723) - DecompressionTime: 7s977ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 983.09 MB (1030840400) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 116.79 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.89K (14895) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m10s - ScannerThreadsSysTime: 998.843ms - ScannerThreadsUserTime: 33s236ms - ScannerThreadsVoluntaryContextSwitches: 113.64K (113644) - TotalRawHdfsReadTime(*): 1s051ms - TotalReadThroughput: 49.18 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d1 (host=vb0214.halxg.cloudera.com:22000):(Total: 27s988ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(500.000ms): 0, 945.84 MB, 994.87 MB, 994.88 MB, 994.80 MB, 994.89 MB, 994.74 MB, 994.95 MB, 994.97 MB, 916.17 MB, 828.70 MB, 820.93 MB, 821.02 MB, 821.03 MB, 820.75 MB, 820.82 MB, 820.63 MB, 733.05 MB, 732.75 MB, 652.69 MB, 644.77 MB, 644.62 MB, 644.56 MB, 644.77 MB, 605.08 MB, 557.10 MB, 556.98 MB, 557.20 MB, 476.98 MB, 428.99 MB, 380.92 MB, 381.11 MB, 373.40 MB, 292.97 MB, 292.94 MB, 292.92 MB, 364.85 MB, 292.81 MB, 563.04 MB, 551.65 MB, 551.54 MB, 535.69 MB, 496.49 MB, 456.59 MB, 456.76 MB, 448.89 MB, 400.82 MB, 368.76 MB, 360.71 MB, 352.58 MB, 312.71 MB, 296.73 MB, 256.45 MB, 208.79 MB, 168.78 MB, 160.81 MB, 142.37 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 10.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.55 MB (1043910592) - PerHostPeakMemUsage: 4.72 GB (5064464360) - PrepareTime: 153.789ms - RowsProduced: 117.14M (117138819) - TotalCpuTime: 4m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 582.059ms - TotalStorageWaitTime: 571.300ms CodeGen:(Total: 371.969ms, non-child: 371.969ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 216.419ms - PrepareTime: 151.787ms DataStreamSender (dst_id=5):(Total: 27s215ms, non-child: 27s215ms, % non-child: 100.00%) - BytesSent: 2.43 GB (2608512035) - NetworkThroughput(*): 39.57 MB/sec - OverallThroughput: 91.41 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s167ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 4.80 GB (5155253676) HDFS_SCAN_NODE (id=1):(Total: 828.300ms, non-child: 828.300ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:96.43% 1:3.571% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 863.27 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 912.52 MB, 996.05 MB, 996.05 MB, 1.37 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.30 - BytesRead: 1.38 GB (1482361679) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.38 GB (1482361679) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.38 GB (1482361679) - DecompressionTime: 5s519ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.21 MB (1043554312) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 141.42 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.48K (12479) - ScannerThreadsTotalWallClockTime: 4m20s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 787.875ms - ScannerThreadsUserTime: 23s916ms - ScannerThreadsVoluntaryContextSwitches: 114.65K (114654) - TotalRawHdfsReadTime(*): 1s180ms - TotalReadThroughput: 50.49 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d0 (host=vb0212.halxg.cloudera.com:22000):(Total: 27s788ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(500.000ms): 55.93 KB, 1001.77 MB, 1002.54 MB, 1002.89 MB, 1002.69 MB, 1003.00 MB, 1002.65 MB, 1002.51 MB, 1002.61 MB, 916.14 MB, 852.29 MB, 828.62 MB, 828.97 MB, 828.69 MB, 829.07 MB, 828.75 MB, 812.81 MB, 740.92 MB, 740.64 MB, 652.99 MB, 652.59 MB, 652.81 MB, 652.90 MB, 652.92 MB, 596.67 MB, 564.83 MB, 564.85 MB, 565.06 MB, 477.04 MB, 412.85 MB, 389.05 MB, 389.14 MB, 332.78 MB, 301.19 MB, 300.89 MB, 301.40 MB, 285.09 MB, 268.59 MB, 551.47 MB, 551.41 MB, 551.51 MB, 528.02 MB, 456.89 MB, 456.69 MB, 456.70 MB, 424.67 MB, 384.82 MB, 360.88 MB, 360.66 MB, 312.99 MB, 304.96 MB, 224.69 MB, 217.03 MB, 168.82 MB, 168.84 MB, 160.93 MB, 13.36 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 1 - AverageThreadTokens: 10.04 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052291000) - PerHostPeakMemUsage: 4.73 GB (5075353680) - PrepareTime: 152.025ms - RowsProduced: 117.66M (117659734) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 590.545ms - TotalStorageWaitTime: 450.043ms CodeGen:(Total: 364.033ms, non-child: 364.033ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 210.155ms - PrepareTime: 149.977ms DataStreamSender (dst_id=5):(Total: 26s859ms, non-child: 26s859ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2618044054) - NetworkThroughput(*): 42.48 MB/sec - OverallThroughput: 92.96 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 15s785ms - ThriftTransmitTime(*): 58s781ms - UncompressedRowBatchSize: 4.82 GB (5178179036) HDFS_SCAN_NODE (id=1):(Total: 968.818ms, non-child: 968.818ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1002.33 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.20 - BytesRead: 1.39 GB (1488945170) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488945170) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488945170) - DecompressionTime: 7s935ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 121.45 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 15.09K (15090) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m10s - ScannerThreadsSysTime: 1s062ms - ScannerThreadsUserTime: 32s547ms - ScannerThreadsVoluntaryContextSwitches: 115.22K (115217) - TotalRawHdfsReadTime(*): 1s051ms - TotalReadThroughput: 49.82 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d5 (host=vb0216.halxg.cloudera.com:22000):(Total: 27s686ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(500.000ms): 849.76 MB, 1002.68 MB, 1002.74 MB, 1002.79 MB, 1003.11 MB, 1003.04 MB, 1002.82 MB, 916.29 MB, 828.82 MB, 828.78 MB, 828.78 MB, 828.96 MB, 829.24 MB, 828.65 MB, 828.90 MB, 740.76 MB, 740.87 MB, 652.92 MB, 653.01 MB, 652.99 MB, 652.73 MB, 652.76 MB, 564.59 MB, 564.65 MB, 564.82 MB, 548.80 MB, 476.76 MB, 389.52 MB, 389.23 MB, 356.95 MB, 300.99 MB, 301.01 MB, 300.87 MB, 300.83 MB, 252.97 MB, 213.14 MB, 551.57 MB, 551.47 MB, 551.71 MB, 551.72 MB, 496.51 MB, 456.73 MB, 456.85 MB, 456.90 MB, 408.62 MB, 368.73 MB, 360.66 MB, 360.57 MB, 312.70 MB, 312.73 MB, 264.59 MB, 216.77 MB, 217.13 MB, 168.97 MB, 168.73 MB, 120.84 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299200) - PerHostPeakMemUsage: 4.73 GB (5074467176) - PrepareTime: 151.526ms - RowsProduced: 117.66M (117660154) - TotalCpuTime: 4m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 646.742ms - TotalStorageWaitTime: 410.493ms CodeGen:(Total: 341.312ms, non-child: 341.312ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 188.270ms - PrepareTime: 149.212ms DataStreamSender (dst_id=5):(Total: 26s850ms, non-child: 26s850ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2618440659) - NetworkThroughput(*): 40.74 MB/sec - OverallThroughput: 93.00 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 15s739ms - ThriftTransmitTime(*): 1m1s - UncompressedRowBatchSize: 4.82 GB (5178197516) HDFS_SCAN_NODE (id=1):(Total: 886.165ms, non-child: 886.165ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.21% 1:0% 2:0% 3:0% 4:0% 5:0% 6:1.786% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 739.67 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 9.21 - BytesRead: 1.39 GB (1488932448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488932448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488932448) - DecompressionTime: 6s387ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942920) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 132.77 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.62K (11616) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m8s - ScannerThreadsSysTime: 808.871ms - ScannerThreadsUserTime: 25s831ms - ScannerThreadsVoluntaryContextSwitches: 115.18K (115181) - TotalRawHdfsReadTime(*): 1s067ms - TotalReadThroughput: 50.71 MB/sec Instance 794eeaf500330be1:1d3f0940bab855da (host=vb0230.halxg.cloudera.com:22000):(Total: 27s017ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(500.000ms): 0, 1001.68 MB, 1002.69 MB, 1002.61 MB, 1003.04 MB, 1002.59 MB, 1002.86 MB, 1002.74 MB, 915.99 MB, 836.75 MB, 828.93 MB, 828.90 MB, 829.10 MB, 828.93 MB, 828.82 MB, 820.72 MB, 740.63 MB, 740.79 MB, 652.70 MB, 653.24 MB, 653.04 MB, 652.89 MB, 652.89 MB, 564.87 MB, 565.07 MB, 564.54 MB, 556.75 MB, 476.59 MB, 388.93 MB, 388.86 MB, 381.26 MB, 301.02 MB, 301.07 MB, 301.15 MB, 300.95 MB, 221.03 MB, 343.14 MB, 551.53 MB, 551.90 MB, 551.64 MB, 504.28 MB, 456.76 MB, 456.67 MB, 456.71 MB, 408.71 MB, 392.81 MB, 360.61 MB, 360.70 MB, 312.74 MB, 312.85 MB, 232.72 MB, 216.75 MB, 168.87 MB, 168.74 MB, 120.98 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299192) - PerHostPeakMemUsage: 4.60 GB (4940250008) - PrepareTime: 150.804ms - RowsProduced: 117.66M (117659841) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 694.293ms - TotalStorageWaitTime: 449.536ms CodeGen:(Total: 336.842ms, non-child: 336.842ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.316ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 184.548ms - PrepareTime: 148.700ms DataStreamSender (dst_id=5):(Total: 26s357ms, non-child: 26s357ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2620629645) - NetworkThroughput(*): 39.47 MB/sec - OverallThroughput: 94.82 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 15s700ms - ThriftTransmitTime(*): 1m3s - UncompressedRowBatchSize: 4.82 GB (5178183740) HDFS_SCAN_NODE (id=1):(Total: 723.579ms, non-child: 723.579ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:98.15% 1:0% 2:1.852% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.09 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 1.39 GB (1488949167) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488949167) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488949167) - DecompressionTime: 4s672ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 162.61 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.81K (8814) - ScannerThreadsTotalWallClockTime: 4m11s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 514.917ms - ScannerThreadsUserTime: 18s566ms - ScannerThreadsVoluntaryContextSwitches: 115.11K (115114) - TotalRawHdfsReadTime(*): 900.976ms - TotalReadThroughput: 52.59 MB/sec Instance 794eeaf500330be1:1d3f0940bab855dd (host=vb0222.halxg.cloudera.com:22000):(Total: 26s855ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(500.000ms): 0, 984.13 MB, 985.21 MB, 985.24 MB, 985.25 MB, 985.31 MB, 985.53 MB, 984.96 MB, 985.56 MB, 898.90 MB, 811.39 MB, 811.29 MB, 811.39 MB, 811.48 MB, 811.47 MB, 811.52 MB, 747.16 MB, 723.61 MB, 659.47 MB, 635.38 MB, 635.07 MB, 635.56 MB, 635.30 MB, 587.17 MB, 547.18 MB, 546.94 MB, 547.64 MB, 467.33 MB, 395.63 MB, 444.43 MB, 429.13 MB, 364.97 MB, 365.01 MB, 365.14 MB, 364.85 MB, 324.81 MB, 507.27 MB, 535.96 MB, 535.91 MB, 535.65 MB, 512.05 MB, 448.89 MB, 440.92 MB, 440.86 MB, 416.76 MB, 384.63 MB, 344.91 MB, 336.83 MB, 296.94 MB, 288.82 MB, 248.85 MB, 182.26 MB, 142.52 MB, 142.19 MB, 110.12 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 10.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 985.94 MB (1033834672) - PerHostPeakMemUsage: 4.57 GB (4908889888) - PrepareTime: 150.450ms - RowsProduced: 116.19M (116191050) - TotalCpuTime: 4m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 592.989ms - TotalStorageWaitTime: 466.593ms CodeGen:(Total: 334.208ms, non-child: 334.208ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.166ms - PrepareTime: 146.770ms DataStreamSender (dst_id=5):(Total: 25s974ms, non-child: 25s974ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2588145344) - NetworkThroughput(*): 42.98 MB/sec - OverallThroughput: 95.02 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - SerializeBatchTime: 15s355ms - ThriftTransmitTime(*): 57s433ms - UncompressedRowBatchSize: 4.76 GB (5113542568) HDFS_SCAN_NODE (id=1):(Total: 927.507ms, non-child: 927.507ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:98.15% 1:1.852% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 901.17 MB, 984.68 MB, 984.68 MB, 984.68 MB, 984.68 MB, 984.68 MB, 984.68 MB, 984.68 MB, 1.23 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.26 - BytesRead: 1.37 GB (1470480664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1470480664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1470480664) - DecompressionTime: 7s644ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 985.59 MB (1033461928) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 125.27 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 14.35K (14351) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 4m - ScannerThreadsSysTime: 999.841ms - ScannerThreadsUserTime: 31s467ms - ScannerThreadsVoluntaryContextSwitches: 113.72K (113723) - TotalRawHdfsReadTime(*): 950.538ms - TotalReadThroughput: 51.94 MB/sec Instance 794eeaf500330be1:1d3f0940bab855d8 (host=vb0220.halxg.cloudera.com:22000):(Total: 26s078ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(500.000ms): 844.02 MB, 1003.03 MB, 1002.94 MB, 1003.09 MB, 1002.89 MB, 1002.88 MB, 1003.07 MB, 963.58 MB, 908.39 MB, 828.92 MB, 828.68 MB, 828.60 MB, 828.91 MB, 828.81 MB, 828.54 MB, 741.21 MB, 740.81 MB, 652.83 MB, 652.82 MB, 652.94 MB, 652.52 MB, 652.92 MB, 628.81 MB, 565.03 MB, 565.07 MB, 564.88 MB, 477.18 MB, 421.37 MB, 388.97 MB, 388.96 MB, 333.05 MB, 301.10 MB, 300.86 MB, 300.84 MB, 301.19 MB, 213.17 MB, 460.08 MB, 461.36 MB, 461.59 MB, 461.31 MB, 382.27 MB, 382.23 MB, 382.31 MB, 342.29 MB, 302.39 MB, 302.39 MB, 278.35 MB, 262.33 MB, 206.23 MB, 182.59 MB, 142.28 MB, 142.27 MB, 10.15 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 10.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.42 MB (1052160040) - PerHostPeakMemUsage: 4.45 GB (4778218336) - PrepareTime: 152.643ms - RowsProduced: 110.74M (110738805) - TotalCpuTime: 4m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 623.811ms - TotalStorageWaitTime: 380.360ms CodeGen:(Total: 340.600ms, non-child: 340.600ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.494ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 186.398ms - PrepareTime: 148.642ms DataStreamSender (dst_id=5):(Total: 25s413ms, non-child: 25s413ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2464078429) - NetworkThroughput(*): 38.74 MB/sec - OverallThroughput: 92.47 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - SerializeBatchTime: 15s052ms - ThriftTransmitTime(*): 1m - UncompressedRowBatchSize: 4.54 GB (4873590468) HDFS_SCAN_NODE (id=1):(Total: 728.951ms, non-child: 728.951ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:96.23% 1:0% 2:0% 3:3.774% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 755.00 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 918.82 MB, 1.19 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 9.09 - BytesRead: 1.31 GB (1401399791) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401399791) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401399791) - DecompressionTime: 4s578ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812008) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 151.92 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 9.37K (9366) - ScannerThreadsTotalWallClockTime: 3m59s - MaterializeTupleTime(*): 3m53s - ScannerThreadsSysTime: 525.914ms - ScannerThreadsUserTime: 18s403ms - ScannerThreadsVoluntaryContextSwitches: 108.34K (108341) - TotalRawHdfsReadTime(*): 881.170ms - TotalReadThroughput: 50.43 MB/sec Fragment F00: Instance 794eeaf500330be1:1d3f0940bab855e2 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 121.665ms, % non-child: 0.14%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(2s000ms): 106.06 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.89 MB, 141.06 MB, 141.16 MB, 141.16 MB, 141.08 MB, 141.03 MB, 141.11 MB, 141.17 MB, 141.11 MB, 141.09 MB, 53.32 MB, 53.27 MB, 62.66 MB, 91.58 MB, 91.49 MB, 91.56 MB, 91.46 MB, 91.53 MB, 77.54 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154624624) - PrepareTime: 332.739us - RowsProduced: 124.58M (124581263) - TotalCpuTime: 15m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 182.625ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 810.05 MB (849397187) - NetworkThroughput(*): 2.06 MB/sec - OverallThroughput: 9.43 MB/sec - PeakMemoryUsage: 516.00 KB (528384) - SerializeBatchTime: 9s411ms - ThriftTransmitTime(*): 6m32s - UncompressedRowBatchSize: 2.32 GB (2492111940) HDFS_SCAN_NODE (id=0):(Total: 580.101ms, non-child: 580.101ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 87.46 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 135.17 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 190.82 MB (200084917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200084917) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200084917) - DecompressionTime: 1s478ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.63 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 214.76 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.95K (5949) - ScannerThreadsTotalWallClockTime: 15m - MaterializeTupleTime(*): 14m58s - ScannerThreadsSysTime: 554.911ms - ScannerThreadsUserTime: 9s689ms - ScannerThreadsVoluntaryContextSwitches: 121.81K (121809) - TotalRawHdfsReadTime(*): 114.422ms - TotalReadThroughput: 2.19 MB/sec Instance 794eeaf500330be1:1d3f0940bab855eb (host=vb0224.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 153.052ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(2s000ms): 138.20 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.21 MB, 138.19 MB, 138.26 MB, 139.15 MB, 139.23 MB, 139.12 MB, 139.11 MB, 139.22 MB, 139.19 MB, 139.04 MB, 139.07 MB, 139.13 MB, 51.39 MB, 56.36 MB, 68.66 MB, 91.57 MB, 91.53 MB, 91.58 MB, 91.54 MB, 89.49 MB, 59.57 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.41 MB (146179848) - PerHostPeakMemUsage: 11.32 GB (12151761792) - PrepareTime: 291.914us - RowsProduced: 123.88M (123876516) - TotalCpuTime: 15m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s600ms - TotalStorageWaitTime: 237.073ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 806.92 MB (846118840) - NetworkThroughput(*): 1.38 MB/sec - OverallThroughput: 9.43 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s322ms - ThriftTransmitTime(*): 9m44s - UncompressedRowBatchSize: 2.31 GB (2478014240) HDFS_SCAN_NODE (id=0):(Total: 741.944ms, non-child: 741.944ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 120.86 MB, 142.06 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 189.77 MB (198987845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.77 MB (198987845) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.77 MB (198987845) - DecompressionTime: 1s445ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.98 MB (145733384) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 166.96 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.48K (6483) - ScannerThreadsTotalWallClockTime: 14m59s - MaterializeTupleTime(*): 14m57s - ScannerThreadsSysTime: 625.901ms - ScannerThreadsUserTime: 9s440ms - ScannerThreadsVoluntaryContextSwitches: 121.25K (121248) - TotalRawHdfsReadTime(*): 146.531ms - TotalReadThroughput: 2.18 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e6 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 162.572ms, % non-child: 0.19%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(2s000ms): 140.89 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 140.99 MB, 141.12 MB, 141.17 MB, 141.15 MB, 141.14 MB, 141.10 MB, 141.17 MB, 141.12 MB, 141.14 MB, 97.27 MB, 53.34 MB, 53.35 MB, 72.09 MB, 91.53 MB, 91.50 MB, 91.56 MB, 91.55 MB, 91.56 MB, 49.62 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.32 GB (12154722592) - PrepareTime: 175.559us - RowsProduced: 124.58M (124580622) - TotalCpuTime: 15m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s878ms - TotalStorageWaitTime: 192.400ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 810.51 MB (849879096) - NetworkThroughput(*): 1.12 MB/sec - OverallThroughput: 9.47 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s221ms - ThriftTransmitTime(*): 12m6s - UncompressedRowBatchSize: 2.32 GB (2492099116) HDFS_SCAN_NODE (id=0):(Total: 716.783ms, non-child: 716.783ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 116.60 MB, 153.71 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 190.81 MB (200077615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.81 MB (200077615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.81 MB (200077615) - DecompressionTime: 1s482ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 173.81 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.04K (6040) - ScannerThreadsTotalWallClockTime: 14m58s - MaterializeTupleTime(*): 14m56s - ScannerThreadsSysTime: 583.907ms - ScannerThreadsUserTime: 9s573ms - ScannerThreadsVoluntaryContextSwitches: 121.78K (121775) - TotalRawHdfsReadTime(*): 153.251ms - TotalReadThroughput: 2.21 MB/sec Instance 794eeaf500330be1:1d3f0940bab855ed (host=vb0218.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 151.020ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(2s000ms): 140.77 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.90 MB, 140.80 MB, 141.07 MB, 141.10 MB, 141.10 MB, 141.13 MB, 141.10 MB, 141.26 MB, 141.21 MB, 141.20 MB, 99.22 MB, 53.25 MB, 53.31 MB, 72.19 MB, 91.51 MB, 91.48 MB, 91.56 MB, 91.53 MB, 91.54 MB, 49.67 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154628456) - PrepareTime: 283.843us - RowsProduced: 124.58M (124581252) - TotalCpuTime: 15m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s741ms - TotalStorageWaitTime: 214.679ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 810.37 MB (849738319) - NetworkThroughput(*): 1.28 MB/sec - OverallThroughput: 9.47 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 10s251ms - ThriftTransmitTime(*): 10m32s - UncompressedRowBatchSize: 2.32 GB (2492111716) HDFS_SCAN_NODE (id=0):(Total: 696.158ms, non-child: 696.158ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 153.74 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 190.86 MB (200126121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.86 MB (200126121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.86 MB (200126121) - DecompressionTime: 1s585ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 178.96 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.67K (5669) - ScannerThreadsTotalWallClockTime: 14m57s - MaterializeTupleTime(*): 14m55s - ScannerThreadsSysTime: 545.911ms - ScannerThreadsUserTime: 9s849ms - ScannerThreadsVoluntaryContextSwitches: 121.82K (121818) - TotalRawHdfsReadTime(*): 144.667ms - TotalReadThroughput: 2.21 MB/sec Instance 794eeaf500330be1:1d3f0940bab855ea (host=vb0208.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 137.478ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(2s000ms): 140.55 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.84 MB, 141.09 MB, 141.15 MB, 141.21 MB, 141.21 MB, 141.17 MB, 141.13 MB, 141.02 MB, 141.06 MB, 87.21 MB, 53.38 MB, 53.33 MB, 83.00 MB, 91.51 MB, 91.47 MB, 91.56 MB, 91.53 MB, 91.51 MB, 47.67 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154614776) - PrepareTime: 327.134us - RowsProduced: 124.58M (124581487) - TotalCpuTime: 15m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m1s - TotalStorageWaitTime: 201.311ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 809.68 MB (849008606) - NetworkThroughput(*): 1.05 MB/sec - OverallThroughput: 9.49 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s385ms - ThriftTransmitTime(*): 12m54s - UncompressedRowBatchSize: 2.32 GB (2492116416) HDFS_SCAN_NODE (id=0):(Total: 704.577ms, non-child: 704.577ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 172.29 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 190.84 MB (200108048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108048) - DecompressionTime: 1s492ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 176.82 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.13K (6126) - ScannerThreadsTotalWallClockTime: 14m54s - MaterializeTupleTime(*): 14m52s - ScannerThreadsSysTime: 564.908ms - ScannerThreadsUserTime: 9s583ms - ScannerThreadsVoluntaryContextSwitches: 121.77K (121773) - TotalRawHdfsReadTime(*): 127.913ms - TotalReadThroughput: 2.21 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e1 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 97.419ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(2s000ms): 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.96 MB, 140.91 MB, 141.05 MB, 141.12 MB, 141.16 MB, 141.12 MB, 141.10 MB, 141.16 MB, 141.15 MB, 141.10 MB, 73.32 MB, 53.33 MB, 55.30 MB, 91.39 MB, 91.56 MB, 91.50 MB, 91.51 MB, 91.52 MB, 63.54 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293392) - PerHostPeakMemUsage: 11.32 GB (12154622592) - PrepareTime: 184.214us - RowsProduced: 124.58M (124581107) - TotalCpuTime: 15m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 195.157ms DataStreamSender (dst_id=4):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - BytesSent: 809.92 MB (849267123) - NetworkThroughput(*): 1.05 MB/sec - OverallThroughput: 9.52 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s344ms - ThriftTransmitTime(*): 12m54s - UncompressedRowBatchSize: 2.32 GB (2492108820) HDFS_SCAN_NODE (id=0):(Total: 584.425ms, non-child: 584.425ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 119.28 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 190.84 MB (200108797) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108797) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108797) - DecompressionTime: 1s329ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 213.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.44K (5440) - ScannerThreadsTotalWallClockTime: 14m50s - MaterializeTupleTime(*): 14m48s - ScannerThreadsSysTime: 401.933ms - ScannerThreadsUserTime: 8s578ms - ScannerThreadsVoluntaryContextSwitches: 121.77K (121770) - TotalRawHdfsReadTime(*): 123.772ms - TotalReadThroughput: 2.23 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e3 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 135.376ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(2s000ms): 140.47 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.61 MB, 140.65 MB, 141.05 MB, 141.13 MB, 141.15 MB, 141.13 MB, 141.10 MB, 141.16 MB, 141.12 MB, 141.15 MB, 101.19 MB, 53.33 MB, 53.33 MB, 71.65 MB, 85.53 MB, 85.55 MB, 85.52 MB, 85.61 MB, 85.51 MB, 30.55 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.46 MB (148334352) - PerHostPeakMemUsage: 11.32 GB (12154355792) - PrepareTime: 200.409us - RowsProduced: 122.02M (122016989) - TotalCpuTime: 15m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m1s - TotalStorageWaitTime: 227.573ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 789.38 MB (827727182) - NetworkThroughput(*): 1.16 MB/sec - OverallThroughput: 9.29 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 9s088ms - ThriftTransmitTime(*): 11m19s - UncompressedRowBatchSize: 2.27 GB (2440816436) HDFS_SCAN_NODE (id=0):(Total: 704.493ms, non-child: 704.493ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 151.79 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 186.98 MB (196063396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 186.98 MB (196063396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 186.98 MB (196063396) - DecompressionTime: 1s601ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 173.20 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.68K (6682) - ScannerThreadsTotalWallClockTime: 14m51s - MaterializeTupleTime(*): 14m49s - ScannerThreadsSysTime: 667.895ms - ScannerThreadsUserTime: 10s235ms - ScannerThreadsVoluntaryContextSwitches: 119.29K (119288) - TotalRawHdfsReadTime(*): 125.047ms - TotalReadThroughput: 2.17 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e4 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 154.180ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(2s000ms): 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.33 MB, 140.47 MB, 140.49 MB, 141.11 MB, 141.20 MB, 141.18 MB, 141.17 MB, 141.13 MB, 141.09 MB, 141.09 MB, 141.22 MB, 97.17 MB, 53.39 MB, 53.32 MB, 66.15 MB, 79.08 MB, 79.15 MB, 79.11 MB, 79.12 MB, 53.19 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154146896) - PrepareTime: 298.057us - RowsProduced: 117.66M (117660154) - TotalCpuTime: 15m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s488ms - TotalStorageWaitTime: 189.949ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 764.11 MB (801223834) - NetworkThroughput(*): 1.05 MB/sec - OverallThroughput: 9.05 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s859ms - ThriftTransmitTime(*): 12m5s - UncompressedRowBatchSize: 2.19 GB (2353662724) HDFS_SCAN_NODE (id=0):(Total: 738.513ms, non-child: 738.513ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 148.43 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 180.24 MB (188999805) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188999805) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188999805) - DecompressionTime: 1s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 159.32 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.00K (5998) - ScannerThreadsTotalWallClockTime: 14m39s - MaterializeTupleTime(*): 14m37s - ScannerThreadsSysTime: 597.904ms - ScannerThreadsUserTime: 9s194ms - ScannerThreadsVoluntaryContextSwitches: 115.03K (115027) - TotalRawHdfsReadTime(*): 137.858ms - TotalReadThroughput: 2.11 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e8 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 132.834ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(2s000ms): 140.88 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.13 MB, 141.04 MB, 141.06 MB, 141.08 MB, 141.17 MB, 141.11 MB, 141.17 MB, 141.05 MB, 141.13 MB, 141.14 MB, 101.21 MB, 53.32 MB, 53.24 MB, 64.20 MB, 75.13 MB, 75.12 MB, 75.13 MB, 75.09 MB, 51.01 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.32 GB (12154875544) - PrepareTime: 208.996us - RowsProduced: 116.10M (116100605) - TotalCpuTime: 15m - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m - TotalStorageWaitTime: 204.747ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 753.57 MB (790179128) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 8.93 MB/sec - PeakMemoryUsage: 516.00 KB (528384) - SerializeBatchTime: 9s531ms - ThriftTransmitTime(*): 9m39s - UncompressedRowBatchSize: 2.16 GB (2322465648) HDFS_SCAN_NODE (id=0):(Total: 669.033ms, non-child: 669.033ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 116.64 MB, 147.40 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 178.15 MB (186808443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.15 MB (186808443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.15 MB (186808443) - DecompressionTime: 1s416ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 173.53 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.11K (5110) - ScannerThreadsTotalWallClockTime: 14m35s - MaterializeTupleTime(*): 14m33s - ScannerThreadsSysTime: 526.913ms - ScannerThreadsUserTime: 8s925ms - ScannerThreadsVoluntaryContextSwitches: 113.52K (113519) - TotalRawHdfsReadTime(*): 132.723ms - TotalReadThroughput: 2.08 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e9 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 147.980ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(2s000ms): 140.39 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.46 MB, 140.49 MB, 141.12 MB, 141.03 MB, 141.17 MB, 141.12 MB, 141.09 MB, 141.17 MB, 141.10 MB, 141.03 MB, 119.25 MB, 53.21 MB, 53.34 MB, 68.37 MB, 79.10 MB, 79.12 MB, 79.15 MB, 79.16 MB, 55.17 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.32 GB (12154149344) - PrepareTime: 287.085us - RowsProduced: 117.66M (117659841) - TotalCpuTime: 15m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m1s - TotalStorageWaitTime: 223.867ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 763.57 MB (800659054) - NetworkThroughput(*): 1.05 MB/sec - OverallThroughput: 9.06 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s096ms - ThriftTransmitTime(*): 12m5s - UncompressedRowBatchSize: 2.19 GB (2353656452) HDFS_SCAN_NODE (id=0):(Total: 745.069ms, non-child: 745.069ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 148.44 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 180.24 MB (188993466) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188993466) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188993466) - DecompressionTime: 1s476ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 157.92 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.79K (5792) - ScannerThreadsTotalWallClockTime: 14m37s - MaterializeTupleTime(*): 14m35s - ScannerThreadsSysTime: 569.909ms - ScannerThreadsUserTime: 9s668ms - ScannerThreadsVoluntaryContextSwitches: 115.04K (115043) - TotalRawHdfsReadTime(*): 118.263ms - TotalReadThroughput: 2.11 MB/sec Instance 794eeaf500330be1:1d3f0940bab855df (host=vb0212.halxg.cloudera.com:22000):(Total: 1m24s, non-child: 101.187ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(2s000ms): 140.98 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.28 MB, 141.24 MB, 141.17 MB, 141.16 MB, 141.08 MB, 141.11 MB, 141.15 MB, 141.01 MB, 141.10 MB, 141.10 MB, 79.23 MB, 53.31 MB, 53.37 MB, 80.62 MB, 79.15 MB, 79.15 MB, 79.10 MB, 79.13 MB, 31.26 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317960) - PerHostPeakMemUsage: 11.32 GB (12155007552) - PrepareTime: 186.295us - RowsProduced: 117.66M (117659734) - TotalCpuTime: 14m49s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m5s - TotalStorageWaitTime: 169.327ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 762.76 MB (799809701) - NetworkThroughput(*): 1.21 MB/sec - OverallThroughput: 9.06 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s392ms - ThriftTransmitTime(*): 10m30s - UncompressedRowBatchSize: 2.19 GB (2353654312) HDFS_SCAN_NODE (id=0):(Total: 541.659ms, non-child: 541.659ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 174.95 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.26 - BytesRead: 180.25 MB (189010408) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010408) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010408) - DecompressionTime: 1s324ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 217.22 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.62K (5624) - ScannerThreadsTotalWallClockTime: 14m30s - MaterializeTupleTime(*): 14m29s - ScannerThreadsSysTime: 402.935ms - ScannerThreadsUserTime: 8s645ms - ScannerThreadsVoluntaryContextSwitches: 114.98K (114982) - TotalRawHdfsReadTime(*): 104.579ms - TotalReadThroughput: 2.12 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e5 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m24s, non-child: 128.605ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(2s000ms): 129.20 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.34 MB, 129.35 MB, 138.15 MB, 141.08 MB, 141.08 MB, 141.13 MB, 141.21 MB, 141.12 MB, 141.06 MB, 141.17 MB, 101.24 MB, 53.30 MB, 53.28 MB, 74.66 MB, 79.10 MB, 79.15 MB, 79.16 MB, 79.16 MB, 31.29 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.58 MB (148457584) - PerHostPeakMemUsage: 11.31 GB (12142490424) - PrepareTime: 206.738us - RowsProduced: 118.04M (118040847) - TotalCpuTime: 14m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 226.479ms DataStreamSender (dst_id=4):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesSent: 766.69 MB (803928369) - NetworkThroughput(*): 1.06 MB/sec - OverallThroughput: 9.12 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 8s118ms - ThriftTransmitTime(*): 12m3s - UncompressedRowBatchSize: 2.20 GB (2361278064) HDFS_SCAN_NODE (id=0):(Total: 657.764ms, non-child: 657.764ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 106.93 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 107.06 MB, 115.02 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 117.67 MB, 165.37 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 181.27 MB (190074309) - BytesReadDataNodeCache: 0 - BytesReadLocal: 181.27 MB (190074309) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181.27 MB (190074309) - DecompressionTime: 1s234ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.13 MB (147986544) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 179.46 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5.19K (5194) - ScannerThreadsTotalWallClockTime: 14m33s - MaterializeTupleTime(*): 14m31s - ScannerThreadsSysTime: 483.920ms - ScannerThreadsUserTime: 8s100ms - ScannerThreadsVoluntaryContextSwitches: 115.39K (115386) - TotalRawHdfsReadTime(*): 112.261ms - TotalReadThroughput: 2.13 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e0 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m24s, non-child: 97.947ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(2s000ms): 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 139.01 MB, 138.91 MB, 139.03 MB, 139.12 MB, 139.06 MB, 139.07 MB, 139.15 MB, 139.17 MB, 139.20 MB, 139.12 MB, 51.31 MB, 51.34 MB, 67.71 MB, 79.11 MB, 79.14 MB, 79.08 MB, 79.14 MB, 45.18 MB, 30.08 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.42 MB (146196232) - PerHostPeakMemUsage: 11.32 GB (12152623624) - PrepareTime: 296.424us - RowsProduced: 117.14M (117138819) - TotalCpuTime: 14m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 211.963ms DataStreamSender (dst_id=4):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - BytesSent: 758.80 MB (795664426) - NetworkThroughput(*): 1006.53 KB/sec - OverallThroughput: 9.10 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 6s516ms - ThriftTransmitTime(*): 12m51s - UncompressedRowBatchSize: 2.18 GB (2343233996) HDFS_SCAN_NODE (id=0):(Total: 538.218ms, non-child: 538.218ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 115.82 MB, 142.33 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 179.43 MB (188149319) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188149319) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188149319) - DecompressionTime: 1s133ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.02 MB (145774352) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 217.64 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.06K (5063) - ScannerThreadsTotalWallClockTime: 14m22s - MaterializeTupleTime(*): 14m20s - ScannerThreadsSysTime: 379.937ms - ScannerThreadsUserTime: 7s420ms - ScannerThreadsVoluntaryContextSwitches: 114.48K (114477) - TotalRawHdfsReadTime(*): 119.797ms - TotalReadThroughput: 2.14 MB/sec Instance 794eeaf500330be1:1d3f0940bab855e7 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 144.781ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(2s000ms): 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.35 MB, 140.46 MB, 141.09 MB, 141.01 MB, 141.14 MB, 141.20 MB, 141.03 MB, 141.13 MB, 141.05 MB, 141.06 MB, 101.21 MB, 53.32 MB, 53.38 MB, 59.84 MB, 66.71 MB, 66.83 MB, 66.74 MB, 56.78 MB, 26.84 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148285192) - PerHostPeakMemUsage: 11.32 GB (12154036392) - PrepareTime: 658.818us - RowsProduced: 110.74M (110738805) - TotalCpuTime: 14m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m - TotalStorageWaitTime: 250.507ms DataStreamSender (dst_id=4):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - BytesSent: 718.14 MB (753022111) - NetworkThroughput(*): 1018.15 KB/sec - OverallThroughput: 8.64 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 8s888ms - ThriftTransmitTime(*): 12m2s - UncompressedRowBatchSize: 2.06 GB (2215208704) HDFS_SCAN_NODE (id=0):(Total: 689.718ms, non-child: 689.718ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 143.15 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 169.66 MB (177900986) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177900986) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177900986) - DecompressionTime: 1s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 160.56 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 5.95K (5947) - ScannerThreadsTotalWallClockTime: 14m20s - MaterializeTupleTime(*): 14m18s - ScannerThreadsSysTime: 529.913ms - ScannerThreadsUserTime: 8s984ms - ScannerThreadsVoluntaryContextSwitches: 108.27K (108270) - TotalRawHdfsReadTime(*): 142.713ms - TotalReadThroughput: 2.02 MB/sec Instance 794eeaf500330be1:1d3f0940bab855ec (host=vb0222.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 85.251ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(2s000ms): 134.91 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.15 MB, 137.16 MB, 137.15 MB, 137.64 MB, 137.55 MB, 137.59 MB, 137.62 MB, 137.62 MB, 137.65 MB, 137.68 MB, 137.66 MB, 81.43 MB, 61.25 MB, 67.16 MB, 80.20 MB, 79.19 MB, 79.11 MB, 75.15 MB, 63.21 MB, 26.80 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.95 MB (144656144) - PerHostPeakMemUsage: 11.32 GB (12150688864) - PrepareTime: 165.674us - RowsProduced: 116.19M (116191050) - TotalCpuTime: 14m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 172.785ms DataStreamSender (dst_id=4):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - BytesSent: 752.75 MB (789314035) - NetworkThroughput(*): 2.45 MB/sec - OverallThroughput: 9.05 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 5s795ms - ThriftTransmitTime(*): 5m7s - UncompressedRowBatchSize: 2.16 GB (2324274896) HDFS_SCAN_NODE (id=0):(Total: 539.201ms, non-child: 539.201ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:99.4% 1:0% 2:0.5952% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 111.92 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 114.42 MB, 119.73 MB, 125.03 MB, 132.98 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 178.05 MB (186696773) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.05 MB (186696773) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.05 MB (186696773) - DecompressionTime: 1s249ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.58 MB (144267032) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 215.49 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.09K (5091) - ScannerThreadsTotalWallClockTime: 14m20s - MaterializeTupleTime(*): 14m18s - ScannerThreadsSysTime: 447.927ms - ScannerThreadsUserTime: 8s098ms - ScannerThreadsVoluntaryContextSwitches: 113.59K (113586) - TotalRawHdfsReadTime(*): 111.851ms - TotalReadThroughput: 2.12 MB/sec ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+-------+-----------+ | 07:AGGREGATE | 1 | 383.72ms | 0ns | 383.72ms | 1 | 1 | | 06:EXCHANGE | 1 | 205.23us | 0ns | 205.23us | 15 | 1 | | 03:AGGREGATE | 15 | 2.56s | 0ns | 2.86s | 15 | 1 | | 02:HASH JOIN | 15 | 59.79s | 0ns | 64.30s | 9.00B | 180.00M | | |--05:EXCHANGE | 15 | 9.74s | 0ns | 13.06s | 1.80B | 180.00M | | | 01:SCAN HDFS | 15 | 883.44ms | 0ns | 1.05s | 1.80B | 180.00M | | 04:EXCHANGE | 15 | 3.39s | 0ns | 3.81s | 1.80B | 1.80B | | 00:SCAN HDFS | 15 | 652.24ms | 0ns | 764.98ms | 1.80B | 1.80B | +-----------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=cb486002883e0421:e8f30b5b4f47dca0): Summary: Session ID: 8b426f0ac25b19cc:1c80a06cdc26180 Session Type: BEESWAX Start Time: 2016-04-21 21:28:12.836467000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:47518 Default Db: tpch_300_parquet Sql Statement: -- Description : Large fact to fact shuffle. -- Target test case : Shuffle large amuonts of data over the network. SELECT /* +straight_join */ count(*) FROM lineitem l1 JOIN /* +shuffle */ lineitem l2 ON l1.l_orderkey = l2.l_orderkey WHERE l2.l_partkey > 0 AND l2.l_suppkey > 0 AND l2.l_linenumber > 0 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=754.83MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = l2.l_orderkey | runtime filters: RF000 <- l2.l_orderkey | hosts=15 per-host-mem=402.83MB | tuple-ids=0,1 row-size=40B cardinality=179998909 | |--05:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l2.l_partkey > 0, l2.l_suppkey > 0, l2.l_linenumber > 0 | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 04:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=8B cardinality=1799989091 | 00:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=1799989091 ---------------- Estimated Per-Host Mem: 791496198 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 11.951ms - Analysis finished: 3.466ms (3.466ms) - Equivalence classes computed: 3.816ms (349.623us) - Single node plan created: 7.268ms (3.452ms) - Runtime filters computed: 7.401ms (133.136us) - Distributed plan created: 9.708ms (2.306ms) - Lineage info computed: 10.285ms (577.490us) - Planning finished: 11.951ms (1.665ms) Query Timeline: 1m32s - Start execution: 318.606us (318.606us) - Planning finished: 15.558ms (15.239ms) - Ready to start 45 remote fragments: 402.868ms (387.310ms) - All 45 remote fragments started: 419.908ms (17.040ms) - Rows available: 1m32s (1m31s) - First row fetched: 1m32s (28.699ms) ImpalaServer: - ClientFetchWaitTimer: 28.983ms - RowMaterializationTimer: 126.498us Execution Profile cb486002883e0421:e8f30b5b4f47dca0:(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 45, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 3ms, 99.9th %-ile: 14ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(11.32 GB) vb0222.halxg.cloudera.com:22000(11.32 GB) vb0224.halxg.cloudera.com:22000(11.32 GB) vb0208.halxg.cloudera.com:22000(11.32 GB) vb0230.halxg.cloudera.com:22000(11.32 GB) vb0228.halxg.cloudera.com:22000(11.32 GB) vb0220.halxg.cloudera.com:22000(11.32 GB) vb0206.halxg.cloudera.com:22000(11.32 GB) vb0232.halxg.cloudera.com:22000(11.32 GB) vb0216.halxg.cloudera.com:22000(11.32 GB) vb0226.halxg.cloudera.com:22000(11.32 GB) vb0234.halxg.cloudera.com:22000(11.32 GB) vb0214.halxg.cloudera.com:22000(11.32 GB) vb0212.halxg.cloudera.com:22000(11.32 GB) vb0204.halxg.cloudera.com:22000(11.32 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 1m32s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 9.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 383.208ms - RowsProduced: 1 (1) - TotalCpuTime: 638.283ms - TotalNetworkReceiveTime: 1m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 584.804ms, non-child: 584.804ms, % non-child: 100.00%) - CodegenTime: 1.740ms - CompileTime: 1.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 290 (290) - NumInstructions: 2.37K (2368) - OptimizationTime: 201.596ms - PrepareTime: 379.677ms AGGREGATION_NODE (id=7):(Total: 1m32s, non-child: 383.718ms, % non-child: 0.42%) ExecOption: Codegen Enabled - BuildTime: 17.249us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 1m31s, non-child: 205.231us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 33.920us - DeserializeRowBatchTimer: 108.477us - FirstBatchArrivalWaitTime: 1m31s - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m31s max:1m31s mean: 1m31s stddev:83.035ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006984089) - PerHostPeakMemUsage: 11.32 GB (12153620960) - PrepareTime: 154.574ms - RowsProduced: 1 (1) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 22s196ms - TotalNetworkSendTime: 299.606us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 428.063ms, non-child: 428.063ms, % non-child: 100.00%) - CodegenTime: 202.711us - CompileTime: 54.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 221.255ms - PrepareTime: 150.356ms DataStreamSender (dst_id=6):(Total: 42.827us, non-child: 42.827us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 65.37 KB/sec - OverallThroughput: 368.23 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.384us - ThriftTransmitTime(*): 247.103us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s559ms, % non-child: 2.80%) - BuildTime: 2s165ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 47.65 KB (48797) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 59s789ms, % non-child: 67.18%) - BuildPartitionTime: 11s622ms - BuildRows: 120.00M (119999272) - BuildRowsPartitioned: 120.00M (119999272) - BuildTime: 13s562ms - GetNewBlockTime: 6.701ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (119999272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s886ms - RowsReturned: 599.99M (599993698) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.605us EXCHANGE_NODE (id=5):(Total: 19s002ms, non-child: 19s002ms, % non-child: 100.00%) - BytesReceived: 2.49 GB (2671204544) - ConvertRowBatchTime: 3s853ms - DeserializeRowBatchTimer: 10s157ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 6.33 M/sec - SendersBlockedTimer: 885.022ms - SendersBlockedTotalTimer(*): 6s963ms EXCHANGE_NODE (id=4):(Total: 10s205ms, non-child: 10s205ms, % non-child: 100.00%) - BytesReceived: 762.04 MB (799060163) - ConvertRowBatchTime: 2s598ms - DeserializeRowBatchTimer: 3s150ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 11.98 M/sec - SendersBlockedTimer: 50s785ms - SendersBlockedTotalTimer(*): 10m10s Averaged Fragment F01:(Total: 29s385ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:27s870ms max:31s268ms mean: 29s846ms stddev:1s029ms execution rates: min:143.22 MB/sec max:148.94 MB/sec mean:147.20 MB/sec stddev:1.44 MB/sec num instances: 15 - AverageThreadTokens: 10.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1000.55 MB (1049153485) - PerHostPeakMemUsage: 4.76 GB (5111943473) - PrepareTime: 152.354ms - RowsProduced: 120.00M (119999272) - TotalCpuTime: 5m3s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s121ms - TotalStorageWaitTime: 470.830ms CodeGen:(Total: 362.334ms, non-child: 362.334ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 208.371ms - PrepareTime: 150.008ms DataStreamSender (dst_id=5):(Total: 28s546ms, non-child: 28s546ms, % non-child: 100.00%) - BytesSent: 2.49 GB (2671204544) - NetworkThroughput(*): 38.55 MB/sec - OverallThroughput: 89.24 MB/sec - PeakMemoryUsage: 435.40 KB (445845) - SerializeBatchTime: 16s609ms - ThriftTransmitTime(*): 1m6s - UncompressedRowBatchSize: 4.92 GB (5281141614) HDFS_SCAN_NODE (id=1):(Total: 883.437ms, non-child: 883.437ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 9.32 - BytesRead: 1.41 GB (1518658363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.41 GB (1518658363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.41 GB (1518658363) - DecompressionTime: 6s554ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1000.19 MB (1048771107) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 137.08 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.37K (13367) - ScannerThreadsTotalWallClockTime: 4m34s - MaterializeTupleTime(*): 4m27s - ScannerThreadsSysTime: 864.996ms - ScannerThreadsUserTime: 26s901ms - ScannerThreadsVoluntaryContextSwitches: 117.45K (117451) - TotalRawHdfsReadTime(*): 1s022ms - TotalReadThroughput: 48.66 MB/sec Averaged Fragment F00:(Total: 1m29s, non-child: 135.188ms, % non-child: 0.15%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 154.66 MB completion times: min:1m27s max:1m31s mean: 1m29s stddev:913.640ms execution rates: min:46.24 MB/sec max:50.73 MB/sec mean:49.12 MB/sec stddev:1.34 MB/sec num instances: 15 - AverageThreadTokens: 11.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.81 MB (147654749) - PerHostPeakMemUsage: 11.32 GB (12153620960) - PrepareTime: 238.235us - RowsProduced: 120.00M (119999272) - TotalCpuTime: 15m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 204.608ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 762.04 MB (799060163) - NetworkThroughput(*): 1.23 MB/sec - OverallThroughput: 8.61 MB/sec - PeakMemoryUsage: 535.73 KB (548590) - SerializeBatchTime: 8s432ms - ThriftTransmitTime(*): 10m37s - UncompressedRowBatchSize: 2.24 GB (2400454232) HDFS_SCAN_NODE (id=0):(Total: 652.236ms, non-child: 652.236ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s406ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.39 MB (147209465) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999272) - RowsReturnedRate: 186.94 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.77K (5772) - ScannerThreadsTotalWallClockTime: 15m20s - MaterializeTupleTime(*): 15m18s - ScannerThreadsSysTime: 506.317ms - ScannerThreadsUserTime: 9s075ms - ScannerThreadsVoluntaryContextSwitches: 117.32K (117319) - TotalRawHdfsReadTime(*): 123.292ms - TotalReadThroughput: 2.06 MB/sec Fragment F02: Instance cb486002883e0421:e8f30b5b4f47dcac (host=vb0230.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.04 MB, 561.82 MB, 817.81 MB, 1.11 GB, 1.42 GB, 1.71 GB, 2.03 GB, 2.31 GB, 2.61 GB, 2.93 GB, 3.21 GB, 3.55 GB, 3.81 GB, 4.13 GB, 4.42 GB, 4.69 GB, 5.28 GB, 6.08 GB, 6.84 GB, 7.60 GB, 8.41 GB, 9.23 GB, 10.05 GB, 10.87 GB, 11.15 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.17 GB, 11.16 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.27 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006961152) - PerHostPeakMemUsage: 11.32 GB (12154391968) - PrepareTime: 152.122ms - RowsProduced: 1 (1) - TotalCpuTime: 1m59s - TotalNetworkReceiveTime: 20s431ms - TotalNetworkSendTime: 359.202us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 411.840ms, non-child: 411.840ms, % non-child: 100.00%) - CodegenTime: 227.505us - CompileTime: 49.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 212.218ms - PrepareTime: 148.466ms DataStreamSender (dst_id=6):(Total: 39.927us, non-child: 39.927us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 55.06 KB/sec - OverallThroughput: 391.34 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.092us - ThriftTransmitTime(*): 283.761us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s398ms, % non-child: 2.62%) ExecOption: Codegen Enabled - BuildTime: 2s023ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.64 KB (51856) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m1s, % non-child: 69.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s261ms - BuildRows: 119.97M (119973827) - BuildRowsPartitioned: 119.97M (119973827) - BuildTime: 13s142ms - GetNewBlockTime: 7.079ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119973827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s802ms - RowsReturned: 599.85M (599847351) - RowsReturnedRate: 6.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.660us EXCHANGE_NODE (id=5):(Total: 18s358ms, non-child: 11s153ms, % non-child: 60.75%) BytesReceived(2s000ms): 60.60 MB, 240.20 MB, 404.36 MB, 574.50 MB, 745.63 MB, 921.47 MB, 1.07 GB, 1.23 GB, 1.40 GB, 1.57 GB, 1.74 GB, 1.91 GB, 2.07 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670609144) - ConvertRowBatchTime: 4s132ms - DeserializeRowBatchTimer: 10s865ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 6.54 M/sec - SendersBlockedTimer: 3s498ms - SendersBlockedTotalTimer(*): 27s674ms EXCHANGE_NODE (id=4):(Total: 9s203ms, non-child: 3s202ms, % non-child: 34.80%) BytesReceived(2s000ms): 9.01 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.15 MB, 10.20 MB, 23.15 MB, 65.55 MB, 104.19 MB, 142.01 MB, 180.59 MB, 219.37 MB, 257.73 MB, 296.28 MB, 334.93 MB, 374.01 MB, 413.35 MB, 453.34 MB, 493.10 MB, 532.71 MB, 573.16 MB, 613.54 MB, 654.23 MB, 694.95 MB, 736.03 MB, 760.13 MB - BytesReceived: 761.90 MB (798914186) - ConvertRowBatchTime: 2s391ms - DeserializeRowBatchTimer: 3s318ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119973827) - RowsReturnedRate: 13.04 M/sec - SendersBlockedTimer: 47s705ms - SendersBlockedTotalTimer(*): 11m55s Instance cb486002883e0421:e8f30b5b4f47dcb0 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 208.20 MB, 561.81 MB, 849.81 MB, 1.14 GB, 1.42 GB, 1.74 GB, 2.05 GB, 2.33 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.55 GB, 3.83 GB, 4.14 GB, 4.42 GB, 4.69 GB, 5.31 GB, 6.12 GB, 6.93 GB, 7.75 GB, 8.57 GB, 9.26 GB, 10.08 GB, 10.89 GB, 11.15 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.55 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154949912) - PrepareTime: 156.853ms - RowsProduced: 1 (1) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 21s994ms - TotalNetworkSendTime: 332.583us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 448.717ms, non-child: 448.717ms, % non-child: 100.00%) - CodegenTime: 180.327us - CompileTime: 74.491ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 220.430ms - PrepareTime: 150.509ms DataStreamSender (dst_id=6):(Total: 41.545us, non-child: 41.545us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 53.32 KB/sec - OverallThroughput: 376.10 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.385us - ThriftTransmitTime(*): 293.033us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s381ms, % non-child: 2.60%) ExecOption: Codegen Enabled - BuildTime: 2s007ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.86 KB (46960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m, % non-child: 67.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s805ms - BuildRows: 120.01M (120007559) - BuildRowsPartitioned: 120.01M (120007559) - BuildTime: 13s232ms - GetNewBlockTime: 6.493ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120007559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s802ms - RowsReturned: 600.04M (600043355) - RowsReturnedRate: 6.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.362us EXCHANGE_NODE (id=5):(Total: 18s806ms, non-child: 8s624ms, % non-child: 45.86%) BytesReceived(2s000ms): 70.85 MB, 251.91 MB, 415.92 MB, 586.99 MB, 757.39 MB, 933.61 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.58 GB, 1.75 GB, 1.92 GB, 2.09 GB, 2.25 GB, 2.41 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671410211) - ConvertRowBatchTime: 3s937ms - DeserializeRowBatchTimer: 9s087ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 6.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s164ms, non-child: 3s293ms, % non-child: 32.40%) BytesReceived(2s000ms): 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.11 MB, 10.16 MB, 25.46 MB, 68.50 MB, 106.91 MB, 144.83 MB, 183.51 MB, 222.23 MB, 260.63 MB, 299.21 MB, 337.86 MB, 376.97 MB, 416.28 MB, 456.32 MB, 496.10 MB, 535.70 MB, 576.23 MB, 616.58 MB, 657.25 MB, 697.95 MB, 739.12 MB, 760.71 MB - BytesReceived: 762.09 MB (799109445) - ConvertRowBatchTime: 2s477ms - DeserializeRowBatchTimer: 3s301ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120007559) - RowsReturnedRate: 11.81 M/sec - SendersBlockedTimer: 47s743ms - SendersBlockedTotalTimer(*): 11m8s Instance cb486002883e0421:e8f30b5b4f47dcaf (host=vb0222.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 167.70 MB, 529.81 MB, 817.79 MB, 1.08 GB, 1.41 GB, 1.70 GB, 2.02 GB, 2.30 GB, 2.61 GB, 2.92 GB, 3.21 GB, 3.52 GB, 3.81 GB, 4.11 GB, 4.41 GB, 4.62 GB, 5.29 GB, 6.11 GB, 6.94 GB, 7.78 GB, 8.62 GB, 9.46 GB, 10.16 GB, 10.77 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.48 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12151049736) - PrepareTime: 156.047ms - RowsProduced: 1 (1) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 22s931ms - TotalNetworkSendTime: 390.489us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 438.005ms, non-child: 438.005ms, % non-child: 100.00%) - CodegenTime: 199.029us - CompileTime: 54.417ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 230.157ms - PrepareTime: 152.138ms DataStreamSender (dst_id=6):(Total: 42.379us, non-child: 42.379us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 48.61 KB/sec - OverallThroughput: 368.70 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.310us - ThriftTransmitTime(*): 321.403us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s578ms, % non-child: 2.81%) ExecOption: Codegen Enabled - BuildTime: 2s181ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 51.62 KB (52864) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s082ms, % non-child: 66.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s505ms - BuildRows: 120.02M (120023171) - BuildRowsPartitioned: 120.02M (120023171) - BuildTime: 13s205ms - GetNewBlockTime: 6.451ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120023171) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s435ms - RowsReturned: 600.12M (600120459) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.445us EXCHANGE_NODE (id=5):(Total: 19s133ms, non-child: 7s719ms, % non-child: 40.34%) BytesReceived(2s000ms): 55.69 MB, 234.19 MB, 398.98 MB, 568.47 MB, 740.22 MB, 915.98 MB, 1.07 GB, 1.23 GB, 1.40 GB, 1.56 GB, 1.73 GB, 1.90 GB, 2.07 GB, 2.23 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671740898) - ConvertRowBatchTime: 3s895ms - DeserializeRowBatchTimer: 8s211ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 6.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s870ms, non-child: 3s451ms, % non-child: 31.75%) BytesReceived(2s000ms): 8.16 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 10.17 MB, 21.98 MB, 64.17 MB, 103.01 MB, 140.79 MB, 179.36 MB, 218.17 MB, 256.54 MB, 295.16 MB, 333.84 MB, 372.91 MB, 412.18 MB, 452.12 MB, 491.90 MB, 531.50 MB, 571.94 MB, 612.35 MB, 653.08 MB, 693.80 MB, 734.80 MB, 760.20 MB - BytesReceived: 762.16 MB (799181652) - ConvertRowBatchTime: 2s627ms - DeserializeRowBatchTimer: 3s248ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120023171) - RowsReturnedRate: 11.04 M/sec - SendersBlockedTimer: 48s202ms - SendersBlockedTotalTimer(*): 9m38s Instance cb486002883e0421:e8f30b5b4f47dcae (host=vb0224.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 204.04 MB, 561.82 MB, 817.86 MB, 1.11 GB, 1.42 GB, 1.70 GB, 2.03 GB, 2.30 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.54 GB, 3.83 GB, 4.12 GB, 4.42 GB, 4.69 GB, 5.31 GB, 6.11 GB, 6.85 GB, 7.58 GB, 8.38 GB, 9.19 GB, 9.86 GB, 10.66 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.86 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12007010304) - PerHostPeakMemUsage: 11.32 GB (12152352304) - PrepareTime: 156.008ms - RowsProduced: 1 (1) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 22s846ms - TotalNetworkSendTime: 287.599us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 418.347ms, non-child: 418.347ms, % non-child: 100.00%) - CodegenTime: 185.243us - CompileTime: 52.062ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 212.739ms - PrepareTime: 152.335ms DataStreamSender (dst_id=6):(Total: 43.415us, non-child: 43.415us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 63.78 KB/sec - OverallThroughput: 359.90 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.984us - ThriftTransmitTime(*): 244.973us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s858ms, % non-child: 3.12%) ExecOption: Codegen Enabled - BuildTime: 2s427ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 42.59 KB (43616) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 58s229ms, % non-child: 65.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s484ms - BuildRows: 119.94M (119935810) - BuildRowsPartitioned: 119.94M (119935810) - BuildTime: 13s563ms - GetNewBlockTime: 6.674ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.94M (119935810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s497ms - RowsReturned: 599.67M (599668002) - RowsReturnedRate: 6.76 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.691us EXCHANGE_NODE (id=5):(Total: 18s170ms, non-child: 8s058ms, % non-child: 44.35%) BytesReceived(2s000ms): 62.21 MB, 242.26 MB, 406.30 MB, 576.31 MB, 747.25 MB, 923.24 MB, 1.07 GB, 1.23 GB, 1.40 GB, 1.57 GB, 1.74 GB, 1.91 GB, 2.07 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2669827338) - ConvertRowBatchTime: 4s166ms - DeserializeRowBatchTimer: 8s238ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 6.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 12s372ms, non-child: 3s808ms, % non-child: 30.78%) BytesReceived(2s000ms): 9.25 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.12 MB, 10.15 MB, 23.50 MB, 66.01 MB, 104.60 MB, 142.40 MB, 180.96 MB, 219.68 MB, 258.05 MB, 296.58 MB, 335.22 MB, 374.32 MB, 413.57 MB, 453.58 MB, 493.40 MB, 532.98 MB, 573.41 MB, 613.79 MB, 654.43 MB, 695.15 MB, 736.24 MB, 759.94 MB - BytesReceived: 761.64 MB (798642385) - ConvertRowBatchTime: 2s947ms - DeserializeRowBatchTimer: 3s351ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.94M (119935810) - RowsReturnedRate: 9.69 M/sec - SendersBlockedTimer: 48s353ms - SendersBlockedTotalTimer(*): 11m17s Instance cb486002883e0421:e8f30b5b4f47dcab (host=vb0228.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 208.90 MB, 563.57 MB, 831.83 MB, 1.14 GB, 1.42 GB, 1.74 GB, 2.05 GB, 2.33 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.55 GB, 3.83 GB, 4.14 GB, 4.42 GB, 4.69 GB, 5.32 GB, 6.14 GB, 6.97 GB, 7.80 GB, 8.63 GB, 9.47 GB, 10.30 GB, 11.04 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12150060008) - PrepareTime: 151.472ms - RowsProduced: 1 (1) - TotalCpuTime: 1m55s - TotalNetworkReceiveTime: 23s515ms - TotalNetworkSendTime: 321.624us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 414.185ms, non-child: 414.185ms, % non-child: 100.00%) - CodegenTime: 177.475us - CompileTime: 49.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 216.211ms - PrepareTime: 147.533ms DataStreamSender (dst_id=6):(Total: 39.704us, non-child: 39.704us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 65.72 KB/sec - OverallThroughput: 393.54 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.263us - ThriftTransmitTime(*): 237.751us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s483ms, % non-child: 2.71%) ExecOption: Codegen Enabled - BuildTime: 2s103ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.53 KB (49696) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 58s978ms, % non-child: 66.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s076ms - BuildRows: 119.97M (119971522) - BuildRowsPartitioned: 119.97M (119971522) - BuildTime: 12s554ms - GetNewBlockTime: 6.533ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119971522) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s856ms - RowsReturned: 599.89M (599885934) - RowsReturnedRate: 6.73 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.530us EXCHANGE_NODE (id=5):(Total: 19s566ms, non-child: 11s038ms, % non-child: 56.41%) BytesReceived(2s000ms): 67.77 MB, 248.90 MB, 413.04 MB, 583.83 MB, 754.19 MB, 930.55 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.58 GB, 1.74 GB, 1.91 GB, 2.08 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670567292) - ConvertRowBatchTime: 3s642ms - DeserializeRowBatchTimer: 11s940ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 6.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s582ms, non-child: 3s250ms, % non-child: 30.71%) BytesReceived(2s000ms): 10.03 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.16 MB, 24.79 MB, 67.64 MB, 106.09 MB, 143.99 MB, 182.61 MB, 221.30 MB, 259.73 MB, 298.31 MB, 336.89 MB, 375.99 MB, 415.30 MB, 455.36 MB, 495.22 MB, 534.81 MB, 575.27 MB, 615.58 MB, 656.31 MB, 697.00 MB, 738.16 MB - BytesReceived: 761.88 MB (798884695) - ConvertRowBatchTime: 2s441ms - DeserializeRowBatchTimer: 3s268ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119971522) - RowsReturnedRate: 11.34 M/sec - SendersBlockedTimer: 47s033ms - SendersBlockedTotalTimer(*): 11m45s Instance cb486002883e0421:e8f30b5b4f47dcad (host=vb0208.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 206.25 MB, 561.81 MB, 817.84 MB, 1.14 GB, 1.42 GB, 1.73 GB, 2.05 GB, 2.32 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.55 GB, 3.83 GB, 4.14 GB, 4.42 GB, 4.69 GB, 5.31 GB, 6.12 GB, 6.95 GB, 7.78 GB, 8.60 GB, 9.43 GB, 10.26 GB, 11.01 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.55 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154443856) - PrepareTime: 157.375ms - RowsProduced: 1 (1) - TotalCpuTime: 1m51s - TotalNetworkReceiveTime: 27s112ms - TotalNetworkSendTime: 254.394us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 461.087ms, non-child: 461.087ms, % non-child: 100.00%) - CodegenTime: 182.383us - CompileTime: 59.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 247.738ms - PrepareTime: 152.363ms DataStreamSender (dst_id=6):(Total: 46.280us, non-child: 46.280us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 84.05 KB/sec - OverallThroughput: 337.62 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.153us - ThriftTransmitTime(*): 185.897us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s771ms, % non-child: 3.03%) ExecOption: Codegen Enabled - BuildTime: 2s377ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 45.39 KB (46480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 54s873ms, % non-child: 61.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s133ms - BuildRows: 119.99M (119985550) - BuildRowsPartitioned: 119.99M (119985550) - BuildTime: 12s826ms - GetNewBlockTime: 5.876ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.99M (119985550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s596ms - RowsReturned: 599.88M (599876718) - RowsReturnedRate: 6.75 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.419us EXCHANGE_NODE (id=5):(Total: 20s492ms, non-child: 6s720ms, % non-child: 32.79%) BytesReceived(2s000ms): 65.46 MB, 246.24 MB, 410.36 MB, 580.96 MB, 751.63 MB, 927.87 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.58 GB, 1.74 GB, 1.91 GB, 2.08 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670917579) - ConvertRowBatchTime: 3s411ms - DeserializeRowBatchTimer: 7s611ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 13s458ms, non-child: 3s814ms, % non-child: 28.34%) BytesReceived(2s000ms): 9.78 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 10.14 MB, 24.29 MB, 67.05 MB, 105.56 MB, 143.43 MB, 182.03 MB, 220.74 MB, 259.12 MB, 297.66 MB, 336.32 MB, 375.46 MB, 414.79 MB, 454.78 MB, 494.58 MB, 534.17 MB, 574.64 MB, 614.97 MB, 655.69 MB, 696.43 MB, 737.63 MB, 760.41 MB - BytesReceived: 761.98 MB (798996447) - ConvertRowBatchTime: 2s914ms - DeserializeRowBatchTimer: 3s525ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.99M (119985550) - RowsReturnedRate: 8.92 M/sec - SendersBlockedTimer: 47s242ms - SendersBlockedTotalTimer(*): 8m39s Instance cb486002883e0421:e8f30b5b4f47dca7 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.45 MB, 511.80 MB, 817.82 MB, 1.08 GB, 1.39 GB, 1.69 GB, 2.02 GB, 2.30 GB, 2.60 GB, 2.91 GB, 3.19 GB, 3.51 GB, 3.80 GB, 4.11 GB, 4.39 GB, 4.62 GB, 5.27 GB, 6.02 GB, 6.76 GB, 7.57 GB, 8.38 GB, 9.20 GB, 9.96 GB, 10.71 GB, 11.15 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.16 GB, 11.15 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.38 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154512840) - PrepareTime: 153.098ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 21s288ms - TotalNetworkSendTime: 296.312us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 448.918ms, non-child: 448.918ms, % non-child: 100.00%) - CodegenTime: 186.351us - CompileTime: 77.168ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 221.185ms - PrepareTime: 149.277ms DataStreamSender (dst_id=6):(Total: 40.471us, non-child: 40.471us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 65.26 KB/sec - OverallThroughput: 386.08 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.119us - ThriftTransmitTime(*): 239.424us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s354ms, % non-child: 2.57%) ExecOption: Codegen Enabled - BuildTime: 2s011ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.73 KB (50928) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m1s, % non-child: 68.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s766ms - BuildRows: 120.00M (120003296) - BuildRowsPartitioned: 120.00M (120003296) - BuildTime: 13s407ms - GetNewBlockTime: 7.028ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31s421ms - RowsReturned: 599.99M (599987706) - RowsReturnedRate: 6.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.565us EXCHANGE_NODE (id=5):(Total: 18s839ms, non-child: 9s973ms, % non-child: 52.94%) BytesReceived(2s000ms): 50.56 MB, 227.51 MB, 392.80 MB, 561.81 MB, 733.68 MB, 909.03 MB, 1.06 GB, 1.22 GB, 1.39 GB, 1.56 GB, 1.73 GB, 1.89 GB, 2.06 GB, 2.22 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671302664) - ConvertRowBatchTime: 3s931ms - DeserializeRowBatchTimer: 10s317ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 6.37 M/sec - SendersBlockedTimer: 682.831ms - SendersBlockedTotalTimer(*): 5s575ms EXCHANGE_NODE (id=4):(Total: 9s324ms, non-child: 3s203ms, % non-child: 34.36%) BytesReceived(2s000ms): 7.59 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.16 MB, 20.71 MB, 62.55 MB, 101.55 MB, 139.37 MB, 177.93 MB, 216.66 MB, 255.09 MB, 293.62 MB, 332.23 MB, 371.30 MB, 410.53 MB, 450.54 MB, 490.40 MB, 529.96 MB, 570.30 MB, 610.67 MB, 651.34 MB, 692.07 MB, 733.10 MB, 759.87 MB - BytesReceived: 762.05 MB (799071464) - ConvertRowBatchTime: 2s379ms - DeserializeRowBatchTimer: 3s429ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003296) - RowsReturnedRate: 12.87 M/sec - SendersBlockedTimer: 47s880ms - SendersBlockedTotalTimer(*): 11m10s Instance cb486002883e0421:e8f30b5b4f47dca5 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 177.74 MB, 532.28 MB, 817.82 MB, 1.08 GB, 1.40 GB, 1.70 GB, 2.02 GB, 2.30 GB, 2.61 GB, 2.92 GB, 3.20 GB, 3.52 GB, 3.81 GB, 4.11 GB, 4.40 GB, 4.62 GB, 5.28 GB, 5.94 GB, 6.71 GB, 7.38 GB, 8.16 GB, 8.82 GB, 9.61 GB, 10.27 GB, 10.99 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.65 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154787912) - PrepareTime: 159.174ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 22s254ms - TotalNetworkSendTime: 189.616us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 401.039ms, non-child: 401.039ms, % non-child: 100.00%) - CodegenTime: 170.501us - CompileTime: 30.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 214.314ms - PrepareTime: 155.546ms DataStreamSender (dst_id=6):(Total: 42.544us, non-child: 42.544us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 97.74 KB/sec - OverallThroughput: 367.27 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.634us - ThriftTransmitTime(*): 159.858us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s663ms, % non-child: 2.91%) ExecOption: Codegen Enabled - BuildTime: 2s245ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 44.58 KB (45648) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 59s935ms, % non-child: 67.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s857ms - BuildRows: 120.01M (120006973) - BuildRowsPartitioned: 120.01M (120006973) - BuildTime: 14s530ms - GetNewBlockTime: 6.523ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29s758ms - RowsReturned: 600.07M (600074405) - RowsReturnedRate: 6.75 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.521us EXCHANGE_NODE (id=5):(Total: 19s802ms, non-child: 11s135ms, % non-child: 56.24%) BytesReceived(2s000ms): 55.19 MB, 233.45 MB, 398.05 MB, 567.50 MB, 739.14 MB, 914.84 MB, 1.06 GB, 1.23 GB, 1.40 GB, 1.56 GB, 1.73 GB, 1.90 GB, 2.07 GB, 2.23 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671350536) - ConvertRowBatchTime: 3s544ms - DeserializeRowBatchTimer: 12s036ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 107.050ms - SendersBlockedTotalTimer(*): 879.362ms EXCHANGE_NODE (id=4):(Total: 9s118ms, non-child: 3s305ms, % non-child: 36.25%) BytesReceived(2s000ms): 8.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.06 MB, 10.11 MB, 21.79 MB, 63.92 MB, 102.76 MB, 140.57 MB, 179.13 MB, 217.91 MB, 256.38 MB, 295.01 MB, 333.66 MB, 372.74 MB, 412.06 MB, 452.09 MB, 491.92 MB, 531.48 MB, 571.86 MB, 612.21 MB, 652.88 MB, 693.63 MB, 734.62 MB, 760.08 MB - BytesReceived: 762.06 MB (799078472) - ConvertRowBatchTime: 2s576ms - DeserializeRowBatchTimer: 2s916ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006973) - RowsReturnedRate: 13.16 M/sec - SendersBlockedTimer: 49s383ms - SendersBlockedTotalTimer(*): 5m4s Instance cb486002883e0421:e8f30b5b4f47dca2 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 209.79 MB, 561.83 MB, 849.78 MB, 1.14 GB, 1.42 GB, 1.74 GB, 2.05 GB, 2.33 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.55 GB, 3.83 GB, 4.14 GB, 4.42 GB, 4.69 GB, 5.38 GB, 6.14 GB, 6.97 GB, 7.79 GB, 8.61 GB, 9.44 GB, 10.27 GB, 11.02 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006961152) - PerHostPeakMemUsage: 11.32 GB (12154689048) - PrepareTime: 153.186ms - RowsProduced: 1 (1) - TotalCpuTime: 1m56s - TotalNetworkReceiveTime: 22s071ms - TotalNetworkSendTime: 327.230us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 399.367ms, non-child: 399.367ms, % non-child: 100.00%) - CodegenTime: 185.942us - CompileTime: 39.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 208.810ms - PrepareTime: 149.467ms DataStreamSender (dst_id=6):(Total: 34.124us, non-child: 34.124us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 58.38 KB/sec - OverallThroughput: 457.89 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.193us - ThriftTransmitTime(*): 267.629us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s516ms, % non-child: 2.75%) ExecOption: Codegen Enabled - BuildTime: 2s128ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.97 KB (50144) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 59s994ms, % non-child: 67.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s249ms - BuildRows: 120.01M (120013947) - BuildRowsPartitioned: 120.01M (120013947) - BuildTime: 12s751ms - GetNewBlockTime: 7.048ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120013947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s610ms - RowsReturned: 600.02M (600017737) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.421us EXCHANGE_NODE (id=5):(Total: 18s406ms, non-child: 8s577ms, % non-child: 46.60%) BytesReceived(2s000ms): 69.12 MB, 250.50 MB, 414.61 MB, 585.63 MB, 755.96 MB, 932.37 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.58 GB, 1.75 GB, 1.92 GB, 2.08 GB, 2.25 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671498627) - ConvertRowBatchTime: 3s950ms - DeserializeRowBatchTimer: 9s023ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 6.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s602ms, non-child: 3s130ms, % non-child: 29.52%) BytesReceived(2s000ms): 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.11 MB, 10.15 MB, 25.07 MB, 68.03 MB, 106.48 MB, 144.39 MB, 183.02 MB, 221.75 MB, 260.14 MB, 298.65 MB, 337.31 MB, 376.46 MB, 415.78 MB, 455.83 MB, 495.66 MB, 535.24 MB, 575.78 MB, 616.19 MB, 656.95 MB, 697.62 MB, 738.77 MB - BytesReceived: 762.09 MB (799113759) - ConvertRowBatchTime: 2s445ms - DeserializeRowBatchTimer: 2s903ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120013947) - RowsReturnedRate: 11.32 M/sec - SendersBlockedTimer: 47s218ms - SendersBlockedTotalTimer(*): 8m39s Instance cb486002883e0421:e8f30b5b4f47dca9 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.36 MB, 497.79 MB, 817.84 MB, 1.08 GB, 1.39 GB, 1.67 GB, 1.99 GB, 2.30 GB, 2.58 GB, 2.89 GB, 3.17 GB, 3.49 GB, 3.80 GB, 4.09 GB, 4.37 GB, 4.62 GB, 5.19 GB, 5.90 GB, 6.55 GB, 7.26 GB, 7.97 GB, 8.62 GB, 9.34 GB, 10.04 GB, 10.70 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.38 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154777136) - PrepareTime: 150.702ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 23s087ms - TotalNetworkSendTime: 359.936us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.027ms, non-child: 436.027ms, % non-child: 100.00%) - CodegenTime: 397.463us - CompileTime: 62.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 225.619ms - PrepareTime: 146.666ms DataStreamSender (dst_id=6):(Total: 54.524us, non-child: 54.524us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 49.23 KB/sec - OverallThroughput: 286.57 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.563us - ThriftTransmitTime(*): 317.386us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s690ms, % non-child: 2.94%) ExecOption: Codegen Enabled - BuildTime: 2s298ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 48.19 KB (49344) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 58s816ms, % non-child: 66.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s766ms - BuildRows: 120.01M (120006731) - BuildRowsPartitioned: 120.01M (120006731) - BuildTime: 15s262ms - GetNewBlockTime: 5.124ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.01M (120006731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s010ms - RowsReturned: 600.08M (600076679) - RowsReturnedRate: 6.76 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.935us EXCHANGE_NODE (id=5):(Total: 19s859ms, non-child: 8s339ms, % non-child: 41.99%) BytesReceived(2s000ms): 86.02 MB, 266.06 MB, 429.38 MB, 601.45 MB, 771.48 MB, 948.42 MB, 1.10 GB, 1.26 GB, 1.43 GB, 1.60 GB, 1.76 GB, 1.93 GB, 2.10 GB, 2.26 GB, 2.42 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671357019) - ConvertRowBatchTime: 3s540ms - DeserializeRowBatchTimer: 9s330ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 10s137ms, non-child: 3s737ms, % non-child: 36.87%) BytesReceived(2s000ms): 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.08 MB, 10.14 MB, 28.66 MB, 71.79 MB, 109.94 MB, 147.86 MB, 186.52 MB, 225.20 MB, 263.64 MB, 302.25 MB, 340.98 MB, 380.16 MB, 419.53 MB, 459.59 MB, 499.29 MB, 538.99 MB, 579.53 MB, 619.93 MB, 660.66 MB, 701.37 MB, 742.24 MB - BytesReceived: 762.08 MB (799101206) - ConvertRowBatchTime: 2s849ms - DeserializeRowBatchTimer: 3s539ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.01M (120006731) - RowsReturnedRate: 11.84 M/sec - SendersBlockedTimer: 50s110ms - SendersBlockedTotalTimer(*): 7m41s Instance cb486002883e0421:e8f30b5b4f47dca4 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.80 MB, 529.80 MB, 817.81 MB, 1.08 GB, 1.39 GB, 1.70 GB, 2.02 GB, 2.30 GB, 2.61 GB, 2.92 GB, 3.20 GB, 3.52 GB, 3.80 GB, 4.11 GB, 4.40 GB, 4.62 GB, 5.29 GB, 6.10 GB, 6.95 GB, 7.80 GB, 8.71 GB, 9.61 GB, 10.46 GB, 11.12 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.17 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 11.18 GB, 9.76 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154977328) - PrepareTime: 150.796ms - RowsProduced: 1 (1) - TotalCpuTime: 1m56s - TotalNetworkReceiveTime: 21s226ms - TotalNetworkSendTime: 252.730us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 414.094ms, non-child: 414.094ms, % non-child: 100.00%) - CodegenTime: 153.394us - CompileTime: 48.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 217.539ms - PrepareTime: 147.133ms DataStreamSender (dst_id=6):(Total: 46.546us, non-child: 46.546us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 72.31 KB/sec - OverallThroughput: 335.69 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.284us - ThriftTransmitTime(*): 216.071us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s415ms, % non-child: 2.64%) ExecOption: Codegen Enabled - BuildTime: 1s985ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 49.95 KB (51152) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m, % non-child: 68.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s571ms - BuildRows: 120.03M (120031620) - BuildRowsPartitioned: 120.03M (120031620) - BuildTime: 12s007ms - GetNewBlockTime: 7.557ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.03M (120031620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 33s065ms - RowsReturned: 600.18M (600179722) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.351us EXCHANGE_NODE (id=5):(Total: 19s090ms, non-child: 7s501ms, % non-child: 39.29%) BytesReceived(2s000ms): 52.88 MB, 230.43 MB, 395.50 MB, 564.85 MB, 736.75 MB, 912.42 MB, 1.06 GB, 1.22 GB, 1.40 GB, 1.56 GB, 1.73 GB, 1.90 GB, 2.07 GB, 2.23 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671943652) - ConvertRowBatchTime: 3s993ms - DeserializeRowBatchTimer: 7s771ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 6.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 8s994ms, non-child: 2s908ms, % non-child: 32.34%) BytesReceived(2s000ms): 7.68 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.12 MB, 10.16 MB, 21.26 MB, 63.21 MB, 102.12 MB, 139.97 MB, 178.57 MB, 217.37 MB, 255.77 MB, 294.35 MB, 333.04 MB, 372.11 MB, 411.40 MB, 451.40 MB, 491.24 MB, 530.79 MB, 571.21 MB, 611.65 MB, 652.31 MB, 693.03 MB, 734.04 MB, 760.17 MB - BytesReceived: 762.25 MB (799274728) - ConvertRowBatchTime: 2s325ms - DeserializeRowBatchTimer: 2s004ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.03M (120031620) - RowsReturnedRate: 13.35 M/sec - SendersBlockedTimer: 1m20s - SendersBlockedTotalTimer(*): 17m37s Instance cb486002883e0421:e8f30b5b4f47dca3 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 166.63 MB, 529.80 MB, 817.77 MB, 1.08 GB, 1.41 GB, 1.71 GB, 2.03 GB, 2.30 GB, 2.61 GB, 2.93 GB, 3.19 GB, 3.52 GB, 3.80 GB, 4.11 GB, 4.41 GB, 4.62 GB, 5.28 GB, 6.01 GB, 6.73 GB, 7.46 GB, 8.18 GB, 8.92 GB, 9.64 GB, 10.36 GB, 11.02 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 9.65 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006961152) - PerHostPeakMemUsage: 11.32 GB (12152383848) - PrepareTime: 152.568ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 22s160ms - TotalNetworkSendTime: 290.720us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 426.879ms, non-child: 426.879ms, % non-child: 100.00%) - CodegenTime: 183.026us - CompileTime: 62.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 214.097ms - PrepareTime: 148.925ms DataStreamSender (dst_id=6):(Total: 42.945us, non-child: 42.945us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 66.51 KB/sec - OverallThroughput: 363.84 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.876us - ThriftTransmitTime(*): 234.923us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s561ms, % non-child: 2.80%) ExecOption: Codegen Enabled - BuildTime: 2s169ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 50.77 KB (51984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 1m, % non-child: 67.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 10s744ms - BuildRows: 120.02M (120017458) - BuildRowsPartitioned: 120.02M (120017458) - BuildTime: 14s246ms - GetNewBlockTime: 6.211ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.02M (120017458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s412ms - RowsReturned: 600.08M (600083546) - RowsReturnedRate: 6.75 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.599us EXCHANGE_NODE (id=5):(Total: 19s885ms, non-child: 11s903ms, % non-child: 59.86%) BytesReceived(2s000ms): 54.16 MB, 232.08 MB, 396.82 MB, 566.12 MB, 737.71 MB, 913.43 MB, 1.06 GB, 1.22 GB, 1.40 GB, 1.56 GB, 1.73 GB, 1.90 GB, 2.07 GB, 2.23 GB, 2.39 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671603500) - ConvertRowBatchTime: 3s514ms - DeserializeRowBatchTimer: 12s430ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 2s873ms - SendersBlockedTotalTimer(*): 23s184ms EXCHANGE_NODE (id=4):(Total: 8s844ms, non-child: 3s189ms, % non-child: 36.07%) BytesReceived(2s000ms): 7.89 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 10.13 MB, 21.57 MB, 63.65 MB, 102.53 MB, 140.32 MB, 178.90 MB, 217.67 MB, 256.09 MB, 294.64 MB, 333.23 MB, 372.26 MB, 411.55 MB, 451.56 MB, 491.41 MB, 531.00 MB, 571.43 MB, 611.79 MB, 652.57 MB, 693.34 MB, 734.35 MB, 760.18 MB - BytesReceived: 762.20 MB (799222380) - ConvertRowBatchTime: 2s505ms - DeserializeRowBatchTimer: 2s769ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.02M (120017458) - RowsReturnedRate: 13.57 M/sec - SendersBlockedTimer: 49s118ms - SendersBlockedTotalTimer(*): 9m52s Instance cb486002883e0421:e8f30b5b4f47dca8 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 206.83 MB, 561.85 MB, 817.84 MB, 1.14 GB, 1.42 GB, 1.73 GB, 2.05 GB, 2.30 GB, 2.63 GB, 2.94 GB, 3.24 GB, 3.54 GB, 3.84 GB, 4.13 GB, 4.42 GB, 4.69 GB, 5.30 GB, 6.11 GB, 6.94 GB, 7.76 GB, 8.59 GB, 9.42 GB, 10.24 GB, 11.00 GB, 11.14 GB, 11.14 GB, 11.15 GB, 11.16 GB, 11.15 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12007010304) - PerHostPeakMemUsage: 11.32 GB (12154057960) - PrepareTime: 150.198ms - RowsProduced: 1 (1) - TotalCpuTime: 1m56s - TotalNetworkReceiveTime: 22s109ms - TotalNetworkSendTime: 244.147us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 425.150ms, non-child: 425.150ms, % non-child: 100.00%) - CodegenTime: 186.890us - CompileTime: 47.982ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 230.053ms - PrepareTime: 145.723ms DataStreamSender (dst_id=6):(Total: 43.632us, non-child: 43.632us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 72.52 KB/sec - OverallThroughput: 358.11 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.809us - ThriftTransmitTime(*): 215.454us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s538ms, % non-child: 2.78%) ExecOption: Codegen Enabled - BuildTime: 2s142ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 44.97 KB (46048) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 59s857ms, % non-child: 67.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 12s086ms - BuildRows: 119.97M (119972466) - BuildRowsPartitioned: 119.97M (119972466) - BuildTime: 12s722ms - GetNewBlockTime: 7.373ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 119.97M (119972466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30s539ms - RowsReturned: 599.85M (599852470) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.334us EXCHANGE_NODE (id=5):(Total: 18s511ms, non-child: 12s076ms, % non-child: 65.24%) BytesReceived(2s000ms): 64.72 MB, 245.27 MB, 409.24 MB, 579.76 MB, 750.26 MB, 926.54 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.57 GB, 1.74 GB, 1.91 GB, 2.08 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2670644527) - ConvertRowBatchTime: 3s924ms - DeserializeRowBatchTimer: 12s186ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 6.48 M/sec - SendersBlockedTimer: 2s839ms - SendersBlockedTotalTimer(*): 22s982ms EXCHANGE_NODE (id=4):(Total: 10s568ms, non-child: 3s113ms, % non-child: 29.46%) BytesReceived(2s000ms): 9.68 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.12 MB, 10.17 MB, 24.12 MB, 66.79 MB, 105.31 MB, 143.18 MB, 181.75 MB, 220.46 MB, 258.84 MB, 297.39 MB, 335.95 MB, 375.10 MB, 414.39 MB, 454.42 MB, 494.23 MB, 533.82 MB, 574.28 MB, 614.66 MB, 655.34 MB, 696.02 MB, 737.22 MB - BytesReceived: 761.88 MB (798890684) - ConvertRowBatchTime: 2s458ms - DeserializeRowBatchTimer: 2s721ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 119.97M (119972466) - RowsReturnedRate: 11.35 M/sec - SendersBlockedTimer: 47s278ms - SendersBlockedTotalTimer(*): 9m27s Instance cb486002883e0421:e8f30b5b4f47dcaa (host=vb0220.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.37 MB, 499.84 MB, 817.80 MB, 1.08 GB, 1.39 GB, 1.68 GB, 2.02 GB, 2.30 GB, 2.59 GB, 2.90 GB, 3.19 GB, 3.51 GB, 3.80 GB, 4.11 GB, 4.38 GB, 4.62 GB, 5.27 GB, 5.93 GB, 6.71 GB, 7.38 GB, 8.16 GB, 8.83 GB, 9.61 GB, 10.28 GB, 11.00 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 10.06 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12154648872) - PrepareTime: 152.437ms - RowsProduced: 1 (1) - TotalCpuTime: 1m58s - TotalNetworkReceiveTime: 22s841ms - TotalNetworkSendTime: 295.088us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 433.751ms, non-child: 433.751ms, % non-child: 100.00%) - CodegenTime: 181.665us - CompileTime: 67.106ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 216.706ms - PrepareTime: 148.656ms DataStreamSender (dst_id=6):(Total: 41.813us, non-child: 41.813us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 61.56 KB/sec - OverallThroughput: 373.69 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.538us - ThriftTransmitTime(*): 253.807us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s808ms, % non-child: 3.07%) ExecOption: Codegen Enabled - BuildTime: 2s403ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.56 KB (47680) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m28s, non-child: 58s464ms, % non-child: 65.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 11s668ms - BuildRows: 120.00M (120003655) - BuildRowsPartitioned: 120.00M (120003655) - BuildTime: 14s328ms - GetNewBlockTime: 6.824ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.00M (120003655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s629ms - RowsReturned: 600.00M (600003263) - RowsReturnedRate: 6.77 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.650us EXCHANGE_NODE (id=5):(Total: 18s953ms, non-child: 10s296ms, % non-child: 54.32%) BytesReceived(2s000ms): 89.65 MB, 269.25 MB, 432.56 MB, 605.02 MB, 775.30 MB, 952.16 MB, 1.10 GB, 1.26 GB, 1.43 GB, 1.60 GB, 1.77 GB, 1.93 GB, 2.10 GB, 2.27 GB, 2.42 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2671287152) - ConvertRowBatchTime: 3s854ms - DeserializeRowBatchTimer: 10s747ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 6.33 M/sec - SendersBlockedTimer: 222.230ms - SendersBlockedTotalTimer(*): 1s823ms EXCHANGE_NODE (id=4):(Total: 11s235ms, non-child: 3s759ms, % non-child: 33.46%) BytesReceived(2s000ms): 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.12 MB, 10.18 MB, 29.51 MB, 72.55 MB, 110.70 MB, 148.66 MB, 187.39 MB, 226.08 MB, 264.53 MB, 303.09 MB, 341.83 MB, 380.97 MB, 420.30 MB, 460.37 MB, 500.06 MB, 539.77 MB, 580.32 MB, 620.76 MB, 661.49 MB, 702.20 MB, 742.93 MB - BytesReceived: 762.10 MB (799123454) - ConvertRowBatchTime: 2s915ms - DeserializeRowBatchTimer: 3s271ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.00M (120003655) - RowsReturnedRate: 10.68 M/sec - SendersBlockedTimer: 49s230ms - SendersBlockedTotalTimer(*): 10m43s Instance cb486002883e0421:e8f30b5b4f47dca6 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 213.62 MB, 548.85 MB, 839.21 MB, 1.11 GB, 1.42 GB, 1.72 GB, 2.05 GB, 2.32 GB, 2.64 GB, 2.92 GB, 3.24 GB, 3.55 GB, 3.84 GB, 4.14 GB, 4.42 GB, 4.69 GB, 5.19 GB, 5.80 GB, 6.43 GB, 7.11 GB, 7.68 GB, 8.36 GB, 8.93 GB, 9.62 GB, 10.19 GB, 10.87 GB, 11.18 GB, 11.18 GB, 11.16 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB, 11.14 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 GB (12006985728) - PerHostPeakMemUsage: 11.32 GB (12152231680) - PrepareTime: 166.567ms - RowsProduced: 1 (1) - TotalCpuTime: 2m6s - TotalNetworkReceiveTime: 17s077ms - TotalNetworkSendTime: 292.427us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 992 (992) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 11.12 GB (11945377792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 443.542ms, non-child: 443.542ms, % non-child: 100.00%) - CodegenTime: 243.472us - CompileTime: 49.013ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 345 (345) - NumInstructions: 3.98K (3985) - OptimizationTime: 231.010ms - PrepareTime: 160.596ms DataStreamSender (dst_id=6):(Total: 42.558us, non-child: 42.558us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 66.44 KB/sec - OverallThroughput: 367.15 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.557us - ThriftTransmitTime(*): 235.181us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 1m31s, non-child: 2s372ms, % non-child: 2.59%) ExecOption: Codegen Enabled - BuildTime: 1s982ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 46.45 KB (47568) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 1m29s, non-child: 1m4s, % non-child: 72.19%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 13s365ms - BuildRows: 120.04M (120035506) - BuildRowsPartitioned: 120.04M (120035506) - BuildTime: 15s651ms - GetNewBlockTime: 7.728ms - HashBuckets: 268.44M (268435456) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.14 GB (11965325312) - PinTime: 0.000ns - ProbeRows: 120.04M (120035506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28s857ms - RowsReturned: 600.19M (600188126) - RowsReturnedRate: 6.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.593us EXCHANGE_NODE (id=5):(Total: 17s164ms, non-child: 13s055ms, % non-child: 76.06%) BytesReceived(2s000ms): 65.83 MB, 246.49 MB, 410.65 MB, 581.47 MB, 751.99 MB, 928.71 MB, 1.08 GB, 1.24 GB, 1.41 GB, 1.58 GB, 1.74 GB, 1.91 GB, 2.08 GB, 2.24 GB, 2.40 GB, 2.48 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB, 2.49 GB - BytesReceived: 2.49 GB (2672008025) - ConvertRowBatchTime: 4s355ms - DeserializeRowBatchTimer: 12s568ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 6.99 M/sec - SendersBlockedTimer: 3s052ms - SendersBlockedTotalTimer(*): 22s335ms EXCHANGE_NODE (id=4):(Total: 7s609ms, non-child: 3s658ms, % non-child: 48.07%) BytesReceived(2s000ms): 9.81 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.08 MB, 10.09 MB, 24.34 MB, 67.10 MB, 105.60 MB, 143.52 MB, 182.17 MB, 220.90 MB, 259.32 MB, 297.91 MB, 336.59 MB, 375.73 MB, 415.01 MB, 455.05 MB, 494.86 MB, 534.49 MB, 574.95 MB, 615.37 MB, 656.14 MB, 696.86 MB, 738.05 MB - BytesReceived: 762.27 MB (799297493) - ConvertRowBatchTime: 2s723ms - DeserializeRowBatchTimer: 3s695ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.04M (120035506) - RowsReturnedRate: 15.77 M/sec - SendersBlockedTimer: 54s969ms - SendersBlockedTotalTimer(*): 8m3s Fragment F01: Instance cb486002883e0421:e8f30b5b4f47dcb3 (host=vb0234.halxg.cloudera.com:22000):(Total: 30s765ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(500.000ms): 55.93 KB, 1001.86 MB, 1002.82 MB, 1003.06 MB, 1003.14 MB, 1002.86 MB, 1003.03 MB, 1002.98 MB, 995.13 MB, 916.32 MB, 829.09 MB, 829.23 MB, 829.04 MB, 828.72 MB, 828.85 MB, 828.68 MB, 812.78 MB, 740.92 MB, 741.08 MB, 652.80 MB, 652.97 MB, 652.63 MB, 652.85 MB, 652.59 MB, 596.88 MB, 564.99 MB, 564.83 MB, 564.84 MB, 484.91 MB, 452.91 MB, 389.03 MB, 389.07 MB, 365.16 MB, 301.01 MB, 301.23 MB, 301.28 MB, 301.00 MB, 269.18 MB, 284.18 MB, 641.31 MB, 641.58 MB, 641.90 MB, 641.72 MB, 641.84 MB, 562.97 MB, 531.28 MB, 531.13 MB, 531.16 MB, 531.28 MB, 475.28 MB, 435.21 MB, 419.17 MB, 418.69 MB, 419.28 MB, 363.26 MB, 363.35 MB, 323.24 MB, 251.41 MB, 251.36 MB, 195.43 MB, 195.31 MB, 195.38 MB, 67.54 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4 - AverageThreadTokens: 10.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.54 MB (1052290920) - PerHostPeakMemUsage: 4.94 GB (5300612072) - PrepareTime: 152.072ms - RowsProduced: 124.58M (124581107) - TotalCpuTime: 5m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s062ms - TotalStorageWaitTime: 442.362ms CodeGen:(Total: 367.283ms, non-child: 367.283ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.686ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 213.353ms - PrepareTime: 150.079ms DataStreamSender (dst_id=5):(Total: 29s742ms, non-child: 29s742ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772239711) - NetworkThroughput(*): 40.93 MB/sec - OverallThroughput: 88.89 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 17s206ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 5.11 GB (5482787140) HDFS_SCAN_NODE (id=1):(Total: 1s051ms, non-child: 1s051ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1002.33 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.39 - BytesRead: 1.47 GB (1576539207) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576539207) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576539207) - DecompressionTime: 8s652ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877288) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 118.51 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 16.02K (16022) - ScannerThreadsTotalWallClockTime: 4m52s - MaterializeTupleTime(*): 4m42s - ScannerThreadsSysTime: 1s055ms - ScannerThreadsUserTime: 35s628ms - ScannerThreadsVoluntaryContextSwitches: 121.98K (121981) - TotalRawHdfsReadTime(*): 999.483ms - TotalReadThroughput: 47.73 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb4 (host=vb0204.halxg.cloudera.com:22000):(Total: 30s609ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(500.000ms): 55.93 KB, 1002.10 MB, 1002.71 MB, 1002.72 MB, 1002.71 MB, 1002.93 MB, 1002.84 MB, 1003.10 MB, 1002.55 MB, 916.27 MB, 828.72 MB, 828.93 MB, 828.89 MB, 829.05 MB, 828.86 MB, 828.88 MB, 765.06 MB, 740.78 MB, 740.81 MB, 652.64 MB, 653.13 MB, 652.71 MB, 652.97 MB, 652.87 MB, 564.88 MB, 564.53 MB, 564.60 MB, 564.81 MB, 476.76 MB, 388.73 MB, 388.85 MB, 388.73 MB, 301.13 MB, 300.91 MB, 300.75 MB, 301.37 MB, 300.90 MB, 213.06 MB, 385.82 MB, 641.87 MB, 641.94 MB, 642.02 MB, 641.84 MB, 586.92 MB, 531.23 MB, 531.32 MB, 531.29 MB, 530.95 MB, 475.07 MB, 475.19 MB, 419.01 MB, 419.48 MB, 419.15 MB, 379.35 MB, 363.14 MB, 363.00 MB, 291.21 MB, 251.37 MB, 211.27 MB, 195.23 MB, 195.21 MB, 147.04 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052323688) - PerHostPeakMemUsage: 4.88 GB (5237153776) - PrepareTime: 159.631ms - RowsProduced: 124.58M (124581263) - TotalCpuTime: 5m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s169ms - TotalStorageWaitTime: 565.158ms CodeGen:(Total: 365.376ms, non-child: 365.376ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.059ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 204.554ms - PrepareTime: 157.716ms DataStreamSender (dst_id=5):(Total: 29s824ms, non-child: 29s824ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773118931) - NetworkThroughput(*): 37.28 MB/sec - OverallThroughput: 88.67 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 17s491ms - ThriftTransmitTime(*): 1m10s - UncompressedRowBatchSize: 5.11 GB (5482794004) HDFS_SCAN_NODE (id=1):(Total: 835.123ms, non-child: 835.123ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:1.639% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.22 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.43 - BytesRead: 1.47 GB (1576547565) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576547565) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576547565) - DecompressionTime: 5s564ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051942832) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 149.18 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.82K (11820) - ScannerThreadsTotalWallClockTime: 4m49s - MaterializeTupleTime(*): 4m42s - ScannerThreadsSysTime: 708.888ms - ScannerThreadsUserTime: 22s634ms - ScannerThreadsVoluntaryContextSwitches: 121.92K (121925) - TotalRawHdfsReadTime(*): 1s109ms - TotalReadThroughput: 48.50 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcbc (host=vb0208.halxg.cloudera.com:22000):(Total: 30s503ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(500.000ms): 72.57 MB, 1002.44 MB, 1002.71 MB, 1002.57 MB, 1002.63 MB, 1002.56 MB, 1002.99 MB, 995.29 MB, 916.00 MB, 844.83 MB, 828.85 MB, 828.71 MB, 828.71 MB, 828.67 MB, 828.81 MB, 829.19 MB, 756.65 MB, 740.41 MB, 732.68 MB, 652.72 MB, 653.17 MB, 652.97 MB, 652.91 MB, 653.20 MB, 588.52 MB, 564.60 MB, 564.60 MB, 548.69 MB, 485.04 MB, 396.75 MB, 389.31 MB, 388.95 MB, 309.24 MB, 300.94 MB, 301.33 MB, 300.85 MB, 276.96 MB, 220.93 MB, 677.68 MB, 642.11 MB, 641.89 MB, 641.80 MB, 641.96 MB, 594.50 MB, 531.36 MB, 531.34 MB, 531.26 MB, 531.15 MB, 483.10 MB, 475.18 MB, 419.21 MB, 419.16 MB, 419.04 MB, 379.26 MB, 363.09 MB, 347.29 MB, 267.39 MB, 251.24 MB, 195.28 MB, 195.23 MB, 195.55 MB, 86.09 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.42 MB (1052160184) - PerHostPeakMemUsage: 4.88 GB (5236723488) - PrepareTime: 150.998ms - RowsProduced: 124.58M (124581487) - TotalCpuTime: 5m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s109ms - TotalStorageWaitTime: 481.089ms CodeGen:(Total: 356.063ms, non-child: 356.063ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.498ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 203.428ms - PrepareTime: 148.130ms DataStreamSender (dst_id=5):(Total: 29s528ms, non-child: 29s528ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2774741892) - NetworkThroughput(*): 40.66 MB/sec - OverallThroughput: 89.61 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s097ms - ThriftTransmitTime(*): 1m5s - UncompressedRowBatchSize: 5.11 GB (5482803856) HDFS_SCAN_NODE (id=1):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.39% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.613% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 1.07 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 918.80 MB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 9.44 - BytesRead: 1.47 GB (1576530636) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576530636) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576530636) - DecompressionTime: 8s200ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.02 MB (1051746640) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 124.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 17.18K (17184) - ScannerThreadsTotalWallClockTime: 4m49s - MaterializeTupleTime(*): 4m40s - ScannerThreadsSysTime: 1s176ms - ScannerThreadsUserTime: 33s997ms - ScannerThreadsVoluntaryContextSwitches: 121.94K (121945) - TotalRawHdfsReadTime(*): 1s129ms - TotalReadThroughput: 48.50 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb8 (host=vb0206.halxg.cloudera.com:22000):(Total: 30s438ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(500.000ms): 0, 1001.75 MB, 1002.64 MB, 1002.79 MB, 1002.78 MB, 1002.72 MB, 1003.04 MB, 1002.68 MB, 939.94 MB, 916.28 MB, 828.79 MB, 828.94 MB, 828.58 MB, 828.81 MB, 828.88 MB, 828.95 MB, 773.18 MB, 740.97 MB, 732.87 MB, 652.91 MB, 652.67 MB, 652.85 MB, 652.67 MB, 652.83 MB, 596.90 MB, 564.67 MB, 564.88 MB, 548.98 MB, 492.67 MB, 437.07 MB, 388.88 MB, 388.84 MB, 357.12 MB, 309.17 MB, 301.19 MB, 300.87 MB, 300.84 MB, 245.26 MB, 331.62 MB, 643.65 MB, 641.85 MB, 642.12 MB, 641.80 MB, 641.96 MB, 570.82 MB, 531.19 MB, 530.95 MB, 530.98 MB, 531.35 MB, 475.31 MB, 443.25 MB, 419.09 MB, 419.34 MB, 419.17 MB, 362.98 MB, 363.28 MB, 315.05 MB, 251.47 MB, 235.41 MB, 195.12 MB, 195.35 MB, 155.41 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.40 MB (1052143968) - PerHostPeakMemUsage: 4.88 GB (5237215360) - PrepareTime: 146.993ms - RowsProduced: 124.58M (124580622) - TotalCpuTime: 5m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s111ms - TotalStorageWaitTime: 480.642ms CodeGen:(Total: 371.098ms, non-child: 371.098ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 222.563ms - PrepareTime: 144.953ms DataStreamSender (dst_id=5):(Total: 29s579ms, non-child: 29s579ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2772524930) - NetworkThroughput(*): 39.09 MB/sec - OverallThroughput: 89.39 MB/sec - PeakMemoryUsage: 427.93 KB (438200) - SerializeBatchTime: 17s194ms - ThriftTransmitTime(*): 1m7s - UncompressedRowBatchSize: 5.11 GB (5482765788) HDFS_SCAN_NODE (id=1):(Total: 892.707ms, non-child: 892.707ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:1.639% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.06 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.51 - BytesRead: 1.47 GB (1576533591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576533591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576533591) - DecompressionTime: 6s991ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.02 MB (1051746728) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 139.55 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.56K (15561) - ScannerThreadsTotalWallClockTime: 4m49s - MaterializeTupleTime(*): 4m41s - ScannerThreadsSysTime: 940.852ms - ScannerThreadsUserTime: 28s843ms - ScannerThreadsVoluntaryContextSwitches: 121.87K (121871) - TotalRawHdfsReadTime(*): 1s090ms - TotalReadThroughput: 49.30 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcbd (host=vb0224.halxg.cloudera.com:22000):(Total: 30s270ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(500.000ms): 55.93 KB, 994.54 MB, 994.86 MB, 994.96 MB, 994.96 MB, 995.07 MB, 994.86 MB, 994.72 MB, 916.01 MB, 868.62 MB, 820.96 MB, 820.71 MB, 820.75 MB, 820.57 MB, 820.78 MB, 820.66 MB, 789.15 MB, 732.87 MB, 732.66 MB, 660.67 MB, 644.80 MB, 645.03 MB, 644.96 MB, 645.01 MB, 620.84 MB, 556.65 MB, 556.69 MB, 556.87 MB, 509.11 MB, 452.95 MB, 381.15 MB, 380.96 MB, 365.28 MB, 292.76 MB, 292.98 MB, 293.15 MB, 364.61 MB, 348.81 MB, 284.59 MB, 641.48 MB, 641.80 MB, 642.11 MB, 633.77 MB, 626.14 MB, 578.68 MB, 531.35 MB, 530.86 MB, 523.33 MB, 523.26 MB, 467.22 MB, 427.26 MB, 419.11 MB, 411.15 MB, 411.08 MB, 355.22 MB, 347.08 MB, 283.37 MB, 243.22 MB, 203.50 MB, 187.45 MB, 153.04 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.41 MB (1043763296) - PerHostPeakMemUsage: 4.87 GB (5226243024) - PrepareTime: 152.541ms - RowsProduced: 123.88M (123876516) - TotalCpuTime: 5m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s069ms - TotalStorageWaitTime: 537.194ms CodeGen:(Total: 377.101ms, non-child: 377.101ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 223.172ms - PrepareTime: 150.390ms DataStreamSender (dst_id=5):(Total: 29s321ms, non-child: 29s321ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2758520711) - NetworkThroughput(*): 40.77 MB/sec - OverallThroughput: 89.72 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 17s082ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 5.08 GB (5451778236) HDFS_SCAN_NODE (id=1):(Total: 983.924ms, non-child: 983.924ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 910.30 MB, 993.82 MB, 993.82 MB, 993.82 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 1.46 GB (1567627792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.46 GB (1567627792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.46 GB (1567627792) - DecompressionTime: 8s090ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.09 MB (1043423400) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 125.90 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 16.22K (16221) - ScannerThreadsTotalWallClockTime: 4m48s - MaterializeTupleTime(*): 4m39s - ScannerThreadsSysTime: 1s161ms - ScannerThreadsUserTime: 33s155ms - ScannerThreadsVoluntaryContextSwitches: 121.37K (121370) - TotalRawHdfsReadTime(*): 1s068ms - TotalReadThroughput: 49.02 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcbf (host=vb0218.halxg.cloudera.com:22000):(Total: 30s204ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(500.000ms): 549.39 MB, 1003.08 MB, 1002.57 MB, 1002.93 MB, 1002.64 MB, 1002.64 MB, 1002.92 MB, 1002.80 MB, 924.12 MB, 836.75 MB, 828.81 MB, 828.82 MB, 828.74 MB, 828.86 MB, 828.74 MB, 828.88 MB, 748.88 MB, 741.01 MB, 716.99 MB, 652.72 MB, 652.89 MB, 652.62 MB, 652.73 MB, 644.78 MB, 564.67 MB, 565.14 MB, 564.93 MB, 493.14 MB, 468.76 MB, 397.12 MB, 389.44 MB, 365.23 MB, 301.13 MB, 301.21 MB, 301.22 MB, 301.08 MB, 245.18 MB, 356.41 MB, 641.90 MB, 641.69 MB, 641.55 MB, 641.99 MB, 641.62 MB, 562.97 MB, 531.35 MB, 531.18 MB, 531.06 MB, 515.21 MB, 475.15 MB, 419.26 MB, 419.18 MB, 419.34 MB, 418.95 MB, 363.11 MB, 363.21 MB, 307.62 MB, 251.35 MB, 235.23 MB, 195.27 MB, 195.70 MB, 139.30 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.51 MB (1052258144) - PerHostPeakMemUsage: 4.88 GB (5237260976) - PrepareTime: 151.169ms - RowsProduced: 124.58M (124581252) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s148ms - TotalStorageWaitTime: 401.579ms CodeGen:(Total: 376.769ms, non-child: 376.769ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.414ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 224.136ms - PrepareTime: 146.879ms DataStreamSender (dst_id=5):(Total: 29s318ms, non-child: 29s318ms, % non-child: 100.00%) - BytesSent: 2.58 GB (2773316692) - NetworkThroughput(*): 39.28 MB/sec - OverallThroughput: 90.21 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s999ms - ThriftTransmitTime(*): 1m7s - UncompressedRowBatchSize: 5.11 GB (5482793504) HDFS_SCAN_NODE (id=1):(Total: 923.836ms, non-child: 923.836ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:1.639% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 423.84 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.06 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 1.47 GB (1576543414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576543414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576543414) - DecompressionTime: 7s198ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877376) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 134.85 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.72K (14725) - ScannerThreadsTotalWallClockTime: 4m47s - MaterializeTupleTime(*): 4m38s - ScannerThreadsSysTime: 970.847ms - ScannerThreadsUserTime: 29s495ms - ScannerThreadsVoluntaryContextSwitches: 122.00K (121998) - TotalRawHdfsReadTime(*): 1s102ms - TotalReadThroughput: 49.30 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb5 (host=vb0226.halxg.cloudera.com:22000):(Total: 29s760ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(500.000ms): 55.93 KB, 995.08 MB, 994.95 MB, 994.49 MB, 994.69 MB, 995.01 MB, 994.86 MB, 994.83 MB, 908.33 MB, 860.36 MB, 820.77 MB, 820.94 MB, 820.46 MB, 821.13 MB, 820.91 MB, 820.85 MB, 732.80 MB, 732.92 MB, 644.81 MB, 644.78 MB, 644.68 MB, 645.08 MB, 644.94 MB, 596.82 MB, 557.04 MB, 556.92 MB, 556.61 MB, 468.70 MB, 397.04 MB, 380.66 MB, 380.82 MB, 308.89 MB, 292.91 MB, 364.55 MB, 364.80 MB, 364.97 MB, 284.58 MB, 552.39 MB, 620.40 MB, 612.44 MB, 604.47 MB, 604.61 MB, 557.29 MB, 509.61 MB, 509.90 MB, 501.41 MB, 493.56 MB, 461.72 MB, 445.55 MB, 397.41 MB, 389.86 MB, 389.51 MB, 333.76 MB, 325.53 MB, 325.83 MB, 248.75 MB, 208.84 MB, 169.06 MB, 142.40 MB, 110.40 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.42 MB (1043771592) - PerHostPeakMemUsage: 4.82 GB (5170755800) - PrepareTime: 164.208ms - RowsProduced: 122.02M (122016989) - TotalCpuTime: 5m7s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s227ms - TotalStorageWaitTime: 503.979ms CodeGen:(Total: 357.373ms, non-child: 357.373ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 191.565ms - PrepareTime: 160.343ms DataStreamSender (dst_id=5):(Total: 28s993ms, non-child: 28s993ms, % non-child: 100.00%) - BytesSent: 2.53 GB (2717830413) - NetworkThroughput(*): 36.63 MB/sec - OverallThroughput: 89.40 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s955ms - ThriftTransmitTime(*): 1m10s - UncompressedRowBatchSize: 5.00 GB (5369940860) HDFS_SCAN_NODE (id=1):(Total: 832.043ms, non-child: 832.043ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:98.31% 1:1.695% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 909.75 MB, 993.27 MB, 993.27 MB, 993.27 MB, 993.27 MB, 1.35 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.44 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.34 - BytesRead: 1.44 GB (1544225999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 GB (1544225999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 GB (1544225999) - DecompressionTime: 5s267ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.09 MB (1043423504) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 146.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.62K (10619) - ScannerThreadsTotalWallClockTime: 4m39s - MaterializeTupleTime(*): 4m32s - ScannerThreadsSysTime: 614.900ms - ScannerThreadsUserTime: 21s255ms - ScannerThreadsVoluntaryContextSwitches: 119.37K (119369) - TotalRawHdfsReadTime(*): 1s030ms - TotalReadThroughput: 49.09 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcbe (host=vb0222.halxg.cloudera.com:22000):(Total: 29s213ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(500.000ms): 55.93 KB, 1001.51 MB, 1002.93 MB, 1003.21 MB, 1003.21 MB, 1003.04 MB, 1002.82 MB, 1002.72 MB, 916.33 MB, 844.92 MB, 828.83 MB, 828.78 MB, 828.87 MB, 828.81 MB, 829.08 MB, 828.79 MB, 740.91 MB, 740.89 MB, 716.77 MB, 652.79 MB, 652.74 MB, 652.71 MB, 652.75 MB, 652.90 MB, 581.09 MB, 565.02 MB, 565.17 MB, 556.52 MB, 476.92 MB, 428.89 MB, 389.11 MB, 389.14 MB, 341.15 MB, 301.13 MB, 300.72 MB, 300.96 MB, 301.19 MB, 260.65 MB, 213.23 MB, 534.15 MB, 534.14 MB, 534.13 MB, 534.29 MB, 518.42 MB, 439.18 MB, 439.49 MB, 439.20 MB, 439.12 MB, 391.37 MB, 343.22 MB, 343.17 MB, 343.32 MB, 319.36 MB, 295.04 MB, 295.08 MB, 223.17 MB, 182.34 MB, 142.22 MB, 142.55 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 10.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.39 MB (1052127320) - PerHostPeakMemUsage: 4.70 GB (5043728296) - PrepareTime: 153.767ms - RowsProduced: 116.19M (116191050) - TotalCpuTime: 4m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s015ms - TotalStorageWaitTime: 390.404ms CodeGen:(Total: 372.089ms, non-child: 372.089ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.794ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 216.393ms - PrepareTime: 151.843ms DataStreamSender (dst_id=5):(Total: 28s236ms, non-child: 28s236ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2586103344) - NetworkThroughput(*): 40.21 MB/sec - OverallThroughput: 87.34 MB/sec - PeakMemoryUsage: 443.93 KB (454584) - SerializeBatchTime: 16s329ms - ThriftTransmitTime(*): 1m1s - UncompressedRowBatchSize: 4.76 GB (5113542568) HDFS_SCAN_NODE (id=1):(Total: 1s008ms, non-child: 1s008ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 918.81 MB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.22 - BytesRead: 1.37 GB (1470480664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1470480664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1470480664) - DecompressionTime: 7s885ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.02 MB (1051746552) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 115.16 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 15.46K (15465) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 1s083ms - ScannerThreadsUserTime: 32s647ms - ScannerThreadsVoluntaryContextSwitches: 113.76K (113761) - TotalRawHdfsReadTime(*): 856.170ms - TotalReadThroughput: 47.54 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb2 (host=vb0214.halxg.cloudera.com:22000):(Total: 28s804ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(500.000ms): 55.93 KB, 993.97 MB, 994.67 MB, 994.93 MB, 994.47 MB, 994.52 MB, 994.72 MB, 994.95 MB, 908.11 MB, 844.69 MB, 820.91 MB, 820.74 MB, 820.59 MB, 820.65 MB, 820.76 MB, 820.75 MB, 740.86 MB, 732.83 MB, 724.87 MB, 645.05 MB, 645.03 MB, 644.84 MB, 644.67 MB, 645.40 MB, 565.01 MB, 557.16 MB, 557.18 MB, 556.75 MB, 468.63 MB, 413.03 MB, 381.04 MB, 381.05 MB, 292.92 MB, 292.93 MB, 293.04 MB, 292.84 MB, 364.60 MB, 292.92 MB, 479.11 MB, 551.62 MB, 551.78 MB, 544.01 MB, 535.78 MB, 456.80 MB, 456.68 MB, 448.71 MB, 448.66 MB, 400.85 MB, 360.53 MB, 360.82 MB, 352.97 MB, 312.69 MB, 296.78 MB, 256.77 MB, 208.82 MB, 184.68 MB, 168.98 MB, 142.30 MB, 10.64 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 1 - AverageThreadTokens: 10.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 995.51 MB (1043869720) - PerHostPeakMemUsage: 4.70 GB (5045210272) - PrepareTime: 151.977ms - RowsProduced: 117.14M (117138819) - TotalCpuTime: 4m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s108ms - TotalStorageWaitTime: 444.217ms CodeGen:(Total: 364.803ms, non-child: 364.803ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 211.008ms - PrepareTime: 149.938ms DataStreamSender (dst_id=5):(Total: 28s082ms, non-child: 28s082ms, % non-child: 100.00%) - BytesSent: 2.43 GB (2606610898) - NetworkThroughput(*): 36.72 MB/sec - OverallThroughput: 88.52 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s436ms - ThriftTransmitTime(*): 1m7s - UncompressedRowBatchSize: 4.80 GB (5155253676) HDFS_SCAN_NODE (id=1):(Total: 778.768ms, non-child: 778.768ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:98.28% 1:1.724% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 912.54 MB, 996.06 MB, 996.06 MB, 1.20 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.16 - BytesRead: 1.38 GB (1482361679) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.38 GB (1482361679) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.38 GB (1482361679) - DecompressionTime: 5s154ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 995.15 MB (1043488944) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 150.42 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.67K (11670) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 739.882ms - ScannerThreadsUserTime: 22s594ms - ScannerThreadsVoluntaryContextSwitches: 114.63K (114632) - TotalRawHdfsReadTime(*): 1s055ms - TotalReadThroughput: 47.92 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb6 (host=vb0216.halxg.cloudera.com:22000):(Total: 28s752ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(500.000ms): 0, 1001.59 MB, 1002.78 MB, 1002.75 MB, 1002.72 MB, 1002.43 MB, 1003.00 MB, 1002.75 MB, 924.22 MB, 907.77 MB, 828.64 MB, 828.89 MB, 828.78 MB, 829.02 MB, 828.68 MB, 828.64 MB, 740.83 MB, 740.77 MB, 741.12 MB, 653.17 MB, 652.84 MB, 652.64 MB, 653.12 MB, 653.08 MB, 564.47 MB, 564.82 MB, 564.84 MB, 500.96 MB, 477.02 MB, 389.23 MB, 389.57 MB, 389.10 MB, 301.14 MB, 300.86 MB, 301.21 MB, 301.03 MB, 253.17 MB, 212.80 MB, 551.65 MB, 551.61 MB, 551.58 MB, 551.76 MB, 504.39 MB, 456.57 MB, 456.86 MB, 456.73 MB, 456.69 MB, 408.69 MB, 360.96 MB, 360.88 MB, 360.99 MB, 312.64 MB, 312.69 MB, 264.80 MB, 216.89 MB, 200.87 MB, 168.81 MB, 168.73 MB, 53.42 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 4 - AverageThreadTokens: 9.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052323864) - PerHostPeakMemUsage: 4.73 GB (5074729136) - PrepareTime: 151.033ms - RowsProduced: 117.66M (117660154) - TotalCpuTime: 4m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s137ms - TotalStorageWaitTime: 443.518ms CodeGen:(Total: 366.933ms, non-child: 366.933ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.455ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 214.296ms - PrepareTime: 149.014ms DataStreamSender (dst_id=5):(Total: 27s929ms, non-child: 27s929ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2618472134) - NetworkThroughput(*): 38.52 MB/sec - OverallThroughput: 89.41 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 16s217ms - ThriftTransmitTime(*): 1m4s - UncompressedRowBatchSize: 4.82 GB (5178197516) HDFS_SCAN_NODE (id=1):(Total: 870.414ms, non-child: 870.414ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 918.79 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.14 - BytesRead: 1.39 GB (1488932448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488932448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488932448) - DecompressionTime: 6s349ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051943008) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 135.18 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.35K (12351) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m17s - ScannerThreadsSysTime: 776.875ms - ScannerThreadsUserTime: 25s803ms - ScannerThreadsVoluntaryContextSwitches: 115.11K (115107) - TotalRawHdfsReadTime(*): 1s006ms - TotalReadThroughput: 48.13 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb7 (host=vb0232.halxg.cloudera.com:22000):(Total: 28s689ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(500.000ms): 165.21 MB, 918.20 MB, 1002.75 MB, 1002.75 MB, 1003.08 MB, 1002.63 MB, 1002.57 MB, 1003.05 MB, 931.93 MB, 844.68 MB, 837.03 MB, 828.87 MB, 828.99 MB, 828.99 MB, 829.26 MB, 829.16 MB, 757.29 MB, 740.83 MB, 716.94 MB, 660.96 MB, 652.62 MB, 652.77 MB, 652.89 MB, 653.16 MB, 573.08 MB, 564.54 MB, 564.89 MB, 492.79 MB, 476.57 MB, 405.11 MB, 388.78 MB, 381.02 MB, 317.16 MB, 301.08 MB, 300.76 MB, 301.26 MB, 285.00 MB, 221.04 MB, 569.55 MB, 551.57 MB, 551.69 MB, 551.60 MB, 504.31 MB, 456.77 MB, 456.94 MB, 456.67 MB, 408.76 MB, 384.76 MB, 360.64 MB, 360.67 MB, 320.80 MB, 312.72 MB, 281.09 MB, 216.85 MB, 216.86 MB, 168.74 MB, 168.86 MB, 120.96 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.47 MB (1052216288) - PerHostPeakMemUsage: 4.72 GB (5066104344) - PrepareTime: 145.816ms - RowsProduced: 118.04M (118040847) - TotalCpuTime: 4m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s140ms - TotalStorageWaitTime: 529.860ms CodeGen:(Total: 333.972ms, non-child: 333.972ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.548ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 186.423ms - PrepareTime: 143.942ms DataStreamSender (dst_id=5):(Total: 27s997ms, non-child: 27s997ms, % non-child: 100.00%) - BytesSent: 2.45 GB (2628099039) - NetworkThroughput(*): 36.67 MB/sec - OverallThroughput: 89.52 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s353ms - ThriftTransmitTime(*): 1m8s - UncompressedRowBatchSize: 4.84 GB (5194951728) HDFS_SCAN_NODE (id=1):(Total: 741.914ms, non-child: 741.914ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:98.28% 1:0% 2:0% 3:0% 4:0% 5:1.724% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(500.000ms): 99.63 MB, 840.60 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 924.12 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 9.29 - BytesRead: 1.39 GB (1494524606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1494524606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1494524606) - DecompressionTime: 5s004ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051812096) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 159.10 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.70K (10695) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 662.893ms - ScannerThreadsUserTime: 20s235ms - ScannerThreadsVoluntaryContextSwitches: 115.47K (115465) - TotalRawHdfsReadTime(*): 959.258ms - TotalReadThroughput: 49.15 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcbb (host=vb0230.halxg.cloudera.com:22000):(Total: 28s661ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(500.000ms): 55.93 KB, 1002.48 MB, 1003.08 MB, 1003.07 MB, 1002.89 MB, 1002.64 MB, 1002.90 MB, 1002.67 MB, 923.96 MB, 908.38 MB, 828.68 MB, 828.65 MB, 828.81 MB, 828.92 MB, 828.78 MB, 828.92 MB, 764.96 MB, 740.95 MB, 740.60 MB, 652.89 MB, 652.60 MB, 652.78 MB, 652.91 MB, 653.00 MB, 564.78 MB, 564.89 MB, 564.70 MB, 525.12 MB, 476.97 MB, 389.23 MB, 389.43 MB, 389.21 MB, 301.05 MB, 300.98 MB, 300.91 MB, 300.73 MB, 277.06 MB, 212.84 MB, 551.49 MB, 551.62 MB, 551.53 MB, 551.81 MB, 504.48 MB, 456.76 MB, 456.65 MB, 456.84 MB, 408.96 MB, 400.85 MB, 360.70 MB, 360.80 MB, 352.85 MB, 312.49 MB, 304.50 MB, 224.85 MB, 216.81 MB, 168.85 MB, 168.83 MB, 128.69 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.55 MB (1052299024) - PerHostPeakMemUsage: 4.73 GB (5074676616) - PrepareTime: 145.768ms - RowsProduced: 117.66M (117659841) - TotalCpuTime: 4m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s062ms - TotalStorageWaitTime: 458.202ms CodeGen:(Total: 356.555ms, non-child: 356.555ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 208.832ms - PrepareTime: 143.699ms DataStreamSender (dst_id=5):(Total: 27s887ms, non-child: 27s887ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2619292432) - NetworkThroughput(*): 38.06 MB/sec - OverallThroughput: 89.57 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 16s267ms - ThriftTransmitTime(*): 1m5s - UncompressedRowBatchSize: 4.82 GB (5178183740) HDFS_SCAN_NODE (id=1):(Total: 823.584ms, non-child: 823.584ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 918.84 MB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.25 - BytesRead: 1.39 GB (1488949167) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488949167) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488949167) - DecompressionTime: 5s999ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.15 MB (1051877464) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 142.86 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.98K (11985) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m18s - ScannerThreadsSysTime: 822.871ms - ScannerThreadsUserTime: 24s229ms - ScannerThreadsVoluntaryContextSwitches: 115.24K (115238) - TotalRawHdfsReadTime(*): 941.764ms - TotalReadThroughput: 48.96 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb1 (host=vb0212.halxg.cloudera.com:22000):(Total: 28s532ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(500.000ms): 285.00 MB, 1002.58 MB, 1002.90 MB, 1003.00 MB, 1002.83 MB, 1002.84 MB, 1002.54 MB, 1002.61 MB, 955.44 MB, 884.59 MB, 829.01 MB, 828.85 MB, 828.56 MB, 828.69 MB, 828.86 MB, 829.05 MB, 756.66 MB, 740.82 MB, 708.90 MB, 652.83 MB, 652.87 MB, 652.94 MB, 652.72 MB, 644.83 MB, 565.24 MB, 564.68 MB, 564.84 MB, 500.94 MB, 428.84 MB, 389.21 MB, 388.92 MB, 341.20 MB, 301.05 MB, 301.25 MB, 301.27 MB, 300.91 MB, 237.33 MB, 619.21 MB, 551.78 MB, 551.66 MB, 551.61 MB, 551.89 MB, 472.68 MB, 456.70 MB, 456.66 MB, 456.78 MB, 408.60 MB, 360.63 MB, 360.65 MB, 360.71 MB, 312.78 MB, 312.35 MB, 264.71 MB, 216.92 MB, 208.96 MB, 168.84 MB, 168.69 MB, 86.10 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 5 - AverageThreadTokens: 10.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.41 MB (1052151808) - PerHostPeakMemUsage: 4.70 GB (5041451656) - PrepareTime: 156.054ms - RowsProduced: 117.66M (117659734) - TotalCpuTime: 4m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s130ms - TotalStorageWaitTime: 485.711ms CodeGen:(Total: 376.172ms, non-child: 376.172ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.575ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 218.471ms - PrepareTime: 153.964ms DataStreamSender (dst_id=5):(Total: 27s673ms, non-child: 27s673ms, % non-child: 100.00%) - BytesSent: 2.44 GB (2618022054) - NetworkThroughput(*): 39.16 MB/sec - OverallThroughput: 90.22 MB/sec - PeakMemoryUsage: 435.93 KB (446392) - SerializeBatchTime: 16s021ms - ThriftTransmitTime(*): 1m3s - UncompressedRowBatchSize: 4.82 GB (5178179036) HDFS_SCAN_NODE (id=1):(Total: 910.217ms, non-child: 910.217ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:96.55% 1:1.724% 2:0% 3:0% 4:0% 5:0% 6:0% 7:1.724% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 223.07 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 918.78 MB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 9.24 - BytesRead: 1.39 GB (1488945170) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.39 GB (1488945170) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.39 GB (1488945170) - DecompressionTime: 6s917ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.09 MB (1051811832) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 129.27 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.68K (13683) - ScannerThreadsTotalWallClockTime: 4m24s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 927.853ms - ScannerThreadsUserTime: 28s237ms - ScannerThreadsVoluntaryContextSwitches: 115.14K (115141) - TotalRawHdfsReadTime(*): 979.262ms - TotalReadThroughput: 48.96 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcba (host=vb0228.halxg.cloudera.com:22000):(Total: 28s137ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(500.000ms): 542.39 MB, 982.40 MB, 982.73 MB, 982.61 MB, 982.70 MB, 982.89 MB, 982.96 MB, 982.71 MB, 895.94 MB, 808.86 MB, 808.93 MB, 808.91 MB, 808.99 MB, 809.03 MB, 808.80 MB, 800.46 MB, 721.08 MB, 720.70 MB, 632.91 MB, 632.82 MB, 633.06 MB, 632.63 MB, 632.63 MB, 568.92 MB, 544.47 MB, 545.07 MB, 545.04 MB, 465.13 MB, 433.12 MB, 444.81 MB, 444.96 MB, 404.81 MB, 364.91 MB, 364.58 MB, 364.98 MB, 365.11 MB, 276.83 MB, 467.25 MB, 535.86 MB, 535.68 MB, 535.74 MB, 527.83 MB, 448.55 MB, 440.95 MB, 441.04 MB, 433.05 MB, 392.51 MB, 344.87 MB, 336.69 MB, 328.75 MB, 288.81 MB, 288.76 MB, 240.74 MB, 182.45 MB, 142.29 MB, 142.41 MB, 102.33 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 10.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 983.50 MB (1031278608) - PerHostPeakMemUsage: 4.57 GB (4908472504) - PrepareTime: 148.140ms - RowsProduced: 116.10M (116100605) - TotalCpuTime: 4m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s196ms - TotalStorageWaitTime: 455.757ms CodeGen:(Total: 332.084ms, non-child: 332.084ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 182.678ms - PrepareTime: 146.100ms DataStreamSender (dst_id=5):(Total: 27s434ms, non-child: 27s434ms, % non-child: 100.00%) - BytesSent: 2.41 GB (2585016325) - NetworkThroughput(*): 36.46 MB/sec - OverallThroughput: 89.86 MB/sec - PeakMemoryUsage: 419.93 KB (430008) - SerializeBatchTime: 16s014ms - ThriftTransmitTime(*): 1m7s - UncompressedRowBatchSize: 4.76 GB (5109562104) HDFS_SCAN_NODE (id=1):(Total: 756.618ms, non-child: 756.618ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:96.49% 1:0% 2:1.754% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:1.754% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 426.42 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 898.51 MB, 982.03 MB, 982.03 MB, 982.03 MB, 982.03 MB, 982.03 MB, 982.03 MB, 982.03 MB, 982.03 MB, 1.20 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB, 1.37 GB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 9.26 - BytesRead: 1.37 GB (1469733723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.37 GB (1469733723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.37 GB (1469733723) - DecompressionTime: 5s096ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 983.15 MB (1030905944) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 153.45 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.45K (10450) - ScannerThreadsTotalWallClockTime: 4m20s - MaterializeTupleTime(*): 4m14s - ScannerThreadsSysTime: 582.906ms - ScannerThreadsUserTime: 20s482ms - ScannerThreadsVoluntaryContextSwitches: 113.60K (113596) - TotalRawHdfsReadTime(*): 1s034ms - TotalReadThroughput: 49.18 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcb9 (host=vb0220.halxg.cloudera.com:22000):(Total: 27s432ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(500.000ms): 0, 1001.79 MB, 1002.74 MB, 1002.85 MB, 1003.23 MB, 1003.00 MB, 1002.97 MB, 1002.72 MB, 955.65 MB, 908.34 MB, 836.87 MB, 828.93 MB, 828.82 MB, 828.88 MB, 828.92 MB, 828.63 MB, 780.58 MB, 740.68 MB, 740.77 MB, 669.00 MB, 653.01 MB, 652.64 MB, 652.89 MB, 652.94 MB, 581.10 MB, 564.73 MB, 564.80 MB, 556.81 MB, 492.76 MB, 405.07 MB, 388.85 MB, 389.07 MB, 316.93 MB, 301.30 MB, 300.97 MB, 301.27 MB, 292.87 MB, 228.98 MB, 517.90 MB, 461.52 MB, 461.36 MB, 461.29 MB, 421.86 MB, 382.15 MB, 382.16 MB, 382.23 MB, 342.15 MB, 302.25 MB, 302.29 MB, 262.52 MB, 262.33 MB, 222.34 MB, 182.45 MB, 142.55 MB, 142.25 MB, 102.37 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 9.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 1003.57 MB (1052323864) - PerHostPeakMemUsage: 4.45 GB (4778814784) - PrepareTime: 155.142ms - RowsProduced: 110.74M (110738805) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s130ms - TotalStorageWaitTime: 442.775ms CodeGen:(Total: 361.347ms, non-child: 361.347ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.452ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 302 (302) - NumInstructions: 2.52K (2517) - OptimizationTime: 204.688ms - PrepareTime: 153.137ms DataStreamSender (dst_id=5):(Total: 26s648ms, non-child: 26s648ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2464158658) - NetworkThroughput(*): 37.88 MB/sec - OverallThroughput: 88.19 MB/sec - PeakMemoryUsage: 451.93 KB (462776) - SerializeBatchTime: 15s468ms - ThriftTransmitTime(*): 1m2s - UncompressedRowBatchSize: 4.54 GB (4873590468) HDFS_SCAN_NODE (id=1):(Total: 838.897ms, non-child: 838.897ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 918.83 MB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.09 - BytesRead: 1.31 GB (1401399791) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.31 GB (1401399791) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.31 GB (1401399791) - DecompressionTime: 5s938ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 1003.21 MB (1051943008) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 132.01 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 12.07K (12068) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 4m3s - ScannerThreadsSysTime: 747.881ms - ScannerThreadsUserTime: 24s277ms - ScannerThreadsVoluntaryContextSwitches: 108.37K (108367) - TotalRawHdfsReadTime(*): 977.664ms - TotalReadThroughput: 48.60 MB/sec Fragment F00: Instance cb486002883e0421:e8f30b5b4f47dcc2 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m31s, non-child: 273.749ms, % non-child: 0.30%) Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB MemoryUsage(2s000ms): 140.87 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.14 MB, 141.13 MB, 141.12 MB, 141.12 MB, 141.14 MB, 141.16 MB, 141.10 MB, 141.11 MB, 141.11 MB, 140.95 MB, 141.20 MB, 141.11 MB, 141.08 MB, 53.30 MB, 53.30 MB, 53.38 MB, 92.54 MB, 91.58 MB, 91.53 MB, 91.53 MB, 91.51 MB, 91.54 MB, 26.74 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.42 MB (148293384) - PerHostPeakMemUsage: 11.32 GB (12154977328) - PrepareTime: 181.975us - RowsProduced: 124.58M (124581107) - TotalCpuTime: 16m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 198.875ms DataStreamSender (dst_id=4):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - BytesSent: 798.30 MB (837078213) - NetworkThroughput(*): 1.35 MB/sec - OverallThroughput: 8.81 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 8s914ms - ThriftTransmitTime(*): 9m49s - UncompressedRowBatchSize: 2.32 GB (2492108820) HDFS_SCAN_NODE (id=0):(Total: 579.280ms, non-child: 579.280ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.81 MB 10:3/760.16 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.17 MB 8:2/506.77 MB 3:3/760.17 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.42 - BytesRead: 190.84 MB (200108797) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108797) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108797) - DecompressionTime: 1s512ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.98 MB (147830536) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581107) - RowsReturned: 124.58M (124581107) - RowsReturnedRate: 215.06 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.03K (6025) - ScannerThreadsTotalWallClockTime: 15m52s - MaterializeTupleTime(*): 15m50s - ScannerThreadsSysTime: 498.919ms - ScannerThreadsUserTime: 9s702ms - ScannerThreadsVoluntaryContextSwitches: 121.79K (121786) - TotalRawHdfsReadTime(*): 116.771ms - TotalReadThroughput: 2.09 MB/sec Instance cb486002883e0421:e8f30b5b4f47dccc (host=vb0224.halxg.cloudera.com:22000):(Total: 1m30s, non-child: 141.745ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB MemoryUsage(2s000ms): 138.46 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.62 MB, 138.99 MB, 139.11 MB, 139.03 MB, 139.09 MB, 139.16 MB, 139.13 MB, 139.17 MB, 139.03 MB, 129.14 MB, 51.33 MB, 56.32 MB, 69.29 MB, 91.49 MB, 91.53 MB, 91.49 MB, 91.54 MB, 91.49 MB, 85.49 MB, 36.59 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.43 MB (146204432) - PerHostPeakMemUsage: 11.32 GB (12152352304) - PrepareTime: 180.947us - RowsProduced: 123.88M (123876516) - TotalCpuTime: 16m - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 206.990ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 789.79 MB (828155780) - NetworkThroughput(*): 1.07 MB/sec - OverallThroughput: 8.86 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s895ms - ThriftTransmitTime(*): 12m16s - UncompressedRowBatchSize: 2.31 GB (2478014240) HDFS_SCAN_NODE (id=0):(Total: 732.031ms, non-child: 732.031ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.40 MB 10:1/253.40 MB 4:1/253.38 MB 6:2/506.78 MB 0:2/506.80 MB 1:5/1.24 GB 8:1/253.39 MB 5:2/481.05 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 115.56 MB, 120.86 MB, 136.76 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB, 189.77 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 189.77 MB (198987845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.77 MB (198987845) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.77 MB (198987845) - DecompressionTime: 1s562ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.04 MB (145798928) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876516) - RowsReturned: 123.88M (123876516) - RowsReturnedRate: 169.22 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.16K (6158) - ScannerThreadsTotalWallClockTime: 15m34s - MaterializeTupleTime(*): 15m32s - ScannerThreadsSysTime: 569.908ms - ScannerThreadsUserTime: 10s153ms - ScannerThreadsVoluntaryContextSwitches: 121.18K (121180) - TotalRawHdfsReadTime(*): 130.567ms - TotalReadThroughput: 2.11 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc7 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 103.878ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB MemoryUsage(2s000ms): 140.83 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.01 MB, 141.07 MB, 140.94 MB, 141.06 MB, 141.10 MB, 141.12 MB, 141.10 MB, 141.09 MB, 141.13 MB, 141.04 MB, 141.21 MB, 129.03 MB, 53.30 MB, 53.38 MB, 54.26 MB, 91.34 MB, 91.48 MB, 91.48 MB, 91.57 MB, 91.49 MB, 91.47 MB, 35.66 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317960) - PerHostPeakMemUsage: 11.32 GB (12154777136) - PrepareTime: 194.144us - RowsProduced: 124.58M (124580622) - TotalCpuTime: 15m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 206.016ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 793.75 MB (832303191) - NetworkThroughput(*): 1.59 MB/sec - OverallThroughput: 8.90 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s479ms - ThriftTransmitTime(*): 8m20s - UncompressedRowBatchSize: 2.32 GB (2492099116) HDFS_SCAN_NODE (id=0):(Total: 588.617ms, non-child: 588.617ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:2/506.77 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:1/253.40 MB 9:3/760.16 MB 10:2/506.81 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 116.61 MB, 119.26 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB, 190.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 190.81 MB (200077615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.81 MB (200077615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.81 MB (200077615) - DecompressionTime: 1s333ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580622) - RowsReturned: 124.58M (124580622) - RowsReturnedRate: 211.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.51K (5514) - ScannerThreadsTotalWallClockTime: 15m33s - MaterializeTupleTime(*): 15m31s - ScannerThreadsSysTime: 414.930ms - ScannerThreadsUserTime: 8s647ms - ScannerThreadsVoluntaryContextSwitches: 121.75K (121752) - TotalRawHdfsReadTime(*): 116.707ms - TotalReadThroughput: 2.12 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcce (host=vb0218.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 150.587ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB MemoryUsage(2s000ms): 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 141.04 MB, 140.99 MB, 140.95 MB, 141.05 MB, 141.14 MB, 141.10 MB, 141.21 MB, 141.12 MB, 141.06 MB, 141.12 MB, 141.02 MB, 97.29 MB, 53.40 MB, 53.32 MB, 73.76 MB, 91.55 MB, 91.50 MB, 91.54 MB, 91.50 MB, 91.48 MB, 77.58 MB, 35.65 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301584) - PerHostPeakMemUsage: 11.32 GB (12154949912) - PrepareTime: 183.311us - RowsProduced: 124.58M (124581252) - TotalCpuTime: 15m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 190.215ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 792.59 MB (831088643) - NetworkThroughput(*): 1.33 MB/sec - OverallThroughput: 8.90 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s788ms - ThriftTransmitTime(*): 9m55s - UncompressedRowBatchSize: 2.32 GB (2492111716) HDFS_SCAN_NODE (id=0):(Total: 717.638ms, non-child: 717.638ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:2/506.77 MB 8:2/506.80 MB 1:3/760.16 MB 9:1/253.38 MB 3:1/253.39 MB 4:1/253.40 MB 6:3/760.20 MB 10:2/506.80 MB 2:2/506.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 153.74 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 190.86 MB (200126121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.86 MB (200126121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.86 MB (200126121) - DecompressionTime: 1s540ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581252) - RowsReturned: 124.58M (124581252) - RowsReturnedRate: 173.60 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.92K (5923) - ScannerThreadsTotalWallClockTime: 15m31s - MaterializeTupleTime(*): 15m29s - ScannerThreadsSysTime: 579.908ms - ScannerThreadsUserTime: 9s754ms - ScannerThreadsVoluntaryContextSwitches: 121.85K (121854) - TotalRawHdfsReadTime(*): 124.477ms - TotalReadThroughput: 2.12 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc3 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 108.831ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB MemoryUsage(2s000ms): 140.71 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.93 MB, 140.94 MB, 141.10 MB, 141.11 MB, 141.11 MB, 141.12 MB, 141.08 MB, 141.09 MB, 141.12 MB, 141.14 MB, 119.26 MB, 53.37 MB, 53.35 MB, 62.66 MB, 91.50 MB, 91.52 MB, 91.59 MB, 91.50 MB, 91.50 MB, 77.58 MB, 35.66 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154787912) - PrepareTime: 287.911us - RowsProduced: 124.58M (124581263) - TotalCpuTime: 15m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 227.197ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 792.98 MB (831503415) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 8.90 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 8s657ms - ThriftTransmitTime(*): 11m30s - UncompressedRowBatchSize: 2.32 GB (2492111940) HDFS_SCAN_NODE (id=0):(Total: 576.610ms, non-child: 576.610ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 4:1/253.39 MB 3:1/253.40 MB 1:2/506.77 MB 2:1/253.40 MB 7:2/506.78 MB 5:4/1013.60 MB 6:3/760.22 MB 0:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 116.62 MB, 135.17 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB, 190.82 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 190.82 MB (200084917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200084917) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200084917) - DecompressionTime: 1s439ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581263) - RowsReturned: 124.58M (124581263) - RowsReturnedRate: 216.06 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.42K (5418) - ScannerThreadsTotalWallClockTime: 15m31s - MaterializeTupleTime(*): 15m29s - ScannerThreadsSysTime: 444.927ms - ScannerThreadsUserTime: 9s154ms - ScannerThreadsVoluntaryContextSwitches: 121.73K (121734) - TotalRawHdfsReadTime(*): 124.709ms - TotalReadThroughput: 2.12 MB/sec Instance cb486002883e0421:e8f30b5b4f47dccb (host=vb0208.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 102.354ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB MemoryUsage(2s000ms): 140.53 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.63 MB, 140.64 MB, 140.54 MB, 140.97 MB, 141.14 MB, 141.10 MB, 141.03 MB, 141.10 MB, 141.10 MB, 141.11 MB, 141.11 MB, 117.11 MB, 53.35 MB, 53.32 MB, 61.72 MB, 91.52 MB, 91.52 MB, 91.58 MB, 91.53 MB, 91.54 MB, 69.64 MB, 29.24 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.44 MB (148309768) - PerHostPeakMemUsage: 11.32 GB (12154443856) - PrepareTime: 195.442us - RowsProduced: 124.58M (124581487) - TotalCpuTime: 15m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 201.687ms DataStreamSender (dst_id=4):(Total: 1m29s, non-child: 1m29s, % non-child: 100.00%) - BytesSent: 793.38 MB (831923660) - NetworkThroughput(*): 1.14 MB/sec - OverallThroughput: 8.91 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s511ms - ThriftTransmitTime(*): 11m32s - UncompressedRowBatchSize: 2.32 GB (2492116416) HDFS_SCAN_NODE (id=0):(Total: 617.349ms, non-child: 617.349ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 9:1/253.39 MB 2:2/506.77 MB 3:1/253.40 MB 5:4/1013.59 MB 6:2/506.81 MB 7:1/253.39 MB 4:2/506.78 MB 0:3/760.18 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 135.18 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 190.84 MB (200108048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200108048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200108048) - DecompressionTime: 1s376ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.97 MB (147814152) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581487) - RowsReturned: 124.58M (124581487) - RowsReturnedRate: 201.80 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.60K (5602) - ScannerThreadsTotalWallClockTime: 15m31s - MaterializeTupleTime(*): 15m29s - ScannerThreadsSysTime: 423.931ms - ScannerThreadsUserTime: 8s794ms - ScannerThreadsVoluntaryContextSwitches: 121.76K (121763) - TotalRawHdfsReadTime(*): 134.617ms - TotalReadThroughput: 2.12 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc6 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 144.886ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB MemoryUsage(2s000ms): 140.20 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.24 MB, 140.18 MB, 140.15 MB, 140.91 MB, 141.11 MB, 141.03 MB, 141.09 MB, 141.09 MB, 141.03 MB, 141.14 MB, 141.04 MB, 141.14 MB, 53.28 MB, 53.21 MB, 53.28 MB, 79.38 MB, 79.09 MB, 79.11 MB, 79.16 MB, 79.10 MB, 31.26 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.41 MB (148277000) - PerHostPeakMemUsage: 11.32 GB (12154057960) - PrepareTime: 284.338us - RowsProduced: 118.04M (118040847) - TotalCpuTime: 15m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 212.755ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 749.69 MB (786111896) - NetworkThroughput(*): 1.86 MB/sec - OverallThroughput: 8.50 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 8s516ms - ThriftTransmitTime(*): 6m43s - UncompressedRowBatchSize: 2.20 GB (2361278064) HDFS_SCAN_NODE (id=0):(Total: 735.090ms, non-child: 735.090ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 3:1/253.40 MB 9:2/506.77 MB 4:4/1013.57 MB 6:2/260.77 MB 2:2/506.78 MB 1:2/506.78 MB 0:1/253.40 MB 5:3/760.19 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:19 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB, 181.27 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 181.27 MB (190074309) - BytesReadDataNodeCache: 0 - BytesReadLocal: 181.27 MB (190074309) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181.27 MB (190074309) - DecompressionTime: 1s538ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 118.04M (118040847) - RowsReturned: 118.04M (118040847) - RowsReturnedRate: 160.58 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.18K (7179) - ScannerThreadsTotalWallClockTime: 15m16s - MaterializeTupleTime(*): 15m14s - ScannerThreadsSysTime: 724.885ms - ScannerThreadsUserTime: 10s273ms - ScannerThreadsVoluntaryContextSwitches: 115.48K (115478) - TotalRawHdfsReadTime(*): 111.674ms - TotalReadThroughput: 2.04 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc4 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 97.359ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB MemoryUsage(2s000ms): 138.49 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.58 MB, 138.50 MB, 138.98 MB, 139.10 MB, 139.18 MB, 139.19 MB, 139.15 MB, 139.17 MB, 139.06 MB, 139.13 MB, 95.36 MB, 51.27 MB, 61.29 MB, 80.80 MB, 87.57 MB, 87.51 MB, 87.44 MB, 87.60 MB, 81.55 MB, 41.23 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.45 MB (146220808) - PerHostPeakMemUsage: 11.32 GB (12152231680) - PrepareTime: 334.640us - RowsProduced: 122.02M (122016989) - TotalCpuTime: 15m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 204.531ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 771.96 MB (809462011) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 8.74 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 6s896ms - ThriftTransmitTime(*): 10m42s - UncompressedRowBatchSize: 2.27 GB (2440816436) HDFS_SCAN_NODE (id=0):(Total: 606.381ms, non-child: 606.381ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.76 MB 4:1/253.39 MB 0:1/253.38 MB 7:1/253.41 MB 3:1/253.38 MB 6:1/253.40 MB 2:3/732.63 MB 1:1/253.40 MB 8:4/947.42 MB 10:2/506.79 MB 9:1/253.38 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 115.48 MB, 126.09 MB, 171.76 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB, 186.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 186.98 MB (196063396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 186.98 MB (196063396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 186.98 MB (196063396) - DecompressionTime: 1s305ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.98 MB (145733384) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.02M (122016989) - RowsReturned: 122.02M (122016989) - RowsReturnedRate: 201.22 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.38K (5379) - ScannerThreadsTotalWallClockTime: 15m19s - MaterializeTupleTime(*): 15m17s - ScannerThreadsSysTime: 364.940ms - ScannerThreadsUserTime: 8s243ms - ScannerThreadsVoluntaryContextSwitches: 119.29K (119287) - TotalRawHdfsReadTime(*): 151.293ms - TotalReadThroughput: 2.10 MB/sec Instance cb486002883e0421:e8f30b5b4f47dccd (host=vb0222.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 155.299ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB MemoryUsage(2s000ms): 137.30 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.40 MB, 137.44 MB, 137.53 MB, 137.58 MB, 137.64 MB, 137.70 MB, 137.60 MB, 137.58 MB, 137.66 MB, 137.64 MB, 137.62 MB, 135.61 MB, 58.41 MB, 61.30 MB, 61.28 MB, 79.14 MB, 79.10 MB, 79.08 MB, 77.10 MB, 71.14 MB, 39.00 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.92 MB (144615176) - PerHostPeakMemUsage: 11.32 GB (12151049736) - PrepareTime: 304.508us - RowsProduced: 116.19M (116191050) - TotalCpuTime: 15m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 226.495ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 736.90 MB (772697250) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 8.37 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s883ms - ThriftTransmitTime(*): 10m40s - UncompressedRowBatchSize: 2.16 GB (2324274896) HDFS_SCAN_NODE (id=0):(Total: 764.978ms, non-child: 764.978ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.39 MB 9:1/253.40 MB 10:2/506.83 MB 2:2/506.78 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:3/760.18 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 114.44 MB, 122.39 MB, 125.04 MB, 125.04 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB, 178.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 178.05 MB (186696773) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.05 MB (186696773) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.05 MB (186696773) - DecompressionTime: 1s402ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.52 MB (144201488) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.19M (116191050) - RowsReturned: 116.19M (116191050) - RowsReturnedRate: 151.89 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.07K (6071) - ScannerThreadsTotalWallClockTime: 15m12s - MaterializeTupleTime(*): 15m10s - ScannerThreadsSysTime: 541.911ms - ScannerThreadsUserTime: 9s245ms - ScannerThreadsVoluntaryContextSwitches: 113.61K (113608) - TotalRawHdfsReadTime(*): 116.845ms - TotalReadThroughput: 2.00 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc0 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 132.276ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB MemoryUsage(2s000ms): 140.89 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.88 MB, 140.96 MB, 141.15 MB, 141.15 MB, 141.13 MB, 141.12 MB, 141.20 MB, 141.07 MB, 141.16 MB, 141.07 MB, 141.08 MB, 119.13 MB, 53.42 MB, 53.35 MB, 59.69 MB, 79.10 MB, 79.13 MB, 79.16 MB, 79.11 MB, 79.13 MB, 31.25 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.46 MB (148334352) - PerHostPeakMemUsage: 11.32 GB (12154689048) - PrepareTime: 184.212us - RowsProduced: 117.66M (117659734) - TotalCpuTime: 15m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m5s - TotalStorageWaitTime: 228.316ms DataStreamSender (dst_id=4):(Total: 1m28s, non-child: 1m28s, % non-child: 100.00%) - BytesSent: 745.49 MB (781706700) - NetworkThroughput(*): 1.27 MB/sec - OverallThroughput: 8.45 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 9s014ms - ThriftTransmitTime(*): 9m48s - UncompressedRowBatchSize: 2.19 GB (2353654312) HDFS_SCAN_NODE (id=0):(Total: 676.356ms, non-child: 676.356ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:2/506.81 MB 8:2/506.79 MB 10:1/253.40 MB 0:1/253.40 MB 2:1/253.39 MB 6:3/760.20 MB 5:2/506.77 MB 4:1/253.40 MB 3:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 132.54 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB, 180.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 180.25 MB (189010408) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.25 MB (189010408) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.25 MB (189010408) - DecompressionTime: 1s491ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659734) - RowsReturned: 117.66M (117659734) - RowsReturnedRate: 173.96 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.93K (5933) - ScannerThreadsTotalWallClockTime: 15m12s - MaterializeTupleTime(*): 15m10s - ScannerThreadsSysTime: 614.901ms - ScannerThreadsUserTime: 9s704ms - ScannerThreadsVoluntaryContextSwitches: 115.06K (115058) - TotalRawHdfsReadTime(*): 139.198ms - TotalReadThroughput: 2.03 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc9 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 152.257ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB MemoryUsage(2s000ms): 133.49 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.45 MB, 136.44 MB, 136.43 MB, 136.48 MB, 136.95 MB, 137.05 MB, 137.22 MB, 137.15 MB, 137.09 MB, 137.08 MB, 137.13 MB, 137.17 MB, 120.20 MB, 61.30 MB, 61.34 MB, 67.97 MB, 79.09 MB, 79.10 MB, 79.10 MB, 75.16 MB, 71.10 MB, 26.84 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.56 MB (148437744) - PerHostPeakMemUsage: 11.32 GB (12150060008) - PrepareTime: 293.172us - RowsProduced: 116.10M (116100605) - TotalCpuTime: 15m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 208.314ms DataStreamSender (dst_id=4):(Total: 1m27s, non-child: 1m27s, % non-child: 100.00%) - BytesSent: 735.64 MB (771373776) - NetworkThroughput(*): 961.92 KB/sec - OverallThroughput: 8.37 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 9s852ms - ThriftTransmitTime(*): 13m3s - UncompressedRowBatchSize: 2.16 GB (2322465648) HDFS_SCAN_NODE (id=0):(Total: 724.081ms, non-child: 724.081ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 2:1/253.41 MB 9:2/506.78 MB 4:1/253.40 MB 0:3/698.44 MB 7:2/506.81 MB 8:2/506.80 MB 10:2/506.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(2s000ms): 111.88 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 114.54 MB, 117.19 MB, 125.14 MB, 125.14 MB, 138.39 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB, 178.15 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 178.15 MB (186808443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.15 MB (186808443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.15 MB (186808443) - DecompressionTime: 1s434ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.15 MB (148008920) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100605) - RowsReturned: 116.10M (116100605) - RowsReturnedRate: 160.34 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.73K (5727) - ScannerThreadsTotalWallClockTime: 15m10s - MaterializeTupleTime(*): 15m8s - ScannerThreadsSysTime: 593.903ms - ScannerThreadsUserTime: 9s191ms - ScannerThreadsVoluntaryContextSwitches: 113.56K (113560) - TotalRawHdfsReadTime(*): 112.445ms - TotalReadThroughput: 2.00 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcca (host=vb0230.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 118.923ms, % non-child: 0.13%) Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB MemoryUsage(2s000ms): 140.44 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.59 MB, 140.60 MB, 140.64 MB, 140.60 MB, 140.95 MB, 141.12 MB, 141.11 MB, 141.18 MB, 141.11 MB, 141.16 MB, 141.22 MB, 141.12 MB, 109.15 MB, 53.24 MB, 53.25 MB, 69.52 MB, 79.11 MB, 79.11 MB, 79.10 MB, 79.16 MB, 67.13 MB, 31.27 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.47 MB (148342536) - PerHostPeakMemUsage: 11.32 GB (12154391968) - PrepareTime: 268.476us - RowsProduced: 117.66M (117659841) - TotalCpuTime: 15m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 174.832ms DataStreamSender (dst_id=4):(Total: 1m27s, non-child: 1m27s, % non-child: 100.00%) - BytesSent: 743.93 MB (780064875) - NetworkThroughput(*): 1.36 MB/sec - OverallThroughput: 8.47 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s863ms - ThriftTransmitTime(*): 9m8s - UncompressedRowBatchSize: 2.19 GB (2353656452) HDFS_SCAN_NODE (id=0):(Total: 624.874ms, non-child: 624.874ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.79 MB 5:3/760.18 MB 0:2/506.80 MB 8:3/760.20 MB 4:4/1013.58 MB 9:1/253.39 MB 1:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 148.43 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 180.24 MB (188993466) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188993466) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188993466) - DecompressionTime: 1s271ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.03 MB (147879696) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659841) - RowsReturned: 117.66M (117659841) - RowsReturnedRate: 188.29 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.49K (5492) - ScannerThreadsTotalWallClockTime: 15m8s - MaterializeTupleTime(*): 15m7s - ScannerThreadsSysTime: 457.924ms - ScannerThreadsUserTime: 8s222ms - ScannerThreadsVoluntaryContextSwitches: 115.00K (115000) - TotalRawHdfsReadTime(*): 96.292ms - TotalReadThroughput: 2.04 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc5 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 85.672ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB MemoryUsage(2s000ms): 140.63 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.69 MB, 140.73 MB, 141.06 MB, 141.10 MB, 141.07 MB, 141.08 MB, 141.26 MB, 141.01 MB, 141.08 MB, 141.10 MB, 127.09 MB, 53.42 MB, 53.42 MB, 60.89 MB, 79.10 MB, 79.10 MB, 79.08 MB, 79.06 MB, 69.10 MB, 31.28 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.45 MB (148317960) - PerHostPeakMemUsage: 11.32 GB (12154512840) - PrepareTime: 184.447us - RowsProduced: 117.66M (117660154) - TotalCpuTime: 15m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 202.248ms DataStreamSender (dst_id=4):(Total: 1m27s, non-child: 1m27s, % non-child: 100.00%) - BytesSent: 744.93 MB (781114922) - NetworkThroughput(*): 971.67 KB/sec - OverallThroughput: 8.47 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 5s881ms - ThriftTransmitTime(*): 13m5s - UncompressedRowBatchSize: 2.19 GB (2353662724) HDFS_SCAN_NODE (id=0):(Total: 505.220ms, non-child: 505.220ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 4:1/253.40 MB 5:1/253.40 MB 3:2/506.80 MB 10:2/506.79 MB 8:1/253.38 MB 2:3/760.18 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 9:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 132.53 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 180.24 MB (188999805) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188999805) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188999805) - DecompressionTime: 1s103ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660154) - RowsReturned: 117.66M (117660154) - RowsReturnedRate: 232.89 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 4.50K (4496) - ScannerThreadsTotalWallClockTime: 15m9s - MaterializeTupleTime(*): 15m8s - ScannerThreadsSysTime: 286.953ms - ScannerThreadsUserTime: 6s884ms - ScannerThreadsVoluntaryContextSwitches: 114.98K (114979) - TotalRawHdfsReadTime(*): 132.993ms - TotalReadThroughput: 2.03 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc1 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 105.608ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB MemoryUsage(2s000ms): 138.51 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.63 MB, 138.66 MB, 138.58 MB, 139.00 MB, 139.12 MB, 139.08 MB, 139.10 MB, 139.16 MB, 139.17 MB, 139.20 MB, 139.14 MB, 115.18 MB, 51.31 MB, 53.78 MB, 67.50 MB, 79.11 MB, 79.07 MB, 79.13 MB, 79.10 MB, 61.23 MB, 31.27 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.47 MB (146245384) - PerHostPeakMemUsage: 11.32 GB (12152383848) - PrepareTime: 308.340us - RowsProduced: 117.14M (117138819) - TotalCpuTime: 15m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 192.129ms DataStreamSender (dst_id=4):(Total: 1m27s, non-child: 1m27s, % non-child: 100.00%) - BytesSent: 741.57 MB (777595827) - NetworkThroughput(*): 1.01 MB/sec - OverallThroughput: 8.45 MB/sec - PeakMemoryUsage: 540.00 KB (552960) - SerializeBatchTime: 7s264ms - ThriftTransmitTime(*): 12m14s - UncompressedRowBatchSize: 2.18 GB (2343233996) HDFS_SCAN_NODE (id=0):(Total: 587.809ms, non-child: 587.809ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:1/253.39 MB 0:1/253.42 MB 6:1/253.37 MB 5:2/487.72 MB 1:4/1013.53 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:2/506.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(2s000ms): 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 115.84 MB, 118.49 MB, 142.33 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB, 179.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.26 - BytesRead: 179.43 MB (188149319) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188149319) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188149319) - DecompressionTime: 1s362ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.02 MB (145774352) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138819) - RowsReturned: 117.14M (117138819) - RowsReturnedRate: 199.28 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 5.65K (5649) - ScannerThreadsTotalWallClockTime: 15m7s - MaterializeTupleTime(*): 15m5s - ScannerThreadsSysTime: 479.921ms - ScannerThreadsUserTime: 8s912ms - ScannerThreadsVoluntaryContextSwitches: 114.50K (114503) - TotalRawHdfsReadTime(*): 119.860ms - TotalReadThroughput: 2.03 MB/sec Instance cb486002883e0421:e8f30b5b4f47dcc8 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 154.391ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB MemoryUsage(2s000ms): 140.62 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.81 MB, 140.85 MB, 141.02 MB, 141.14 MB, 141.13 MB, 141.16 MB, 141.14 MB, 141.06 MB, 141.18 MB, 141.08 MB, 139.09 MB, 53.36 MB, 53.38 MB, 55.25 MB, 68.02 MB, 66.74 MB, 66.70 MB, 66.78 MB, 44.73 MB, 20.62 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 11.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.43 MB (148301576) - PerHostPeakMemUsage: 11.32 GB (12154648872) - PrepareTime: 187.671us - RowsProduced: 110.74M (110738805) - TotalCpuTime: 15m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 188.519ms DataStreamSender (dst_id=4):(Total: 1m26s, non-child: 1m26s, % non-child: 100.00%) - BytesSent: 699.73 MB (733722291) - NetworkThroughput(*): 1.09 MB/sec - OverallThroughput: 8.08 MB/sec - PeakMemoryUsage: 524.00 KB (536576) - SerializeBatchTime: 9s059ms - ThriftTransmitTime(*): 10m39s - UncompressedRowBatchSize: 2.06 GB (2215208704) HDFS_SCAN_NODE (id=0):(Total: 747.221ms, non-child: 747.221ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 9:1/253.40 MB 10:1/253.39 MB 7:1/253.41 MB 8:3/760.19 MB 5:1/253.39 MB 0:2/506.80 MB 2:2/506.79 MB 4:3/760.19 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 116.63 MB, 119.29 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB, 169.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.16 - BytesRead: 169.66 MB (177900986) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177900986) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177900986) - DecompressionTime: 1s420ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.02 MB (147871504) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738805) - RowsReturned: 110.74M (110738805) - RowsReturnedRate: 148.20 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.01K (6015) - ScannerThreadsTotalWallClockTime: 14m54s - MaterializeTupleTime(*): 14m52s - ScannerThreadsSysTime: 596.904ms - ScannerThreadsUserTime: 9s246ms - ScannerThreadsVoluntaryContextSwitches: 108.26K (108256) - TotalRawHdfsReadTime(*): 120.931ms - TotalReadThroughput: 1.93 MB/sec ================================================================================