================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 16:EXCHANGE | 1 | 6.93us | 0ns | 6.93us | 0 | 36.00M | | 15:AGGREGATE | 15 | 5.30s | 0ns | 5.83s | 0 | 36.00M | | 14:EXCHANGE | 15 | 908.13ms | 0ns | 1.05s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 3.99s | 0ns | 4.65s | 395.39M | 36.00M | | 00:UNION | 15 | 4.00s | 0ns | 4.88s | 398.68M | 36.00M | | |--08:AGGREGATE | 15 | 9.40s | 0ns | 10.15s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.70s | 0ns | 15.80s | 774.31M | 18.00M | | | |--13:EXCHANGE | 15 | 1.26s | 0ns | 4.86s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 397.84ms | 0ns | 526.70ms | 204.99M | 45.00M | | | 12:EXCHANGE | 15 | 3.09s | 0ns | 5.10s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 688.26ms | 0ns | 743.18ms | 774.31M | 180.00M | | 04:AGGREGATE | 15 | 9.20s | 0ns | 9.80s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.67s | 0ns | 15.09s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 1.05s | 0ns | 1.21s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 392.09ms | 0ns | 506.11ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 3.00s | 0ns | 4.11s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 667.19ms | 0ns | 807.24ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=2b455e6e74ea02a1:93296120d7b96bb2): Summary: Session ID: b34420b9f110d4d9:5d1edbad6a755fad Session Type: BEESWAX Start Time: 2016-03-23 22:55:42.857433000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a57a5e1a62605356dd3271c1488741ea109c4b5a) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:60010 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=2 16:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 15:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 14:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--08:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--13:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 12:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 04:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 35.830ms - Analysis finished: 9.965ms (9.965ms) - Equivalence classes computed: 10.367ms (401.155us) - Single node plan created: 18.327ms (7.960ms) - Runtime filters computed: 18.566ms (238.855us) - Distributed plan created: 29.136ms (10.570ms) - Lineage info computed: 30.306ms (1.170ms) - Planning finished: 35.830ms (5.523ms) Query Timeline: 1m30s - Start execution: 103.129us (103.129us) - Planning finished: 40.657ms (40.554ms) - Ready to start 90 remote fragments: 43.736ms (3.079ms) - All 90 remote fragments started: 54.299ms (10.562ms) - Rows available: 1m30s (1m30s) - First row fetched: 1m30s (76.017ms) ImpalaServer: - ClientFetchWaitTimer: 76.024ms - RowMaterializationTimer: 0.000ns Execution Profile 2b455e6e74ea02a1:93296120d7b96bb2:(Total: 1m30s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: vb0214.halxg.cloudera.com:22000(3.00 GB) vb0208.halxg.cloudera.com:22000(3.14 GB) vb0230.halxg.cloudera.com:22000(3.03 GB) vb0234.halxg.cloudera.com:22000(3.08 GB) vb0212.halxg.cloudera.com:22000(3.02 GB) vb0226.halxg.cloudera.com:22000(3.03 GB) vb0232.halxg.cloudera.com:22000(3.03 GB) vb0216.halxg.cloudera.com:22000(2.97 GB) vb0228.halxg.cloudera.com:22000(3.02 GB) vb0206.halxg.cloudera.com:22000(3.05 GB) vb0220.halxg.cloudera.com:22000(3.02 GB) vb0224.halxg.cloudera.com:22000(3.04 GB) vb0222.halxg.cloudera.com:22000(3.03 GB) vb0218.halxg.cloudera.com:22000(3.00 GB) vb0204.halxg.cloudera.com:22000(3.04 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F08:(Total: 1m30s, non-child: 553.994us, % non-child: 0.00%) MemoryUsage(2s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 102.038us - RowsProduced: 0 (0) - TotalCpuTime: 89.323ms - TotalNetworkReceiveTime: 1m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=16):(Total: 1m30s, non-child: 6.932us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.124us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1m30s - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F07:(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m29s max:1m30s mean: 1m29s stddev:19.017ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.34 MB (971333754) - PerHostPeakMemUsage: 3.03 GB (3257620141) - PrepareTime: 146.868ms - RowsProduced: 0 (0) - TotalCpuTime: 6s398ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 244.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 461.277ms, non-child: 461.277ms, % non-child: 100.00%) - CodegenTime: 2.015ms - CompileTime: 36.414ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 281.100ms - PrepareTime: 140.390ms DataStreamSender (dst_id=16):(Total: 50.553us, non-child: 50.553us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s299ms, % non-child: 5.91%) - BuildTime: 4s381ms - GetNewBlockTime: 633.715us - GetResultsTime: 676.242ms - HTResizeTime: 1s371ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.547us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759418) - ConvertRowBatchTime: 720.391ms - DeserializeRowBatchTimer: 662.986ms - FirstBatchArrivalWaitTime: 33s052ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 312.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m26s max:1m29s mean: 1m27s stddev:916.256ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135796536) - PerHostPeakMemUsage: 3.03 GB (3257620141) - PrepareTime: 158.825ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 22s980ms - TotalNetworkSendTime: 1s132ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 664.241ms, non-child: 664.241ms, % non-child: 100.00%) - CodegenTime: 5.002ms - CompileTime: 128.503ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 391.258ms - PrepareTime: 141.009ms DataStreamSender (dst_id=14):(Total: 5s810ms, non-child: 5s810ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759418) - NetworkThroughput(*): 62.85 MB/sec - OverallThroughput: 49.38 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s138ms - ThriftTransmitTime(*): 4s587ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 3s994ms, % non-child: 4.93%) - GetNewBlockTime: 496.354us - GetResultsTime: 127.266ms - HTResizeTime: 150.126ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 325.27 K/sec - StreamingTime: 3s653ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 3s995ms, % non-child: 5.19%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 344.99 K/sec AGGREGATION_NODE (id=8):(Total: 39s675ms, non-child: 9s395ms, % non-child: 23.68%) - BuildTime: 8s617ms - GetNewBlockTime: 845.573us - GetResultsTime: 627.493ms - HTResizeTime: 1s179ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 335.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.344us HASH_JOIN_NODE (id=7):(Total: 30s280ms, non-child: 13s695ms, % non-child: 45.23%) - BuildPartitionTime: 1s619ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s764ms - GetNewBlockTime: 493.611us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s466ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 1.71 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.207us EXCHANGE_NODE (id=13):(Total: 7s923ms, non-child: 7s923ms, % non-child: 100.00%) - BytesReceived: 252.18 MB (264431880) - ConvertRowBatchTime: 360.097ms - DeserializeRowBatchTimer: 1s388ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 1.74 M/sec - SendersBlockedTimer: 39s758ms - SendersBlockedTotalTimer(*): 9m27s EXCHANGE_NODE (id=12):(Total: 8s661ms, non-child: 8s661ms, % non-child: 100.00%) - BytesReceived: 864.93 MB (906942063) - ConvertRowBatchTime: 1s525ms - DeserializeRowBatchTimer: 5s488ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 53s343ms - SendersBlockedTotalTimer(*): 10m47s AGGREGATION_NODE (id=4):(Total: 33s375ms, non-child: 9s196ms, % non-child: 27.56%) - BuildTime: 8s489ms - GetNewBlockTime: 1.104ms - GetResultsTime: 556.202ms - HTResizeTime: 1s224ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 398.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.363us HASH_JOIN_NODE (id=3):(Total: 24s178ms, non-child: 13s669ms, % non-child: 56.53%) - BuildPartitionTime: 1s583ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s710ms - GetNewBlockTime: 905.142us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s535ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.632us EXCHANGE_NODE (id=11):(Total: 2s525ms, non-child: 2s525ms, % non-child: 100.00%) - BytesReceived: 252.78 MB (265062407) - ConvertRowBatchTime: 351.235ms - DeserializeRowBatchTimer: 1s461ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 5.51 M/sec - SendersBlockedTimer: 13.794ms - SendersBlockedTotalTimer(*): 180.904ms EXCHANGE_NODE (id=10):(Total: 7s984ms, non-child: 7s984ms, % non-child: 100.00%) - BytesReceived: 864.82 MB (906825777) - ConvertRowBatchTime: 1s470ms - DeserializeRowBatchTimer: 5s291ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.51 M/sec - SendersBlockedTimer: 8s053ms - SendersBlockedTotalTimer(*): 1m36s Averaged Fragment F04:(Total: 48s832ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:48s954ms max:49s983ms mean: 49s391ms stddev:300.177ms execution rates: min:23.01 MB/sec max:30.38 MB/sec mean:26.00 MB/sec stddev:2.02 MB/sec num instances: 15 - AverageThreadTokens: 6.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190589816) - PerHostPeakMemUsage: 2.47 GB (2655468093) - PrepareTime: 147.501ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s052ms - TotalStorageWaitTime: 188.604ms CodeGen:(Total: 420.073ms, non-child: 420.073ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.283ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 268.016ms - PrepareTime: 142.888ms DataStreamSender (dst_id=13):(Total: 48s557ms, non-child: 48s557ms, % non-child: 100.00%) - BytesSent: 252.18 MB (264431880) - NetworkThroughput(*): 451.46 KB/sec - OverallThroughput: 5.19 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s015ms - ThriftTransmitTime(*): 9m36s - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=6):(Total: 397.840ms, non-child: 397.840ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.37 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 611.044ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.33 MB (190140569) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 34.71 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1689) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m22s - ScannerThreadsSysTime: 125.911ms - ScannerThreadsUserTime: 4s590ms - ScannerThreadsVoluntaryContextSwitches: 13.21K (13209) - TotalRawHdfsReadTime(*): 127.963ms - TotalReadThroughput: 3.22 MB/sec Averaged Fragment F03:(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:1m16s max:1m19s mean: 1m18s stddev:720.309ms execution rates: min:53.24 MB/sec max:58.13 MB/sec mean:56.16 MB/sec stddev:1.51 MB/sec num instances: 15 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 261.23 MB (273915924) - PerHostPeakMemUsage: 3.02 GB (3245696776) - PrepareTime: 145.850ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 13m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s644ms - TotalStorageWaitTime: 528.961ms CodeGen:(Total: 400.909ms, non-child: 400.909ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.582ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.158ms - PrepareTime: 141.521ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 864.93 MB (906942063) - NetworkThroughput(*): 1.32 MB/sec - OverallThroughput: 11.21 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s419ms - ThriftTransmitTime(*): 11m12s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=5):(Total: 688.264ms, non-child: 688.264ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s985ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.78 MB (273447895) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 75.15 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.08K (12079) - ScannerThreadsTotalWallClockTime: 13m27s - MaterializeTupleTime(*): 13m24s - ScannerThreadsSysTime: 765.211ms - ScannerThreadsUserTime: 21s101ms - ScannerThreadsVoluntaryContextSwitches: 50.49K (50493) - TotalRawHdfsReadTime(*): 299.213ms - TotalReadThroughput: 4.56 MB/sec Averaged Fragment F01:(Total: 3s910ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:3s708ms max:4s813ms mean: 4s206ms stddev:309.482ms execution rates: min:283.28 MB/sec max:329.79 MB/sec mean:305.49 MB/sec stddev:13.07 MB/sec num instances: 15 - AverageThreadTokens: 5.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.77 MB (190601498) - PerHostPeakMemUsage: 1.43 GB (1535797697) - PrepareTime: 144.380ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 23s074ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.210ms - TotalStorageWaitTime: 226.146ms CodeGen:(Total: 402.660ms, non-child: 402.660ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.981ms - PrepareTime: 140.010ms DataStreamSender (dst_id=11):(Total: 3s637ms, non-child: 3s637ms, % non-child: 100.00%) - BytesSent: 252.78 MB (265062407) - NetworkThroughput(*): 38.04 MB/sec - OverallThroughput: 69.52 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s054ms - ThriftTransmitTime(*): 6s645ms - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=2):(Total: 392.092ms, non-child: 392.092ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 5.04 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 589.028ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.33 MB (190135650) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 35.03 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1680) - ScannerThreadsTotalWallClockTime: 19s151ms - MaterializeTupleTime(*): 18s215ms - ScannerThreadsSysTime: 114.113ms - ScannerThreadsUserTime: 4s395ms - ScannerThreadsVoluntaryContextSwitches: 13.21K (13206) - TotalRawHdfsReadTime(*): 130.832ms - TotalReadThroughput: 39.38 MB/sec Averaged Fragment F00:(Total: 31s937ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:30s379ms max:33s431ms mean: 32s379ms stddev:728.030ms execution rates: min:132.37 MB/sec max:138.96 MB/sec mean:135.66 MB/sec stddev:2.26 MB/sec num instances: 15 - AverageThreadTokens: 10.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 261.07 MB (273749312) - PerHostPeakMemUsage: 2.46 GB (2639296858) - PrepareTime: 144.080ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 5m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s215ms - TotalStorageWaitTime: 496.934ms CodeGen:(Total: 397.022ms, non-child: 397.022ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 248.830ms - PrepareTime: 140.447ms DataStreamSender (dst_id=10):(Total: 31s332ms, non-child: 31s332ms, % non-child: 100.00%) - BytesSent: 864.82 MB (906825777) - NetworkThroughput(*): 7.31 MB/sec - OverallThroughput: 27.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s180ms - ThriftTransmitTime(*): 1m59s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=1):(Total: 667.189ms, non-child: 667.189ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.62 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s925ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.63 MB (273293292) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 77.68 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.33K (12331) - ScannerThreadsTotalWallClockTime: 5m7s - MaterializeTupleTime(*): 5m4s - ScannerThreadsSysTime: 743.815ms - ScannerThreadsUserTime: 21s047ms - ScannerThreadsVoluntaryContextSwitches: 50.52K (50522) - TotalRawHdfsReadTime(*): 301.361ms - TotalReadThroughput: 11.07 MB/sec Fragment F07: Instance 2b455e6e74ea02a1:93296120d7b96bc2 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 6.45 MB, 172.88 MB, 445.17 MB, 723.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 894.05 MB, 778.62 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.13 MB (970071600) - PerHostPeakMemUsage: 3.00 GB (3224296520) - PrepareTime: 139.474ms - RowsProduced: 0 (0) - TotalCpuTime: 6s880ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 302.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 403.690ms, non-child: 403.690ms, % non-child: 100.00%) - CodegenTime: 1.143ms - CompileTime: 44.473ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 221.502ms - PrepareTime: 136.335ms DataStreamSender (dst_id=16):(Total: 11.700us, non-child: 11.700us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s789ms, % non-child: 6.45%) ExecOption: Codegen Enabled - BuildTime: 4s853ms - GetNewBlockTime: 421.232us - GetResultsTime: 702.261ms - HTResizeTime: 1s466ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.580us EXCHANGE_NODE (id=14):(Total: 1m23s, non-child: 943.240ms, % non-child: 1.12%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 682.85 KB, 29.13 MB, 72.14 MB, 115.36 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.76 MB, 156.36 MB, 191.13 MB, 225.77 MB, 263.66 MB - BytesReceived: 283.93 MB (297721542) - ConvertRowBatchTime: 759.929ms - DeserializeRowBatchTimer: 758.581ms - FirstBatchArrivalWaitTime: 33s141ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 313.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb5 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 12.82 MB, 199.66 MB, 454.02 MB, 723.48 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 894.06 MB, 687.54 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.24 MB (970180720) - PerHostPeakMemUsage: 3.03 GB (3254188152) - PrepareTime: 150.458ms - RowsProduced: 0 (0) - TotalCpuTime: 7s008ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 185.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.620ms, non-child: 434.620ms, % non-child: 100.00%) - CodegenTime: 1.106ms - CompileTime: 27.940ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.944ms - PrepareTime: 144.743ms DataStreamSender (dst_id=16):(Total: 12.073us, non-child: 12.073us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s808ms, % non-child: 6.47%) ExecOption: Codegen Enabled - BuildTime: 4s836ms - GetNewBlockTime: 450.218us - GetResultsTime: 701.338ms - HTResizeTime: 1s470ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.473us EXCHANGE_NODE (id=14):(Total: 1m23s, non-child: 1s045ms, % non-child: 1.25%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.82 MB, 33.64 MB, 73.18 MB, 116.05 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 161.07 MB, 199.03 MB, 233.30 MB, 269.06 MB - BytesReceived: 284.05 MB (297848237) - ConvertRowBatchTime: 841.747ms - DeserializeRowBatchTimer: 729.027ms - FirstBatchArrivalWaitTime: 33s070ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 314.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bbc (host=vb0226.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.96 MB, 189.17 MB, 432.81 MB, 688.44 MB, 871.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.04 MB, 888.05 MB, 906.04 MB, 665.37 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.24 MB (972286736) - PerHostPeakMemUsage: 3.03 GB (3252945744) - PrepareTime: 134.337ms - RowsProduced: 0 (0) - TotalCpuTime: 5s654ms - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 468.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 397.238ms, non-child: 397.238ms, % non-child: 100.00%) - CodegenTime: 1.119ms - CompileTime: 22.165ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 242.601ms - PrepareTime: 130.462ms DataStreamSender (dst_id=16):(Total: 10.015us, non-child: 10.015us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 4s760ms, % non-child: 5.31%) ExecOption: Codegen Enabled - BuildTime: 3s853ms - GetNewBlockTime: 588.127us - GetResultsTime: 688.762ms - HTResizeTime: 1s302ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.428us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 758.357ms, % non-child: 0.89%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.78 MB, 31.12 MB, 70.90 MB, 109.52 MB, 138.91 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 163.08 MB, 207.67 MB, 256.11 MB, 283.96 MB - BytesReceived: 283.96 MB (297751133) - ConvertRowBatchTime: 577.146ms - DeserializeRowBatchTimer: 587.363ms - FirstBatchArrivalWaitTime: 33s102ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 310.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb4 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.45 MB, 209.94 MB, 495.72 MB, 785.57 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.04 MB, 888.05 MB, 736.16 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.40 MB (970355312) - PerHostPeakMemUsage: 3.00 GB (3224037496) - PrepareTime: 133.831ms - RowsProduced: 0 (0) - TotalCpuTime: 5s579ms - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 398.924ms, non-child: 398.924ms, % non-child: 100.00%) - CodegenTime: 1.234ms - CompileTime: 30.926ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 236.018ms - PrepareTime: 130.719ms DataStreamSender (dst_id=16):(Total: 13.878us, non-child: 13.878us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 4s599ms, % non-child: 5.13%) ExecOption: Codegen Enabled - BuildTime: 3s696ms - GetNewBlockTime: 349.082us - GetResultsTime: 687.199ms - HTResizeTime: 1s188ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.224us EXCHANGE_NODE (id=14):(Total: 1m25s, non-child: 832.616ms, % non-child: 0.98%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.52 MB, 34.06 MB, 79.87 MB, 125.26 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.75 MB, 155.99 MB, 185.14 MB, 218.16 MB, 257.20 MB - BytesReceived: 283.91 MB (297701968) - ConvertRowBatchTime: 654.108ms - DeserializeRowBatchTimer: 583.738ms - FirstBatchArrivalWaitTime: 33s090ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 309.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bbd (host=vb0212.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.46 MB, 181.01 MB, 455.27 MB, 736.60 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 894.05 MB, 721.99 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.13 MB (971119152) - PerHostPeakMemUsage: 3.02 GB (3247760064) - PrepareTime: 148.915ms - RowsProduced: 0 (0) - TotalCpuTime: 7s055ms - TotalNetworkReceiveTime: 1m22s - TotalNetworkSendTime: 269.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 468.894ms, non-child: 468.894ms, % non-child: 100.00%) - CodegenTime: 1.288ms - CompileTime: 40.388ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 281.571ms - PrepareTime: 142.613ms DataStreamSender (dst_id=16):(Total: 13.796us, non-child: 13.796us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s831ms, % non-child: 6.50%) ExecOption: Codegen Enabled - BuildTime: 4s877ms - GetNewBlockTime: 550.379us - GetResultsTime: 660.922ms - HTResizeTime: 1s492ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.916us EXCHANGE_NODE (id=14):(Total: 1m23s, non-child: 1s040ms, % non-child: 1.24%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.52 MB, 30.03 MB, 74.10 MB, 117.29 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 158.76 MB, 195.65 MB, 233.21 MB, 268.69 MB - BytesReceived: 284.01 MB (297804268) - ConvertRowBatchTime: 833.723ms - DeserializeRowBatchTimer: 725.613ms - FirstBatchArrivalWaitTime: 33s064ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 314.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bbb (host=vb0232.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.58 MB, 141.30 MB, 376.12 MB, 603.94 MB, 831.72 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.04 MB, 894.05 MB, 821.09 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.98 MB (972013936) - PerHostPeakMemUsage: 3.03 GB (3250756880) - PrepareTime: 154.098ms - RowsProduced: 0 (0) - TotalCpuTime: 6s619ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 246.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 460.115ms, non-child: 460.115ms, % non-child: 100.00%) - CodegenTime: 1.307ms - CompileTime: 34.106ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 275.462ms - PrepareTime: 149.464ms DataStreamSender (dst_id=16):(Total: 12.049us, non-child: 12.049us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s459ms, % non-child: 6.09%) ExecOption: Codegen Enabled - BuildTime: 4s533ms - GetNewBlockTime: 563.686us - GetResultsTime: 679.722ms - HTResizeTime: 1s384ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.681us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 979.276ms, % non-child: 1.16%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.47 MB, 33.16 MB, 69.81 MB, 106.82 MB, 138.47 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.83 MB, 159.53 MB, 196.44 MB, 230.90 MB, 273.44 MB - BytesReceived: 284.08 MB (297874280) - ConvertRowBatchTime: 791.313ms - DeserializeRowBatchTimer: 680.330ms - FirstBatchArrivalWaitTime: 33s049ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 313.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bc0 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.46 MB, 152.19 MB, 361.08 MB, 575.21 MB, 769.36 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 888.06 MB, 906.06 MB, 693.69 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.90 MB (972974192) - PerHostPeakMemUsage: 3.14 GB (3368530816) - PrepareTime: 146.333ms - RowsProduced: 0 (0) - TotalCpuTime: 6s167ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 239.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 452.091ms, non-child: 452.091ms, % non-child: 100.00%) - CodegenTime: 1.255ms - CompileTime: 28.159ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 279.564ms - PrepareTime: 143.172ms DataStreamSender (dst_id=16):(Total: 12.701us, non-child: 12.701us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s178ms, % non-child: 5.78%) ExecOption: Codegen Enabled - BuildTime: 4s266ms - GetNewBlockTime: 446.171us - GetResultsTime: 677.447ms - HTResizeTime: 1s330ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.458us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 799.896ms, % non-child: 0.95%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.42 MB, 26.52 MB, 58.72 MB, 91.77 MB, 124.14 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.73 MB, 160.31 MB, 206.04 MB, 253.77 MB, 283.87 MB - BytesReceived: 283.87 MB (297663874) - ConvertRowBatchTime: 626.736ms - DeserializeRowBatchTimer: 607.022ms - FirstBatchArrivalWaitTime: 33s080ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 311.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bbe (host=vb0234.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 5.45 MB, 196.25 MB, 525.66 MB, 824.80 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 900.04 MB, 792.78 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.84 MB (972908720) - PerHostPeakMemUsage: 3.08 GB (3311730816) - PrepareTime: 158.209ms - RowsProduced: 0 (0) - TotalCpuTime: 5s241ms - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 266.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 463.506ms, non-child: 463.506ms, % non-child: 100.00%) - CodegenTime: 7.497ms - CompileTime: 40.954ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 272.547ms - PrepareTime: 140.972ms DataStreamSender (dst_id=16):(Total: 16.370us, non-child: 16.370us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 4s355ms, % non-child: 4.86%) ExecOption: Codegen Enabled - BuildTime: 3s450ms - GetNewBlockTime: 439.014us - GetResultsTime: 667.584ms - HTResizeTime: 1s207ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.933us EXCHANGE_NODE (id=14):(Total: 1m25s, non-child: 659.906ms, % non-child: 0.77%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.98 MB, 45.98 MB, 97.00 MB, 137.85 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.94 MB, 159.52 MB, 197.25 MB, 242.70 MB, 283.95 MB - BytesReceived: 283.95 MB (297741304) - ConvertRowBatchTime: 525.713ms - DeserializeRowBatchTimer: 498.909ms - FirstBatchArrivalWaitTime: 33s067ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 309.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb7 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 7.47 MB, 154.21 MB, 426.34 MB, 698.56 MB, 873.11 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 902.05 MB, 792.78 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.49 MB (972543168) - PerHostPeakMemUsage: 3.02 GB (3240529664) - PrepareTime: 140.555ms - RowsProduced: 0 (0) - TotalCpuTime: 6s424ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 148.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 449.036ms, non-child: 449.036ms, % non-child: 100.00%) - CodegenTime: 2.750ms - CompileTime: 39.271ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 272.864ms - PrepareTime: 132.009ms DataStreamSender (dst_id=16):(Total: 576.354us, non-child: 576.354us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s380ms, % non-child: 6.00%) ExecOption: Codegen Enabled - BuildTime: 4s491ms - GetNewBlockTime: 710.389us - GetResultsTime: 665.566ms - HTResizeTime: 1s452ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.536us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 838.933ms, % non-child: 1.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.69 MB, 37.13 MB, 79.20 MB, 119.56 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 160.97 MB, 198.95 MB, 245.95 MB, 282.70 MB - BytesReceived: 283.82 MB (297606551) - ConvertRowBatchTime: 671.854ms - DeserializeRowBatchTimer: 622.181ms - FirstBatchArrivalWaitTime: 33s044ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 312.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bbf (host=vb0230.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.51 MB, 152.19 MB, 401.70 MB, 640.45 MB, 844.25 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.05 MB, 730.16 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.32 MB (970273472) - PerHostPeakMemUsage: 3.03 GB (3248247568) - PrepareTime: 147.367ms - RowsProduced: 0 (0) - TotalCpuTime: 6s455ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 342.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 460.649ms, non-child: 460.649ms, % non-child: 100.00%) - CodegenTime: 1.294ms - CompileTime: 34.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 280.942ms - PrepareTime: 144.117ms DataStreamSender (dst_id=16):(Total: 12.361us, non-child: 12.361us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s318ms, % non-child: 5.93%) ExecOption: Codegen Enabled - BuildTime: 4s420ms - GetNewBlockTime: 448.086us - GetResultsTime: 663.118ms - HTResizeTime: 1s352ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.336us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 986.018ms, % non-child: 1.17%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.20 MB, 27.34 MB, 64.98 MB, 101.96 MB, 134.82 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 153.96 MB, 181.49 MB, 210.91 MB, 241.44 MB - BytesReceived: 283.98 MB (297773877) - ConvertRowBatchTime: 759.166ms - DeserializeRowBatchTimer: 813.175ms - FirstBatchArrivalWaitTime: 33s068ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 312.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb9 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.46 MB, 187.54 MB, 463.88 MB, 716.90 MB, 876.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.05 MB, 722.00 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.32 MB (969220464) - PerHostPeakMemUsage: 3.02 GB (3241615072) - PrepareTime: 135.638ms - RowsProduced: 0 (0) - TotalCpuTime: 6s389ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 159.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 488.412ms, non-child: 488.412ms, % non-child: 100.00%) - CodegenTime: 993.750us - CompileTime: 32.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 321.499ms - PrepareTime: 131.828ms DataStreamSender (dst_id=16):(Total: 10.997us, non-child: 10.997us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s216ms, % non-child: 5.82%) ExecOption: Codegen Enabled - BuildTime: 4s286ms - GetNewBlockTime: 449.500us - GetResultsTime: 691.256ms - HTResizeTime: 1s275ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.293us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 958.986ms, % non-child: 1.14%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.56 MB, 31.32 MB, 74.57 MB, 116.10 MB, 139.94 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 154.13 MB, 184.92 MB, 215.51 MB, 248.07 MB - BytesReceived: 283.97 MB (297762949) - ConvertRowBatchTime: 748.173ms - DeserializeRowBatchTimer: 709.886ms - FirstBatchArrivalWaitTime: 32s996ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 312.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb6 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.88 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 6.45 MB, 150.20 MB, 398.36 MB, 683.65 MB, 876.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 894.05 MB, 778.63 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.87 MB (970840896) - PerHostPeakMemUsage: 3.04 GB (3269264312) - PrepareTime: 149.492ms - RowsProduced: 0 (0) - TotalCpuTime: 6s065ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 254.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 470.287ms, non-child: 470.287ms, % non-child: 100.00%) - CodegenTime: 1.260ms - CompileTime: 36.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 286.271ms - PrepareTime: 144.151ms DataStreamSender (dst_id=16):(Total: 12.500us, non-child: 12.500us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 4s996ms, % non-child: 5.58%) ExecOption: Codegen Enabled - BuildTime: 4s099ms - GetNewBlockTime: 437.995us - GetResultsTime: 659.118ms - HTResizeTime: 1s273ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.247us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 857.489ms, % non-child: 1.01%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 769.35 KB, 24.80 MB, 63.81 MB, 109.85 MB, 140.30 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.80 MB, 155.64 MB, 193.76 MB, 232.00 MB, 269.25 MB - BytesReceived: 284.01 MB (297803129) - ConvertRowBatchTime: 688.258ms - DeserializeRowBatchTimer: 648.854ms - FirstBatchArrivalWaitTime: 33s032ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 311.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bba (host=vb0216.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 4.70 MB, 146.20 MB, 438.24 MB, 729.47 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.05 MB, 882.05 MB, 894.05 MB, 821.10 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.45 MB (970404416) - PerHostPeakMemUsage: 2.97 GB (3190662720) - PrepareTime: 158.014ms - RowsProduced: 0 (0) - TotalCpuTime: 6s944ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 197.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.505ms, non-child: 480.505ms, % non-child: 100.00%) - CodegenTime: 2.434ms - CompileTime: 34.325ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 294.472ms - PrepareTime: 146.421ms DataStreamSender (dst_id=16):(Total: 14.976us, non-child: 14.976us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s700ms, % non-child: 6.36%) ExecOption: Codegen Enabled - BuildTime: 4s782ms - GetNewBlockTime: 1.551ms - GetResultsTime: 661.810ms - HTResizeTime: 1s473ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.211us EXCHANGE_NODE (id=14):(Total: 1m23s, non-child: 1s052ms, % non-child: 1.25%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.66 MB, 35.35 MB, 82.20 MB, 127.90 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.79 MB, 167.21 MB, 204.35 MB, 236.40 MB, 272.55 MB - BytesReceived: 283.89 MB (297681591) - ConvertRowBatchTime: 840.012ms - DeserializeRowBatchTimer: 635.149ms - FirstBatchArrivalWaitTime: 33s021ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 314.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bc1 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 5.45 MB, 138.19 MB, 382.33 MB, 618.56 MB, 866.24 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.05 MB, 906.05 MB, 786.65 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.69 MB (972755952) - PerHostPeakMemUsage: 3.04 GB (3264931072) - PrepareTime: 162.536ms - RowsProduced: 0 (0) - TotalCpuTime: 6s619ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 120.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 526.236ms, non-child: 526.236ms, % non-child: 100.00%) - CodegenTime: 4.241ms - CompileTime: 67.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 302.068ms - PrepareTime: 148.421ms DataStreamSender (dst_id=16):(Total: 14.373us, non-child: 14.373us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s479ms, % non-child: 6.12%) ExecOption: Codegen Enabled - BuildTime: 4s571ms - GetNewBlockTime: 1.661ms - GetResultsTime: 659.513ms - HTResizeTime: 1s439ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.253us EXCHANGE_NODE (id=14):(Total: 1m24s, non-child: 892.447ms, % non-child: 1.06%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.92 MB, 32.95 MB, 72.35 MB, 110.65 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.83 MB, 162.40 MB, 200.52 MB, 248.32 MB, 283.95 MB - BytesReceived: 283.95 MB (297740916) - ConvertRowBatchTime: 711.011ms - DeserializeRowBatchTimer: 642.964ms - FirstBatchArrivalWaitTime: 33s018ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 313.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2b455e6e74ea02a1:93296120d7b96bb8 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.45 MB, 182.06 MB, 457.79 MB, 747.27 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 750.31 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.03 MB (972057584) - PerHostPeakMemUsage: 3.05 GB (3274805224) - PrepareTime: 143.759ms - RowsProduced: 0 (0) - TotalCpuTime: 6s876ms - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 330.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 564.959ms, non-child: 564.959ms, % non-child: 100.00%) - CodegenTime: 1.304ms - CompileTime: 31.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 391.175ms - PrepareTime: 140.425ms DataStreamSender (dst_id=16):(Total: 14.158us, non-child: 14.158us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m29s, non-child: 5s614ms, % non-child: 6.27%) ExecOption: Codegen Enabled - BuildTime: 4s702ms - GetNewBlockTime: 439.121us - GetResultsTime: 678.006ms - HTResizeTime: 1s466ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.649us EXCHANGE_NODE (id=14):(Total: 1m23s, non-child: 977.364ms, % non-child: 1.16%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.24 MB, 30.69 MB, 74.52 MB, 119.85 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 153.27 MB, 183.24 MB, 215.54 MB, 246.25 MB - BytesReceived: 284.11 MB (297915658) - ConvertRowBatchTime: 776.980ms - DeserializeRowBatchTimer: 701.996ms - FirstBatchArrivalWaitTime: 32s939ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 314.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance 2b455e6e74ea02a1:93296120d7b96bce (host=vb0230.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 207.54 MB, 514.36 MB, 818.34 MB, 1.15 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.57 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.80 GB, 1.67 GB, 726.87 MB, 508.04 MB, 289.24 MB, 163.07 MB, 182.78 MB, 182.78 MB, 320.82 MB, 582.15 MB, 942.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.40 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.54 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.02 MB, 603.64 MB, 447.24 MB, 266.78 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135644504) - PerHostPeakMemUsage: 3.03 GB (3248247568) - PrepareTime: 162.207ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 1m22s - TotalNetworkReceiveTime: 23s464ms - TotalNetworkSendTime: 1s545ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 690.932ms, non-child: 690.932ms, % non-child: 100.00%) - CodegenTime: 3.573ms - CompileTime: 122.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 418.798ms - PrepareTime: 146.004ms DataStreamSender (dst_id=14):(Total: 7s112ms, non-child: 7s112ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297773877) - NetworkThroughput(*): 47.44 MB/sec - OverallThroughput: 39.93 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s529ms - ThriftTransmitTime(*): 5s986ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 4s648ms, % non-child: 5.70%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 351.484us - GetResultsTime: 146.012ms - HTResizeTime: 165.509ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 323.40 K/sec - StreamingTime: 4s272ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 4s268ms, % non-child: 5.55%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 345.81 K/sec AGGREGATION_NODE (id=8):(Total: 39s182ms, non-child: 9s452ms, % non-child: 24.12%) ExecOption: Codegen Enabled - BuildTime: 8s457ms - GetNewBlockTime: 626.014us - GetResultsTime: 866.162ms - HTResizeTime: 1s269ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 339.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.229us HASH_JOIN_NODE (id=7):(Total: 29s730ms, non-child: 13s734ms, % non-child: 46.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s160ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s769ms - GetNewBlockTime: 518.407us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s949ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 1.74 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.188us EXCHANGE_NODE (id=13):(Total: 6s642ms, non-child: 1s359ms, % non-child: 20.47%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 10.47 MB, 10.47 MB, 87.23 MB, 219.00 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB - BytesReceived: 252.21 MB (264459691) - ConvertRowBatchTime: 474.670ms - DeserializeRowBatchTimer: 1s620ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 2.06 M/sec - SendersBlockedTimer: 40s981ms - SendersBlockedTotalTimer(*): 9m30s EXCHANGE_NODE (id=12):(Total: 9s353ms, non-child: 3s107ms, % non-child: 33.22%) BytesReceived(2s000ms): 7.59 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 32.04 MB, 100.13 MB, 164.38 MB, 230.22 MB, 302.49 MB, 368.97 MB, 428.62 MB, 492.70 MB, 559.62 MB, 624.88 MB, 689.53 MB, 754.61 MB, 817.76 MB - BytesReceived: 865.00 MB (907022910) - ConvertRowBatchTime: 1s396ms - DeserializeRowBatchTimer: 6s174ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 5.52 M/sec - SendersBlockedTimer: 51s722ms - SendersBlockedTotalTimer(*): 12m4s AGGREGATION_NODE (id=4):(Total: 33s414ms, non-child: 9s352ms, % non-child: 27.99%) ExecOption: Codegen Enabled - BuildTime: 8s601ms - GetNewBlockTime: 538.670us - GetResultsTime: 613.218ms - HTResizeTime: 1s256ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 397.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.226us HASH_JOIN_NODE (id=3):(Total: 24s061ms, non-child: 12s479ms, % non-child: 51.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s122ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s768ms - GetNewBlockTime: 734.145us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s768ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.215us EXCHANGE_NODE (id=11):(Total: 2s971ms, non-child: 1s120ms, % non-child: 37.72%) BytesReceived(1s000ms): 6.75 MB, 65.03 MB, 134.63 MB, 204.75 MB, 249.58 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB - BytesReceived: 252.81 MB (265094502) - ConvertRowBatchTime: 240.360ms - DeserializeRowBatchTimer: 1s693ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 4.60 M/sec - SendersBlockedTimer: 29.746ms - SendersBlockedTotalTimer(*): 389.352ms EXCHANGE_NODE (id=10):(Total: 8s610ms, non-child: 2s984ms, % non-child: 34.66%) BytesReceived(1s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 16.29 MB, 53.54 MB, 97.76 MB, 128.03 MB, 160.28 MB, 192.25 MB, 220.61 MB, 252.24 MB, 284.23 MB, 316.34 MB, 349.23 MB, 383.08 MB, 415.86 MB, 454.15 MB, 498.62 MB, 531.12 MB, 562.65 MB, 594.35 MB, 626.04 MB, 657.08 MB, 688.90 MB, 720.78 MB, 758.59 MB, 797.32 MB, 827.08 MB, 851.19 MB - BytesReceived: 864.91 MB (906921742) - ConvertRowBatchTime: 1s579ms - DeserializeRowBatchTimer: 5s207ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 6.00 M/sec - SendersBlockedTimer: 6s535ms - SendersBlockedTotalTimer(*): 1m37s Instance 2b455e6e74ea02a1:93296120d7b96bc8 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.31 MB, 514.75 MB, 818.34 MB, 1.14 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.57 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.80 GB, 1.67 GB, 690.38 MB, 459.41 MB, 240.61 MB, 166.86 MB, 182.80 MB, 182.80 MB, 310.81 MB, 574.83 MB, 950.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.40 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.55 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.02 MB, 579.58 MB, 411.13 MB, 242.71 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135938408) - PerHostPeakMemUsage: 3.02 GB (3241615072) - PrepareTime: 144.511ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 24s729ms - TotalNetworkSendTime: 1s195ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 651.385ms, non-child: 651.385ms, % non-child: 100.00%) - CodegenTime: 4.584ms - CompileTime: 107.522ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 410.670ms - PrepareTime: 130.872ms DataStreamSender (dst_id=14):(Total: 6s267ms, non-child: 6s267ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297762949) - NetworkThroughput(*): 56.88 MB/sec - OverallThroughput: 45.31 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s308ms - ThriftTransmitTime(*): 4s992ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 4s491ms, % non-child: 5.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 204.440us - GetResultsTime: 145.958ms - HTResizeTime: 163.152ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 322.46 K/sec - StreamingTime: 4s143ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 4s244ms, % non-child: 5.49%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 344.05 K/sec AGGREGATION_NODE (id=8):(Total: 39s633ms, non-child: 9s124ms, % non-child: 23.02%) ExecOption: Codegen Enabled - BuildTime: 8s281ms - GetNewBlockTime: 507.273us - GetResultsTime: 698.671ms - HTResizeTime: 1s156ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 335.30 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.317us HASH_JOIN_NODE (id=7):(Total: 30s509ms, non-child: 12s947ms, % non-child: 42.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s318ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s641ms - GetNewBlockTime: 429.855us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s155ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.171us EXCHANGE_NODE (id=13):(Total: 8s102ms, non-child: 525.288ms, % non-child: 6.48%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.16 MB, 10.48 MB, 10.48 MB, 88.51 MB, 219.74 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB - BytesReceived: 252.17 MB (264421967) - ConvertRowBatchTime: 257.323ms - DeserializeRowBatchTimer: 947.056ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 1.69 M/sec - SendersBlockedTimer: 39s844ms - SendersBlockedTotalTimer(*): 9m18s EXCHANGE_NODE (id=12):(Total: 9s459ms, non-child: 2s703ms, % non-child: 28.58%) BytesReceived(2s000ms): 7.57 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 32.70 MB, 100.77 MB, 165.03 MB, 230.88 MB, 303.10 MB, 369.58 MB, 429.10 MB, 493.32 MB, 560.13 MB, 625.40 MB, 690.14 MB, 755.12 MB, 817.95 MB - BytesReceived: 864.82 MB (906830521) - ConvertRowBatchTime: 1s474ms - DeserializeRowBatchTimer: 4s905ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 5.46 M/sec - SendersBlockedTimer: 51s547ms - SendersBlockedTotalTimer(*): 9m26s AGGREGATION_NODE (id=4):(Total: 33s374ms, non-child: 9s042ms, % non-child: 27.09%) ExecOption: Codegen Enabled - BuildTime: 8s329ms - GetNewBlockTime: 1.528ms - GetResultsTime: 567.298ms - HTResizeTime: 1s236ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 398.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.644us HASH_JOIN_NODE (id=3):(Total: 24s332ms, non-child: 13s315ms, % non-child: 54.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s556ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s954ms - GetNewBlockTime: 774.008us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s964ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.337us EXCHANGE_NODE (id=11):(Total: 2s564ms, non-child: 1s162ms, % non-child: 45.33%) BytesReceived(1s000ms): 7.33 MB, 66.24 MB, 135.79 MB, 205.89 MB, 249.82 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB - BytesReceived: 252.78 MB (265063694) - ConvertRowBatchTime: 342.427ms - DeserializeRowBatchTimer: 1s610ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s452ms, non-child: 3s300ms, % non-child: 39.05%) BytesReceived(1s000ms): 5.05 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 16.62 MB, 54.38 MB, 98.35 MB, 128.73 MB, 160.91 MB, 192.89 MB, 220.97 MB, 252.85 MB, 284.87 MB, 316.94 MB, 349.80 MB, 383.63 MB, 416.23 MB, 454.97 MB, 499.28 MB, 531.56 MB, 563.19 MB, 594.86 MB, 626.57 MB, 657.66 MB, 689.42 MB, 721.43 MB, 759.12 MB, 797.93 MB, 827.35 MB, 851.56 MB - BytesReceived: 864.71 MB (906718144) - ConvertRowBatchTime: 1s391ms - DeserializeRowBatchTimer: 6s093ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 6.11 M/sec - SendersBlockedTimer: 8s386ms - SendersBlockedTotalTimer(*): 1m39s Instance 2b455e6e74ea02a1:93296120d7b96bc7 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m28s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 205.82 MB, 514.42 MB, 826.33 MB, 1.15 GB, 1.37 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.80 GB, 1.67 GB, 690.38 MB, 459.41 MB, 204.14 MB, 182.82 MB, 182.80 MB, 182.80 MB, 311.46 MB, 567.23 MB, 934.78 MB, 1.24 GB, 1.33 GB, 1.35 GB, 1.40 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.01 MB, 603.64 MB, 411.15 MB, 254.75 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2137909408) - PerHostPeakMemUsage: 3.05 GB (3274805224) - PrepareTime: 148.387ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 1m23s - TotalNetworkReceiveTime: 22s596ms - TotalNetworkSendTime: 1s131ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 662.462ms, non-child: 662.462ms, % non-child: 100.00%) - CodegenTime: 3.255ms - CompileTime: 127.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 396.128ms - PrepareTime: 137.416ms DataStreamSender (dst_id=14):(Total: 5s906ms, non-child: 5s906ms, % non-child: 100.00%) - BytesSent: 284.11 MB (297915658) - NetworkThroughput(*): 61.56 MB/sec - OverallThroughput: 48.10 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s215ms - ThriftTransmitTime(*): 4s615ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 1m22s, non-child: 4s117ms, % non-child: 5.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 180.141us - GetResultsTime: 136.923ms - HTResizeTime: 163.976ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278191) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 321.25 K/sec - StreamingTime: 3s773ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 4s538ms, % non-child: 5.82%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 341.03 K/sec AGGREGATION_NODE (id=8):(Total: 40s102ms, non-child: 9s541ms, % non-child: 23.79%) ExecOption: Codegen Enabled - BuildTime: 8s719ms - GetNewBlockTime: 1.226ms - GetResultsTime: 686.634ms - HTResizeTime: 1s210ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 331.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.525us HASH_JOIN_NODE (id=7):(Total: 30s560ms, non-child: 14s126ms, % non-child: 46.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s950ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s696ms - GetNewBlockTime: 528.912us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s647ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.798us EXCHANGE_NODE (id=13):(Total: 7s961ms, non-child: 1s215ms, % non-child: 15.27%) BytesReceived(2s000ms): 7.60 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.20 MB, 10.51 MB, 10.51 MB, 85.36 MB, 217.91 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB - BytesReceived: 252.33 MB (264589106) - ConvertRowBatchTime: 461.052ms - DeserializeRowBatchTimer: 1s538ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 1.72 M/sec - SendersBlockedTimer: 39s345ms - SendersBlockedTotalTimer(*): 9m50s EXCHANGE_NODE (id=12):(Total: 8s472ms, non-child: 2s664ms, % non-child: 31.45%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 31.19 MB, 99.15 MB, 163.43 MB, 229.17 MB, 301.70 MB, 368.37 MB, 428.09 MB, 491.90 MB, 558.80 MB, 624.09 MB, 688.93 MB, 754.02 MB, 817.30 MB - BytesReceived: 865.32 MB (907349763) - ConvertRowBatchTime: 1s503ms - DeserializeRowBatchTimer: 4s844ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.10 M/sec - SendersBlockedTimer: 51s609ms - SendersBlockedTotalTimer(*): 11m10s AGGREGATION_NODE (id=4):(Total: 33s337ms, non-child: 8s908ms, % non-child: 26.72%) ExecOption: Codegen Enabled - BuildTime: 8s229ms - GetNewBlockTime: 492.792us - GetResultsTime: 527.593ms - HTResizeTime: 1s244ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 398.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.301us HASH_JOIN_NODE (id=3):(Total: 24s428ms, non-child: 14s029ms, % non-child: 57.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s688ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s659ms - GetNewBlockTime: 985.065us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s851ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.074us EXCHANGE_NODE (id=11):(Total: 2s421ms, non-child: 1s162ms, % non-child: 48.00%) BytesReceived(1s000ms): 5.78 MB, 62.98 MB, 132.59 MB, 202.81 MB, 249.19 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB, 252.92 MB - BytesReceived: 252.92 MB (265206409) - ConvertRowBatchTime: 377.232ms - DeserializeRowBatchTimer: 1s590ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 5.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s978ms, non-child: 3s137ms, % non-child: 39.33%) BytesReceived(1s000ms): 5.07 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 15.93 MB, 52.04 MB, 96.83 MB, 127.11 MB, 159.42 MB, 191.54 MB, 220.27 MB, 251.55 MB, 283.67 MB, 315.89 MB, 348.86 MB, 382.52 MB, 415.70 MB, 453.15 MB, 497.85 MB, 530.67 MB, 562.19 MB, 593.88 MB, 625.49 MB, 656.49 MB, 688.08 MB, 720.10 MB, 757.79 MB, 796.74 MB, 826.91 MB, 850.55 MB - BytesReceived: 865.20 MB (907227835) - ConvertRowBatchTime: 1s479ms - DeserializeRowBatchTimer: 5s873ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.47 M/sec - SendersBlockedTimer: 6s422ms - SendersBlockedTotalTimer(*): 1m36s Instance 2b455e6e74ea02a1:93296120d7b96bc3 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.93 MB, 514.38 MB, 818.34 MB, 1.15 GB, 1.37 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 678.23 MB, 422.95 MB, 207.93 MB, 182.80 MB, 182.81 MB, 182.81 MB, 310.87 MB, 566.83 MB, 942.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.40 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.54 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.78 GB, 1.63 GB, 748.02 MB, 579.59 MB, 411.15 MB, 204.36 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135470536) - PerHostPeakMemUsage: 3.00 GB (3224037496) - PrepareTime: 156.050ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 24s973ms - TotalNetworkSendTime: 1s150ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 655.348ms, non-child: 655.348ms, % non-child: 100.00%) - CodegenTime: 5.768ms - CompileTime: 124.891ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 387.550ms - PrepareTime: 141.788ms DataStreamSender (dst_id=14):(Total: 5s720ms, non-child: 5s720ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297701968) - NetworkThroughput(*): 60.44 MB/sec - OverallThroughput: 49.63 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s033ms - ThriftTransmitTime(*): 4s697ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 3s860ms, % non-child: 4.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 243.635us - GetResultsTime: 135.144ms - HTResizeTime: 133.739ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 322.27 K/sec - StreamingTime: 3s516ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 4s203ms, % non-child: 5.39%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 341.06 K/sec AGGREGATION_NODE (id=8):(Total: 40s445ms, non-child: 8s847ms, % non-child: 21.87%) ExecOption: Codegen Enabled - BuildTime: 8s031ms - GetNewBlockTime: 736.705us - GetResultsTime: 672.310ms - HTResizeTime: 1s038ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 328.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.122us HASH_JOIN_NODE (id=7):(Total: 31s598ms, non-child: 14s351ms, % non-child: 45.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s717ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s695ms - GetNewBlockTime: 421.491us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s090ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 1.63 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.330us EXCHANGE_NODE (id=13):(Total: 8s552ms, non-child: 4s861ms, % non-child: 56.85%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.16 MB, 10.27 MB, 10.27 MB, 87.11 MB, 218.91 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB, 252.16 MB - BytesReceived: 252.16 MB (264404693) - ConvertRowBatchTime: 394.186ms - DeserializeRowBatchTimer: 1s517ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 1.60 M/sec - SendersBlockedTimer: 38s989ms - SendersBlockedTotalTimer(*): 9m5s EXCHANGE_NODE (id=12):(Total: 8s694ms, non-child: 2s839ms, % non-child: 32.66%) BytesReceived(2s000ms): 7.57 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 31.99 MB, 100.04 MB, 164.33 MB, 230.22 MB, 302.50 MB, 368.91 MB, 428.43 MB, 492.55 MB, 559.40 MB, 624.64 MB, 689.36 MB, 754.31 MB, 817.31 MB - BytesReceived: 864.64 MB (906640812) - ConvertRowBatchTime: 1s450ms - DeserializeRowBatchTimer: 5s405ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.94 M/sec - SendersBlockedTimer: 51s628ms - SendersBlockedTotalTimer(*): 9m28s AGGREGATION_NODE (id=4):(Total: 33s268ms, non-child: 8s260ms, % non-child: 24.83%) ExecOption: Codegen Enabled - BuildTime: 7s656ms - GetNewBlockTime: 492.146us - GetResultsTime: 480.953ms - HTResizeTime: 1s228ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 399.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.506us HASH_JOIN_NODE (id=3):(Total: 25s007ms, non-child: 13s432ms, % non-child: 53.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s670ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s728ms - GetNewBlockTime: 955.671us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s220ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.06 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.317us EXCHANGE_NODE (id=11):(Total: 2s445ms, non-child: 781.594ms, % non-child: 31.97%) BytesReceived(1s000ms): 6.67 MB, 64.90 MB, 134.48 MB, 204.60 MB, 249.52 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB, 252.75 MB - BytesReceived: 252.75 MB (265030499) - ConvertRowBatchTime: 394.356ms - DeserializeRowBatchTimer: 1s104ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 5.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s130ms, non-child: 2s284ms, % non-child: 25.02%) BytesReceived(1s000ms): 5.04 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 16.16 MB, 53.42 MB, 97.65 MB, 127.91 MB, 160.14 MB, 192.22 MB, 220.69 MB, 252.25 MB, 284.20 MB, 316.29 MB, 349.09 MB, 382.83 MB, 415.58 MB, 453.80 MB, 498.32 MB, 530.81 MB, 562.33 MB, 593.96 MB, 625.71 MB, 656.75 MB, 688.44 MB, 720.42 MB, 758.15 MB, 796.88 MB, 826.67 MB, 850.73 MB - BytesReceived: 864.51 MB (906507571) - ConvertRowBatchTime: 1s247ms - DeserializeRowBatchTimer: 4s393ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.65 M/sec - SendersBlockedTimer: 6s485ms - SendersBlockedTotalTimer(*): 51s982ms Instance 2b455e6e74ea02a1:93296120d7b96bd1 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 176.03 MB, 482.39 MB, 810.34 MB, 1.15 GB, 1.33 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.57 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 702.55 MB, 471.57 MB, 240.62 MB, 182.81 MB, 182.82 MB, 182.82 MB, 278.86 MB, 566.85 MB, 910.78 MB, 1.20 GB, 1.33 GB, 1.34 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.02 MB, 555.51 MB, 363.02 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134976904) - PerHostPeakMemUsage: 3.00 GB (3224296520) - PrepareTime: 156.099ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 1m23s - TotalNetworkReceiveTime: 21s781ms - TotalNetworkSendTime: 1s266ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 704.407ms, non-child: 704.407ms, % non-child: 100.00%) - CodegenTime: 3.618ms - CompileTime: 107.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 451.508ms - PrepareTime: 142.903ms DataStreamSender (dst_id=14):(Total: 6s146ms, non-child: 6s146ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297721542) - NetworkThroughput(*): 58.53 MB/sec - OverallThroughput: 46.20 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s304ms - ThriftTransmitTime(*): 4s850ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 4s052ms, % non-child: 5.01%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 297.864us - GetResultsTime: 128.690ms - HTResizeTime: 133.308ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 325.75 K/sec - StreamingTime: 3s705ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 3s537ms, % non-child: 4.60%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 345.78 K/sec AGGREGATION_NODE (id=8):(Total: 39s981ms, non-child: 9s401ms, % non-child: 23.52%) ExecOption: Codegen Enabled - BuildTime: 8s610ms - GetNewBlockTime: 703.536us - GetResultsTime: 648.621ms - HTResizeTime: 1s094ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 332.35 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.377us HASH_JOIN_NODE (id=7):(Total: 30s579ms, non-child: 14s317ms, % non-child: 46.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s863ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s941ms - GetNewBlockTime: 553.201us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s635ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 1.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.420us EXCHANGE_NODE (id=13):(Total: 7s977ms, non-child: 850.040ms, % non-child: 10.66%) BytesReceived(2s000ms): 7.34 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 10.42 MB, 10.50 MB, 80.27 MB, 214.24 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB, 252.14 MB - BytesReceived: 252.14 MB (264383294) - ConvertRowBatchTime: 454.472ms - DeserializeRowBatchTimer: 1s077ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 1.71 M/sec - SendersBlockedTimer: 39s427ms - SendersBlockedTotalTimer(*): 9m11s EXCHANGE_NODE (id=12):(Total: 8s284ms, non-child: 2s771ms, % non-child: 33.45%) BytesReceived(2s000ms): 7.34 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 29.03 MB, 97.00 MB, 161.25 MB, 226.69 MB, 299.32 MB, 365.95 MB, 426.11 MB, 489.38 MB, 556.27 MB, 621.58 MB, 686.50 MB, 751.49 MB, 815.37 MB - BytesReceived: 864.90 MB (906916970) - ConvertRowBatchTime: 1s534ms - DeserializeRowBatchTimer: 4s971ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.23 M/sec - SendersBlockedTimer: 51s902ms - SendersBlockedTotalTimer(*): 12m6s AGGREGATION_NODE (id=4):(Total: 33s337ms, non-child: 9s253ms, % non-child: 27.76%) ExecOption: Codegen Enabled - BuildTime: 8s577ms - GetNewBlockTime: 507.855us - GetResultsTime: 525.386ms - HTResizeTime: 1s197ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 398.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.289us HASH_JOIN_NODE (id=3):(Total: 24s083ms, non-child: 14s306ms, % non-child: 59.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s939ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s676ms - GetNewBlockTime: 841.167us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s793ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.445us EXCHANGE_NODE (id=11):(Total: 2s134ms, non-child: 823.235ms, % non-child: 38.57%) BytesReceived(1s000ms): 4.95 MB, 58.26 MB, 127.80 MB, 198.07 MB, 247.46 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB - BytesReceived: 252.73 MB (265007363) - ConvertRowBatchTime: 420.946ms - DeserializeRowBatchTimer: 1s054ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 6.40 M/sec - SendersBlockedTimer: 43.191ms - SendersBlockedTotalTimer(*): 575.165ms EXCHANGE_NODE (id=10):(Total: 7s641ms, non-child: 2s602ms, % non-child: 34.06%) BytesReceived(1s000ms): 4.61 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 14.72 MB, 49.01 MB, 94.48 MB, 124.99 MB, 157.30 MB, 189.50 MB, 218.40 MB, 249.29 MB, 281.32 MB, 313.54 MB, 346.27 MB, 379.78 MB, 413.91 MB, 449.69 MB, 494.76 MB, 528.05 MB, 559.49 MB, 591.32 MB, 622.92 MB, 653.98 MB, 685.41 MB, 717.29 MB, 754.48 MB, 793.82 MB, 825.19 MB, 847.73 MB - BytesReceived: 864.79 MB (906803131) - ConvertRowBatchTime: 1s446ms - DeserializeRowBatchTimer: 4s785ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.75 M/sec - SendersBlockedTimer: 6s487ms - SendersBlockedTotalTimer(*): 1m24s Instance 2b455e6e74ea02a1:93296120d7b96bc4 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.27 MB, 546.36 MB, 842.34 MB, 1.16 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.81 GB, 1.66 GB, 678.24 MB, 459.43 MB, 228.46 MB, 182.80 MB, 182.80 MB, 182.80 MB, 310.83 MB, 630.82 MB, 966.78 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.52 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.80 GB, 1.59 GB, 699.90 MB, 507.40 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135447608) - PerHostPeakMemUsage: 3.03 GB (3254188152) - PrepareTime: 159.362ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 23s358ms - TotalNetworkSendTime: 1s281ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 629.142ms, non-child: 629.142ms, % non-child: 100.00%) - CodegenTime: 4.378ms - CompileTime: 97.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 383.612ms - PrepareTime: 143.850ms DataStreamSender (dst_id=14):(Total: 6s217ms, non-child: 6s217ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297848237) - NetworkThroughput(*): 57.87 MB/sec - OverallThroughput: 45.69 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s306ms - ThriftTransmitTime(*): 4s908ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 4s062ms, % non-child: 5.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.296ms - GetResultsTime: 139.736ms - HTResizeTime: 127.883ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 326.20 K/sec - StreamingTime: 3s701ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 3s513ms, % non-child: 4.58%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 346.32 K/sec AGGREGATION_NODE (id=8):(Total: 39s840ms, non-child: 9s305ms, % non-child: 23.36%) ExecOption: Codegen Enabled - BuildTime: 8s486ms - GetNewBlockTime: 520.384us - GetResultsTime: 650.354ms - HTResizeTime: 1s077ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 333.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.263us HASH_JOIN_NODE (id=7):(Total: 30s534ms, non-child: 13s428ms, % non-child: 43.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s379ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s646ms - GetNewBlockTime: 467.363us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s555ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 1.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.460us EXCHANGE_NODE (id=13):(Total: 8s299ms, non-child: 560.379ms, % non-child: 6.75%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.19 MB, 10.49 MB, 10.49 MB, 94.74 MB, 223.54 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB - BytesReceived: 252.25 MB (264501560) - ConvertRowBatchTime: 273.923ms - DeserializeRowBatchTimer: 984.334ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 1.65 M/sec - SendersBlockedTimer: 39s584ms - SendersBlockedTotalTimer(*): 9m14s EXCHANGE_NODE (id=12):(Total: 8s806ms, non-child: 2s972ms, % non-child: 33.75%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 35.18 MB, 103.49 MB, 168.03 MB, 234.31 MB, 306.16 MB, 372.61 MB, 431.68 MB, 496.42 MB, 563.18 MB, 628.35 MB, 693.14 MB, 758.19 MB, 820.99 MB - BytesReceived: 865.17 MB (907196939) - ConvertRowBatchTime: 1s583ms - DeserializeRowBatchTimer: 5s415ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 51s559ms - SendersBlockedTotalTimer(*): 11m49s AGGREGATION_NODE (id=4):(Total: 33s416ms, non-child: 9s357ms, % non-child: 28.00%) ExecOption: Codegen Enabled - BuildTime: 8s632ms - GetNewBlockTime: 435.404us - GetResultsTime: 550.102ms - HTResizeTime: 1s257ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 397.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.124us HASH_JOIN_NODE (id=3):(Total: 24s058ms, non-child: 13s698ms, % non-child: 56.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s428ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s706ms - GetNewBlockTime: 824.066us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s717ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.620us EXCHANGE_NODE (id=11):(Total: 2s713ms, non-child: 1s163ms, % non-child: 42.86%) BytesReceived(1s000ms): 10.22 MB, 72.19 MB, 141.91 MB, 211.56 MB, 250.62 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB, 252.85 MB - BytesReceived: 252.85 MB (265130794) - ConvertRowBatchTime: 313.913ms - DeserializeRowBatchTimer: 1s658ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 5.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s647ms, non-child: 2s832ms, % non-child: 37.04%) BytesReceived(1s000ms): 5.04 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 18.57 MB, 58.74 MB, 101.01 MB, 131.57 MB, 163.61 MB, 195.58 MB, 222.74 MB, 255.82 MB, 287.68 MB, 319.81 MB, 352.78 MB, 387.25 MB, 420.26 MB, 459.04 MB, 502.40 MB, 534.53 MB, 566.00 MB, 597.75 MB, 629.49 MB, 660.47 MB, 692.41 MB, 724.51 MB, 762.64 MB, 801.62 MB, 828.19 MB, 854.38 MB - BytesReceived: 865.05 MB (907071007) - ConvertRowBatchTime: 1s546ms - DeserializeRowBatchTimer: 5s046ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 6.75 M/sec - SendersBlockedTimer: 6s455ms - SendersBlockedTotalTimer(*): 1m4s Instance 2b455e6e74ea02a1:93296120d7b96bcc (host=vb0212.halxg.cloudera.com:22000):(Total: 1m27s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 205.61 MB, 516.38 MB, 834.33 MB, 1.16 GB, 1.37 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.81 GB, 1.67 GB, 702.54 MB, 459.42 MB, 228.46 MB, 182.80 MB, 182.80 MB, 182.80 MB, 310.85 MB, 600.84 MB, 958.76 MB, 1.23 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.79 GB, 1.63 GB, 735.99 MB, 507.38 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135317960) - PerHostPeakMemUsage: 3.02 GB (3247760064) - PrepareTime: 156.489ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 1m20s - TotalNetworkReceiveTime: 24s033ms - TotalNetworkSendTime: 1s243ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 692.825ms, non-child: 692.825ms, % non-child: 100.00%) - CodegenTime: 3.499ms - CompileTime: 127.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 417.891ms - PrepareTime: 141.473ms DataStreamSender (dst_id=14):(Total: 6s175ms, non-child: 6s175ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297804268) - NetworkThroughput(*): 58.03 MB/sec - OverallThroughput: 45.99 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s259ms - ThriftTransmitTime(*): 4s893ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 3s995ms, % non-child: 4.94%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 210.728us - GetResultsTime: 143.341ms - HTResizeTime: 140.325ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 326.29 K/sec - StreamingTime: 3s638ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 3s540ms, % non-child: 4.61%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 346.12 K/sec AGGREGATION_NODE (id=8):(Total: 39s882ms, non-child: 9s132ms, % non-child: 22.90%) ExecOption: Codegen Enabled - BuildTime: 8s345ms - GetNewBlockTime: 518.452us - GetResultsTime: 648.474ms - HTResizeTime: 1s227ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 333.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 928.000ns HASH_JOIN_NODE (id=7):(Total: 30s749ms, non-child: 12s751ms, % non-child: 41.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s211ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s565ms - GetNewBlockTime: 438.154us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s193ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.68 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.179us EXCHANGE_NODE (id=13):(Total: 8s536ms, non-child: 1s162ms, % non-child: 13.62%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.18 MB, 10.48 MB, 10.48 MB, 92.21 MB, 222.00 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB - BytesReceived: 252.21 MB (264462415) - ConvertRowBatchTime: 252.451ms - DeserializeRowBatchTimer: 1s689ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 1.60 M/sec - SendersBlockedTimer: 39s527ms - SendersBlockedTotalTimer(*): 8m34s EXCHANGE_NODE (id=12):(Total: 9s461ms, non-child: 2s786ms, % non-child: 29.45%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 34.23 MB, 102.46 MB, 166.81 MB, 232.88 MB, 304.87 MB, 371.25 MB, 430.53 MB, 495.12 MB, 561.92 MB, 627.16 MB, 691.93 MB, 756.96 MB, 819.72 MB - BytesReceived: 865.11 MB (907134920) - ConvertRowBatchTime: 1s424ms - DeserializeRowBatchTimer: 5s412ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 5.46 M/sec - SendersBlockedTimer: 51s457ms - SendersBlockedTotalTimer(*): 12m51s AGGREGATION_NODE (id=4):(Total: 33s379ms, non-child: 9s332ms, % non-child: 27.96%) ExecOption: Codegen Enabled - BuildTime: 8s611ms - GetNewBlockTime: 647.432us - GetResultsTime: 559.120ms - HTResizeTime: 1s172ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 398.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.213us HASH_JOIN_NODE (id=3):(Total: 24s046ms, non-child: 14s126ms, % non-child: 58.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s161ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s694ms - GetNewBlockTime: 753.375us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s441ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.124us EXCHANGE_NODE (id=11):(Total: 2s933ms, non-child: 1s140ms, % non-child: 38.90%) BytesReceived(1s000ms): 9.06 MB, 69.80 MB, 139.42 MB, 209.28 MB, 250.34 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB, 252.82 MB - BytesReceived: 252.82 MB (265096955) - ConvertRowBatchTime: 252.373ms - DeserializeRowBatchTimer: 1s688ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 4.66 M/sec - SendersBlockedTimer: 27.513ms - SendersBlockedTotalTimer(*): 350.924ms EXCHANGE_NODE (id=10):(Total: 6s987ms, non-child: 2s919ms, % non-child: 41.78%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 17.86 MB, 57.17 MB, 99.99 MB, 130.36 MB, 162.53 MB, 194.48 MB, 222.08 MB, 254.58 MB, 286.60 MB, 318.71 MB, 351.65 MB, 385.86 MB, 418.76 MB, 457.53 MB, 501.21 MB, 533.37 MB, 564.93 MB, 596.63 MB, 628.44 MB, 659.41 MB, 691.34 MB, 723.53 MB, 761.49 MB, 800.19 MB, 827.89 MB, 853.47 MB - BytesReceived: 865.01 MB (907026138) - ConvertRowBatchTime: 1s574ms - DeserializeRowBatchTimer: 5s240ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 7.39 M/sec - SendersBlockedTimer: 6s433ms - SendersBlockedTotalTimer(*): 1m23s Instance 2b455e6e74ea02a1:93296120d7b96bc9 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 151.97 MB, 482.36 MB, 762.35 MB, 1.12 GB, 1.33 GB, 1.41 GB, 1.43 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.60 GB, 1.57 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.76 GB, 1.67 GB, 726.86 MB, 471.58 MB, 216.30 MB, 182.78 MB, 182.78 MB, 182.78 MB, 278.85 MB, 566.83 MB, 886.76 MB, 1.20 GB, 1.32 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.75 GB, 1.63 GB, 735.98 MB, 507.40 MB, 363.03 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134730408) - PerHostPeakMemUsage: 2.97 GB (3190662720) - PrepareTime: 156.866ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 1m22s - TotalNetworkReceiveTime: 23s293ms - TotalNetworkSendTime: 1s009ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 655.042ms, non-child: 655.042ms, % non-child: 100.00%) - CodegenTime: 5.036ms - CompileTime: 121.376ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 389.533ms - PrepareTime: 142.816ms DataStreamSender (dst_id=14):(Total: 5s817ms, non-child: 5s817ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297681591) - NetworkThroughput(*): 64.94 MB/sec - OverallThroughput: 48.80 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s089ms - ThriftTransmitTime(*): 4s371ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 3s825ms, % non-child: 4.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 689.331us - GetResultsTime: 119.459ms - HTResizeTime: 123.031ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 325.05 K/sec - StreamingTime: 3s483ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 3s545ms, % non-child: 4.59%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 343.99 K/sec AGGREGATION_NODE (id=8):(Total: 40s373ms, non-child: 9s456ms, % non-child: 23.42%) ExecOption: Codegen Enabled - BuildTime: 8s659ms - GetNewBlockTime: 590.351us - GetResultsTime: 656.652ms - HTResizeTime: 1s097ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 329.08 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 874.000ns HASH_JOIN_NODE (id=7):(Total: 30s917ms, non-child: 13s672ms, % non-child: 44.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s564ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s647ms - GetNewBlockTime: 415.554us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s632ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 1.67 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.114us EXCHANGE_NODE (id=13):(Total: 8s663ms, non-child: 682.635ms, % non-child: 7.88%) BytesReceived(2s000ms): 8.00 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.18 MB, 10.47 MB, 11.70 MB, 104.76 MB, 229.06 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB, 252.13 MB - BytesReceived: 252.13 MB (264374098) - ConvertRowBatchTime: 337.011ms - DeserializeRowBatchTimer: 1s066ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 1.58 M/sec - SendersBlockedTimer: 39s037ms - SendersBlockedTotalTimer(*): 9m6s EXCHANGE_NODE (id=12):(Total: 8s582ms, non-child: 2s987ms, % non-child: 34.81%) BytesReceived(2s000ms): 8.07 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 39.52 MB, 107.44 MB, 172.20 MB, 239.07 MB, 310.75 MB, 376.34 MB, 435.86 MB, 500.44 MB, 567.24 MB, 632.56 MB, 697.64 MB, 762.89 MB, 824.12 MB - BytesReceived: 864.78 MB (906787527) - ConvertRowBatchTime: 1s601ms - DeserializeRowBatchTimer: 5s324ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 6.01 M/sec - SendersBlockedTimer: 51s559ms - SendersBlockedTotalTimer(*): 5m59s AGGREGATION_NODE (id=4):(Total: 33s330ms, non-child: 9s323ms, % non-child: 27.97%) ExecOption: Codegen Enabled - BuildTime: 8s644ms - GetNewBlockTime: 866.254us - GetResultsTime: 503.821ms - HTResizeTime: 1s224ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 398.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.357us HASH_JOIN_NODE (id=3):(Total: 24s006ms, non-child: 13s826ms, % non-child: 57.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s157ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s639ms - GetNewBlockTime: 794.919us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s202ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.409us EXCHANGE_NODE (id=11):(Total: 2s969ms, non-child: 1s177ms, % non-child: 39.65%) BytesReceived(1s000ms): 16.03 MB, 82.01 MB, 151.75 MB, 220.08 MB, 251.53 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB, 252.72 MB - BytesReceived: 252.72 MB (264996443) - ConvertRowBatchTime: 250.510ms - DeserializeRowBatchTimer: 1s740ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 4.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s209ms, non-child: 4s112ms, % non-child: 57.05%) BytesReceived(1s000ms): 6.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 22.85 MB, 66.07 MB, 104.87 MB, 136.19 MB, 167.85 MB, 199.84 MB, 227.25 MB, 260.11 MB, 291.91 MB, 324.12 MB, 357.32 MB, 392.56 MB, 424.47 MB, 465.44 MB, 506.73 MB, 538.64 MB, 569.98 MB, 601.94 MB, 633.63 MB, 664.53 MB, 696.35 MB, 728.98 MB, 767.81 MB, 806.55 MB, 829.60 MB, 856.96 MB - BytesReceived: 864.64 MB (906644483) - ConvertRowBatchTime: 1s530ms - DeserializeRowBatchTimer: 5s734ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 7.16 M/sec - SendersBlockedTimer: 18s052ms - SendersBlockedTotalTimer(*): 3m47s Instance 2b455e6e74ea02a1:93296120d7b96bca (host=vb0232.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 151.67 MB, 482.40 MB, 762.35 MB, 1.12 GB, 1.32 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.78 GB, 1.67 GB, 726.85 MB, 532.36 MB, 337.86 MB, 161.52 MB, 182.80 MB, 182.80 MB, 278.84 MB, 566.85 MB, 870.78 MB, 1.19 GB, 1.32 GB, 1.34 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.75 GB, 1.63 GB, 745.01 MB, 567.54 MB, 363.00 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2137892608) - PerHostPeakMemUsage: 3.03 GB (3250756880) - PrepareTime: 152.435ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 24s934ms - TotalNetworkSendTime: 1s183ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 698.196ms, non-child: 698.196ms, % non-child: 100.00%) - CodegenTime: 3.919ms - CompileTime: 149.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 406.233ms - PrepareTime: 140.955ms DataStreamSender (dst_id=14):(Total: 6s046ms, non-child: 6s046ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297874280) - NetworkThroughput(*): 59.97 MB/sec - OverallThroughput: 46.98 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s255ms - ThriftTransmitTime(*): 4s737ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 4s270ms, % non-child: 5.28%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 199.668us - GetResultsTime: 136.011ms - HTResizeTime: 162.844ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270594) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 326.27 K/sec - StreamingTime: 3s925ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 4s105ms, % non-child: 5.36%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 347.35 K/sec AGGREGATION_NODE (id=8):(Total: 39s051ms, non-child: 9s089ms, % non-child: 23.28%) ExecOption: Codegen Enabled - BuildTime: 8s344ms - GetNewBlockTime: 567.017us - GetResultsTime: 629.549ms - HTResizeTime: 1s275ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 340.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.324us HASH_JOIN_NODE (id=7):(Total: 29s962ms, non-child: 12s047ms, % non-child: 40.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s212ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s995ms - GetNewBlockTime: 462.943us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s045ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 1.72 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.653us EXCHANGE_NODE (id=13):(Total: 7s735ms, non-child: 1s166ms, % non-child: 15.08%) BytesReceived(2s000ms): 7.98 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.19 MB, 10.53 MB, 11.72 MB, 104.74 MB, 229.16 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB - BytesReceived: 252.30 MB (264555395) - ConvertRowBatchTime: 260.351ms - DeserializeRowBatchTimer: 1s698ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 1.77 M/sec - SendersBlockedTimer: 40s326ms - SendersBlockedTotalTimer(*): 10m4s EXCHANGE_NODE (id=12):(Total: 10s179ms, non-child: 3s194ms, % non-child: 31.39%) BytesReceived(2s000ms): 8.04 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 39.54 MB, 107.59 MB, 172.43 MB, 239.36 MB, 311.12 MB, 376.73 MB, 436.36 MB, 500.89 MB, 567.59 MB, 632.83 MB, 697.97 MB, 763.39 MB, 824.67 MB - BytesReceived: 865.35 MB (907389509) - ConvertRowBatchTime: 1s369ms - DeserializeRowBatchTimer: 6s298ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 52s566ms - SendersBlockedTotalTimer(*): 6m50s AGGREGATION_NODE (id=4):(Total: 33s390ms, non-child: 9s314ms, % non-child: 27.90%) ExecOption: Codegen Enabled - BuildTime: 8s560ms - GetNewBlockTime: 450.871us - GetResultsTime: 610.041ms - HTResizeTime: 1s191ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 398.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.269us HASH_JOIN_NODE (id=3):(Total: 24s076ms, non-child: 13s337ms, % non-child: 55.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s202ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s668ms - GetNewBlockTime: 949.233us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s580ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.400us EXCHANGE_NODE (id=11):(Total: 2s880ms, non-child: 1s180ms, % non-child: 40.98%) BytesReceived(1s000ms): 15.85 MB, 81.76 MB, 151.54 MB, 219.94 MB, 251.68 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB, 252.90 MB - BytesReceived: 252.90 MB (265181365) - ConvertRowBatchTime: 253.717ms - DeserializeRowBatchTimer: 1s708ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 4.75 M/sec - SendersBlockedTimer: 36.204ms - SendersBlockedTotalTimer(*): 496.505ms EXCHANGE_NODE (id=10):(Total: 7s857ms, non-child: 2s651ms, % non-child: 33.74%) BytesReceived(1s000ms): 6.04 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 22.62 MB, 65.79 MB, 104.81 MB, 136.17 MB, 167.89 MB, 199.77 MB, 227.20 MB, 260.17 MB, 292.02 MB, 324.23 MB, 357.50 MB, 392.69 MB, 424.85 MB, 465.67 MB, 506.93 MB, 538.84 MB, 570.27 MB, 602.20 MB, 633.90 MB, 664.81 MB, 696.76 MB, 729.42 MB, 768.30 MB, 807.04 MB, 830.08 MB, 857.52 MB - BytesReceived: 865.22 MB (907247835) - ConvertRowBatchTime: 1s460ms - DeserializeRowBatchTimer: 4s853ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 6.57 M/sec - SendersBlockedTimer: 6s474ms - SendersBlockedTotalTimer(*): 51s911ms Instance 2b455e6e74ea02a1:93296120d7b96bc5 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 167.46 MB, 482.38 MB, 810.33 MB, 1.14 GB, 1.32 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.59 GB, 1.60 GB, 1.70 GB, 1.73 GB, 1.73 GB, 1.76 GB, 1.68 GB, 726.86 MB, 520.20 MB, 264.93 MB, 166.84 MB, 182.80 MB, 182.80 MB, 278.83 MB, 566.84 MB, 910.76 MB, 1.21 GB, 1.33 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.02 MB, 543.48 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2140436784) - PerHostPeakMemUsage: 3.04 GB (3269264312) - PrepareTime: 177.368ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 23s307ms - TotalNetworkSendTime: 1s078ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 657.585ms, non-child: 657.585ms, % non-child: 100.00%) - CodegenTime: 12.779ms - CompileTime: 120.138ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 390.581ms - PrepareTime: 143.327ms DataStreamSender (dst_id=14):(Total: 5s624ms, non-child: 5s624ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297803129) - NetworkThroughput(*): 64.36 MB/sec - OverallThroughput: 50.49 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s080ms - ThriftTransmitTime(*): 4s412ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 3s947ms, % non-child: 4.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.687ms - GetResultsTime: 131.989ms - HTResizeTime: 136.129ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 324.80 K/sec - StreamingTime: 3s601ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 4s077ms, % non-child: 5.28%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 344.25 K/sec AGGREGATION_NODE (id=8):(Total: 39s824ms, non-child: 9s491ms, % non-child: 23.83%) ExecOption: Codegen Enabled - BuildTime: 8s739ms - GetNewBlockTime: 3.789ms - GetResultsTime: 588.749ms - HTResizeTime: 1s144ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 333.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.119us HASH_JOIN_NODE (id=7):(Total: 30s332ms, non-child: 13s785ms, % non-child: 45.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s844ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s631ms - GetNewBlockTime: 553.856us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s483ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 1.70 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.096us EXCHANGE_NODE (id=13):(Total: 7s869ms, non-child: 840.053ms, % non-child: 10.67%) BytesReceived(2s000ms): 9.46 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.21 MB, 10.52 MB, 13.97 MB, 113.82 MB, 233.89 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB - BytesReceived: 252.17 MB (264422705) - ConvertRowBatchTime: 438.148ms - DeserializeRowBatchTimer: 1s085ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 1.74 M/sec - SendersBlockedTimer: 39s547ms - SendersBlockedTotalTimer(*): 9m53s EXCHANGE_NODE (id=12):(Total: 8s677ms, non-child: 2s940ms, % non-child: 33.89%) BytesReceived(2s000ms): 9.48 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 43.63 MB, 111.79 MB, 176.66 MB, 243.68 MB, 315.48 MB, 380.82 MB, 440.13 MB, 505.12 MB, 571.94 MB, 637.00 MB, 702.03 MB, 767.50 MB, 827.73 MB - BytesReceived: 865.11 MB (907138536) - ConvertRowBatchTime: 1s498ms - DeserializeRowBatchTimer: 5s508ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.95 M/sec - SendersBlockedTimer: 51s551ms - SendersBlockedTotalTimer(*): 12m53s AGGREGATION_NODE (id=4):(Total: 33s315ms, non-child: 9s350ms, % non-child: 28.07%) ExecOption: Codegen Enabled - BuildTime: 8s669ms - GetNewBlockTime: 540.212us - GetResultsTime: 533.456ms - HTResizeTime: 1s237ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 398.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 892.000ns HASH_JOIN_NODE (id=3):(Total: 23s964ms, non-child: 13s100ms, % non-child: 54.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s207ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s608ms - GetNewBlockTime: 711.743us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s479ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.398us EXCHANGE_NODE (id=11):(Total: 2s894ms, non-child: 1s132ms, % non-child: 39.12%) BytesReceived(1s000ms): 4.09 MB, 56.17 MB, 125.62 MB, 195.93 MB, 246.62 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB - BytesReceived: 252.77 MB (265051991) - ConvertRowBatchTime: 249.236ms - DeserializeRowBatchTimer: 1s690ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.72 M/sec - SendersBlockedTimer: 15.403ms - SendersBlockedTotalTimer(*): 204.443ms EXCHANGE_NODE (id=10):(Total: 7s970ms, non-child: 3s958ms, % non-child: 49.67%) BytesReceived(1s000ms): 3.80 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 14.18 MB, 48.07 MB, 93.09 MB, 123.97 MB, 156.47 MB, 188.58 MB, 217.37 MB, 248.17 MB, 280.26 MB, 312.20 MB, 345.08 MB, 378.58 MB, 413.19 MB, 448.19 MB, 493.51 MB, 527.28 MB, 558.65 MB, 590.54 MB, 622.16 MB, 653.30 MB, 684.74 MB, 716.59 MB, 753.58 MB, 792.82 MB, 824.76 MB, 846.84 MB - BytesReceived: 865.01 MB (907029103) - ConvertRowBatchTime: 1s489ms - DeserializeRowBatchTimer: 5s891ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 6.48 M/sec - SendersBlockedTimer: 16s701ms - SendersBlockedTotalTimer(*): 3m18s Instance 2b455e6e74ea02a1:93296120d7b96bc6 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 161.00 MB, 482.42 MB, 770.35 MB, 1.13 GB, 1.33 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 726.85 MB, 483.73 MB, 252.76 MB, 166.86 MB, 182.78 MB, 182.78 MB, 278.98 MB, 566.82 MB, 894.76 MB, 1.19 GB, 1.33 GB, 1.34 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.75 GB, 1.63 GB, 745.01 MB, 567.55 MB, 314.88 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2133754928) - PerHostPeakMemUsage: 3.02 GB (3240529664) - PrepareTime: 152.309ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 22s617ms - TotalNetworkSendTime: 1s092ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 685.309ms, non-child: 685.309ms, % non-child: 100.00%) - CodegenTime: 5.835ms - CompileTime: 139.414ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 406.729ms - PrepareTime: 137.868ms DataStreamSender (dst_id=14):(Total: 5s527ms, non-child: 5s527ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297606551) - NetworkThroughput(*): 65.31 MB/sec - OverallThroughput: 51.35 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s040ms - ThriftTransmitTime(*): 4s345ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 3s840ms, % non-child: 4.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 213.068us - GetResultsTime: 138.265ms - HTResizeTime: 162.639ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 326.76 K/sec - StreamingTime: 3s501ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 3s827ms, % non-child: 4.98%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 345.96 K/sec AGGREGATION_NODE (id=8):(Total: 39s636ms, non-child: 9s815ms, % non-child: 24.76%) ExecOption: Codegen Enabled - BuildTime: 9s046ms - GetNewBlockTime: 435.407us - GetResultsTime: 593.890ms - HTResizeTime: 1s294ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 335.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.054us HASH_JOIN_NODE (id=7):(Total: 29s821ms, non-child: 13s195ms, % non-child: 44.25%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s276ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s890ms - GetNewBlockTime: 414.531us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s207ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 1.73 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.734us EXCHANGE_NODE (id=13):(Total: 8s247ms, non-child: 1s168ms, % non-child: 14.16%) BytesReceived(2s000ms): 8.84 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.21 MB, 10.49 MB, 13.18 MB, 110.62 MB, 232.18 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB, 252.06 MB - BytesReceived: 252.06 MB (264309028) - ConvertRowBatchTime: 265.148ms - DeserializeRowBatchTimer: 1s695ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 1.66 M/sec - SendersBlockedTimer: 39s745ms - SendersBlockedTotalTimer(*): 9m56s EXCHANGE_NODE (id=12):(Total: 8s378ms, non-child: 3s074ms, % non-child: 36.69%) BytesReceived(2s000ms): 8.92 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 42.09 MB, 110.22 MB, 174.99 MB, 242.11 MB, 313.59 MB, 378.95 MB, 438.59 MB, 503.30 MB, 570.01 MB, 635.22 MB, 700.24 MB, 765.68 MB, 826.09 MB - BytesReceived: 864.60 MB (906596467) - ConvertRowBatchTime: 1s606ms - DeserializeRowBatchTimer: 5s546ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.16 M/sec - SendersBlockedTimer: 51s813ms - SendersBlockedTotalTimer(*): 12m45s AGGREGATION_NODE (id=4):(Total: 33s321ms, non-child: 9s369ms, % non-child: 28.12%) ExecOption: Codegen Enabled - BuildTime: 8s669ms - GetNewBlockTime: 583.759us - GetResultsTime: 543.653ms - HTResizeTime: 1s184ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 398.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.043us HASH_JOIN_NODE (id=3):(Total: 23s952ms, non-child: 13s802ms, % non-child: 57.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s775ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s739ms - GetNewBlockTime: 1.055ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s449ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.091us EXCHANGE_NODE (id=11):(Total: 2s309ms, non-child: 803.659ms, % non-child: 34.79%) BytesReceived(1s000ms): 20.68 MB, 87.69 MB, 157.49 MB, 224.86 MB, 251.90 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB, 252.67 MB - BytesReceived: 252.67 MB (264945163) - ConvertRowBatchTime: 407.700ms - DeserializeRowBatchTimer: 1s119ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 5.91 M/sec - SendersBlockedTimer: 26.021ms - SendersBlockedTotalTimer(*): 345.937ms EXCHANGE_NODE (id=10):(Total: 7s840ms, non-child: 3s027ms, % non-child: 38.61%) BytesReceived(1s000ms): 7.72 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 25.60 MB, 70.38 MB, 107.37 MB, 138.92 MB, 170.89 MB, 202.36 MB, 230.13 MB, 262.75 MB, 294.53 MB, 326.76 MB, 360.00 MB, 395.74 MB, 426.84 MB, 469.29 MB, 509.44 MB, 541.29 MB, 572.78 MB, 604.37 MB, 635.91 MB, 666.91 MB, 698.85 MB, 731.71 MB, 771.05 MB, 809.54 MB, 831.35 MB, 858.40 MB - BytesReceived: 864.50 MB (906494201) - ConvertRowBatchTime: 1s468ms - DeserializeRowBatchTimer: 5s734ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.58 M/sec - SendersBlockedTimer: 6s495ms - SendersBlockedTotalTimer(*): 1m17s Instance 2b455e6e74ea02a1:93296120d7b96bcd (host=vb0234.halxg.cloudera.com:22000):(Total: 1m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 163.42 MB, 482.41 MB, 778.33 MB, 1.13 GB, 1.33 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 678.23 MB, 410.80 MB, 188.79 MB, 182.82 MB, 182.82 MB, 182.82 MB, 278.85 MB, 566.83 MB, 910.78 MB, 1.20 GB, 1.33 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.63 GB, 760.06 MB, 567.54 MB, 338.96 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134267464) - PerHostPeakMemUsage: 3.08 GB (3311730816) - PrepareTime: 184.073ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 1m20s - TotalNetworkReceiveTime: 25s254ms - TotalNetworkSendTime: 715.400ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 646.483ms, non-child: 646.483ms, % non-child: 100.00%) - CodegenTime: 8.609ms - CompileTime: 137.245ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 360.823ms - PrepareTime: 139.574ms DataStreamSender (dst_id=14):(Total: 4s527ms, non-child: 4s527ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741304) - NetworkThroughput(*): 85.25 MB/sec - OverallThroughput: 62.71 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s723ms - ThriftTransmitTime(*): 3s330ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 1m21s, non-child: 3s538ms, % non-child: 4.34%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 195.037us - GetResultsTime: 89.809ms - HTResizeTime: 161.287ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 323.43 K/sec - StreamingTime: 3s239ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m17s, non-child: 3s656ms, % non-child: 4.69%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 340.93 K/sec AGGREGATION_NODE (id=8):(Total: 40s966ms, non-child: 9s827ms, % non-child: 23.99%) ExecOption: Codegen Enabled - BuildTime: 9s104ms - GetNewBlockTime: 802.404us - GetResultsTime: 561.478ms - HTResizeTime: 1s245ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 324.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.417us HASH_JOIN_NODE (id=7):(Total: 31s138ms, non-child: 13s270ms, % non-child: 42.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s778ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s804ms - GetNewBlockTime: 593.228us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s848ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 1.66 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.864us EXCHANGE_NODE (id=13):(Total: 9s105ms, non-child: 827.241ms, % non-child: 9.09%) BytesReceived(2s000ms): 9.05 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 10.19 MB, 10.50 MB, 13.47 MB, 111.84 MB, 232.87 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB - BytesReceived: 252.18 MB (264425054) - ConvertRowBatchTime: 432.528ms - DeserializeRowBatchTimer: 1s089ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 1.50 M/sec - SendersBlockedTimer: 38s384ms - SendersBlockedTotalTimer(*): 8m57s EXCHANGE_NODE (id=12):(Total: 8s762ms, non-child: 3s084ms, % non-child: 35.20%) BytesReceived(2s000ms): 9.12 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 42.72 MB, 110.83 MB, 175.54 MB, 242.66 MB, 314.29 MB, 379.65 MB, 439.20 MB, 503.93 MB, 570.66 MB, 635.76 MB, 700.93 MB, 766.31 MB, 826.61 MB - BytesReceived: 864.71 MB (906717955) - ConvertRowBatchTime: 1s663ms - DeserializeRowBatchTimer: 5s250ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.89 M/sec - SendersBlockedTimer: 51s730ms - SendersBlockedTotalTimer(*): 12m16s AGGREGATION_NODE (id=4):(Total: 33s330ms, non-child: 8s677ms, % non-child: 26.03%) ExecOption: Codegen Enabled - BuildTime: 8s054ms - GetNewBlockTime: 5.095ms - GetResultsTime: 472.294ms - HTResizeTime: 1s265ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 398.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.486us HASH_JOIN_NODE (id=3):(Total: 24s653ms, non-child: 12s955ms, % non-child: 52.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s850ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s748ms - GetNewBlockTime: 943.326us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s525ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.09 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.955us EXCHANGE_NODE (id=11):(Total: 2s255ms, non-child: 817.897ms, % non-child: 36.27%) BytesReceived(1s000ms): 21.73 MB, 88.89 MB, 158.74 MB, 225.93 MB, 252.07 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB - BytesReceived: 252.77 MB (265048164) - ConvertRowBatchTime: 430.561ms - DeserializeRowBatchTimer: 1s100ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 7.822ms - SendersBlockedTotalTimer(*): 81.611ms EXCHANGE_NODE (id=10):(Total: 9s442ms, non-child: 3s017ms, % non-child: 31.96%) BytesReceived(1s000ms): 8.16 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 26.03 MB, 71.14 MB, 107.85 MB, 139.42 MB, 171.56 MB, 202.94 MB, 230.77 MB, 263.51 MB, 295.23 MB, 327.53 MB, 360.65 MB, 396.34 MB, 427.44 MB, 470.26 MB, 510.18 MB, 541.99 MB, 573.57 MB, 605.11 MB, 636.55 MB, 667.54 MB, 699.55 MB, 732.49 MB, 771.98 MB, 810.36 MB, 831.94 MB, 858.81 MB - BytesReceived: 864.60 MB (906598390) - ConvertRowBatchTime: 1s351ms - DeserializeRowBatchTimer: 5s925ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.47 M/sec - SendersBlockedTimer: 6s520ms - SendersBlockedTotalTimer(*): 1m24s Instance 2b455e6e74ea02a1:93296120d7b96bd0 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.16 MB, 484.08 MB, 796.34 MB, 1.15 GB, 1.32 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 726.86 MB, 532.36 MB, 325.70 MB, 151.44 MB, 182.79 MB, 182.78 MB, 279.51 MB, 567.12 MB, 910.76 MB, 1.20 GB, 1.33 GB, 1.34 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.63 GB, 748.02 MB, 555.52 MB, 314.90 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2136471456) - PerHostPeakMemUsage: 3.04 GB (3264931072) - PrepareTime: 169.536ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 22s062ms - TotalNetworkSendTime: 1s038ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 677.518ms, non-child: 677.518ms, % non-child: 100.00%) - CodegenTime: 3.360ms - CompileTime: 135.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 387.342ms - PrepareTime: 145.639ms DataStreamSender (dst_id=14):(Total: 5s517ms, non-child: 5s517ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297740916) - NetworkThroughput(*): 67.79 MB/sec - OverallThroughput: 51.46 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s076ms - ThriftTransmitTime(*): 4s188ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 3s881ms, % non-child: 4.83%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 267.129us - GetResultsTime: 93.307ms - HTResizeTime: 160.140ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 328.21 K/sec - StreamingTime: 3s565ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 3s560ms, % non-child: 4.66%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 347.75 K/sec AGGREGATION_NODE (id=8):(Total: 39s393ms, non-child: 8s850ms, % non-child: 22.47%) ExecOption: Codegen Enabled - BuildTime: 8s142ms - GetNewBlockTime: 407.421us - GetResultsTime: 554.085ms - HTResizeTime: 1s243ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 337.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us HASH_JOIN_NODE (id=7):(Total: 30s543ms, non-child: 13s425ms, % non-child: 43.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s828ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s881ms - GetNewBlockTime: 577.998us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s843ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 1.69 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.553us EXCHANGE_NODE (id=13):(Total: 7s493ms, non-child: 1s169ms, % non-child: 15.61%) BytesReceived(2s000ms): 9.20 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.19 MB, 10.51 MB, 13.65 MB, 112.58 MB, 233.25 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB - BytesReceived: 252.17 MB (264415223) - ConvertRowBatchTime: 382.430ms - DeserializeRowBatchTimer: 1s562ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 1.82 M/sec - SendersBlockedTimer: 39s945ms - SendersBlockedTotalTimer(*): 9m19s EXCHANGE_NODE (id=12):(Total: 9s625ms, non-child: 3s051ms, % non-child: 31.71%) BytesReceived(2s000ms): 9.20 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 42.98 MB, 111.27 MB, 176.08 MB, 243.20 MB, 314.93 MB, 380.32 MB, 439.75 MB, 504.53 MB, 571.34 MB, 636.44 MB, 701.46 MB, 766.89 MB, 827.16 MB - BytesReceived: 864.91 MB (906924381) - ConvertRowBatchTime: 1s375ms - DeserializeRowBatchTimer: 6s058ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.36 M/sec - SendersBlockedTimer: 51s860ms - SendersBlockedTotalTimer(*): 6m44s AGGREGATION_NODE (id=4):(Total: 33s473ms, non-child: 9s214ms, % non-child: 27.53%) ExecOption: Codegen Enabled - BuildTime: 8s441ms - GetNewBlockTime: 3.350ms - GetResultsTime: 622.428ms - HTResizeTime: 1s271ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 397.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.520us HASH_JOIN_NODE (id=3):(Total: 24s258ms, non-child: 15s092ms, % non-child: 62.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s185ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s685ms - GetNewBlockTime: 954.387us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s362ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.444us EXCHANGE_NODE (id=11):(Total: 1s900ms, non-child: 1s208ms, % non-child: 63.59%) BytesReceived(1s000ms): 22.37 MB, 89.60 MB, 159.48 MB, 226.58 MB, 252.13 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB - BytesReceived: 252.77 MB (265052240) - ConvertRowBatchTime: 466.865ms - DeserializeRowBatchTimer: 1s527ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 7.19 M/sec - SendersBlockedTimer: 21.016ms - SendersBlockedTotalTimer(*): 269.625ms EXCHANGE_NODE (id=10):(Total: 7s266ms, non-child: 2s906ms, % non-child: 40.00%) BytesReceived(1s000ms): 8.40 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 26.32 MB, 71.72 MB, 108.42 MB, 140.02 MB, 172.10 MB, 203.43 MB, 231.35 MB, 264.08 MB, 295.82 MB, 328.29 MB, 361.29 MB, 397.04 MB, 427.99 MB, 470.89 MB, 510.57 MB, 542.39 MB, 574.02 MB, 605.65 MB, 637.11 MB, 668.08 MB, 699.98 MB, 732.93 MB, 772.42 MB, 810.90 MB, 832.34 MB, 859.21 MB - BytesReceived: 864.80 MB (906809882) - ConvertRowBatchTime: 1s569ms - DeserializeRowBatchTimer: 5s021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 7.10 M/sec - SendersBlockedTimer: 6s446ms - SendersBlockedTotalTimer(*): 1m17s Instance 2b455e6e74ea02a1:93296120d7b96bcf (host=vb0208.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.24 MB, 514.39 MB, 834.33 MB, 1.16 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.57 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.80 GB, 1.67 GB, 726.87 MB, 532.34 MB, 362.18 MB, 191.97 MB, 182.80 MB, 182.80 MB, 310.80 MB, 598.81 MB, 942.76 MB, 1.22 GB, 1.35 GB, 1.37 GB, 1.42 GB, 1.44 GB, 1.44 GB, 1.53 GB, 1.56 GB, 1.56 GB, 1.69 GB, 1.69 GB, 1.69 GB, 1.77 GB, 1.63 GB, 719.81 MB, 471.30 MB, 204.37 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2133311560) - PerHostPeakMemUsage: 3.14 GB (3368530816) - PrepareTime: 148.811ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 1m23s - TotalNetworkReceiveTime: 18s638ms - TotalNetworkSendTime: 1s118ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 606.599ms, non-child: 606.599ms, % non-child: 100.00%) - CodegenTime: 2.704ms - CompileTime: 182.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 283.605ms - PrepareTime: 139.711ms DataStreamSender (dst_id=14):(Total: 5s595ms, non-child: 5s595ms, % non-child: 100.00%) - BytesSent: 283.87 MB (297663874) - NetworkThroughput(*): 63.14 MB/sec - OverallThroughput: 50.74 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s028ms - ThriftTransmitTime(*): 4s496ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 1m19s, non-child: 3s844ms, % non-child: 4.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 181.544us - GetResultsTime: 122.222ms - HTResizeTime: 165.330ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255945) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 329.44 K/sec - StreamingTime: 3s513ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 4s880ms, % non-child: 6.41%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 348.96 K/sec AGGREGATION_NODE (id=8):(Total: 37s706ms, non-child: 9s448ms, % non-child: 25.06%) ExecOption: Codegen Enabled - BuildTime: 8s785ms - GetNewBlockTime: 541.946us - GetResultsTime: 483.896ms - HTResizeTime: 1s047ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 352.33 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.178us HASH_JOIN_NODE (id=7):(Total: 28s258ms, non-child: 15s801ms, % non-child: 55.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s066ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s954ms - GetNewBlockTime: 451.549us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 11s882ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 1.83 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.484us EXCHANGE_NODE (id=13):(Total: 6s683ms, non-child: 1s128ms, % non-child: 16.88%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 10.48 MB, 10.48 MB, 91.38 MB, 221.45 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB, 252.09 MB - BytesReceived: 252.09 MB (264330495) - ConvertRowBatchTime: 240.513ms - DeserializeRowBatchTimer: 1s667ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 2.04 M/sec - SendersBlockedTimer: 41s529ms - SendersBlockedTotalTimer(*): 9m43s EXCHANGE_NODE (id=12):(Total: 5s773ms, non-child: 5s100ms, % non-child: 88.34%) BytesReceived(2s000ms): 7.57 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 33.84 MB, 101.90 MB, 166.15 MB, 232.22 MB, 304.21 MB, 370.54 MB, 429.69 MB, 494.25 MB, 561.03 MB, 626.35 MB, 690.98 MB, 756.14 MB, 818.97 MB - BytesReceived: 864.75 MB (906755708) - ConvertRowBatchTime: 1s823ms - DeserializeRowBatchTimer: 5s475ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 8.94 M/sec - SendersBlockedTimer: 1m15s - SendersBlockedTotalTimer(*): 15m23s AGGREGATION_NODE (id=4):(Total: 33s553ms, non-child: 9s389ms, % non-child: 27.98%) ExecOption: Codegen Enabled - BuildTime: 8s587ms - GetNewBlockTime: 529.576us - GetResultsTime: 659.206ms - HTResizeTime: 1s152ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 395.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.466us HASH_JOIN_NODE (id=3):(Total: 24s164ms, non-child: 13s565ms, % non-child: 56.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s931ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s737ms - GetNewBlockTime: 1.376ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s074ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.086us EXCHANGE_NODE (id=11):(Total: 2s241ms, non-child: 828.273ms, % non-child: 36.96%) BytesReceived(1s000ms): 8.69 MB, 69.01 MB, 138.67 MB, 208.60 MB, 250.14 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB, 252.69 MB - BytesReceived: 252.69 MB (264969701) - ConvertRowBatchTime: 450.628ms - DeserializeRowBatchTimer: 1s054ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 6.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s357ms, non-child: 2s651ms, % non-child: 31.73%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 17.67 MB, 56.50 MB, 99.60 MB, 129.91 MB, 162.04 MB, 193.90 MB, 221.69 MB, 254.09 MB, 286.01 MB, 318.03 MB, 350.91 MB, 385.04 MB, 417.79 MB, 456.54 MB, 500.42 MB, 532.66 MB, 564.12 MB, 595.74 MB, 627.52 MB, 658.46 MB, 690.40 MB, 722.55 MB, 760.58 MB, 799.40 MB, 827.49 MB, 852.79 MB - BytesReceived: 864.66 MB (906658171) - ConvertRowBatchTime: 1s456ms - DeserializeRowBatchTimer: 4s757ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 6.18 M/sec - SendersBlockedTimer: 6s495ms - SendersBlockedTotalTimer(*): 1m24s Instance 2b455e6e74ea02a1:93296120d7b96bcb (host=vb0226.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.46 MB, 546.52 MB, 842.33 MB, 1.17 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.81 GB, 1.62 GB, 678.23 MB, 483.74 MB, 252.77 MB, 166.97 MB, 182.80 MB, 182.80 MB, 315.83 MB, 622.48 MB, 966.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.52 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.79 GB, 1.55 GB, 699.88 MB, 459.27 MB, 190.22 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135377504) - PerHostPeakMemUsage: 3.03 GB (3252945744) - PrepareTime: 157.870ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 1m23s - TotalNetworkReceiveTime: 19s656ms - TotalNetworkSendTime: 940.531ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 650.382ms, non-child: 650.382ms, % non-child: 100.00%) - CodegenTime: 4.106ms - CompileTime: 126.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 377.873ms - PrepareTime: 140.943ms DataStreamSender (dst_id=14):(Total: 4s951ms, non-child: 4s951ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297751133) - NetworkThroughput(*): 71.21 MB/sec - OverallThroughput: 57.35 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s831ms - ThriftTransmitTime(*): 3s987ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 1m20s, non-child: 3s539ms, % non-child: 4.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 227.306us - GetResultsTime: 102.132ms - HTResizeTime: 152.599ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 327.52 K/sec - StreamingTime: 3s224ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m16s, non-child: 4s431ms, % non-child: 5.76%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 345.44 K/sec AGGREGATION_NODE (id=8):(Total: 39s116ms, non-child: 10s149ms, % non-child: 25.95%) ExecOption: Codegen Enabled - BuildTime: 9s507ms - GetNewBlockTime: 711.251us - GetResultsTime: 472.867ms - HTResizeTime: 1s264ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 339.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.278us HASH_JOIN_NODE (id=7):(Total: 28s967ms, non-child: 14s570ms, % non-child: 50.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s119ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s708ms - GetNewBlockTime: 577.126us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s819ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 1.78 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.063us EXCHANGE_NODE (id=13):(Total: 6s979ms, non-child: 1s318ms, % non-child: 18.89%) BytesReceived(2s000ms): 7.63 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.18 MB, 10.50 MB, 10.50 MB, 96.51 MB, 224.51 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB - BytesReceived: 252.17 MB (264423484) - ConvertRowBatchTime: 477.251ms - DeserializeRowBatchTimer: 1s583ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 1.96 M/sec - SendersBlockedTimer: 40s156ms - SendersBlockedTotalTimer(*): 10m2s EXCHANGE_NODE (id=12):(Total: 7s417ms, non-child: 3s092ms, % non-child: 41.69%) BytesReceived(2s000ms): 7.58 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 35.80 MB, 104.04 MB, 168.49 MB, 235.03 MB, 306.61 MB, 372.90 MB, 432.15 MB, 496.79 MB, 563.55 MB, 628.83 MB, 693.64 MB, 758.71 MB, 821.31 MB - BytesReceived: 864.72 MB (906728032) - ConvertRowBatchTime: 1s580ms - DeserializeRowBatchTimer: 5s736ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 6.96 M/sec - SendersBlockedTimer: 51s652ms - SendersBlockedTotalTimer(*): 10m8s AGGREGATION_NODE (id=4):(Total: 33s390ms, non-child: 9s802ms, % non-child: 29.36%) ExecOption: Codegen Enabled - BuildTime: 9s076ms - GetNewBlockTime: 502.792us - GetResultsTime: 574.467ms - HTResizeTime: 1s249ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 397.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.115us HASH_JOIN_NODE (id=3):(Total: 23s587ms, non-child: 13s970ms, % non-child: 59.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s874ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s642ms - GetNewBlockTime: 923.889us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s605ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.573us EXCHANGE_NODE (id=11):(Total: 2s242ms, non-child: 1s206ms, % non-child: 53.80%) BytesReceived(1s000ms): 11.06 MB, 73.82 MB, 143.54 MB, 212.97 MB, 250.72 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB, 252.78 MB - BytesReceived: 252.78 MB (265060825) - ConvertRowBatchTime: 417.706ms - DeserializeRowBatchTimer: 1s581ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 6.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s374ms, non-child: 2s653ms, % non-child: 35.99%) BytesReceived(1s000ms): 5.07 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 19.04 MB, 59.99 MB, 101.92 MB, 132.48 MB, 164.40 MB, 196.35 MB, 223.27 MB, 256.62 MB, 288.35 MB, 320.47 MB, 353.51 MB, 388.10 MB, 421.19 MB, 460.09 MB, 503.12 MB, 535.18 MB, 566.59 MB, 598.30 MB, 629.97 MB, 660.92 MB, 692.87 MB, 725.10 MB, 763.43 MB, 802.31 MB, 827.80 MB, 854.46 MB - BytesReceived: 864.63 MB (906629031) - ConvertRowBatchTime: 1s465ms - DeserializeRowBatchTimer: 4s814ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 6s409ms - SendersBlockedTotalTimer(*): 1m10s Fragment F04: Instance 2b455e6e74ea02a1:93296120d7b96bd6 (host=vb0214.halxg.cloudera.com:22000):(Total: 49s595ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(1s000ms): 105.15 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.33 MB, 210.30 MB, 210.29 MB, 210.36 MB, 210.42 MB, 210.42 MB, 210.42 MB, 210.29 MB, 182.50 MB, 158.82 MB, 101.83 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.68 MB (220914392) - PerHostPeakMemUsage: 2.49 GB (2675626072) - PrepareTime: 145.147ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 5m - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s303ms - TotalStorageWaitTime: 138.580ms CodeGen:(Total: 491.331ms, non-child: 491.331ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 342.362ms - PrepareTime: 142.102ms DataStreamSender (dst_id=13):(Total: 49s319ms, non-child: 49s319ms, % non-child: 100.00%) - BytesSent: 297.92 MB (312390540) - NetworkThroughput(*): 537.62 KB/sec - OverallThroughput: 6.04 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s314ms - ThriftTransmitTime(*): 9m27s - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=6):(Total: 399.443ms, non-child: 399.443ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 93.59 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 923.933ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.26 MB (220472024) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 40.45 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.41K (2411) - ScannerThreadsTotalWallClockTime: 4m56s - MaterializeTupleTime(*): 4m55s - ScannerThreadsSysTime: 200.966ms - ScannerThreadsUserTime: 6s750ms - ScannerThreadsVoluntaryContextSwitches: 15.67K (15670) - TotalRawHdfsReadTime(*): 130.165ms - TotalReadThroughput: 3.74 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bdd (host=vb0224.halxg.cloudera.com:22000):(Total: 49s566ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(1s000ms): 101.64 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.42 MB, 203.53 MB, 203.44 MB, 203.35 MB, 203.35 MB, 203.35 MB, 203.51 MB, 170.19 MB, 133.09 MB, 84.23 MB ThreadUsage(1s000ms): 4, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6, 5 - AverageThreadTokens: 7.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.76 MB (213657880) - PerHostPeakMemUsage: 2.59 GB (2783880352) - PrepareTime: 149.889ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 5m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s304ms - TotalStorageWaitTime: 182.274ms CodeGen:(Total: 412.288ms, non-child: 412.288ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.670ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 259.254ms - PrepareTime: 142.834ms DataStreamSender (dst_id=13):(Total: 49s233ms, non-child: 49s233ms, % non-child: 100.00%) - BytesSent: 282.05 MB (295752577) - NetworkThroughput(*): 476.18 KB/sec - OverallThroughput: 5.73 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s239ms - ThriftTransmitTime(*): 10m6s - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=6):(Total: 438.257ms, non-child: 438.257ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(1s000ms): 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.89 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 849.770ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.34 MB (213215512) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 34.88 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.10K (2101) - ScannerThreadsTotalWallClockTime: 5m40s - MaterializeTupleTime(*): 5m39s - ScannerThreadsSysTime: 187.968ms - ScannerThreadsUserTime: 6s296ms - ScannerThreadsVoluntaryContextSwitches: 14.96K (14963) - TotalRawHdfsReadTime(*): 166.357ms - TotalReadThroughput: 3.58 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be0 (host=vb0208.halxg.cloudera.com:22000):(Total: 49s465ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(1s000ms): 98.83 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.59 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.71 MB, 154.06 MB, 116.91 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.27 MB (207905504) - PerHostPeakMemUsage: 2.48 GB (2657904352) - PrepareTime: 199.050ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 4m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s312ms - TotalStorageWaitTime: 289.709ms CodeGen:(Total: 426.437ms, non-child: 426.437ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.278ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 224.127ms - PrepareTime: 195.119ms DataStreamSender (dst_id=13):(Total: 49s111ms, non-child: 49s111ms, % non-child: 100.00%) - BytesSent: 273.49 MB (286774901) - NetworkThroughput(*): 531.58 KB/sec - OverallThroughput: 5.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s202ms - ThriftTransmitTime(*): 8m46s - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=6):(Total: 526.700ms, non-child: 526.700ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 85.98 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.97 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 510.479ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.82 MB (207430368) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 28.15 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1619) - ScannerThreadsTotalWallClockTime: 4m53s - MaterializeTupleTime(*): 4m52s - ScannerThreadsSysTime: 109.980ms - ScannerThreadsUserTime: 3s756ms - ScannerThreadsVoluntaryContextSwitches: 14.41K (14414) - TotalRawHdfsReadTime(*): 156.428ms - TotalReadThroughput: 3.47 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd9 (host=vb0220.halxg.cloudera.com:22000):(Total: 49s284ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(1s000ms): 100.92 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.99 MB, 201.94 MB, 202.00 MB, 201.91 MB, 201.77 MB, 201.77 MB, 201.77 MB, 201.79 MB, 170.01 MB, 117.08 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.20 MB (212017928) - PerHostPeakMemUsage: 2.48 GB (2657611576) - PrepareTime: 134.267ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 4m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s314ms - TotalStorageWaitTime: 90.140ms CodeGen:(Total: 364.918ms, non-child: 364.918ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 227.431ms - PrepareTime: 129.039ms DataStreamSender (dst_id=13):(Total: 49s038ms, non-child: 49s038ms, % non-child: 100.00%) - BytesSent: 276.66 MB (290100620) - NetworkThroughput(*): 536.48 KB/sec - OverallThroughput: 5.64 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s168ms - ThriftTransmitTime(*): 8m48s - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=6):(Total: 357.167ms, non-child: 357.167ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.97 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 529.522ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.70 MB (211501872) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 41.89 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1672) - ScannerThreadsTotalWallClockTime: 4m53s - MaterializeTupleTime(*): 4m52s - ScannerThreadsSysTime: 107.981ms - ScannerThreadsUserTime: 3s852ms - ScannerThreadsVoluntaryContextSwitches: 14.60K (14602) - TotalRawHdfsReadTime(*): 106.772ms - TotalReadThroughput: 3.54 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd3 (host=vb0212.halxg.cloudera.com:22000):(Total: 49s264ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.36 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.70 MB, 176.60 MB, 176.62 MB, 176.62 MB, 176.62 MB, 176.62 MB, 176.85 MB, 137.00 MB, 113.01 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629976) - PerHostPeakMemUsage: 2.47 GB (2652569656) - PrepareTime: 141.008ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 4m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s291ms - TotalStorageWaitTime: 131.559ms CodeGen:(Total: 392.181ms, non-child: 392.181ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 247.907ms - PrepareTime: 138.941ms DataStreamSender (dst_id=13):(Total: 49s015ms, non-child: 49s015ms, % non-child: 100.00%) - BytesSent: 248.58 MB (260655660) - NetworkThroughput(*): 419.86 KB/sec - OverallThroughput: 5.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s109ms - ThriftTransmitTime(*): 10m6s - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=6):(Total: 371.048ms, non-child: 371.048ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 552.470ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 36.27 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.80K (1801) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 4m4s - ScannerThreadsSysTime: 98.982ms - ScannerThreadsUserTime: 4s396ms - ScannerThreadsVoluntaryContextSwitches: 12.97K (12970) - TotalRawHdfsReadTime(*): 132.220ms - TotalReadThroughput: 3.15 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bdf (host=vb0230.halxg.cloudera.com:22000):(Total: 49s233ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(1s000ms): 88.33 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.62 MB, 176.64 MB, 176.60 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 137.13 MB, 117.09 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670992) - PerHostPeakMemUsage: 2.47 GB (2652646808) - PrepareTime: 143.271ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 4m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s278ms - TotalStorageWaitTime: 216.114ms CodeGen:(Total: 416.357ms, non-child: 416.357ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.813ms - PrepareTime: 141.667ms DataStreamSender (dst_id=13):(Total: 48s959ms, non-child: 48s959ms, % non-child: 100.00%) - BytesSent: 248.30 MB (260358778) - NetworkThroughput(*): 419.36 KB/sec - OverallThroughput: 5.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s102ms - ThriftTransmitTime(*): 10m6s - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=6):(Total: 393.563ms, non-child: 393.563ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 552.438ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.68 MB (185261352) - PerReadThreadRawHdfsThroughput: 946.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 34.20 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1745) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 4m4s - ScannerThreadsSysTime: 131.977ms - ScannerThreadsUserTime: 4s453ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13031) - TotalRawHdfsReadTime(*): 164.754ms - TotalReadThroughput: 3.15 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bde (host=vb0234.halxg.cloudera.com:22000):(Total: 49s040ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(1s000ms): 88.34 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.74 MB, 176.78 MB, 176.84 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.66 MB, 136.98 MB, 109.07 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 2.48 GB (2658292584) - PrepareTime: 151.062ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 4m7s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s302ms - TotalStorageWaitTime: 239.000ms CodeGen:(Total: 447.144ms, non-child: 447.144ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 290.077ms - PrepareTime: 140.989ms DataStreamSender (dst_id=13):(Total: 48s721ms, non-child: 48s721ms, % non-child: 100.00%) - BytesSent: 248.09 MB (260142785) - NetworkThroughput(*): 448.85 KB/sec - OverallThroughput: 5.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s956ms - ThriftTransmitTime(*): 9m25s - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=6):(Total: 430.907ms, non-child: 430.907ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 761.954ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 31.25 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.11K (2112) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 173.971ms - ScannerThreadsUserTime: 6s011ms - ScannerThreadsVoluntaryContextSwitches: 12.88K (12880) - TotalRawHdfsReadTime(*): 105.188ms - TotalReadThroughput: 3.18 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bda (host=vb0228.halxg.cloudera.com:22000):(Total: 48s991ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(1s000ms): 88.44 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.85 MB, 176.87 MB, 176.84 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.73 MB, 136.95 MB, 97.11 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185630032) - PerHostPeakMemUsage: 2.44 GB (2624567248) - PrepareTime: 144.997ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 4m7s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s300ms - TotalStorageWaitTime: 127.116ms CodeGen:(Total: 446.424ms, non-child: 446.424ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.257ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 292.619ms - PrepareTime: 142.097ms DataStreamSender (dst_id=13):(Total: 48s717ms, non-child: 48s717ms, % non-child: 100.00%) - BytesSent: 248.13 MB (260178294) - NetworkThroughput(*): 419.50 KB/sec - OverallThroughput: 5.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s969ms - ThriftTransmitTime(*): 10m5s - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=6):(Total: 398.849ms, non-child: 398.849ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 847.799ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 33.74 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.93K (1931) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 146.975ms - ScannerThreadsUserTime: 6s258ms - ScannerThreadsVoluntaryContextSwitches: 12.96K (12955) - TotalRawHdfsReadTime(*): 120.971ms - TotalReadThroughput: 3.15 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd4 (host=vb0204.halxg.cloudera.com:22000):(Total: 48s955ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.27 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.60 MB, 176.66 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.82 MB, 136.98 MB, 113.06 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 2.46 GB (2644740640) - PrepareTime: 154.187ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 4m7s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s307ms - TotalStorageWaitTime: 246.625ms CodeGen:(Total: 424.109ms, non-child: 424.109ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.137ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 260.306ms - PrepareTime: 144.817ms DataStreamSender (dst_id=13):(Total: 48s667ms, non-child: 48s667ms, % non-child: 100.00%) - BytesSent: 248.21 MB (260265447) - NetworkThroughput(*): 419.31 KB/sec - OverallThroughput: 5.10 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s960ms - ThriftTransmitTime(*): 10m6s - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=6):(Total: 417.257ms, non-child: 417.257ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 466.124ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 32.26 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1413) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 106.981ms - ScannerThreadsUserTime: 3s624ms - ScannerThreadsVoluntaryContextSwitches: 12.99K (12994) - TotalRawHdfsReadTime(*): 144.375ms - TotalReadThroughput: 3.18 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd2 (host=vb0226.halxg.cloudera.com:22000):(Total: 48s866ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(1s000ms): 146.79 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.17 MB, 168.18 MB, 168.19 MB, 168.26 MB, 168.26 MB, 168.26 MB, 168.26 MB, 168.21 MB, 120.01 MB, 75.41 MB ThreadUsage(1s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.49 MB (176669416) - PerHostPeakMemUsage: 2.48 GB (2668033824) - PrepareTime: 130.644ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 4m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s306ms - TotalStorageWaitTime: 101.220ms CodeGen:(Total: 363.396ms, non-child: 363.396ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 229.870ms - PrepareTime: 128.088ms DataStreamSender (dst_id=13):(Total: 48s631ms, non-child: 48s631ms, % non-child: 100.00%) - BytesSent: 227.27 MB (238310128) - NetworkThroughput(*): 384.12 KB/sec - OverallThroughput: 4.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s904ms - ThriftTransmitTime(*): 10m5s - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=6):(Total: 346.326ms, non-child: 346.326ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:98.98% 1:0% 2:1.02% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 116.06 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 445.445ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217368) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 35.54 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1393) - ScannerThreadsTotalWallClockTime: 4m2s - MaterializeTupleTime(*): 4m1s - ScannerThreadsSysTime: 88.984ms - ScannerThreadsUserTime: 3s293ms - ScannerThreadsVoluntaryContextSwitches: 11.97K (11973) - TotalRawHdfsReadTime(*): 94.075ms - TotalReadThroughput: 2.91 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd7 (host=vb0232.halxg.cloudera.com:22000):(Total: 48s838ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(1s000ms): 51.47 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.35 MB, 178.36 MB, 178.26 MB, 178.31 MB, 178.37 MB, 178.37 MB, 178.37 MB, 178.23 MB, 151.41 MB, 95.40 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 5 - AverageThreadTokens: 6.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.70 MB (187384584) - PerHostPeakMemUsage: 2.47 GB (2656461776) - PrepareTime: 146.881ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 4m52s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s299ms - TotalStorageWaitTime: 261.079ms CodeGen:(Total: 443.329ms, non-child: 443.329ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 293.094ms - PrepareTime: 143.385ms DataStreamSender (dst_id=13):(Total: 48s594ms, non-child: 48s594ms, % non-child: 100.00%) - BytesSent: 243.00 MB (254805564) - NetworkThroughput(*): 410.54 KB/sec - OverallThroughput: 5.00 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s890ms - ThriftTransmitTime(*): 10m6s - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=6):(Total: 370.369ms, non-child: 370.369ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:98.98% 1:1.02% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 114.81 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 5.93 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 447.681ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.26 MB (186917640) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 35.53 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1095) - ScannerThreadsTotalWallClockTime: 4m48s - MaterializeTupleTime(*): 4m47s - ScannerThreadsSysTime: 82.985ms - ScannerThreadsUserTime: 3s213ms - ScannerThreadsVoluntaryContextSwitches: 12.75K (12749) - TotalRawHdfsReadTime(*): 131.872ms - TotalReadThroughput: 3.12 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bdb (host=vb0206.halxg.cloudera.com:22000):(Total: 48s794ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(1s000ms): 88.37 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.77 MB, 176.85 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.80 MB, 176.61 MB, 137.05 MB, 97.05 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.06 MB (185662800) - PerHostPeakMemUsage: 2.48 GB (2662721424) - PrepareTime: 141.773ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 4m6s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s294ms - TotalStorageWaitTime: 71.588ms CodeGen:(Total: 506.438ms, non-child: 506.438ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 360.865ms - PrepareTime: 138.802ms DataStreamSender (dst_id=13):(Total: 48s565ms, non-child: 48s565ms, % non-child: 100.00%) - BytesSent: 248.09 MB (260141171) - NetworkThroughput(*): 564.86 KB/sec - OverallThroughput: 5.11 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s913ms - ThriftTransmitTime(*): 7m29s - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=6):(Total: 352.985ms, non-child: 352.985ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 475.120ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 38.13 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1443) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 102.983ms - ScannerThreadsUserTime: 3s667ms - ScannerThreadsVoluntaryContextSwitches: 12.98K (12983) - TotalRawHdfsReadTime(*): 116.407ms - TotalReadThroughput: 3.18 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bdc (host=vb0222.halxg.cloudera.com:22000):(Total: 48s667ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(1s000ms): 82.14 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.22 MB, 164.15 MB, 164.20 MB, 164.20 MB, 164.20 MB, 164.20 MB, 164.26 MB, 117.87 MB, 49.39 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 3 - AverageThreadTokens: 5.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.53 MB (172522824) - PerHostPeakMemUsage: 2.48 GB (2659118896) - PrepareTime: 150.661ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 4m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s292ms - TotalStorageWaitTime: 302.673ms CodeGen:(Total: 398.270ms, non-child: 398.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.066ms - PrepareTime: 142.540ms DataStreamSender (dst_id=13):(Total: 48s373ms, non-child: 48s373ms, % non-child: 100.00%) - BytesSent: 222.99 MB (233826112) - NetworkThroughput(*): 377.35 KB/sec - OverallThroughput: 4.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s758ms - ThriftTransmitTime(*): 10m5s - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=6):(Total: 417.393ms, non-child: 417.393ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 70.05 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 747.813ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088608) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 28.95 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1552) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 3m59s - ScannerThreadsSysTime: 142.975ms - ScannerThreadsUserTime: 5s356ms - ScannerThreadsVoluntaryContextSwitches: 11.63K (11632) - TotalRawHdfsReadTime(*): 133.981ms - TotalReadThroughput: 2.86 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd8 (host=vb0216.halxg.cloudera.com:22000):(Total: 48s652ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(1s000ms): 53.08 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.30 MB, 160.26 MB, 160.36 MB, 160.47 MB, 160.47 MB, 160.47 MB, 160.19 MB, 127.81 MB, 91.36 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.54 MB (168336712) - PerHostPeakMemUsage: 2.40 GB (2580316032) - PrepareTime: 149.347ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 4m3s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s291ms - TotalStorageWaitTime: 331.175ms CodeGen:(Total: 414.191ms, non-child: 414.191ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.121ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.250ms - PrepareTime: 144.023ms DataStreamSender (dst_id=13):(Total: 48s356ms, non-child: 48s356ms, % non-child: 100.00%) - BytesSent: 221.19 MB (231929996) - NetworkThroughput(*): 374.37 KB/sec - OverallThroughput: 4.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s760ms - ThriftTransmitTime(*): 10m5s - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=6):(Total: 415.005ms, non-child: 415.005ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 114.73 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 593.478ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.12 MB (167894304) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 28.85 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1580) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 3m59s - ScannerThreadsSysTime: 132.978ms - ScannerThreadsUserTime: 4s256ms - ScannerThreadsVoluntaryContextSwitches: 11.27K (11273) - TotalRawHdfsReadTime(*): 92.510ms - TotalReadThroughput: 2.86 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bd5 (host=vb0218.halxg.cloudera.com:22000):(Total: 45s273ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.36 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.65 MB, 176.66 MB, 176.87 MB, 176.75 MB, 176.75 MB, 176.75 MB, 176.75 MB, 176.68 MB, 137.01 MB, 97.07 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 176.98 MB (185576040) - PerHostPeakMemUsage: 2.42 GB (2597530160) - PrepareTime: 130.326ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 4m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s587ms - TotalStorageWaitTime: 100.209ms CodeGen:(Total: 354.278ms, non-child: 354.278ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 221.196ms - PrepareTime: 128.872ms DataStreamSender (dst_id=13):(Total: 45s052ms, non-child: 45s052ms, % non-child: 100.00%) - BytesSent: 248.76 MB (260845635) - NetworkThroughput(*): 451.97 KB/sec - OverallThroughput: 5.52 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s985ms - ThriftTransmitTime(*): 9m23s - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=6):(Total: 332.328ms, non-child: 332.328ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 461.633ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 40.50 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.47K (1468) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 4m3s - ScannerThreadsSysTime: 71.987ms - ScannerThreadsUserTime: 3s665ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13046) - TotalRawHdfsReadTime(*): 123.365ms - TotalReadThroughput: 3.18 MB/sec Fragment F03: Instance 2b455e6e74ea02a1:93296120d7b96be3 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(2s000ms): 180.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 240.08 MB, 257.23 MB, 262.99 MB, 263.02 MB, 263.00 MB, 263.06 MB, 262.95 MB, 233.12 MB, 92.81 MB, 109.56 MB, 164.56 MB, 164.55 MB, 164.55 MB, 164.63 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275312) - PerHostPeakMemUsage: 3.14 GB (3368530816) - PrepareTime: 198.783ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 14m7s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s259ms - TotalStorageWaitTime: 413.407ms CodeGen:(Total: 513.190ms, non-child: 513.190ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 310.811ms - PrepareTime: 194.879ms DataStreamSender (dst_id=12):(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - BytesSent: 886.17 MB (929213196) - NetworkThroughput(*): 1.44 MB/sec - OverallThroughput: 11.32 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s840ms - ThriftTransmitTime(*): 10m14s - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=5):(Total: 735.104ms, non-child: 735.104ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(2s000ms): 154.59 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 206.11 MB, 221.51 MB, 226.65 MB, 226.65 MB, 226.65 MB, 226.65 MB, 226.65 MB, 226.65 MB, 226.65 MB, 261.25 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.44 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 1s926ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 71.97 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.18K (11178) - ScannerThreadsTotalWallClockTime: 13m47s - MaterializeTupleTime(*): 13m44s - ScannerThreadsSysTime: 703.888ms - ScannerThreadsUserTime: 20s055ms - ScannerThreadsVoluntaryContextSwitches: 51.70K (51705) - TotalRawHdfsReadTime(*): 293.758ms - TotalReadThroughput: 4.59 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be5 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(2s000ms): 195.70 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 260.95 MB, 262.03 MB, 263.04 MB, 263.00 MB, 263.01 MB, 262.98 MB, 262.92 MB, 213.33 MB, 90.90 MB, 140.92 MB, 170.57 MB, 170.62 MB, 170.61 MB, 146.73 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8 - AverageThreadTokens: 11.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250776) - PerHostPeakMemUsage: 3.08 GB (3311730816) - PrepareTime: 146.178ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 14m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s652ms - TotalStorageWaitTime: 426.989ms CodeGen:(Total: 406.184ms, non-child: 406.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.737ms - PrepareTime: 136.429ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 897.74 MB (941345281) - NetworkThroughput(*): 1.21 MB/sec - OverallThroughput: 11.53 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s800ms - ThriftTransmitTime(*): 12m24s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=5):(Total: 743.184ms, non-child: 743.184ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 338.79 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.52 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 2s120ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 72.10 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.67K (14674) - ScannerThreadsTotalWallClockTime: 13m44s - MaterializeTupleTime(*): 13m41s - ScannerThreadsSysTime: 891.858ms - ScannerThreadsUserTime: 24s772ms - ScannerThreadsVoluntaryContextSwitches: 52.46K (52464) - TotalRawHdfsReadTime(*): 320.715ms - TotalReadThroughput: 4.71 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96beb (host=vb0206.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(2s000ms): 196.27 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 262.56 MB, 262.97 MB, 262.97 MB, 262.94 MB, 263.01 MB, 263.04 MB, 153.88 MB, 88.96 MB, 162.17 MB, 170.57 MB, 170.54 MB, 170.60 MB, 107.05 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.52 MB (276324456) - PerHostPeakMemUsage: 3.05 GB (3274805224) - PrepareTime: 136.342ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 14m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s495ms - TotalStorageWaitTime: 633.807ms CodeGen:(Total: 370.503ms, non-child: 370.503ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 231.348ms - PrepareTime: 134.799ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 898.30 MB (941939081) - NetworkThroughput(*): 1.95 MB/sec - OverallThroughput: 11.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s684ms - ThriftTransmitTime(*): 7m39s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=5):(Total: 705.056ms, non-child: 705.056ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.38 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 343.90 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.43 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 2s200ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 76.04 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.61K (13607) - ScannerThreadsTotalWallClockTime: 13m41s - MaterializeTupleTime(*): 13m38s - ScannerThreadsSysTime: 784.875ms - ScannerThreadsUserTime: 23s592ms - ScannerThreadsVoluntaryContextSwitches: 52.38K (52378) - TotalRawHdfsReadTime(*): 308.851ms - TotalReadThroughput: 4.68 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bed (host=vb0224.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(2s000ms): 195.83 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 262.11 MB, 263.08 MB, 262.98 MB, 263.06 MB, 262.92 MB, 263.10 MB, 157.75 MB, 88.94 MB, 157.94 MB, 170.57 MB, 170.57 MB, 170.59 MB, 112.95 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.44 MB (276234344) - PerHostPeakMemUsage: 3.04 GB (3269264312) - PrepareTime: 147.832ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 13m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s870ms - TotalStorageWaitTime: 645.683ms CodeGen:(Total: 411.918ms, non-child: 411.918ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.011ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 260.551ms - PrepareTime: 141.113ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 897.78 MB (941387946) - NetworkThroughput(*): 1.60 MB/sec - OverallThroughput: 11.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s656ms - ThriftTransmitTime(*): 9m22s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=5):(Total: 726.968ms, non-child: 726.968ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 231.01 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 2s138ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 73.69 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.53K (12531) - ScannerThreadsTotalWallClockTime: 13m40s - MaterializeTupleTime(*): 13m37s - ScannerThreadsSysTime: 796.873ms - ScannerThreadsUserTime: 22s397ms - ScannerThreadsVoluntaryContextSwitches: 52.37K (52370) - TotalRawHdfsReadTime(*): 307.387ms - TotalReadThroughput: 4.71 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be7 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(2s000ms): 196.48 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 261.95 MB, 262.01 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.77 MB, 263.03 MB, 263.02 MB, 263.11 MB, 262.97 MB, 262.99 MB, 140.03 MB, 88.86 MB, 169.34 MB, 167.53 MB, 167.60 MB, 167.62 MB, 74.47 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258968) - PerHostPeakMemUsage: 3.03 GB (3252945744) - PrepareTime: 143.518ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 13m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s658ms - TotalStorageWaitTime: 499.496ms CodeGen:(Total: 420.850ms, non-child: 420.850ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 268.860ms - PrepareTime: 137.612ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 892.36 MB (935706843) - NetworkThroughput(*): 1.26 MB/sec - OverallThroughput: 11.51 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s413ms - ThriftTransmitTime(*): 11m46s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=5):(Total: 625.305ms, non-child: 625.305ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.39 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 362.24 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.47 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 1s877ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 85.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.56K (11564) - ScannerThreadsTotalWallClockTime: 13m38s - MaterializeTupleTime(*): 13m35s - ScannerThreadsSysTime: 684.892ms - ScannerThreadsUserTime: 19s223ms - ScannerThreadsVoluntaryContextSwitches: 52.04K (52036) - TotalRawHdfsReadTime(*): 306.664ms - TotalReadThroughput: 4.68 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bee (host=vb0222.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(2s000ms): 191.84 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 255.76 MB, 257.06 MB, 257.46 MB, 257.46 MB, 257.56 MB, 257.45 MB, 257.50 MB, 155.49 MB, 104.79 MB, 158.05 MB, 170.59 MB, 170.54 MB, 158.73 MB, 78.01 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 7 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.92 MB (270450832) - PerHostPeakMemUsage: 3.03 GB (3254188152) - PrepareTime: 148.626ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 13m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s419ms - TotalStorageWaitTime: 690.621ms CodeGen:(Total: 405.955ms, non-child: 405.955ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.190ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.758ms - PrepareTime: 140.231ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 887.81 MB (930939976) - NetworkThroughput(*): 1.08 MB/sec - OverallThroughput: 11.46 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s781ms - ThriftTransmitTime(*): 13m40s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=5):(Total: 678.423ms, non-child: 678.423ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 166.17 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 221.56 MB, 231.83 MB, 242.09 MB, 339.63 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 2s002ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.47 MB (269975696) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 78.07 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.91K (11911) - ScannerThreadsTotalWallClockTime: 13m37s - MaterializeTupleTime(*): 13m33s - ScannerThreadsSysTime: 762.878ms - ScannerThreadsUserTime: 20s966ms - ScannerThreadsVoluntaryContextSwitches: 51.69K (51688) - TotalRawHdfsReadTime(*): 338.285ms - TotalReadThroughput: 4.65 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be2 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(2s000ms): 178.91 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.69 MB, 238.81 MB, 238.78 MB, 238.78 MB, 238.78 MB, 238.78 MB, 238.78 MB, 239.34 MB, 239.85 MB, 239.94 MB, 239.93 MB, 239.93 MB, 190.24 MB, 81.67 MB, 137.54 MB, 193.66 MB, 193.67 MB, 193.68 MB, 193.62 MB, 82.83 MB ThreadUsage(2s000ms): 8, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 10, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.40 MB (252082872) - PerHostPeakMemUsage: 3.04 GB (3264931072) - PrepareTime: 149.721ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 12m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s826ms - TotalStorageWaitTime: 575.365ms CodeGen:(Total: 396.741ms, non-child: 396.741ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.654ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 241.995ms - PrepareTime: 143.048ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 898.23 MB (941858246) - NetworkThroughput(*): 1.31 MB/sec - OverallThroughput: 11.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s471ms - ThriftTransmitTime(*): 11m27s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=5):(Total: 678.794ms, non-child: 678.794ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 205.32 MB, 328.52 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.71 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 1s878ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.95 MB (251607736) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 78.96 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.51K (9513) - ScannerThreadsTotalWallClockTime: 12m37s - MaterializeTupleTime(*): 12m34s - ScannerThreadsSysTime: 690.889ms - ScannerThreadsUserTime: 19s102ms - ScannerThreadsVoluntaryContextSwitches: 52.48K (52479) - TotalRawHdfsReadTime(*): 344.698ms - TotalReadThroughput: 4.74 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bea (host=vb0228.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(2s000ms): 196.24 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 262.58 MB, 263.03 MB, 262.98 MB, 262.95 MB, 262.89 MB, 263.03 MB, 197.47 MB, 90.88 MB, 130.73 MB, 141.47 MB, 141.50 MB, 141.50 MB, 55.17 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 6 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242584) - PerHostPeakMemUsage: 3.02 GB (3241615072) - PrepareTime: 139.252ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 13m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s477ms - TotalStorageWaitTime: 377.717ms CodeGen:(Total: 380.679ms, non-child: 380.679ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 238.518ms - PrepareTime: 136.989ms DataStreamSender (dst_id=12):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - BytesSent: 836.29 MB (876912677) - NetworkThroughput(*): 1.09 MB/sec - OverallThroughput: 10.86 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s358ms - ThriftTransmitTime(*): 12m47s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=5):(Total: 733.535ms, non-child: 733.535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 300.70 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.41 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 2s058ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 68.10 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.62K (14617) - ScannerThreadsTotalWallClockTime: 13m28s - MaterializeTupleTime(*): 13m26s - ScannerThreadsSysTime: 906.857ms - ScannerThreadsUserTime: 21s727ms - ScannerThreadsVoluntaryContextSwitches: 49.14K (49139) - TotalRawHdfsReadTime(*): 280.045ms - TotalReadThroughput: 4.42 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be6 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(2s000ms): 196.27 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 261.67 MB, 262.61 MB, 263.04 MB, 263.02 MB, 262.96 MB, 262.91 MB, 260.94 MB, 161.82 MB, 88.98 MB, 140.91 MB, 147.53 MB, 147.49 MB, 125.60 MB, 49.12 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 6 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 3.02 GB (3247760064) - PrepareTime: 142.199ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 13m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s631ms - TotalStorageWaitTime: 448.732ms CodeGen:(Total: 395.556ms, non-child: 395.556ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.346ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 249.535ms - PrepareTime: 137.621ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 847.99 MB (889185685) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 11.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s234ms - ThriftTransmitTime(*): 10m52s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=5):(Total: 674.834ms, non-child: 674.834ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 328.53 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s962ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 74.97 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.13K (11132) - ScannerThreadsTotalWallClockTime: 13m26s - MaterializeTupleTime(*): 13m23s - ScannerThreadsSysTime: 764.877ms - ScannerThreadsUserTime: 20s502ms - ScannerThreadsVoluntaryContextSwitches: 49.60K (49603) - TotalRawHdfsReadTime(*): 309.153ms - TotalReadThroughput: 4.48 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be1 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(2s000ms): 193.26 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.87 MB, 257.87 MB, 257.87 MB, 257.87 MB, 257.87 MB, 257.87 MB, 258.01 MB, 258.00 MB, 258.04 MB, 257.94 MB, 258.00 MB, 258.03 MB, 166.68 MB, 102.46 MB, 144.99 MB, 147.53 MB, 147.42 MB, 125.65 MB, 42.64 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 5 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 258.47 MB (271024240) - PerHostPeakMemUsage: 3.00 GB (3224296520) - PrepareTime: 136.220ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 13m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s765ms - TotalStorageWaitTime: 368.551ms CodeGen:(Total: 349.366ms, non-child: 349.366ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 210.286ms - PrepareTime: 133.581ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 839.17 MB (879937072) - NetworkThroughput(*): 1.40 MB/sec - OverallThroughput: 10.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s210ms - ThriftTransmitTime(*): 10m - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=5):(Total: 672.560ms, non-child: 672.560ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:99.35% 1:0.6452% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 166.69 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 242.79 MB, 319.81 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s989ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.03 MB (270565480) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 74.46 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.85K (13853) - ScannerThreadsTotalWallClockTime: 13m24s - MaterializeTupleTime(*): 13m21s - ScannerThreadsSysTime: 775.875ms - ScannerThreadsUserTime: 23s636ms - ScannerThreadsVoluntaryContextSwitches: 48.90K (48900) - TotalRawHdfsReadTime(*): 283.061ms - TotalReadThroughput: 4.43 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bec (host=vb0220.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(2s000ms): 196.12 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 262.35 MB, 262.90 MB, 263.01 MB, 262.96 MB, 263.09 MB, 262.98 MB, 179.56 MB, 88.95 MB, 140.36 MB, 147.39 MB, 147.49 MB, 135.56 MB, 50.98 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 6 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 3.02 GB (3240529664) - PrepareTime: 137.986ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 13m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s317ms - TotalStorageWaitTime: 780.451ms CodeGen:(Total: 399.761ms, non-child: 399.761ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 259.140ms - PrepareTime: 135.274ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 847.93 MB (889123521) - NetworkThroughput(*): 1.11 MB/sec - OverallThroughput: 11.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s455ms - ThriftTransmitTime(*): 12m47s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=5):(Total: 711.207ms, non-child: 711.207ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.41 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 2s023ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 71.14 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.72K (12722) - ScannerThreadsTotalWallClockTime: 13m25s - MaterializeTupleTime(*): 13m22s - ScannerThreadsSysTime: 808.871ms - ScannerThreadsUserTime: 21s038ms - ScannerThreadsVoluntaryContextSwitches: 49.55K (49547) - TotalRawHdfsReadTime(*): 296.832ms - TotalReadThroughput: 4.50 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bef (host=vb0218.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(2s000ms): 196.32 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.74 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 261.70 MB, 262.64 MB, 263.02 MB, 263.02 MB, 263.08 MB, 263.06 MB, 260.99 MB, 132.10 MB, 88.84 MB, 152.56 MB, 147.47 MB, 147.49 MB, 123.64 MB, 42.14 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 5 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276283504) - PerHostPeakMemUsage: 3.00 GB (3224037496) - PrepareTime: 129.446ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 13m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s736ms - TotalStorageWaitTime: 657.477ms CodeGen:(Total: 358.360ms, non-child: 358.360ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.265ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 226.058ms - PrepareTime: 128.124ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 848.44 MB (889658673) - NetworkThroughput(*): 1.18 MB/sec - OverallThroughput: 11.04 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s134ms - ThriftTransmitTime(*): 11m58s - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=5):(Total: 649.437ms, non-child: 649.437ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.39 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 343.93 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 1s917ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 77.95 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.25K (11248) - ScannerThreadsTotalWallClockTime: 13m23s - MaterializeTupleTime(*): 13m20s - ScannerThreadsSysTime: 676.890ms - ScannerThreadsUserTime: 20s447ms - ScannerThreadsVoluntaryContextSwitches: 49.46K (49459) - TotalRawHdfsReadTime(*): 262.870ms - TotalReadThroughput: 4.48 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be4 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(2s000ms): 196.28 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 261.68 MB, 262.60 MB, 263.02 MB, 262.89 MB, 263.05 MB, 262.98 MB, 262.93 MB, 169.68 MB, 88.95 MB, 138.66 MB, 147.37 MB, 147.46 MB, 133.60 MB, 51.03 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 6 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 3.03 GB (3248247568) - PrepareTime: 146.378ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 13m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 58s906ms - TotalStorageWaitTime: 745.265ms CodeGen:(Total: 438.340ms, non-child: 438.340ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.249ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 287.231ms - PrepareTime: 142.306ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 848.11 MB (889305555) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 11.04 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s232ms - ThriftTransmitTime(*): 10m52s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=5):(Total: 682.776ms, non-child: 682.776ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 318.26 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 1s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 74.15 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.89K (10893) - ScannerThreadsTotalWallClockTime: 13m26s - MaterializeTupleTime(*): 13m22s - ScannerThreadsSysTime: 709.886ms - ScannerThreadsUserTime: 19s583ms - ScannerThreadsVoluntaryContextSwitches: 49.44K (49436) - TotalRawHdfsReadTime(*): 295.701ms - TotalReadThroughput: 4.48 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be8 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(2s000ms): 195.88 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 261.29 MB, 262.18 MB, 262.90 MB, 262.90 MB, 262.97 MB, 262.92 MB, 262.97 MB, 171.77 MB, 88.91 MB, 134.99 MB, 147.47 MB, 147.50 MB, 135.60 MB, 52.44 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276283496) - PerHostPeakMemUsage: 3.03 GB (3250756880) - PrepareTime: 143.412ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 13m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s010ms - TotalStorageWaitTime: 338.998ms CodeGen:(Total: 387.342ms, non-child: 387.342ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.891ms - PrepareTime: 140.691ms DataStreamSender (dst_id=12):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 849.45 MB (890713572) - NetworkThroughput(*): 1.51 MB/sec - OverallThroughput: 11.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s139ms - ThriftTransmitTime(*): 9m21s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=5):(Total: 658.337ms, non-child: 658.337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 1s898ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 76.99 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.44K (10436) - ScannerThreadsTotalWallClockTime: 13m24s - MaterializeTupleTime(*): 13m21s - ScannerThreadsSysTime: 767.879ms - ScannerThreadsUserTime: 19s595ms - ScannerThreadsVoluntaryContextSwitches: 49.63K (49633) - TotalRawHdfsReadTime(*): 288.320ms - TotalReadThroughput: 4.51 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96be9 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m15s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(2s000ms): 196.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.38 MB, 262.57 MB, 263.01 MB, 262.94 MB, 262.94 MB, 263.03 MB, 262.88 MB, 177.51 MB, 88.97 MB, 124.34 MB, 124.30 MB, 124.38 MB, 72.99 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 6, 6, 6 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.50 MB (276299888) - PerHostPeakMemUsage: 2.80 GB (3011812240) - PrepareTime: 141.863ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 13m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 57s644ms - TotalStorageWaitTime: 331.850ms CodeGen:(Total: 378.887ms, non-child: 378.887ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 233.657ms - PrepareTime: 140.111ms DataStreamSender (dst_id=12):(Total: 1m15s, non-child: 1m15s, % non-child: 100.00%) - BytesSent: 798.13 MB (836903626) - NetworkThroughput(*): 1.04 MB/sec - OverallThroughput: 10.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s879ms - ThriftTransmitTime(*): 12m44s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=5):(Total: 648.448ms, non-child: 648.448ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(2s000ms): 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 73.48 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 11.31K (11308) - ScannerThreadsTotalWallClockTime: 13m7s - MaterializeTupleTime(*): 13m4s - ScannerThreadsSysTime: 750.880ms - ScannerThreadsUserTime: 19s874ms - ScannerThreadsVoluntaryContextSwitches: 46.56K (46564) - TotalRawHdfsReadTime(*): 251.859ms - TotalReadThroughput: 4.32 MB/sec Fragment F01: Instance 2b455e6e74ea02a1:93296120d7b96bf4 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s503ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 210.45 MB, 210.17 MB, 210.43 MB, 162.68 MB, 162.74 MB, 162.61 MB, 114.78 MB, 114.74 MB, 67.64 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.70 MB (220938968) - PerHostPeakMemUsage: 1.54 GB (1657303952) - PrepareTime: 133.720ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 30s561ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 62.214ms - TotalStorageWaitTime: 200.202ms CodeGen:(Total: 396.599ms, non-child: 396.599ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 254.597ms - PrepareTime: 131.060ms DataStreamSender (dst_id=11):(Total: 4s211ms, non-child: 4s211ms, % non-child: 100.00%) - BytesSent: 300.17 MB (314752193) - NetworkThroughput(*): 40.08 MB/sec - OverallThroughput: 71.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s398ms - ThriftTransmitTime(*): 7s488ms - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=2):(Total: 398.495ms, non-child: 398.495ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 946.505ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.26 MB (220472024) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 40.54 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.32K (2324) - ScannerThreadsTotalWallClockTime: 26s011ms - MaterializeTupleTime(*): 24s752ms - ScannerThreadsSysTime: 151.974ms - ScannerThreadsUserTime: 7s111ms - ScannerThreadsVoluntaryContextSwitches: 15.66K (15665) - TotalRawHdfsReadTime(*): 144.635ms - TotalReadThroughput: 37.44 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf7 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s416ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(500.000ms): 0, 201.83 MB, 201.82 MB, 201.81 MB, 185.92 MB, 154.23 MB, 154.16 MB, 121.14 MB, 97.09 MB, 47.95 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 6, 6, 5 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.31 MB (212140728) - PerHostPeakMemUsage: 1.53 GB (1639633784) - PrepareTime: 131.545ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 28s280ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 60.824ms - TotalStorageWaitTime: 280.288ms CodeGen:(Total: 384.265ms, non-child: 384.265ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 247.587ms - PrepareTime: 126.628ms DataStreamSender (dst_id=11):(Total: 4s112ms, non-child: 4s112ms, % non-child: 100.00%) - BytesSent: 276.80 MB (290250627) - NetworkThroughput(*): 39.12 MB/sec - OverallThroughput: 67.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s290ms - ThriftTransmitTime(*): 7s075ms - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=2):(Total: 404.992ms, non-child: 404.992ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.56 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 853.811ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.88 MB (211690168) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 36.95 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.72K (2716) - ScannerThreadsTotalWallClockTime: 23s908ms - MaterializeTupleTime(*): 22s651ms - ScannerThreadsSysTime: 158.973ms - ScannerThreadsUserTime: 6s817ms - ScannerThreadsVoluntaryContextSwitches: 14.48K (14480) - TotalRawHdfsReadTime(*): 160.487ms - TotalReadThroughput: 38.55 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bfb (host=vb0224.halxg.cloudera.com:22000):(Total: 4s207ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(500.000ms): 0, 202.90 MB, 203.26 MB, 203.45 MB, 183.47 MB, 137.03 MB, 137.19 MB, 97.00 MB, 89.19 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.71 MB (213600528) - PerHostPeakMemUsage: 1.52 GB (1632171544) - PrepareTime: 147.936ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 27s187ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53.470ms - TotalStorageWaitTime: 540.645ms CodeGen:(Total: 413.316ms, non-child: 413.316ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 260.261ms - PrepareTime: 140.015ms DataStreamSender (dst_id=11):(Total: 3s920ms, non-child: 3s920ms, % non-child: 100.00%) - BytesSent: 282.51 MB (296234119) - NetworkThroughput(*): 37.34 MB/sec - OverallThroughput: 72.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s240ms - ThriftTransmitTime(*): 7s565ms - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=2):(Total: 393.632ms, non-child: 393.632ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.88 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 568.580ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.28 MB (213149968) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 38.83 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1789) - ScannerThreadsTotalWallClockTime: 23s260ms - MaterializeTupleTime(*): 21s930ms - ScannerThreadsSysTime: 105.981ms - ScannerThreadsUserTime: 4s532ms - ScannerThreadsVoluntaryContextSwitches: 14.64K (14641) - TotalRawHdfsReadTime(*): 159.097ms - TotalReadThroughput: 44.34 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bfe (host=vb0208.halxg.cloudera.com:22000):(Total: 4s037ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(500.000ms): 68.00 KB, 197.77 MB, 197.73 MB, 197.79 MB, 150.08 MB, 137.12 MB, 121.19 MB, 96.99 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 5.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.18 MB (207807240) - PerHostPeakMemUsage: 1.45 GB (1555875616) - PrepareTime: 193.191ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 25s341ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 48.856ms - TotalStorageWaitTime: 158.457ms CodeGen:(Total: 419.361ms, non-child: 419.361ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 223.087ms - PrepareTime: 190.725ms DataStreamSender (dst_id=11):(Total: 3s703ms, non-child: 3s703ms, % non-child: 100.00%) - BytesSent: 273.21 MB (286484109) - NetworkThroughput(*): 41.97 MB/sec - OverallThroughput: 73.77 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s119ms - ThriftTransmitTime(*): 6s510ms - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=2):(Total: 506.110ms, non-child: 506.110ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.57 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 860.655ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.76 MB (207364872) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 29.30 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1969) - ScannerThreadsTotalWallClockTime: 21s240ms - MaterializeTupleTime(*): 20s143ms - ScannerThreadsSysTime: 166.971ms - ScannerThreadsUserTime: 6s252ms - ScannerThreadsVoluntaryContextSwitches: 14.50K (14499) - TotalRawHdfsReadTime(*): 154.134ms - TotalReadThroughput: 42.99 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf9 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s020ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 176.79 MB, 176.60 MB, 176.81 MB, 137.07 MB, 137.00 MB, 105.02 MB, 97.15 MB, 40.07 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 5.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646368) - PerHostPeakMemUsage: 1.46 GB (1571938048) - PrepareTime: 139.452ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 23s280ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 62.313ms - TotalStorageWaitTime: 179.187ms CodeGen:(Total: 398.266ms, non-child: 398.266ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.109ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.376ms - PrepareTime: 136.553ms DataStreamSender (dst_id=11):(Total: 3s758ms, non-child: 3s758ms, % non-child: 100.00%) - BytesSent: 247.88 MB (259920529) - NetworkThroughput(*): 35.91 MB/sec - OverallThroughput: 65.95 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s090ms - ThriftTransmitTime(*): 6s903ms - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=2):(Total: 379.704ms, non-child: 379.704ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.75 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 559.602ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 35.45 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1818) - ScannerThreadsTotalWallClockTime: 19s207ms - MaterializeTupleTime(*): 18s344ms - ScannerThreadsSysTime: 110.981ms - ScannerThreadsUserTime: 4s263ms - ScannerThreadsVoluntaryContextSwitches: 12.99K (12986) - TotalRawHdfsReadTime(*): 138.709ms - TotalReadThroughput: 34.66 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf2 (host=vb0204.halxg.cloudera.com:22000):(Total: 3s969ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(500.000ms): 0, 176.82 MB, 176.66 MB, 176.66 MB, 137.11 MB, 137.01 MB, 113.04 MB, 97.09 MB, 57.88 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.08 MB (185679136) - PerHostPeakMemUsage: 1.42 GB (1523923512) - PrepareTime: 151.834ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 22s873ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54.178ms - TotalStorageWaitTime: 207.132ms CodeGen:(Total: 408.797ms, non-child: 408.797ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.680ms - PrepareTime: 142.617ms DataStreamSender (dst_id=11):(Total: 3s713ms, non-child: 3s713ms, % non-child: 100.00%) - BytesSent: 250.31 MB (262468101) - NetworkThroughput(*): 37.88 MB/sec - OverallThroughput: 67.40 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s123ms - ThriftTransmitTime(*): 6s607ms - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=2):(Total: 380.775ms, non-child: 380.775ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 483.741ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 35.35 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1670) - ScannerThreadsTotalWallClockTime: 18s874ms - MaterializeTupleTime(*): 18s084ms - ScannerThreadsSysTime: 92.983ms - ScannerThreadsUserTime: 3s587ms - ScannerThreadsVoluntaryContextSwitches: 13.04K (13035) - TotalRawHdfsReadTime(*): 147.165ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bfd (host=vb0230.halxg.cloudera.com:22000):(Total: 3s952ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.85 MB, 176.67 MB, 176.77 MB, 137.10 MB, 136.95 MB, 97.15 MB, 96.96 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638168) - PerHostPeakMemUsage: 1.46 GB (1570952864) - PrepareTime: 140.021ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 22s940ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53.380ms - TotalStorageWaitTime: 95.587ms CodeGen:(Total: 409.774ms, non-child: 409.774ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 266.473ms - PrepareTime: 138.496ms DataStreamSender (dst_id=11):(Total: 3s698ms, non-child: 3s698ms, % non-child: 100.00%) - BytesSent: 250.34 MB (262495736) - NetworkThroughput(*): 38.19 MB/sec - OverallThroughput: 67.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s094ms - ThriftTransmitTime(*): 6s554ms - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=2):(Total: 370.966ms, non-child: 370.966ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 481.555ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 36.28 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1579) - ScannerThreadsTotalWallClockTime: 18s835ms - MaterializeTupleTime(*): 18s211ms - ScannerThreadsSysTime: 98.983ms - ScannerThreadsUserTime: 3s557ms - ScannerThreadsVoluntaryContextSwitches: 13.11K (13113) - TotalRawHdfsReadTime(*): 138.246ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf5 (host=vb0232.halxg.cloudera.com:22000):(Total: 3s919ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(500.000ms): 0, 46.48 MB, 178.19 MB, 178.44 MB, 162.37 MB, 124.66 MB, 111.38 MB, 79.39 MB, 71.47 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 5 - AverageThreadTokens: 5.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.72 MB (187400968) - PerHostPeakMemUsage: 1.43 GB (1539633728) - PrepareTime: 143.493ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 22s656ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 51.287ms - TotalStorageWaitTime: 284.136ms CodeGen:(Total: 451.982ms, non-child: 451.982ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 300.737ms - PrepareTime: 141.110ms DataStreamSender (dst_id=11):(Total: 3s657ms, non-child: 3s657ms, % non-child: 100.00%) - BytesSent: 244.96 MB (256864252) - NetworkThroughput(*): 37.39 MB/sec - OverallThroughput: 66.97 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s070ms - ThriftTransmitTime(*): 6s551ms - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=2):(Total: 381.467ms, non-child: 381.467ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:12.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 28.17 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 5.12 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 490.427ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.26 MB (186917640) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 34.50 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.47K (1474) - ScannerThreadsTotalWallClockTime: 18s729ms - MaterializeTupleTime(*): 17s765ms - ScannerThreadsSysTime: 87.984ms - ScannerThreadsUserTime: 3s625ms - ScannerThreadsVoluntaryContextSwitches: 12.67K (12673) - TotalRawHdfsReadTime(*): 111.635ms - TotalReadThroughput: 38.19 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf3 (host=vb0218.halxg.cloudera.com:22000):(Total: 3s911ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.75 MB, 176.66 MB, 168.68 MB, 137.13 MB, 137.04 MB, 97.03 MB, 96.82 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646368) - PerHostPeakMemUsage: 1.44 GB (1541931096) - PrepareTime: 141.156ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 22s447ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 55.121ms - TotalStorageWaitTime: 180.264ms CodeGen:(Total: 401.534ms, non-child: 401.534ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.710ms - PrepareTime: 139.496ms DataStreamSender (dst_id=11):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 248.67 MB (260748663) - NetworkThroughput(*): 40.08 MB/sec - OverallThroughput: 68.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s023ms - ThriftTransmitTime(*): 6s204ms - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=2):(Total: 391.443ms, non-child: 391.443ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 576.404ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 34.38 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1717) - ScannerThreadsTotalWallClockTime: 18s468ms - MaterializeTupleTime(*): 17s592ms - ScannerThreadsSysTime: 156.973ms - ScannerThreadsUserTime: 4s216ms - ScannerThreadsVoluntaryContextSwitches: 12.97K (12969) - TotalRawHdfsReadTime(*): 146.906ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bfc (host=vb0234.halxg.cloudera.com:22000):(Total: 3s856ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(500.000ms): 0, 176.29 MB, 176.66 MB, 176.83 MB, 137.24 MB, 137.12 MB, 121.20 MB, 97.06 MB, 18.57 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 2 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646368) - PerHostPeakMemUsage: 1.42 GB (1520437896) - PrepareTime: 146.720ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 21s811ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 49.868ms - TotalStorageWaitTime: 223.195ms CodeGen:(Total: 424.987ms, non-child: 424.987ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 273.914ms - PrepareTime: 137.647ms DataStreamSender (dst_id=11):(Total: 3s536ms, non-child: 3s536ms, % non-child: 100.00%) - BytesSent: 248.91 MB (261003601) - NetworkThroughput(*): 40.94 MB/sec - OverallThroughput: 70.38 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s994ms - ThriftTransmitTime(*): 6s079ms - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=2):(Total: 426.134ms, non-child: 426.134ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 634.348ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 31.60 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1754) - ScannerThreadsTotalWallClockTime: 17s904ms - MaterializeTupleTime(*): 16s897ms - ScannerThreadsSysTime: 135.976ms - ScannerThreadsUserTime: 4s555ms - ScannerThreadsVoluntaryContextSwitches: 12.93K (12933) - TotalRawHdfsReadTime(*): 107.013ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf6 (host=vb0216.halxg.cloudera.com:22000):(Total: 3s692ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(500.000ms): 0, 122.35 MB, 160.15 MB, 160.21 MB, 128.50 MB, 111.41 MB, 103.42 MB, 79.40 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.58 MB (168377632) - PerHostPeakMemUsage: 1.34 GB (1444120264) - PrepareTime: 145.747ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 19s733ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 52.580ms - TotalStorageWaitTime: 265.829ms CodeGen:(Total: 396.545ms, non-child: 396.545ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 246.919ms - PrepareTime: 140.084ms DataStreamSender (dst_id=11):(Total: 3s423ms, non-child: 3s423ms, % non-child: 100.00%) - BytesSent: 220.94 MB (231675854) - NetworkThroughput(*): 36.44 MB/sec - OverallThroughput: 64.54 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s873ms - ThriftTransmitTime(*): 6s063ms - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=2):(Total: 390.417ms, non-child: 390.417ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 102.68 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 586.091ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.12 MB (167894304) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 30.67 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1524) - ScannerThreadsTotalWallClockTime: 16s076ms - MaterializeTupleTime(*): 15s088ms - ScannerThreadsSysTime: 135.977ms - ScannerThreadsUserTime: 4s378ms - ScannerThreadsVoluntaryContextSwitches: 11.53K (11532) - TotalRawHdfsReadTime(*): 107.086ms - TotalReadThroughput: 39.70 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf1 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s615ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.65 MB, 176.71 MB, 145.08 MB, 137.05 MB, 128.99 MB, 97.17 MB, 48.02 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 176.99 MB (185589112) - PerHostPeakMemUsage: 1.38 GB (1478333184) - PrepareTime: 144.170ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 20s535ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 52.930ms - TotalStorageWaitTime: 341.318ms CodeGen:(Total: 418.704ms, non-child: 418.704ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 267.229ms - PrepareTime: 139.334ms DataStreamSender (dst_id=11):(Total: 3s351ms, non-child: 3s351ms, % non-child: 100.00%) - BytesSent: 248.65 MB (260724958) - NetworkThroughput(*): 37.00 MB/sec - OverallThroughput: 74.20 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s936ms - ThriftTransmitTime(*): 6s720ms - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=2):(Total: 389.982ms, non-child: 389.982ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 471.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130360) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 34.51 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1238) - ScannerThreadsTotalWallClockTime: 17s010ms - MaterializeTupleTime(*): 15s976ms - ScannerThreadsSysTime: 84.983ms - ScannerThreadsUserTime: 3s344ms - ScannerThreadsVoluntaryContextSwitches: 12.87K (12870) - TotalRawHdfsReadTime(*): 114.336ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf8 (host=vb0228.halxg.cloudera.com:22000):(Total: 3s586ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(500.000ms): 68.00 KB, 176.80 MB, 176.80 MB, 136.92 MB, 136.91 MB, 137.07 MB, 97.19 MB, 31.10 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.09 MB (185695520) - PerHostPeakMemUsage: 1.37 GB (1471768392) - PrepareTime: 129.619ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 20s789ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 67.527ms - TotalStorageWaitTime: 90.160ms CodeGen:(Total: 351.330ms, non-child: 351.330ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 218.703ms - PrepareTime: 128.176ms DataStreamSender (dst_id=11):(Total: 3s365ms, non-child: 3s365ms, % non-child: 100.00%) - BytesSent: 248.36 MB (260425301) - NetworkThroughput(*): 36.24 MB/sec - OverallThroughput: 73.79 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s927ms - ThriftTransmitTime(*): 6s853ms - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=2):(Total: 332.003ms, non-child: 332.003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 458.514ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 40.54 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1211) - ScannerThreadsTotalWallClockTime: 17s111ms - MaterializeTupleTime(*): 16s520ms - ScannerThreadsSysTime: 71.986ms - ScannerThreadsUserTime: 3s370ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13053) - TotalRawHdfsReadTime(*): 91.779ms - TotalReadThroughput: 39.00 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bf0 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s540ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(500.000ms): 17.07 MB, 168.28 MB, 168.15 MB, 128.56 MB, 128.34 MB, 111.31 MB, 79.42 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.51 MB (176692552) - PerHostPeakMemUsage: 1.35 GB (1448454512) - PrepareTime: 130.472ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 19s271ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 61.865ms - TotalStorageWaitTime: 236.577ms CodeGen:(Total: 366.196ms, non-child: 366.196ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.095ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 231.997ms - PrepareTime: 129.113ms DataStreamSender (dst_id=11):(Total: 3s299ms, non-child: 3s299ms, % non-child: 100.00%) - BytesSent: 227.28 MB (238315379) - NetworkThroughput(*): 36.06 MB/sec - OverallThroughput: 68.89 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s848ms - ThriftTransmitTime(*): 6s303ms - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=2):(Total: 353.132ms, non-child: 353.132ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 8.39 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.71 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 433.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217416) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 34.86 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1200) - ScannerThreadsTotalWallClockTime: 15s764ms - MaterializeTupleTime(*): 14s985ms - ScannerThreadsSysTime: 67.988ms - ScannerThreadsUserTime: 3s180ms - ScannerThreadsVoluntaryContextSwitches: 11.88K (11877) - TotalRawHdfsReadTime(*): 129.152ms - TotalReadThroughput: 40.77 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bfa (host=vb0222.halxg.cloudera.com:22000):(Total: 3s424ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 164.12 MB, 164.25 MB, 124.54 MB, 111.48 MB, 95.33 MB, 79.28 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 4.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.53 MB (172522824) - PerHostPeakMemUsage: 1.34 GB (1440487072) - PrepareTime: 146.628ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 18s410ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.733ms - TotalStorageWaitTime: 109.215ms CodeGen:(Total: 398.252ms, non-child: 398.252ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.632ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 248.439ms - PrepareTime: 139.095ms DataStreamSender (dst_id=11):(Total: 3s169ms, non-child: 3s169ms, % non-child: 100.00%) - BytesSent: 222.75 MB (233572686) - NetworkThroughput(*): 35.92 MB/sec - OverallThroughput: 70.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s788ms - ThriftTransmitTime(*): 6s200ms - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=2):(Total: 382.132ms, non-child: 382.132ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 430.487ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.05 MB (172023112) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 31.62 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.23K (1225) - ScannerThreadsTotalWallClockTime: 14s868ms - MaterializeTupleTime(*): 14s283ms - ScannerThreadsSysTime: 82.985ms - ScannerThreadsUserTime: 3s139ms - ScannerThreadsVoluntaryContextSwitches: 11.78K (11775) - TotalRawHdfsReadTime(*): 112.097ms - TotalReadThroughput: 40.03 MB/sec Fragment F00: Instance 2b455e6e74ea02a1:93296120d7b96c0b (host=vb0224.halxg.cloudera.com:22000):(Total: 32s975ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 130.48 MB, 261.72 MB, 261.72 MB, 261.72 MB, 261.72 MB, 261.72 MB, 261.72 MB, 262.22 MB, 262.86 MB, 262.97 MB, 263.03 MB, 262.95 MB, 262.98 MB, 262.95 MB, 262.97 MB, 263.05 MB, 263.07 MB, 262.82 MB, 263.21 MB, 251.13 MB, 124.24 MB, 88.88 MB, 88.94 MB, 150.22 MB, 170.56 MB, 170.61 MB, 170.62 MB, 170.52 MB, 170.57 MB, 170.62 MB, 170.62 MB, 166.64 MB, 87.30 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 2.59 GB (2783880352) - PrepareTime: 144.823ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 5m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s497ms - TotalStorageWaitTime: 966.179ms CodeGen:(Total: 411.802ms, non-child: 411.802ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.735ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 262.683ms - PrepareTime: 138.214ms DataStreamSender (dst_id=10):(Total: 32s310ms, non-child: 32s310ms, % non-child: 100.00%) - BytesSent: 897.25 MB (940838053) - NetworkThroughput(*): 8.77 MB/sec - OverallThroughput: 27.77 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s636ms - ThriftTransmitTime(*): 1m42s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=1):(Total: 678.567ms, non-child: 678.567ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 246.40 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.80 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 2s044ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 78.95 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.20K (12200) - ScannerThreadsTotalWallClockTime: 5m22s - MaterializeTupleTime(*): 5m19s - ScannerThreadsSysTime: 804.872ms - ScannerThreadsUserTime: 21s542ms - ScannerThreadsVoluntaryContextSwitches: 52.31K (52312) - TotalRawHdfsReadTime(*): 342.737ms - TotalReadThroughput: 11.20 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c00 (host=vb0204.halxg.cloudera.com:22000):(Total: 32s628ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(1s000ms): 118.87 MB, 239.37 MB, 239.37 MB, 239.37 MB, 239.37 MB, 239.37 MB, 239.37 MB, 239.72 MB, 239.95 MB, 239.88 MB, 239.90 MB, 239.76 MB, 239.88 MB, 239.83 MB, 239.89 MB, 239.84 MB, 239.87 MB, 239.94 MB, 188.06 MB, 81.65 MB, 81.62 MB, 126.13 MB, 193.77 MB, 193.63 MB, 193.76 MB, 193.63 MB, 193.70 MB, 193.68 MB, 193.68 MB, 193.64 MB, 177.63 MB, 82.85 MB, 67.11 MB ThreadUsage(1s000ms): 6, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.33 MB (252000992) - PerHostPeakMemUsage: 2.46 GB (2644740640) - PrepareTime: 141.336ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 5m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s174ms - TotalStorageWaitTime: 327.546ms CodeGen:(Total: 381.438ms, non-child: 381.438ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.531ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 237.129ms - PrepareTime: 139.576ms DataStreamSender (dst_id=10):(Total: 31s975ms, non-child: 31s975ms, % non-child: 100.00%) - BytesSent: 897.54 MB (941142082) - NetworkThroughput(*): 8.28 MB/sec - OverallThroughput: 28.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s484ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=1):(Total: 711.651ms, non-child: 711.651ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 349.06 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.32 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 2s103ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.83 MB (251476696) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 75.31 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 14.16K (14164) - ScannerThreadsTotalWallClockTime: 5m3s - MaterializeTupleTime(*): 5m - ScannerThreadsSysTime: 879.863ms - ScannerThreadsUserTime: 21s767ms - ScannerThreadsVoluntaryContextSwitches: 52.60K (52598) - TotalRawHdfsReadTime(*): 264.853ms - TotalReadThroughput: 11.37 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c01 (host=vb0208.halxg.cloudera.com:22000):(Total: 32s457ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(1s000ms): 128.16 MB, 256.25 MB, 256.25 MB, 256.25 MB, 256.25 MB, 256.25 MB, 256.25 MB, 256.73 MB, 256.88 MB, 257.02 MB, 256.93 MB, 256.96 MB, 257.01 MB, 257.04 MB, 257.00 MB, 256.92 MB, 256.72 MB, 257.00 MB, 257.05 MB, 223.09 MB, 120.42 MB, 104.78 MB, 104.71 MB, 166.32 MB, 170.44 MB, 170.51 MB, 170.62 MB, 170.56 MB, 166.51 MB, 154.76 MB, 143.14 MB, 60.44 MB, 35.30 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 7, 7, 4 - AverageThreadTokens: 10.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 264.29 MB (277124456) - PerHostPeakMemUsage: 2.48 GB (2657904352) - PrepareTime: 192.973ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 5m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s037ms - TotalStorageWaitTime: 467.487ms CodeGen:(Total: 418.895ms, non-child: 418.895ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 223.262ms - PrepareTime: 190.155ms DataStreamSender (dst_id=10):(Total: 31s753ms, non-child: 31s753ms, % non-child: 100.00%) - BytesSent: 886.31 MB (929365647) - NetworkThroughput(*): 7.37 MB/sec - OverallThroughput: 27.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s446ms - ThriftTransmitTime(*): 2m - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=1):(Total: 807.244ms, non-child: 807.244ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 110.67 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 241.87 MB, 241.87 MB, 241.87 MB, 241.87 MB, 344.53 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.68 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 2s127ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.91 MB (276731240) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 65.53 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 13.83K (13827) - ScannerThreadsTotalWallClockTime: 5m17s - MaterializeTupleTime(*): 5m14s - ScannerThreadsSysTime: 826.868ms - ScannerThreadsUserTime: 22s325ms - ScannerThreadsVoluntaryContextSwitches: 51.73K (51730) - TotalRawHdfsReadTime(*): 311.427ms - TotalReadThroughput: 11.06 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c09 (host=vb0206.halxg.cloudera.com:22000):(Total: 32s414ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(1s000ms): 131.04 MB, 262.01 MB, 262.01 MB, 262.01 MB, 262.01 MB, 262.01 MB, 262.01 MB, 262.43 MB, 263.04 MB, 262.98 MB, 263.04 MB, 262.89 MB, 263.04 MB, 262.93 MB, 263.17 MB, 262.97 MB, 262.98 MB, 262.94 MB, 262.93 MB, 179.12 MB, 88.93 MB, 88.89 MB, 133.01 MB, 170.43 MB, 170.62 MB, 170.56 MB, 170.64 MB, 170.44 MB, 170.66 MB, 170.75 MB, 154.63 MB, 59.88 MB, 49.55 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 10.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250728) - PerHostPeakMemUsage: 2.48 GB (2662721424) - PrepareTime: 135.340ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 5m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s322ms - TotalStorageWaitTime: 397.259ms CodeGen:(Total: 365.482ms, non-child: 365.482ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 226.757ms - PrepareTime: 133.957ms DataStreamSender (dst_id=10):(Total: 31s817ms, non-child: 31s817ms, % non-child: 100.00%) - BytesSent: 897.97 MB (941593758) - NetworkThroughput(*): 6.38 MB/sec - OverallThroughput: 28.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s502ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=1):(Total: 654.021ms, non-child: 654.021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.93 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 297.71 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.68 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 1s960ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 81.98 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.33K (12333) - ScannerThreadsTotalWallClockTime: 5m15s - MaterializeTupleTime(*): 5m13s - ScannerThreadsSysTime: 713.885ms - ScannerThreadsUserTime: 22s889ms - ScannerThreadsVoluntaryContextSwitches: 52.48K (52478) - TotalRawHdfsReadTime(*): 301.694ms - TotalReadThroughput: 11.20 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c05 (host=vb0226.halxg.cloudera.com:22000):(Total: 32s411ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(1s000ms): 150.39 MB, 258.91 MB, 258.91 MB, 258.91 MB, 258.91 MB, 258.91 MB, 258.91 MB, 259.37 MB, 260.02 MB, 259.99 MB, 259.92 MB, 259.98 MB, 259.98 MB, 260.01 MB, 259.98 MB, 259.91 MB, 259.98 MB, 259.94 MB, 255.92 MB, 164.42 MB, 99.20 MB, 104.83 MB, 152.82 MB, 170.98 MB, 170.62 MB, 170.54 MB, 170.53 MB, 170.62 MB, 170.53 MB, 166.56 MB, 134.78 MB, 75.57 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 260.41 MB (273064032) - PerHostPeakMemUsage: 2.48 GB (2668033824) - PrepareTime: 140.635ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 5m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s955ms - TotalStorageWaitTime: 399.021ms CodeGen:(Total: 386.738ms, non-child: 386.738ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 242.854ms - PrepareTime: 135.019ms DataStreamSender (dst_id=10):(Total: 31s772ms, non-child: 31s772ms, % non-child: 100.00%) - BytesSent: 892.41 MB (935762119) - NetworkThroughput(*): 8.79 MB/sec - OverallThroughput: 28.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s486ms - ThriftTransmitTime(*): 1m41s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=1):(Total: 703.427ms, non-child: 703.427ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.46% 1:1.538% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.21 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 233.91 MB, 244.17 MB, 305.82 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.82 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 2s152ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 259.97 MB (272597136) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 75.71 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.76K (15763) - ScannerThreadsTotalWallClockTime: 5m16s - MaterializeTupleTime(*): 5m13s - ScannerThreadsSysTime: 854.865ms - ScannerThreadsUserTime: 25s430ms - ScannerThreadsVoluntaryContextSwitches: 52.21K (52209) - TotalRawHdfsReadTime(*): 315.330ms - TotalReadThroughput: 11.30 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c0c (host=vb0222.halxg.cloudera.com:22000):(Total: 32s392ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(1s000ms): 130.74 MB, 261.41 MB, 261.41 MB, 261.41 MB, 261.41 MB, 261.41 MB, 261.41 MB, 262.20 MB, 262.91 MB, 262.99 MB, 263.02 MB, 263.11 MB, 263.06 MB, 263.01 MB, 263.08 MB, 263.00 MB, 263.14 MB, 263.05 MB, 262.95 MB, 207.16 MB, 104.65 MB, 88.91 MB, 101.74 MB, 179.31 MB, 165.08 MB, 165.01 MB, 165.09 MB, 165.09 MB, 165.15 MB, 165.03 MB, 161.06 MB, 80.47 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.68 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 2.48 GB (2659118896) - PrepareTime: 146.304ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 5m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s131ms - TotalStorageWaitTime: 466.392ms CodeGen:(Total: 399.642ms, non-child: 399.642ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 249.447ms - PrepareTime: 137.820ms DataStreamSender (dst_id=10):(Total: 31s758ms, non-child: 31s758ms, % non-child: 100.00%) - BytesSent: 887.42 MB (930531102) - NetworkThroughput(*): 6.97 MB/sec - OverallThroughput: 27.94 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s533ms - ThriftTransmitTime(*): 2m7s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=1):(Total: 694.554ms, non-child: 694.554ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.93 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 244.24 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.83 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 2s027ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 76.26 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.30K (13299) - ScannerThreadsTotalWallClockTime: 5m17s - MaterializeTupleTime(*): 5m15s - ScannerThreadsSysTime: 815.871ms - ScannerThreadsUserTime: 21s345ms - ScannerThreadsVoluntaryContextSwitches: 51.91K (51906) - TotalRawHdfsReadTime(*): 350.974ms - TotalReadThroughput: 11.24 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c03 (host=vb0234.halxg.cloudera.com:22000):(Total: 32s383ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(1s000ms): 130.52 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 262.20 MB, 262.90 MB, 262.90 MB, 263.02 MB, 263.02 MB, 262.87 MB, 262.96 MB, 262.90 MB, 263.05 MB, 263.06 MB, 263.02 MB, 262.86 MB, 214.96 MB, 100.64 MB, 89.02 MB, 97.26 MB, 169.86 MB, 170.60 MB, 170.57 MB, 170.67 MB, 170.52 MB, 170.74 MB, 170.44 MB, 170.76 MB, 67.69 MB, 59.90 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.40 MB (276193376) - PerHostPeakMemUsage: 2.48 GB (2658292584) - PrepareTime: 143.977ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 5m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s194ms - TotalStorageWaitTime: 491.854ms CodeGen:(Total: 420.733ms, non-child: 420.733ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.556ms - PrepareTime: 135.868ms DataStreamSender (dst_id=10):(Total: 31s791ms, non-child: 31s791ms, % non-child: 100.00%) - BytesSent: 898.64 MB (942288681) - NetworkThroughput(*): 7.41 MB/sec - OverallThroughput: 28.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s460ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=1):(Total: 649.419ms, non-child: 649.419ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 307.99 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.77 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 1s866ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 82.51 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.23K (10231) - ScannerThreadsTotalWallClockTime: 5m16s - MaterializeTupleTime(*): 5m13s - ScannerThreadsSysTime: 689.888ms - ScannerThreadsUserTime: 19s216ms - ScannerThreadsVoluntaryContextSwitches: 52.41K (52414) - TotalRawHdfsReadTime(*): 283.530ms - TotalReadThroughput: 11.37 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c06 (host=vb0232.halxg.cloudera.com:22000):(Total: 31s993ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(1s000ms): 112.87 MB, 239.84 MB, 239.84 MB, 239.84 MB, 239.84 MB, 239.84 MB, 239.84 MB, 240.39 MB, 262.80 MB, 262.98 MB, 262.83 MB, 262.87 MB, 262.93 MB, 262.99 MB, 262.85 MB, 262.87 MB, 262.93 MB, 263.05 MB, 263.00 MB, 243.15 MB, 151.90 MB, 88.96 MB, 88.89 MB, 160.80 MB, 151.53 MB, 147.43 MB, 147.41 MB, 147.54 MB, 147.47 MB, 147.54 MB, 115.63 MB, 52.56 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 264.10 MB (276932856) - PerHostPeakMemUsage: 2.47 GB (2656461776) - PrepareTime: 145.088ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 5m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s259ms - TotalStorageWaitTime: 393.795ms CodeGen:(Total: 436.747ms, non-child: 436.747ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 288.237ms - PrepareTime: 143.643ms DataStreamSender (dst_id=10):(Total: 31s377ms, non-child: 31s377ms, % non-child: 100.00%) - BytesSent: 849.37 MB (890633245) - NetworkThroughput(*): 6.42 MB/sec - OverallThroughput: 27.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s064ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=1):(Total: 681.775ms, non-child: 681.775ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:1.562% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 196.74 MB, 206.14 MB, 206.14 MB, 206.14 MB, 206.14 MB, 206.14 MB, 206.14 MB, 216.40 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 257.47 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.69 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 2s057ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.69 MB (276498680) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 74.34 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.13K (15126) - ScannerThreadsTotalWallClockTime: 5m8s - MaterializeTupleTime(*): 5m5s - ScannerThreadsSysTime: 848.867ms - ScannerThreadsUserTime: 24s757ms - ScannerThreadsVoluntaryContextSwitches: 49.70K (49700) - TotalRawHdfsReadTime(*): 295.190ms - TotalReadThroughput: 10.93 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96bff (host=vb0214.halxg.cloudera.com:22000):(Total: 31s776ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(1s000ms): 128.35 MB, 256.75 MB, 256.75 MB, 256.75 MB, 256.75 MB, 256.75 MB, 256.75 MB, 257.39 MB, 257.99 MB, 258.10 MB, 258.19 MB, 258.05 MB, 258.05 MB, 258.06 MB, 258.00 MB, 257.85 MB, 258.00 MB, 257.96 MB, 258.01 MB, 214.25 MB, 111.40 MB, 93.27 MB, 120.43 MB, 157.52 MB, 147.51 MB, 147.55 MB, 147.69 MB, 147.45 MB, 147.55 MB, 135.62 MB, 72.19 MB, 45.34 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 258.45 MB (270999656) - PerHostPeakMemUsage: 2.49 GB (2675626072) - PrepareTime: 139.945ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 5m22s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s183ms - TotalStorageWaitTime: 411.156ms CodeGen:(Total: 374.433ms, non-child: 374.433ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 229.914ms - PrepareTime: 138.012ms DataStreamSender (dst_id=10):(Total: 31s170ms, non-child: 31s170ms, % non-child: 100.00%) - BytesSent: 838.94 MB (879689091) - NetworkThroughput(*): 6.04 MB/sec - OverallThroughput: 26.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s079ms - ThriftTransmitTime(*): 2m19s - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=1):(Total: 665.356ms, non-child: 665.356ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 111.13 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 222.26 MB, 232.53 MB, 263.32 MB, 335.19 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s959ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.03 MB (270565480) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 75.27 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.61K (12614) - ScannerThreadsTotalWallClockTime: 5m3s - MaterializeTupleTime(*): 5m1s - ScannerThreadsSysTime: 776.877ms - ScannerThreadsUserTime: 20s597ms - ScannerThreadsVoluntaryContextSwitches: 49.03K (49030) - TotalRawHdfsReadTime(*): 271.562ms - TotalReadThroughput: 10.63 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c02 (host=vb0230.halxg.cloudera.com:22000):(Total: 31s770ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(1s000ms): 130.62 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 262.09 MB, 263.00 MB, 263.01 MB, 262.88 MB, 262.98 MB, 263.04 MB, 263.10 MB, 262.95 MB, 263.00 MB, 262.81 MB, 262.90 MB, 263.00 MB, 218.95 MB, 104.56 MB, 88.99 MB, 112.35 MB, 162.66 MB, 147.45 MB, 147.48 MB, 147.49 MB, 147.56 MB, 147.52 MB, 143.52 MB, 64.18 MB, 52.54 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275352) - PerHostPeakMemUsage: 2.47 GB (2652646808) - PrepareTime: 144.025ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 5m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s186ms - TotalStorageWaitTime: 583.801ms CodeGen:(Total: 431.132ms, non-child: 431.132ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 282.113ms - PrepareTime: 140.975ms DataStreamSender (dst_id=10):(Total: 31s155ms, non-child: 31s155ms, % non-child: 100.00%) - BytesSent: 848.21 MB (889415605) - NetworkThroughput(*): 7.09 MB/sec - OverallThroughput: 27.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s192ms - ThriftTransmitTime(*): 1m59s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=1):(Total: 677.511ms, non-child: 677.511ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.92 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 256.65 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.63 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 1s928ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 74.72 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.92K (12922) - ScannerThreadsTotalWallClockTime: 5m5s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 805.874ms - ScannerThreadsUserTime: 22s235ms - ScannerThreadsVoluntaryContextSwitches: 49.51K (49512) - TotalRawHdfsReadTime(*): 313.425ms - TotalReadThroughput: 10.91 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c04 (host=vb0212.halxg.cloudera.com:22000):(Total: 31s689ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(1s000ms): 130.80 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 262.32 MB, 262.91 MB, 262.95 MB, 262.83 MB, 262.89 MB, 262.96 MB, 262.95 MB, 263.04 MB, 262.93 MB, 262.96 MB, 263.12 MB, 263.11 MB, 183.36 MB, 92.97 MB, 88.90 MB, 126.43 MB, 147.48 MB, 147.53 MB, 147.51 MB, 147.41 MB, 147.49 MB, 147.46 MB, 123.40 MB, 52.60 MB, 52.56 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.43 MB (276226144) - PerHostPeakMemUsage: 2.47 GB (2652569656) - PrepareTime: 142.269ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 5m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s035ms - TotalStorageWaitTime: 604.047ms CodeGen:(Total: 407.174ms, non-child: 407.174ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.279ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 260.217ms - PrepareTime: 136.731ms DataStreamSender (dst_id=10):(Total: 31s165ms, non-child: 31s165ms, % non-child: 100.00%) - BytesSent: 847.53 MB (888696929) - NetworkThroughput(*): 7.46 MB/sec - OverallThroughput: 27.19 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s120ms - ThriftTransmitTime(*): 1m53s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=1):(Total: 603.944ms, non-child: 603.944ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.41% 1:1.587% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.93 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 277.25 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.57 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s762ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 83.77 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.59K (10592) - ScannerThreadsTotalWallClockTime: 5m2s - MaterializeTupleTime(*): 4m59s - ScannerThreadsSysTime: 605.903ms - ScannerThreadsUserTime: 18s680ms - ScannerThreadsVoluntaryContextSwitches: 49.46K (49456) - TotalRawHdfsReadTime(*): 332.833ms - TotalReadThroughput: 10.91 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c0a (host=vb0220.halxg.cloudera.com:22000):(Total: 31s580ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(1s000ms): 130.39 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 262.51 MB, 263.06 MB, 262.97 MB, 262.94 MB, 263.07 MB, 262.96 MB, 262.98 MB, 263.05 MB, 262.89 MB, 262.88 MB, 263.02 MB, 262.98 MB, 199.05 MB, 89.05 MB, 88.93 MB, 123.10 MB, 147.60 MB, 147.41 MB, 147.40 MB, 147.37 MB, 147.46 MB, 147.54 MB, 123.70 MB, 52.68 MB, 43.04 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 7, 5 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.44 MB (276234384) - PerHostPeakMemUsage: 2.48 GB (2657611576) - PrepareTime: 137.306ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s300ms - TotalStorageWaitTime: 473.271ms CodeGen:(Total: 382.055ms, non-child: 382.055ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.384ms - PrepareTime: 135.820ms DataStreamSender (dst_id=10):(Total: 31s042ms, non-child: 31s042ms, % non-child: 100.00%) - BytesSent: 847.11 MB (888255965) - NetworkThroughput(*): 7.87 MB/sec - OverallThroughput: 27.29 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s099ms - ThriftTransmitTime(*): 1m47s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=1):(Total: 600.017ms, non-child: 600.017ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.46 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 1s739ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742816) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 84.33 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.95K (9948) - ScannerThreadsTotalWallClockTime: 4m57s - MaterializeTupleTime(*): 4m55s - ScannerThreadsSysTime: 599.904ms - ScannerThreadsUserTime: 18s267ms - ScannerThreadsVoluntaryContextSwitches: 49.45K (49454) - TotalRawHdfsReadTime(*): 287.634ms - TotalReadThroughput: 11.08 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c08 (host=vb0228.halxg.cloudera.com:22000):(Total: 31s551ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(1s000ms): 127.55 MB, 255.04 MB, 255.04 MB, 255.04 MB, 255.04 MB, 255.04 MB, 255.04 MB, 256.02 MB, 256.98 MB, 256.79 MB, 256.97 MB, 257.04 MB, 256.98 MB, 257.00 MB, 257.02 MB, 256.85 MB, 256.91 MB, 256.98 MB, 256.74 MB, 208.00 MB, 108.81 MB, 104.82 MB, 104.75 MB, 147.08 MB, 147.40 MB, 147.42 MB, 147.49 MB, 147.58 MB, 131.71 MB, 123.66 MB, 45.20 MB, 25.04 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 6, 3 - AverageThreadTokens: 10.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.45 MB (269951176) - PerHostPeakMemUsage: 2.44 GB (2624567248) - PrepareTime: 139.721ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s275ms - TotalStorageWaitTime: 408.009ms CodeGen:(Total: 401.587ms, non-child: 401.587ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.161ms - PrepareTime: 136.889ms DataStreamSender (dst_id=10):(Total: 30s973ms, non-child: 30s973ms, % non-child: 100.00%) - BytesSent: 836.91 MB (877567750) - NetworkThroughput(*): 6.30 MB/sec - OverallThroughput: 27.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s962ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=1):(Total: 643.436ms, non-child: 643.436ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 110.78 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 231.82 MB, 242.09 MB, 242.09 MB, 242.09 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.41 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 1s817ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.03 MB (269516904) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 77.63 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.80K (11801) - ScannerThreadsTotalWallClockTime: 4m58s - MaterializeTupleTime(*): 4m55s - ScannerThreadsSysTime: 668.894ms - ScannerThreadsUserTime: 21s434ms - ScannerThreadsVoluntaryContextSwitches: 48.90K (48896) - TotalRawHdfsReadTime(*): 287.097ms - TotalReadThroughput: 10.77 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c0d (host=vb0218.halxg.cloudera.com:22000):(Total: 31s064ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(500.000ms): 68.00 KB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 261.99 MB, 262.03 MB, 262.95 MB, 262.92 MB, 262.96 MB, 262.88 MB, 262.89 MB, 262.97 MB, 262.83 MB, 262.85 MB, 263.13 MB, 262.81 MB, 262.91 MB, 262.80 MB, 262.95 MB, 263.10 MB, 262.87 MB, 263.03 MB, 262.98 MB, 262.82 MB, 262.97 MB, 263.11 MB, 262.77 MB, 262.95 MB, 263.19 MB, 207.24 MB, 199.09 MB, 112.40 MB, 88.87 MB, 88.93 MB, 89.08 MB, 89.04 MB, 153.87 MB, 168.79 MB, 147.41 MB, 147.32 MB, 147.60 MB, 147.53 MB, 147.50 MB, 147.59 MB, 147.38 MB, 147.41 MB, 147.52 MB, 147.52 MB, 147.38 MB, 147.45 MB, 99.45 MB, 52.72 MB, 52.50 MB, 10.35 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 1 - AverageThreadTokens: 10.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250728) - PerHostPeakMemUsage: 2.36 GB (2532765232) - PrepareTime: 128.897ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s115ms - TotalStorageWaitTime: 565.390ms CodeGen:(Total: 354.142ms, non-child: 354.142ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 222.919ms - PrepareTime: 127.254ms DataStreamSender (dst_id=10):(Total: 30s497ms, non-child: 30s497ms, % non-child: 100.00%) - BytesSent: 848.18 MB (889385936) - NetworkThroughput(*): 6.42 MB/sec - OverallThroughput: 27.81 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s169ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=1):(Total: 623.485ms, non-child: 623.485ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 0, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 308.01 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.58 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 1s609ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 81.20 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.72K (10722) - ScannerThreadsTotalWallClockTime: 5m - MaterializeTupleTime(*): 4m57s - ScannerThreadsSysTime: 648.894ms - ScannerThreadsUserTime: 17s120ms - ScannerThreadsVoluntaryContextSwitches: 49.60K (49596) - TotalRawHdfsReadTime(*): 276.252ms - TotalReadThroughput: 11.08 MB/sec Instance 2b455e6e74ea02a1:93296120d7b96c07 (host=vb0216.halxg.cloudera.com:22000):(Total: 29s973ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 0, 261.09 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 262.79 MB, 262.95 MB, 262.99 MB, 263.06 MB, 262.76 MB, 262.98 MB, 262.96 MB, 262.83 MB, 263.19 MB, 263.16 MB, 263.03 MB, 262.92 MB, 262.99 MB, 262.96 MB, 262.89 MB, 262.79 MB, 262.98 MB, 262.88 MB, 263.09 MB, 262.87 MB, 262.88 MB, 263.06 MB, 263.08 MB, 262.98 MB, 223.17 MB, 167.40 MB, 89.01 MB, 89.01 MB, 88.98 MB, 89.06 MB, 88.98 MB, 137.63 MB, 124.35 MB, 124.43 MB, 124.31 MB, 124.35 MB, 124.34 MB, 124.37 MB, 124.41 MB, 124.35 MB, 124.36 MB, 124.44 MB, 124.48 MB, 60.96 MB, 45.17 MB, 45.27 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250728) - PerHostPeakMemUsage: 2.24 GB (2402512432) - PrepareTime: 138.567ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 5m2s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s557ms - TotalStorageWaitTime: 498.804ms CodeGen:(Total: 383.332ms, non-child: 383.332ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.813ms - PrepareTime: 136.780ms DataStreamSender (dst_id=10):(Total: 29s426ms, non-child: 29s426ms, % non-child: 100.00%) - BytesSent: 798.44 MB (837220701) - NetworkThroughput(*): 8.07 MB/sec - OverallThroughput: 27.13 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s470ms - ThriftTransmitTime(*): 1m38s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=1):(Total: 613.426ms, non-child: 613.426ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.53 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s724ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 77.68 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 9.43K (9433) - ScannerThreadsTotalWallClockTime: 4m44s - MaterializeTupleTime(*): 4m42s - ScannerThreadsSysTime: 615.900ms - ScannerThreadsUserTime: 18s109ms - ScannerThreadsVoluntaryContextSwitches: 46.55K (46546) - TotalRawHdfsReadTime(*): 285.878ms - TotalReadThroughput: 10.95 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 16:EXCHANGE | 1 | 9.21us | 0ns | 9.21us | 0 | 36.00M | | 15:AGGREGATE | 15 | 5.42s | 0ns | 5.89s | 0 | 36.00M | | 14:EXCHANGE | 15 | 926.77ms | 0ns | 1.04s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 4.04s | 0ns | 4.48s | 395.39M | 36.00M | | 00:UNION | 15 | 4.07s | 0ns | 4.60s | 398.68M | 36.00M | | |--08:AGGREGATE | 15 | 9.09s | 0ns | 9.84s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.47s | 0ns | 14.31s | 774.31M | 18.00M | | | |--13:EXCHANGE | 15 | 1.05s | 0ns | 1.32s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 390.66ms | 0ns | 449.80ms | 204.99M | 45.00M | | | 12:EXCHANGE | 15 | 3.08s | 0ns | 4.63s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 667.08ms | 0ns | 728.19ms | 774.31M | 180.00M | | 04:AGGREGATE | 15 | 9.58s | 0ns | 9.94s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.87s | 0ns | 15.45s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 1.05s | 0ns | 1.35s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 403.48ms | 0ns | 425.79ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 3.00s | 0ns | 4.68s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 678.89ms | 0ns | 754.17ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=2a427b598be90b44:8a531ae61488a9b7): Summary: Session ID: ef480f59c430ae08:6a343fac42345886 Session Type: BEESWAX Start Time: 2016-03-23 22:57:13.274808000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a57a5e1a62605356dd3271c1488741ea109c4b5a) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:60125 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=2 16:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 15:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 14:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--08:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--13:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 12:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 04:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 24.468ms - Analysis finished: 9.616ms (9.616ms) - Equivalence classes computed: 9.970ms (354.402us) - Single node plan created: 16.427ms (6.456ms) - Runtime filters computed: 16.665ms (238.063us) - Distributed plan created: 19.982ms (3.317ms) - Lineage info computed: 20.827ms (844.540us) - Planning finished: 24.468ms (3.640ms) Query Timeline: 1m22s - Start execution: 111.368us (111.368us) - Planning finished: 29.190ms (29.078ms) - Ready to start 90 remote fragments: 32.174ms (2.984ms) - All 90 remote fragments started: 45.669ms (13.494ms) - Rows available: 1m22s (1m22s) - First row fetched: 1m22s (26.734ms) ImpalaServer: - ClientFetchWaitTimer: 26.743ms - RowMaterializationTimer: 0.000ns Execution Profile 2a427b598be90b44:8a531ae61488a9b7:(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 4ms Per Node Peak Memory Usage: vb0214.halxg.cloudera.com:22000(3.00 GB) vb0208.halxg.cloudera.com:22000(3.06 GB) vb0230.halxg.cloudera.com:22000(2.97 GB) vb0234.halxg.cloudera.com:22000(3.06 GB) vb0212.halxg.cloudera.com:22000(2.98 GB) vb0226.halxg.cloudera.com:22000(3.03 GB) vb0232.halxg.cloudera.com:22000(3.03 GB) vb0216.halxg.cloudera.com:22000(2.97 GB) vb0228.halxg.cloudera.com:22000(3.02 GB) vb0206.halxg.cloudera.com:22000(3.05 GB) vb0220.halxg.cloudera.com:22000(3.02 GB) vb0224.halxg.cloudera.com:22000(3.07 GB) vb0222.halxg.cloudera.com:22000(3.02 GB) vb0218.halxg.cloudera.com:22000(3.02 GB) vb0204.halxg.cloudera.com:22000(3.07 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F08:(Total: 1m22s, non-child: 503.557us, % non-child: 0.00%) MemoryUsage(2s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 55.952us - RowsProduced: 0 (0) - TotalCpuTime: 43.390ms - TotalNetworkReceiveTime: 1m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=16):(Total: 1m22s, non-child: 9.214us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.095us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1m22s - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F07:(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m22s max:1m22s mean: 1m22s stddev:16.417ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.37 MB (971372310) - PerHostPeakMemUsage: 3.02 GB (3247909970) - PrepareTime: 149.776ms - RowsProduced: 0 (0) - TotalCpuTime: 6s533ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 264.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 464.027ms, non-child: 464.027ms, % non-child: 100.00%) - CodegenTime: 1.460ms - CompileTime: 35.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 280.697ms - PrepareTime: 145.113ms DataStreamSender (dst_id=16):(Total: 13.320us, non-child: 13.320us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s421ms, % non-child: 6.62%) - BuildTime: 4s492ms - GetNewBlockTime: 544.585us - GetResultsTime: 681.306ms - HTResizeTime: 1s413ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.415us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759156) - ConvertRowBatchTime: 732.398ms - DeserializeRowBatchTimer: 697.907ms - FirstBatchArrivalWaitTime: 33s429ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 344.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m18s max:1m21s mean: 1m20s stddev:693.232ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135419739) - PerHostPeakMemUsage: 3.02 GB (3247909970) - PrepareTime: 160.055ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 15s716ms - TotalNetworkSendTime: 1s194ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 664.204ms, non-child: 664.204ms, % non-child: 100.00%) - CodegenTime: 4.756ms - CompileTime: 124.372ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 393.376ms - PrepareTime: 143.908ms DataStreamSender (dst_id=14):(Total: 5s991ms, non-child: 5s991ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759156) - NetworkThroughput(*): 59.85 MB/sec - OverallThroughput: 47.76 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s207ms - ThriftTransmitTime(*): 4s809ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s038ms, % non-child: 5.46%) - GetNewBlockTime: 404.248us - GetResultsTime: 135.137ms - HTResizeTime: 146.016ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 356.41 K/sec - StreamingTime: 3s686ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s065ms, % non-child: 5.81%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 380.14 K/sec AGGREGATION_NODE (id=8):(Total: 32s073ms, non-child: 9s091ms, % non-child: 28.34%) - BuildTime: 8s343ms - GetNewBlockTime: 909.116us - GetResultsTime: 609.575ms - HTResizeTime: 1s206ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 414.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.456us HASH_JOIN_NODE (id=7):(Total: 22s982ms, non-child: 13s474ms, % non-child: 58.63%) - BuildPartitionTime: 1s721ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s659ms - GetNewBlockTime: 525.778us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s268ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.161us EXCHANGE_NODE (id=13):(Total: 2s907ms, non-child: 2s907ms, % non-child: 100.00%) - BytesReceived: 252.23 MB (264486500) - ConvertRowBatchTime: 386.504ms - DeserializeRowBatchTimer: 1s393ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 5.05 M/sec - SendersBlockedTimer: 40s475ms - SendersBlockedTotalTimer(*): 9m24s EXCHANGE_NODE (id=12):(Total: 6s599ms, non-child: 6s599ms, % non-child: 100.00%) - BytesReceived: 864.91 MB (906925594) - ConvertRowBatchTime: 1s475ms - DeserializeRowBatchTimer: 5s233ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 7.86 M/sec - SendersBlockedTimer: 48s852ms - SendersBlockedTotalTimer(*): 10m17s AGGREGATION_NODE (id=4):(Total: 33s782ms, non-child: 9s581ms, % non-child: 28.36%) - BuildTime: 8s844ms - GetNewBlockTime: 1.331ms - GetResultsTime: 582.632ms - HTResizeTime: 1s246ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 393.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.380us HASH_JOIN_NODE (id=3):(Total: 24s200ms, non-child: 13s870ms, % non-child: 57.32%) - BuildPartitionTime: 1s534ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s685ms - GetNewBlockTime: 868.750us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s811ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.611us EXCHANGE_NODE (id=11):(Total: 2s710ms, non-child: 2s710ms, % non-child: 100.00%) - BytesReceived: 252.65 MB (264927891) - ConvertRowBatchTime: 337.555ms - DeserializeRowBatchTimer: 1s480ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 70.814ms - SendersBlockedTotalTimer(*): 548.079ms EXCHANGE_NODE (id=10):(Total: 7s619ms, non-child: 7s619ms, % non-child: 100.00%) - BytesReceived: 865.13 MB (907155112) - ConvertRowBatchTime: 1s517ms - DeserializeRowBatchTimer: 5s312ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.84 M/sec - SendersBlockedTimer: 8s191ms - SendersBlockedTotalTimer(*): 1m33s Averaged Fragment F04:(Total: 45s018ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:44s797ms max:45s818ms mean: 45s330ms stddev:293.805ms execution rates: min:25.15 MB/sec max:33.14 MB/sec mean:28.33 MB/sec stddev:2.20 MB/sec num instances: 15 - AverageThreadTokens: 6.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.77 MB (190594939) - PerHostPeakMemUsage: 2.48 GB (2661525836) - PrepareTime: 146.280ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 4m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s244ms - TotalStorageWaitTime: 206.122ms CodeGen:(Total: 418.704ms, non-child: 418.704ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.269ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 267.654ms - PrepareTime: 142.245ms DataStreamSender (dst_id=13):(Total: 44s750ms, non-child: 44s750ms, % non-child: 100.00%) - BytesSent: 252.23 MB (264486500) - NetworkThroughput(*): 454.11 KB/sec - OverallThroughput: 5.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s020ms - ThriftTransmitTime(*): 9m31s - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=6):(Total: 390.664ms, non-child: 390.664ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.37 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 589.273ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.32 MB (190125278) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 35.11 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1591) - ScannerThreadsTotalWallClockTime: 4m1s - MaterializeTupleTime(*): 4m - ScannerThreadsSysTime: 116.312ms - ScannerThreadsUserTime: 4s371ms - ScannerThreadsVoluntaryContextSwitches: 13.22K (13218) - TotalRawHdfsReadTime(*): 131.453ms - TotalReadThroughput: 3.51 MB/sec Averaged Fragment F03:(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:1m10s max:1m12s mean: 1m11s stddev:691.198ms execution rates: min:57.92 MB/sec max:63.06 MB/sec mean:61.22 MB/sec stddev:1.59 MB/sec num instances: 15 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 261.28 MB (273976352) - PerHostPeakMemUsage: 3.01 GB (3228583089) - PrepareTime: 143.389ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 12m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s281ms - TotalStorageWaitTime: 474.125ms CodeGen:(Total: 400.100ms, non-child: 400.100ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.751ms - PrepareTime: 140.172ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 864.91 MB (906925594) - NetworkThroughput(*): 1.37 MB/sec - OverallThroughput: 12.23 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s819ms - ThriftTransmitTime(*): 10m40s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=5):(Total: 667.080ms, non-child: 667.080ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s884ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.83 MB (273500684) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 77.52 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.36K (11358) - ScannerThreadsTotalWallClockTime: 12m21s - MaterializeTupleTime(*): 12m18s - ScannerThreadsSysTime: 701.754ms - ScannerThreadsUserTime: 19s953ms - ScannerThreadsVoluntaryContextSwitches: 50.54K (50539) - TotalRawHdfsReadTime(*): 287.354ms - TotalReadThroughput: 4.97 MB/sec Averaged Fragment F01:(Total: 3s985ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:3s795ms max:4s947ms mean: 4s290ms stddev:311.818ms execution rates: min:282.42 MB/sec max:312.40 MB/sec mean:299.34 MB/sec stddev:7.73 MB/sec num instances: 15 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190591129) - PerHostPeakMemUsage: 1.42 GB (1527546122) - PrepareTime: 143.689ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 23s487ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 85.028ms - TotalStorageWaitTime: 261.265ms CodeGen:(Total: 410.391ms, non-child: 410.391ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.067ms - PrepareTime: 139.583ms DataStreamSender (dst_id=11):(Total: 3s699ms, non-child: 3s699ms, % non-child: 100.00%) - BytesSent: 252.65 MB (264927891) - NetworkThroughput(*): 35.15 MB/sec - OverallThroughput: 68.32 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s069ms - ThriftTransmitTime(*): 7s192ms - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=2):(Total: 403.484ms, non-child: 403.484ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 584.584ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.33 MB (190137291) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 33.94 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1672) - ScannerThreadsTotalWallClockTime: 19s544ms - MaterializeTupleTime(*): 18s571ms - ScannerThreadsSysTime: 121.712ms - ScannerThreadsUserTime: 4s292ms - ScannerThreadsVoluntaryContextSwitches: 13.21K (13206) - TotalRawHdfsReadTime(*): 127.117ms - TotalReadThroughput: 38.13 MB/sec Averaged Fragment F00:(Total: 32s282ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:30s818ms max:33s833ms mean: 32s734ms stddev:759.117ms execution rates: min:130.85 MB/sec max:137.57 MB/sec mean:134.19 MB/sec stddev:2.18 MB/sec num instances: 15 - AverageThreadTokens: 10.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 261.31 MB (274003302) - PerHostPeakMemUsage: 2.46 GB (2643026450) - PrepareTime: 142.142ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 5m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s203ms - TotalStorageWaitTime: 545.826ms CodeGen:(Total: 398.166ms, non-child: 398.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.901ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.138ms - PrepareTime: 138.049ms DataStreamSender (dst_id=10):(Total: 31s663ms, non-child: 31s663ms, % non-child: 100.00%) - BytesSent: 865.13 MB (907155112) - NetworkThroughput(*): 7.48 MB/sec - OverallThroughput: 27.32 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s416ms - ThriftTransmitTime(*): 1m56s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=1):(Total: 678.888ms, non-child: 678.888ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.61 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s983ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.87 MB (273539650) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 76.25 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.00K (11999) - ScannerThreadsTotalWallClockTime: 5m10s - MaterializeTupleTime(*): 5m7s - ScannerThreadsSysTime: 763.478ms - ScannerThreadsUserTime: 20s694ms - ScannerThreadsVoluntaryContextSwitches: 50.56K (50558) - TotalRawHdfsReadTime(*): 297.427ms - TotalReadThroughput: 10.92 MB/sec Fragment F07: Instance 2a427b598be90b44:8a531ae61488a9be (host=vb0228.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.58 MB, 134.20 MB, 360.19 MB, 597.15 MB, 848.13 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 794.81 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.28 MB (970224368) - PerHostPeakMemUsage: 3.02 GB (3240372496) - PrepareTime: 145.925ms - RowsProduced: 0 (0) - TotalCpuTime: 6s822ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 341.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 412.895ms, non-child: 412.895ms, % non-child: 100.00%) - CodegenTime: 1.216ms - CompileTime: 18.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 250.000ms - PrepareTime: 142.925ms DataStreamSender (dst_id=16):(Total: 14.118us, non-child: 14.118us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m22s, non-child: 5s706ms, % non-child: 6.96%) ExecOption: Codegen Enabled - BuildTime: 4s754ms - GetNewBlockTime: 431.229us - GetResultsTime: 692.541ms - HTResizeTime: 1s430ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.140us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 987.406ms, % non-child: 1.29%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 52.68 KB, 22.59 MB, 57.82 MB, 95.06 MB, 134.92 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 143.93 MB, 172.87 MB, 204.04 MB, 235.92 MB - BytesReceived: 283.97 MB (297762245) - ConvertRowBatchTime: 777.357ms - DeserializeRowBatchTimer: 764.120ms - FirstBatchArrivalWaitTime: 33s488ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 345.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9ba (host=vb0222.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 5.45 MB, 144.19 MB, 409.73 MB, 670.61 MB, 871.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 764.47 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.57 MB (970529904) - PerHostPeakMemUsage: 3.02 GB (3244825656) - PrepareTime: 148.730ms - RowsProduced: 0 (0) - TotalCpuTime: 7s036ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 185.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 414.196ms, non-child: 414.196ms, % non-child: 100.00%) - CodegenTime: 1.362ms - CompileTime: 16.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 250.829ms - PrepareTime: 145.487ms DataStreamSender (dst_id=16):(Total: 12.416us, non-child: 12.416us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m22s, non-child: 5s890ms, % non-child: 7.18%) ExecOption: Codegen Enabled - BuildTime: 4s943ms - GetNewBlockTime: 444.817us - GetResultsTime: 683.620ms - HTResizeTime: 1s558ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.813us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 1s014ms, % non-child: 1.33%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 522.84 KB, 25.11 MB, 65.90 MB, 107.67 MB, 138.97 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 146.01 MB, 178.88 MB, 211.94 MB, 244.90 MB - BytesReceived: 284.05 MB (297848069) - ConvertRowBatchTime: 809.098ms - DeserializeRowBatchTimer: 766.130ms - FirstBatchArrivalWaitTime: 33s477ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 346.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c5 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 5.52 MB, 142.56 MB, 380.08 MB, 650.37 MB, 851.93 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 888.05 MB, 778.64 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.24 MB (970180720) - PerHostPeakMemUsage: 3.06 GB (3285919576) - PrepareTime: 142.374ms - RowsProduced: 0 (0) - TotalCpuTime: 6s855ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 305.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 424.309ms, non-child: 424.309ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 24.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 259.709ms - PrepareTime: 139.280ms DataStreamSender (dst_id=16):(Total: 11.226us, non-child: 11.226us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s693ms, % non-child: 6.95%) ExecOption: Codegen Enabled - BuildTime: 4s762ms - GetNewBlockTime: 425.471us - GetResultsTime: 680.771ms - HTResizeTime: 1s474ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.623us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 1s003ms, % non-child: 1.32%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 325.38 KB, 23.87 MB, 63.01 MB, 103.31 MB, 136.49 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 144.67 MB, 177.96 MB, 215.59 MB, 256.68 MB - BytesReceived: 283.87 MB (297663003) - ConvertRowBatchTime: 809.628ms - DeserializeRowBatchTimer: 702.564ms - FirstBatchArrivalWaitTime: 33s459ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 345.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9bf (host=vb0216.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 103.80 MB, 321.60 MB, 543.63 MB, 758.45 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.05 MB, 882.05 MB, 871.74 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.30 MB (970251648) - PerHostPeakMemUsage: 2.97 GB (3191632576) - PrepareTime: 147.796ms - RowsProduced: 0 (0) - TotalCpuTime: 6s424ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 289.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 451.248ms, non-child: 451.248ms, % non-child: 100.00%) - CodegenTime: 1.291ms - CompileTime: 34.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 270.613ms - PrepareTime: 144.631ms DataStreamSender (dst_id=16):(Total: 11.574us, non-child: 11.574us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s297ms, % non-child: 6.46%) ExecOption: Codegen Enabled - BuildTime: 4s356ms - GetNewBlockTime: 427.844us - GetResultsTime: 689.517ms - HTResizeTime: 1s352ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.113us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 977.321ms, % non-child: 1.27%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.09 MB, 26.27 MB, 62.12 MB, 95.50 MB, 129.48 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 145.13 MB, 175.02 MB, 207.94 MB, 244.12 MB - BytesReceived: 283.89 MB (297682058) - ConvertRowBatchTime: 754.664ms - DeserializeRowBatchTimer: 787.379ms - FirstBatchArrivalWaitTime: 33s437ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 343.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9b9 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 103.91 MB, 321.97 MB, 530.48 MB, 771.59 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.05 MB, 882.05 MB, 786.79 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.42 MB (970377136) - PerHostPeakMemUsage: 3.02 GB (3245598696) - PrepareTime: 146.261ms - RowsProduced: 0 (0) - TotalCpuTime: 6s840ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.672ms, non-child: 434.672ms, % non-child: 100.00%) - CodegenTime: 2.025ms - CompileTime: 37.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 253.136ms - PrepareTime: 142.392ms DataStreamSender (dst_id=16):(Total: 12.667us, non-child: 12.667us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s680ms, % non-child: 6.93%) ExecOption: Codegen Enabled - BuildTime: 4s750ms - GetNewBlockTime: 445.907us - GetResultsTime: 674.340ms - HTResizeTime: 1s428ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.181us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 999.647ms, % non-child: 1.31%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 19.00 MB, 51.57 MB, 84.68 MB, 122.76 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 143.64 MB, 168.29 MB, 200.18 MB, 237.39 MB - BytesReceived: 283.91 MB (297701547) - ConvertRowBatchTime: 802.895ms - DeserializeRowBatchTimer: 724.238ms - FirstBatchArrivalWaitTime: 33s473ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 345.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c6 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 99.72 MB, 324.13 MB, 543.71 MB, 796.07 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 888.05 MB, 849.41 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.09 MB (971080960) - PerHostPeakMemUsage: 3.07 GB (3299130968) - PrepareTime: 164.816ms - RowsProduced: 0 (0) - TotalCpuTime: 6s489ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 481.446ms, non-child: 481.446ms, % non-child: 100.00%) - CodegenTime: 1.433ms - CompileTime: 55.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.245ms - PrepareTime: 161.278ms DataStreamSender (dst_id=16):(Total: 14.055us, non-child: 14.055us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s437ms, % non-child: 6.63%) ExecOption: Codegen Enabled - BuildTime: 4s477ms - GetNewBlockTime: 507.850us - GetResultsTime: 695.105ms - HTResizeTime: 1s447ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.497us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 862.453ms, % non-child: 1.13%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.60 MB, 51.82 MB, 87.79 MB, 127.09 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 142.51 MB, 171.51 MB, 212.66 MB, 256.40 MB - BytesReceived: 283.95 MB (297739803) - ConvertRowBatchTime: 675.641ms - DeserializeRowBatchTimer: 679.352ms - FirstBatchArrivalWaitTime: 33s413ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 344.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c1 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 102.44 MB, 321.61 MB, 550.10 MB, 775.35 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 900.05 MB, 906.04 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.66 MB (972723216) - PerHostPeakMemUsage: 3.03 GB (3252430024) - PrepareTime: 148.886ms - RowsProduced: 0 (0) - TotalCpuTime: 5s890ms - TotalNetworkReceiveTime: 1m16s - TotalNetworkSendTime: 314.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 454.099ms, non-child: 454.099ms, % non-child: 100.00%) - CodegenTime: 1.398ms - CompileTime: 37.284ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.907ms - PrepareTime: 144.292ms DataStreamSender (dst_id=16):(Total: 13.987us, non-child: 13.987us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 4s898ms, % non-child: 5.98%) ExecOption: Codegen Enabled - BuildTime: 3s975ms - GetNewBlockTime: 451.797us - GetResultsTime: 683.018ms - HTResizeTime: 1s373ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.253us EXCHANGE_NODE (id=14):(Total: 1m17s, non-child: 817.958ms, % non-child: 1.06%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 613.08 KB, 25.10 MB, 61.21 MB, 96.75 MB, 132.12 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 146.03 MB, 185.65 MB, 235.19 MB, 280.43 MB - BytesReceived: 283.96 MB (297749354) - ConvertRowBatchTime: 625.225ms - DeserializeRowBatchTimer: 646.541ms - FirstBatchArrivalWaitTime: 33s443ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 342.06 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9bc (host=vb0220.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 116.20 MB, 321.60 MB, 547.48 MB, 773.35 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 849.41 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.22 MB (971211904) - PerHostPeakMemUsage: 3.02 GB (3246245568) - PrepareTime: 153.384ms - RowsProduced: 0 (0) - TotalCpuTime: 6s225ms - TotalNetworkReceiveTime: 1m16s - TotalNetworkSendTime: 346.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 463.107ms, non-child: 463.107ms, % non-child: 100.00%) - CodegenTime: 1.470ms - CompileTime: 35.373ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 277.250ms - PrepareTime: 145.430ms DataStreamSender (dst_id=16):(Total: 16.285us, non-child: 16.285us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s183ms, % non-child: 6.33%) ExecOption: Codegen Enabled - BuildTime: 4s257ms - GetNewBlockTime: 960.567us - GetResultsTime: 682.317ms - HTResizeTime: 1s363ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.372us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 865.750ms, % non-child: 1.13%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 19.75 MB, 53.88 MB, 88.25 MB, 125.02 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 142.91 MB, 173.29 MB, 207.70 MB, 243.24 MB - BytesReceived: 283.82 MB (297606606) - ConvertRowBatchTime: 673.290ms - DeserializeRowBatchTimer: 789.727ms - FirstBatchArrivalWaitTime: 33s422ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 343.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9bb (host=vb0224.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 121.68 MB, 352.17 MB, 663.04 MB, 876.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.04 MB, 888.06 MB, 835.26 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.80 MB (972865072) - PerHostPeakMemUsage: 3.07 GB (3294777432) - PrepareTime: 148.470ms - RowsProduced: 0 (0) - TotalCpuTime: 5s600ms - TotalNetworkReceiveTime: 1m16s - TotalNetworkSendTime: 149.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.908ms, non-child: 436.908ms, % non-child: 100.00%) - CodegenTime: 1.164ms - CompileTime: 26.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.912ms - PrepareTime: 143.770ms DataStreamSender (dst_id=16):(Total: 13.058us, non-child: 13.058us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 4s683ms, % non-child: 5.72%) ExecOption: Codegen Enabled - BuildTime: 3s794ms - GetNewBlockTime: 448.105us - GetResultsTime: 655.160ms - HTResizeTime: 1s282ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.383us EXCHANGE_NODE (id=14):(Total: 1m17s, non-child: 735.431ms, % non-child: 0.95%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20.59 MB, 58.26 MB, 106.45 MB, 139.83 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 143.44 MB, 178.37 MB, 213.31 MB, 251.58 MB - BytesReceived: 284.01 MB (297802648) - ConvertRowBatchTime: 581.065ms - DeserializeRowBatchTimer: 548.937ms - FirstBatchArrivalWaitTime: 33s452ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 341.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c3 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 143.62 MB, 443.04 MB, 733.44 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.04 MB, 849.40 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.76 MB (972826880) - PerHostPeakMemUsage: 3.06 GB (3286580264) - PrepareTime: 156.771ms - RowsProduced: 0 (0) - TotalCpuTime: 6s976ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 289.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 484.036ms, non-child: 484.036ms, % non-child: 100.00%) - CodegenTime: 3.076ms - CompileTime: 49.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 282.619ms - PrepareTime: 147.243ms DataStreamSender (dst_id=16):(Total: 18.511us, non-child: 18.511us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s741ms, % non-child: 7.01%) ExecOption: Codegen Enabled - BuildTime: 4s794ms - GetNewBlockTime: 555.022us - GetResultsTime: 695.664ms - HTResizeTime: 1s468ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.332us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 1s037ms, % non-child: 1.36%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 24.12 MB, 71.05 MB, 117.65 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 142.64 MB, 168.72 MB, 201.99 MB, 241.15 MB - BytesReceived: 283.95 MB (297740965) - ConvertRowBatchTime: 827.365ms - DeserializeRowBatchTimer: 605.515ms - FirstBatchArrivalWaitTime: 33s401ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 345.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c0 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 123.21 MB, 401.59 MB, 693.26 MB, 876.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 871.72 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.82 MB (970791792) - PerHostPeakMemUsage: 3.03 GB (3250022104) - PrepareTime: 147.455ms - RowsProduced: 0 (0) - TotalCpuTime: 6s003ms - TotalNetworkReceiveTime: 1m16s - TotalNetworkSendTime: 335.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 499.843ms, non-child: 499.843ms, % non-child: 100.00%) - CodegenTime: 1.360ms - CompileTime: 47.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 307.452ms - PrepareTime: 143.230ms DataStreamSender (dst_id=16):(Total: 11.626us, non-child: 11.626us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 4s946ms, % non-child: 6.04%) ExecOption: Codegen Enabled - BuildTime: 4s008ms - GetNewBlockTime: 609.208us - GetResultsTime: 694.434ms - HTResizeTime: 1s301ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.511us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 817.937ms, % non-child: 1.06%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.16 MB, 30.20 MB, 76.73 MB, 123.32 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 146.44 MB, 176.74 MB, 208.65 MB, 242.65 MB - BytesReceived: 284.08 MB (297875051) - ConvertRowBatchTime: 646.283ms - DeserializeRowBatchTimer: 691.899ms - FirstBatchArrivalWaitTime: 33s391ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 342.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c2 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 5.46 MB, 134.94 MB, 336.22 MB, 558.10 MB, 808.70 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 888.05 MB, 778.63 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.73 MB (972799600) - PerHostPeakMemUsage: 2.98 GB (3197951424) - PrepareTime: 149.199ms - RowsProduced: 0 (0) - TotalCpuTime: 6s852ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 277.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 462.248ms, non-child: 462.248ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 31.461ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 283.857ms - PrepareTime: 144.187ms DataStreamSender (dst_id=16):(Total: 13.256us, non-child: 13.256us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s698ms, % non-child: 6.96%) ExecOption: Codegen Enabled - BuildTime: 4s796ms - GetNewBlockTime: 653.837us - GetResultsTime: 663.666ms - HTResizeTime: 1s466ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.567us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 982.335ms, % non-child: 1.29%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 346.01 KB, 22.08 MB, 55.62 MB, 91.07 MB, 129.26 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 144.06 MB, 174.37 MB, 206.63 MB, 248.95 MB - BytesReceived: 284.01 MB (297804765) - ConvertRowBatchTime: 775.630ms - DeserializeRowBatchTimer: 685.003ms - FirstBatchArrivalWaitTime: 33s424ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 345.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c4 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 135.42 MB, 368.07 MB, 603.95 MB, 840.12 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 896.05 MB, 792.78 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 928.12 MB (973203344) - PerHostPeakMemUsage: 2.97 GB (3193899920) - PrepareTime: 147.959ms - RowsProduced: 0 (0) - TotalCpuTime: 6s667ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 149.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.138ms, non-child: 481.138ms, % non-child: 100.00%) - CodegenTime: 1.212ms - CompileTime: 46.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 288.191ms - PrepareTime: 144.039ms DataStreamSender (dst_id=16):(Total: 11.601us, non-child: 11.601us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s577ms, % non-child: 6.81%) ExecOption: Codegen Enabled - BuildTime: 4s658ms - GetNewBlockTime: 692.570us - GetResultsTime: 682.446ms - HTResizeTime: 1s523ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.592us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 871.653ms, % non-child: 1.14%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22.12 MB, 59.20 MB, 98.27 MB, 133.79 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 144.73 MB, 185.48 MB, 224.88 MB, 269.89 MB - BytesReceived: 283.98 MB (297773682) - ConvertRowBatchTime: 699.298ms - DeserializeRowBatchTimer: 636.198ms - FirstBatchArrivalWaitTime: 33s428ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 345.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9bd (host=vb0206.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 156.78 MB, 431.01 MB, 768.64 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 888.05 MB, 806.94 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.07 MB (971053680) - PerHostPeakMemUsage: 3.05 GB (3271422744) - PrepareTime: 148.389ms - RowsProduced: 0 (0) - TotalCpuTime: 6s745ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 310.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.509ms, non-child: 480.509ms, % non-child: 100.00%) - CodegenTime: 1.198ms - CompileTime: 38.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 295.419ms - PrepareTime: 145.200ms DataStreamSender (dst_id=16):(Total: 12.395us, non-child: 12.395us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s578ms, % non-child: 6.81%) ExecOption: Codegen Enabled - BuildTime: 4s683ms - GetNewBlockTime: 415.748us - GetResultsTime: 662.092ms - HTResizeTime: 1s438ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.488us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 959.047ms, % non-child: 1.26%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 26.07 MB, 69.44 MB, 121.00 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 144.43 MB, 173.70 MB, 212.62 MB, 250.99 MB - BytesReceived: 284.12 MB (297916837) - ConvertRowBatchTime: 764.586ms - DeserializeRowBatchTimer: 691.068ms - FirstBatchArrivalWaitTime: 33s411ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 345.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2a427b598be90b44:8a531ae61488a9c7 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 135.19 MB, 357.65 MB, 576.85 MB, 781.35 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 829.26 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.51 MB (970464432) - PerHostPeakMemUsage: 3.00 GB (3217840104) - PrepareTime: 150.228ms - RowsProduced: 0 (0) - TotalCpuTime: 6s568ms - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 397.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 579.753ms, non-child: 579.753ms, % non-child: 100.00%) - CodegenTime: 1.191ms - CompileTime: 37.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 394.312ms - PrepareTime: 143.305ms DataStreamSender (dst_id=16):(Total: 13.036us, non-child: 13.036us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m21s, non-child: 5s309ms, % non-child: 6.49%) ExecOption: Codegen Enabled - BuildTime: 4s379ms - GetNewBlockTime: 698.817us - GetResultsTime: 684.898ms - HTResizeTime: 1s286ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.373us EXCHANGE_NODE (id=14):(Total: 1m16s, non-child: 970.327ms, % non-child: 1.27%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22.73 MB, 57.40 MB, 92.74 MB, 126.80 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 143.59 MB, 172.10 MB, 208.16 MB, 239.79 MB - BytesReceived: 283.93 MB (297720709) - ConvertRowBatchTime: 763.940ms - DeserializeRowBatchTimer: 749.933ms - FirstBatchArrivalWaitTime: 33s313ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 344.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance 2a427b598be90b44:8a531ae61488a9cd (host=vb0228.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 204.08 MB, 546.36 MB, 826.31 MB, 1.17 GB, 1.36 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.78 GB, 1.67 GB, 726.83 MB, 532.33 MB, 337.83 MB, 171.07 MB, 312.69 MB, 641.66 MB, 1006.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.85 GB, 1.06 GB, 651.76 MB, 459.27 MB, 314.90 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135865256) - PerHostPeakMemUsage: 3.02 GB (3240372496) - PrepareTime: 154.414ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 15s290ms - TotalNetworkSendTime: 1s340ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 640.745ms, non-child: 640.745ms, % non-child: 100.00%) - CodegenTime: 3.172ms - CompileTime: 100.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 394.522ms - PrepareTime: 143.938ms DataStreamSender (dst_id=14):(Total: 6s500ms, non-child: 6s500ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297762245) - NetworkThroughput(*): 54.49 MB/sec - OverallThroughput: 43.69 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s394ms - ThriftTransmitTime(*): 5s211ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 4s324ms, % non-child: 5.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 191.004us - GetResultsTime: 148.395ms - HTResizeTime: 132.399ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 353.95 K/sec - StreamingTime: 3s962ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 4s135ms, % non-child: 5.90%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 378.90 K/sec AGGREGATION_NODE (id=8):(Total: 32s185ms, non-child: 8s987ms, % non-child: 27.92%) ExecOption: Codegen Enabled - BuildTime: 8s168ms - GetNewBlockTime: 491.585us - GetResultsTime: 692.536ms - HTResizeTime: 1s221ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 412.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.868us HASH_JOIN_NODE (id=7):(Total: 23s198ms, non-child: 14s308ms, % non-child: 61.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s079ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s619ms - GetNewBlockTime: 517.221us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s792ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.22 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.265us EXCHANGE_NODE (id=13):(Total: 2s566ms, non-child: 1s293ms, % non-child: 50.40%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.26 MB, 97.96 MB, 226.59 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB - BytesReceived: 252.23 MB (264480198) - ConvertRowBatchTime: 472.167ms - DeserializeRowBatchTimer: 1s564ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 5.32 M/sec - SendersBlockedTimer: 40s445ms - SendersBlockedTotalTimer(*): 8m47s EXCHANGE_NODE (id=12):(Total: 6s323ms, non-child: 2s951ms, % non-child: 46.68%) BytesReceived(2s000ms): 7.55 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 40.79 MB, 107.24 MB, 187.62 MB, 254.18 MB, 325.14 MB, 393.89 MB, 459.15 MB, 540.83 MB, 625.13 MB, 697.42 MB, 770.78 MB, 832.46 MB - BytesReceived: 864.80 MB (906807687) - ConvertRowBatchTime: 1s521ms - DeserializeRowBatchTimer: 5s040ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 8.16 M/sec - SendersBlockedTimer: 47s350ms - SendersBlockedTotalTimer(*): 6m59s AGGREGATION_NODE (id=4):(Total: 33s824ms, non-child: 9s593ms, % non-child: 28.36%) ExecOption: Codegen Enabled - BuildTime: 8s854ms - GetNewBlockTime: 605.421us - GetResultsTime: 586.023ms - HTResizeTime: 1s242ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 392.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.296us HASH_JOIN_NODE (id=3):(Total: 24s231ms, non-child: 13s572ms, % non-child: 56.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s870ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s615ms - GetNewBlockTime: 901.553us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s275ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.283us EXCHANGE_NODE (id=11):(Total: 2s395ms, non-child: 1s174ms, % non-child: 49.03%) BytesReceived(1s000ms): 10.95 MB, 74.47 MB, 140.90 MB, 208.18 MB, 249.49 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB - BytesReceived: 252.65 MB (264922504) - ConvertRowBatchTime: 416.954ms - DeserializeRowBatchTimer: 1s561ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s263ms, non-child: 2s886ms, % non-child: 34.93%) BytesReceived(1s000ms): 5.05 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 21.98 MB, 61.48 MB, 101.08 MB, 141.89 MB, 174.73 MB, 207.17 MB, 237.46 MB, 269.82 MB, 308.05 MB, 340.65 MB, 372.00 MB, 402.73 MB, 426.71 MB, 459.60 MB, 492.41 MB, 525.36 MB, 557.50 MB, 590.11 MB, 623.06 MB, 654.93 MB, 691.83 MB, 729.64 MB, 765.36 MB, 795.79 MB, 823.16 MB, 842.58 MB - BytesReceived: 865.03 MB (907049630) - ConvertRowBatchTime: 1s432ms - DeserializeRowBatchTimer: 5s564ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 6.25 M/sec - SendersBlockedTimer: 6s461ms - SendersBlockedTotalTimer(*): 1m4s Instance 2a427b598be90b44:8a531ae61488a9d6 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 207.34 MB, 514.41 MB, 810.33 MB, 1.14 GB, 1.36 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.57 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.76 GB, 1.93 GB, 726.86 MB, 532.36 MB, 350.01 MB, 191.99 MB, 318.11 MB, 606.06 MB, 974.78 MB, 1.24 GB, 1.33 GB, 1.37 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.84 GB, 1.07 GB, 651.77 MB, 459.28 MB, 286.68 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134201208) - PerHostPeakMemUsage: 3.00 GB (3217840104) - PrepareTime: 166.796ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 14s556ms - TotalNetworkSendTime: 1s308ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 699.564ms, non-child: 699.564ms, % non-child: 100.00%) - CodegenTime: 4.690ms - CompileTime: 145.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 401.384ms - PrepareTime: 142.252ms DataStreamSender (dst_id=14):(Total: 6s677ms, non-child: 6s677ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297720709) - NetworkThroughput(*): 52.82 MB/sec - OverallThroughput: 42.52 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s467ms - ThriftTransmitTime(*): 5s375ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s483ms, % non-child: 6.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 242.795us - GetResultsTime: 150.342ms - HTResizeTime: 124.834ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 356.29 K/sec - StreamingTime: 4s109ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s204ms, % non-child: 6.05%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 382.43 K/sec AGGREGATION_NODE (id=8):(Total: 31s492ms, non-child: 9s080ms, % non-child: 28.83%) ExecOption: Codegen Enabled - BuildTime: 8s238ms - GetNewBlockTime: 546.266us - GetResultsTime: 703.893ms - HTResizeTime: 1s226ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 421.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.346us HASH_JOIN_NODE (id=7):(Total: 22s412ms, non-child: 13s677ms, % non-child: 61.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s131ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s651ms - GetNewBlockTime: 625.380us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s025ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.30 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.147us EXCHANGE_NODE (id=13):(Total: 1s813ms, non-child: 1s315ms, % non-child: 72.56%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 89.98 MB, 221.88 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB, 252.19 MB - BytesReceived: 252.19 MB (264435213) - ConvertRowBatchTime: 475.494ms - DeserializeRowBatchTimer: 1s575ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 7.53 M/sec - SendersBlockedTimer: 41s150ms - SendersBlockedTotalTimer(*): 9m36s EXCHANGE_NODE (id=12):(Total: 6s921ms, non-child: 2s783ms, % non-child: 40.22%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 37.06 MB, 103.54 MB, 183.18 MB, 249.90 MB, 321.21 MB, 390.85 MB, 454.86 MB, 535.87 MB, 620.84 MB, 693.84 MB, 766.94 MB, 829.51 MB - BytesReceived: 864.88 MB (906892348) - ConvertRowBatchTime: 1s479ms - DeserializeRowBatchTimer: 4s856ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 7.46 M/sec - SendersBlockedTimer: 47s422ms - SendersBlockedTotalTimer(*): 11m3s AGGREGATION_NODE (id=4):(Total: 33s793ms, non-child: 9s744ms, % non-child: 28.83%) ExecOption: Codegen Enabled - BuildTime: 8s962ms - GetNewBlockTime: 2.552ms - GetResultsTime: 623.373ms - HTResizeTime: 1s207ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 393.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.625us HASH_JOIN_NODE (id=3):(Total: 24s049ms, non-child: 13s938ms, % non-child: 57.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s765ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s766ms - GetNewBlockTime: 813.392us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s566ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.691us EXCHANGE_NODE (id=11):(Total: 2s446ms, non-child: 791.686ms, % non-child: 32.36%) BytesReceived(1s000ms): 7.08 MB, 66.35 MB, 133.41 MB, 200.46 MB, 247.76 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB, 252.61 MB - BytesReceived: 252.61 MB (264877127) - ConvertRowBatchTime: 404.855ms - DeserializeRowBatchTimer: 1s080ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 5.58 M/sec - SendersBlockedTimer: 23.035ms - SendersBlockedTotalTimer(*): 309.158ms EXCHANGE_NODE (id=10):(Total: 7s664ms, non-child: 2s763ms, % non-child: 36.06%) BytesReceived(1s000ms): 5.04 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 18.77 MB, 57.01 MB, 96.85 MB, 137.19 MB, 170.79 MB, 204.66 MB, 234.06 MB, 266.48 MB, 304.42 MB, 337.38 MB, 369.01 MB, 399.66 MB, 425.03 MB, 456.20 MB, 488.98 MB, 521.96 MB, 554.22 MB, 586.78 MB, 619.67 MB, 651.35 MB, 687.70 MB, 725.43 MB, 761.95 MB, 792.42 MB, 821.40 MB, 839.11 MB, 863.22 MB - BytesReceived: 865.10 MB (907124765) - ConvertRowBatchTime: 1s524ms - DeserializeRowBatchTimer: 4s998ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.73 M/sec - SendersBlockedTimer: 6s650ms - SendersBlockedTotalTimer(*): 53s745ms Instance 2a427b598be90b44:8a531ae61488a9c8 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.25 MB, 546.42 MB, 826.34 MB, 1.15 GB, 1.36 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.77 GB, 1.67 GB, 763.32 MB, 580.98 MB, 398.63 MB, 211.53 MB, 310.86 MB, 638.83 MB, 1006.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.85 GB, 1.06 GB, 675.82 MB, 507.39 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135285808) - PerHostPeakMemUsage: 3.02 GB (3245598696) - PrepareTime: 175.432ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 16s162ms - TotalNetworkSendTime: 1s376ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 643.139ms, non-child: 643.139ms, % non-child: 100.00%) - CodegenTime: 8.183ms - CompileTime: 114.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 383.614ms - PrepareTime: 143.825ms DataStreamSender (dst_id=14):(Total: 6s622ms, non-child: 6s622ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297701547) - NetworkThroughput(*): 52.05 MB/sec - OverallThroughput: 42.87 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s397ms - ThriftTransmitTime(*): 5s454ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 4s382ms, % non-child: 5.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 561.271us - GetResultsTime: 149.758ms - HTResizeTime: 135.972ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 356.07 K/sec - StreamingTime: 4s010ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s343ms, % non-child: 6.24%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 381.63 K/sec AGGREGATION_NODE (id=8):(Total: 31s383ms, non-child: 9s082ms, % non-child: 28.94%) ExecOption: Codegen Enabled - BuildTime: 8s323ms - GetNewBlockTime: 632.221us - GetResultsTime: 629.831ms - HTResizeTime: 1s100ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 423.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.829us HASH_JOIN_NODE (id=7):(Total: 22s300ms, non-child: 12s590ms, % non-child: 56.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s252ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s651ms - GetNewBlockTime: 431.183us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s874ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.31 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.362us EXCHANGE_NODE (id=13):(Total: 2s676ms, non-child: 1s147ms, % non-child: 42.89%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.15 MB, 96.67 MB, 225.87 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB, 252.21 MB - BytesReceived: 252.21 MB (264459055) - ConvertRowBatchTime: 257.260ms - DeserializeRowBatchTimer: 1s681ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 5.11 M/sec - SendersBlockedTimer: 41s176ms - SendersBlockedTotalTimer(*): 8m16s EXCHANGE_NODE (id=12):(Total: 7s033ms, non-child: 3s019ms, % non-child: 42.93%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 40.09 MB, 106.55 MB, 186.80 MB, 253.51 MB, 324.46 MB, 393.22 MB, 458.43 MB, 539.99 MB, 624.42 MB, 696.89 MB, 770.21 MB, 831.86 MB - BytesReceived: 864.61 MB (906608034) - ConvertRowBatchTime: 1s505ms - DeserializeRowBatchTimer: 5s233ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 7.34 M/sec - SendersBlockedTimer: 47s394ms - SendersBlockedTotalTimer(*): 10m16s AGGREGATION_NODE (id=4):(Total: 33s905ms, non-child: 9s649ms, % non-child: 28.46%) ExecOption: Codegen Enabled - BuildTime: 8s817ms - GetNewBlockTime: 4.099ms - GetResultsTime: 672.069ms - HTResizeTime: 1s262ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 391.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.348us HASH_JOIN_NODE (id=3):(Total: 24s256ms, non-child: 13s775ms, % non-child: 56.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s305ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s629ms - GetNewBlockTime: 685.358us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s954ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.204us EXCHANGE_NODE (id=11):(Total: 2s947ms, non-child: 1s123ms, % non-child: 38.10%) BytesReceived(1s000ms): 10.30 MB, 73.07 MB, 139.65 MB, 206.89 MB, 249.19 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB, 252.62 MB - BytesReceived: 252.62 MB (264889111) - ConvertRowBatchTime: 283.206ms - DeserializeRowBatchTimer: 1s661ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 4.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s534ms, non-child: 2s892ms, % non-child: 38.39%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 21.32 MB, 60.77 MB, 100.34 MB, 141.16 MB, 173.82 MB, 206.81 MB, 236.98 MB, 269.24 MB, 307.54 MB, 340.22 MB, 371.55 MB, 402.24 MB, 426.38 MB, 458.97 MB, 491.74 MB, 524.74 MB, 556.85 MB, 589.47 MB, 622.28 MB, 654.17 MB, 690.97 MB, 728.62 MB, 764.56 MB, 794.94 MB, 822.59 MB, 841.79 MB - BytesReceived: 864.83 MB (906836419) - ConvertRowBatchTime: 1s587ms - DeserializeRowBatchTimer: 5s080ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 6.85 M/sec - SendersBlockedTimer: 6s535ms - SendersBlockedTotalTimer(*): 1m11s Instance 2a427b598be90b44:8a531ae61488a9cf (host=vb0232.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 164.38 MB, 482.42 MB, 762.34 MB, 1.13 GB, 1.35 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.74 GB, 1.95 GB, 763.33 MB, 508.05 MB, 252.76 MB, 166.86 MB, 289.00 MB, 568.05 MB, 958.78 MB, 1.23 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.42 GB, 1.53 GB, 1.53 GB, 1.63 GB, 1.66 GB, 1.66 GB, 1.82 GB, 1.06 GB, 663.80 MB, 507.40 MB, 314.90 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2138294304) - PerHostPeakMemUsage: 3.03 GB (3250022104) - PrepareTime: 155.160ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 16s965ms - TotalNetworkSendTime: 1s122ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 679.182ms, non-child: 679.182ms, % non-child: 100.00%) - CodegenTime: 3.568ms - CompileTime: 125.661ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 407.902ms - PrepareTime: 144.348ms DataStreamSender (dst_id=14):(Total: 5s788ms, non-child: 5s788ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297875051) - NetworkThroughput(*): 62.67 MB/sec - OverallThroughput: 49.08 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s174ms - ThriftTransmitTime(*): 4s532ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 3s900ms, % non-child: 5.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 250.955us - GetResultsTime: 142.157ms - HTResizeTime: 131.664ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270593) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 352.52 K/sec - StreamingTime: 3s546ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 4s160ms, % non-child: 5.87%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 375.01 K/sec AGGREGATION_NODE (id=8):(Total: 33s072ms, non-child: 9s152ms, % non-child: 27.67%) ExecOption: Codegen Enabled - BuildTime: 8s355ms - GetNewBlockTime: 424.369us - GetResultsTime: 665.430ms - HTResizeTime: 1s258ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 401.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.370us HASH_JOIN_NODE (id=7):(Total: 23s919ms, non-child: 13s062ms, % non-child: 54.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s991ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s560ms - GetNewBlockTime: 386.904us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s754ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.449us EXCHANGE_NODE (id=13):(Total: 3s599ms, non-child: 1s234ms, % non-child: 34.31%) BytesReceived(2s000ms): 9.28 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 14.05 MB, 114.31 MB, 235.64 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB, 252.34 MB - BytesReceived: 252.34 MB (264601093) - ConvertRowBatchTime: 443.464ms - DeserializeRowBatchTimer: 1s538ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 3.80 M/sec - SendersBlockedTimer: 39s507ms - SendersBlockedTotalTimer(*): 9m52s EXCHANGE_NODE (id=12):(Total: 7s258ms, non-child: 2s877ms, % non-child: 39.65%) BytesReceived(2s000ms): 9.25 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.11 MB, 48.87 MB, 116.40 MB, 194.40 MB, 262.09 MB, 332.83 MB, 399.82 MB, 467.19 MB, 550.73 MB, 634.02 MB, 705.63 MB, 779.59 MB, 839.29 MB - BytesReceived: 865.35 MB (907381212) - ConvertRowBatchTime: 1s425ms - DeserializeRowBatchTimer: 5s275ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 7.12 M/sec - SendersBlockedTimer: 47s255ms - SendersBlockedTotalTimer(*): 8m38s AGGREGATION_NODE (id=4):(Total: 33s668ms, non-child: 9s734ms, % non-child: 28.91%) ExecOption: Codegen Enabled - BuildTime: 9s109ms - GetNewBlockTime: 529.762us - GetResultsTime: 497.117ms - HTResizeTime: 1s299ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 394.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.584us HASH_JOIN_NODE (id=3):(Total: 23s933ms, non-child: 13s679ms, % non-child: 57.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s836ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s738ms - GetNewBlockTime: 974.805us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s279ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.971us EXCHANGE_NODE (id=11):(Total: 2s396ms, non-child: 847.111ms, % non-child: 35.34%) BytesReceived(1s000ms): 22.07 MB, 89.86 MB, 155.72 MB, 222.59 MB, 251.46 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB - BytesReceived: 252.77 MB (265043688) - ConvertRowBatchTime: 442.499ms - DeserializeRowBatchTimer: 1s128ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s857ms, non-child: 2s946ms, % non-child: 37.50%) BytesReceived(1s000ms): 8.21 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 30.82 MB, 70.59 MB, 109.32 MB, 149.16 MB, 182.51 MB, 213.76 MB, 244.94 MB, 278.66 MB, 315.65 MB, 348.10 MB, 379.20 MB, 409.98 MB, 434.19 MB, 467.25 MB, 500.18 MB, 532.95 MB, 565.24 MB, 597.92 MB, 630.62 MB, 663.39 MB, 700.46 MB, 738.39 MB, 772.68 MB, 803.12 MB, 827.56 MB, 850.40 MB - BytesReceived: 865.55 MB (907595381) - ConvertRowBatchTime: 1s436ms - DeserializeRowBatchTimer: 5s761ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 6.57 M/sec - SendersBlockedTimer: 6s619ms - SendersBlockedTotalTimer(*): 40s236ms Instance 2a427b598be90b44:8a531ae61488a9ce (host=vb0216.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 164.54 MB, 482.39 MB, 754.35 MB, 1.11 GB, 1.35 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.57 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.74 GB, 1.95 GB, 775.49 MB, 580.98 MB, 386.47 MB, 191.98 MB, 290.62 MB, 566.80 MB, 942.76 MB, 1.24 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.42 GB, 1.53 GB, 1.53 GB, 1.63 GB, 1.66 GB, 1.66 GB, 1.82 GB, 1.06 GB, 699.90 MB, 507.39 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135956840) - PerHostPeakMemUsage: 2.97 GB (3191632576) - PrepareTime: 165.465ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 14s656ms - TotalNetworkSendTime: 1s353ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 655.896ms, non-child: 655.896ms, % non-child: 100.00%) - CodegenTime: 5.956ms - CompileTime: 116.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 388.783ms - PrepareTime: 143.911ms DataStreamSender (dst_id=14):(Total: 6s543ms, non-child: 6s543ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297682058) - NetworkThroughput(*): 52.20 MB/sec - OverallThroughput: 43.39 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s366ms - ThriftTransmitTime(*): 5s438ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 4s248ms, % non-child: 5.74%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 156.995us - GetResultsTime: 140.152ms - HTResizeTime: 163.599ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 356.03 K/sec - StreamingTime: 3s884ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s601ms, % non-child: 6.60%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 380.86 K/sec AGGREGATION_NODE (id=8):(Total: 31s355ms, non-child: 9s305ms, % non-child: 29.68%) ExecOption: Codegen Enabled - BuildTime: 8s545ms - GetNewBlockTime: 610.521us - GetResultsTime: 642.560ms - HTResizeTime: 1s258ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 423.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.115us HASH_JOIN_NODE (id=7):(Total: 22s049ms, non-child: 13s926ms, % non-child: 63.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s854ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s645ms - GetNewBlockTime: 531.863us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s628ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.34 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.992us EXCHANGE_NODE (id=13):(Total: 2s032ms, non-child: 1s296ms, % non-child: 63.80%) BytesReceived(2s000ms): 9.28 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 14.01 MB, 114.27 MB, 235.50 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB, 252.17 MB - BytesReceived: 252.17 MB (264421972) - ConvertRowBatchTime: 450.256ms - DeserializeRowBatchTimer: 1s575ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 6.72 M/sec - SendersBlockedTimer: 41s263ms - SendersBlockedTotalTimer(*): 8m19s EXCHANGE_NODE (id=12):(Total: 6s090ms, non-child: 3s021ms, % non-child: 49.61%) BytesReceived(2s000ms): 9.26 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 48.84 MB, 116.40 MB, 194.53 MB, 262.04 MB, 332.76 MB, 399.67 MB, 467.00 MB, 550.57 MB, 633.69 MB, 705.18 MB, 778.99 MB, 838.70 MB - BytesReceived: 864.75 MB (906752428) - ConvertRowBatchTime: 1s546ms - DeserializeRowBatchTimer: 5s176ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 8.47 M/sec - SendersBlockedTimer: 47s380ms - SendersBlockedTotalTimer(*): 7m54s AGGREGATION_NODE (id=4):(Total: 33s815ms, non-child: 9s610ms, % non-child: 28.42%) ExecOption: Codegen Enabled - BuildTime: 8s843ms - GetNewBlockTime: 4.330ms - GetResultsTime: 610.623ms - HTResizeTime: 1s241ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 392.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.410us HASH_JOIN_NODE (id=3):(Total: 24s204ms, non-child: 13s476ms, % non-child: 55.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s264ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s706ms - GetNewBlockTime: 857.471us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s682ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.597us EXCHANGE_NODE (id=11):(Total: 2s992ms, non-child: 1s198ms, % non-child: 40.05%) BytesReceived(1s000ms): 22.10 MB, 89.82 MB, 155.69 MB, 222.50 MB, 251.31 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB, 252.60 MB - BytesReceived: 252.60 MB (264873490) - ConvertRowBatchTime: 274.080ms - DeserializeRowBatchTimer: 1s725ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 4.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s735ms, non-child: 2s860ms, % non-child: 36.97%) BytesReceived(1s000ms): 8.26 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 30.92 MB, 70.60 MB, 109.26 MB, 149.10 MB, 182.55 MB, 213.81 MB, 244.85 MB, 278.55 MB, 315.55 MB, 348.01 MB, 379.00 MB, 409.72 MB, 434.00 MB, 467.11 MB, 500.13 MB, 532.96 MB, 565.09 MB, 597.80 MB, 630.50 MB, 663.17 MB, 700.17 MB, 738.03 MB, 772.20 MB, 802.58 MB, 827.04 MB, 849.86 MB - BytesReceived: 864.96 MB (906977975) - ConvertRowBatchTime: 1s516ms - DeserializeRowBatchTimer: 5s284ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 6.67 M/sec - SendersBlockedTimer: 6s578ms - SendersBlockedTotalTimer(*): 1m12s Instance 2a427b598be90b44:8a531ae61488a9c9 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 205.96 MB, 546.38 MB, 842.34 MB, 1.17 GB, 1.37 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.53 GB, 1.58 GB, 1.58 GB, 1.69 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 726.87 MB, 495.89 MB, 289.24 MB, 166.87 MB, 312.83 MB, 638.81 MB, 1006.78 MB, 1.25 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.87 GB, 1.04 GB, 603.64 MB, 447.23 MB, 266.77 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135419176) - PerHostPeakMemUsage: 3.02 GB (3244825656) - PrepareTime: 153.948ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 16s954ms - TotalNetworkSendTime: 1s318ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 681.601ms, non-child: 681.601ms, % non-child: 100.00%) - CodegenTime: 3.265ms - CompileTime: 123.241ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 413.408ms - PrepareTime: 143.661ms DataStreamSender (dst_id=14):(Total: 6s455ms, non-child: 6s455ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297848069) - NetworkThroughput(*): 53.63 MB/sec - OverallThroughput: 44.00 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s357ms - ThriftTransmitTime(*): 5s296ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s147ms, % non-child: 5.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 176.003us - GetResultsTime: 160.165ms - HTResizeTime: 123.332ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 357.10 K/sec - StreamingTime: 3s770ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 3s436ms, % non-child: 4.93%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 381.50 K/sec AGGREGATION_NODE (id=8):(Total: 32s467ms, non-child: 8s488ms, % non-child: 26.14%) ExecOption: Codegen Enabled - BuildTime: 7s650ms - GetNewBlockTime: 902.126us - GetResultsTime: 680.165ms - HTResizeTime: 1s017ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 409.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.048us HASH_JOIN_NODE (id=7):(Total: 23s979ms, non-child: 13s878ms, % non-child: 57.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s260ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s805ms - GetNewBlockTime: 495.305us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s922ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.179us EXCHANGE_NODE (id=13):(Total: 3s688ms, non-child: 547.909ms, % non-child: 14.85%) BytesReceived(2s000ms): 7.83 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 11.66 MB, 104.10 MB, 230.12 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB, 252.30 MB - BytesReceived: 252.30 MB (264560649) - ConvertRowBatchTime: 266.177ms - DeserializeRowBatchTimer: 977.043ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 40s153ms - SendersBlockedTotalTimer(*): 8m42s EXCHANGE_NODE (id=12):(Total: 6s412ms, non-child: 2s792ms, % non-child: 43.55%) BytesReceived(2s000ms): 7.91 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 44.05 MB, 110.68 MB, 190.19 MB, 257.15 MB, 328.07 MB, 396.20 MB, 462.30 MB, 544.91 MB, 628.79 MB, 700.88 MB, 774.28 MB, 835.41 MB - BytesReceived: 865.16 MB (907185965) - ConvertRowBatchTime: 1s477ms - DeserializeRowBatchTimer: 4s924ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 8.05 M/sec - SendersBlockedTimer: 47s608ms - SendersBlockedTotalTimer(*): 10m18s AGGREGATION_NODE (id=4):(Total: 33s786ms, non-child: 9s937ms, % non-child: 29.41%) ExecOption: Codegen Enabled - BuildTime: 9s171ms - GetNewBlockTime: 547.388us - GetResultsTime: 578.704ms - HTResizeTime: 1s294ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 393.46 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.557us HASH_JOIN_NODE (id=3):(Total: 23s849ms, non-child: 13s035ms, % non-child: 54.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s323ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s617ms - GetNewBlockTime: 686.985us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s262ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.17 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.350us EXCHANGE_NODE (id=11):(Total: 2s907ms, non-child: 587.862ms, % non-child: 20.22%) BytesReceived(1s000ms): 14.21 MB, 80.37 MB, 146.56 MB, 213.86 MB, 250.45 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB, 252.73 MB - BytesReceived: 252.73 MB (265001811) - ConvertRowBatchTime: 287.258ms - DeserializeRowBatchTimer: 1s008ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 4.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s906ms, non-child: 2s869ms, % non-child: 36.29%) BytesReceived(1s000ms): 5.60 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 25.00 MB, 64.75 MB, 103.75 MB, 144.60 MB, 177.88 MB, 208.82 MB, 240.27 MB, 272.68 MB, 310.92 MB, 343.56 MB, 374.77 MB, 405.56 MB, 429.42 MB, 462.50 MB, 495.38 MB, 528.33 MB, 560.35 MB, 593.10 MB, 625.98 MB, 658.29 MB, 695.11 MB, 733.18 MB, 768.19 MB, 798.64 MB, 825.04 MB, 845.66 MB - BytesReceived: 865.37 MB (907408736) - ConvertRowBatchTime: 1s559ms - DeserializeRowBatchTimer: 5s165ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 6.53 M/sec - SendersBlockedTimer: 6s478ms - SendersBlockedTotalTimer(*): 1m17s Instance 2a427b598be90b44:8a531ae61488a9cb (host=vb0220.halxg.cloudera.com:22000):(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 205.87 MB, 482.39 MB, 802.35 MB, 1.13 GB, 1.36 GB, 1.39 GB, 1.44 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.58 GB, 1.57 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.74 GB, 1.95 GB, 763.33 MB, 580.98 MB, 386.48 MB, 191.98 MB, 310.84 MB, 572.82 MB, 966.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.43 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.82 GB, 1.06 GB, 651.78 MB, 459.27 MB, 266.76 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134016208) - PerHostPeakMemUsage: 3.02 GB (3246245568) - PrepareTime: 152.734ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 1m15s - TotalNetworkReceiveTime: 16s299ms - TotalNetworkSendTime: 1s372ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 653.800ms, non-child: 653.800ms, % non-child: 100.00%) - CodegenTime: 3.334ms - CompileTime: 132.965ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 377.249ms - PrepareTime: 141.627ms DataStreamSender (dst_id=14):(Total: 6s265ms, non-child: 6s265ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297606606) - NetworkThroughput(*): 52.81 MB/sec - OverallThroughput: 45.30 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s242ms - ThriftTransmitTime(*): 5s374ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s026ms, % non-child: 5.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 162.539us - GetResultsTime: 137.861ms - HTResizeTime: 132.662ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 356.94 K/sec - StreamingTime: 3s675ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s575ms, % non-child: 6.56%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 380.68 K/sec AGGREGATION_NODE (id=8):(Total: 31s420ms, non-child: 8s903ms, % non-child: 28.34%) ExecOption: Codegen Enabled - BuildTime: 8s160ms - GetNewBlockTime: 947.708us - GetResultsTime: 614.282ms - HTResizeTime: 1s248ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 422.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.482us HASH_JOIN_NODE (id=7):(Total: 22s516ms, non-child: 13s428ms, % non-child: 59.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s759ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s658ms - GetNewBlockTime: 508.610us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s187ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.095us EXCHANGE_NODE (id=13):(Total: 2s218ms, non-child: 834.975ms, % non-child: 37.64%) BytesReceived(2s000ms): 7.60 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 84.66 MB, 218.59 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB, 252.12 MB - BytesReceived: 252.12 MB (264365798) - ConvertRowBatchTime: 438.257ms - DeserializeRowBatchTimer: 1s079ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 6.16 M/sec - SendersBlockedTimer: 41s122ms - SendersBlockedTotalTimer(*): 10m16s EXCHANGE_NODE (id=12):(Total: 6s870ms, non-child: 2s959ms, % non-child: 43.08%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 35.48 MB, 100.68 MB, 180.25 MB, 246.91 MB, 318.28 MB, 387.13 MB, 451.18 MB, 532.13 MB, 617.61 MB, 690.58 MB, 763.67 MB, 827.77 MB - BytesReceived: 864.60 MB (906598790) - ConvertRowBatchTime: 1s377ms - DeserializeRowBatchTimer: 5s508ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 7.51 M/sec - SendersBlockedTimer: 47s422ms - SendersBlockedTotalTimer(*): 11m3s AGGREGATION_NODE (id=4):(Total: 33s787ms, non-child: 8s966ms, % non-child: 26.54%) ExecOption: Codegen Enabled - BuildTime: 8s231ms - GetNewBlockTime: 554.016us - GetResultsTime: 592.855ms - HTResizeTime: 1s241ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 393.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.224us HASH_JOIN_NODE (id=3):(Total: 24s821ms, non-child: 13s774ms, % non-child: 55.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s245ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s731ms - GetNewBlockTime: 750.905us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s995ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.685us EXCHANGE_NODE (id=11):(Total: 3s020ms, non-child: 1s121ms, % non-child: 37.12%) BytesReceived(1s000ms): 5.10 MB, 61.14 MB, 128.58 MB, 195.23 MB, 246.27 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB - BytesReceived: 252.54 MB (264803528) - ConvertRowBatchTime: 261.284ms - DeserializeRowBatchTimer: 1s662ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 4.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s025ms, non-child: 2s496ms, % non-child: 31.11%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 17.02 MB, 54.04 MB, 93.94 MB, 133.56 MB, 168.36 MB, 201.97 MB, 231.32 MB, 263.87 MB, 301.14 MB, 334.72 MB, 366.30 MB, 397.03 MB, 423.11 MB, 453.39 MB, 486.23 MB, 519.23 MB, 551.50 MB, 583.95 MB, 616.79 MB, 648.64 MB, 684.44 MB, 722.21 MB, 758.88 MB, 789.83 MB, 819.64 MB, 836.65 MB, 862.10 MB - BytesReceived: 864.83 MB (906838303) - ConvertRowBatchTime: 1s386ms - DeserializeRowBatchTimer: 4s782ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.43 M/sec - SendersBlockedTimer: 6s609ms - SendersBlockedTotalTimer(*): 1m12s Instance 2a427b598be90b44:8a531ae61488a9d1 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 204.90 MB, 546.42 MB, 834.35 MB, 1.17 GB, 1.36 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.53 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.78 GB, 1.67 GB, 726.88 MB, 568.85 MB, 374.35 MB, 171.51 MB, 311.10 MB, 646.87 MB, 1022.79 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.54 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.86 GB, 1.06 GB, 651.76 MB, 459.25 MB, 242.56 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2133755112) - PerHostPeakMemUsage: 2.98 GB (3197951424) - PrepareTime: 163.687ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 15s438ms - TotalNetworkSendTime: 1s271ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 704.465ms, non-child: 704.465ms, % non-child: 100.00%) - CodegenTime: 4.853ms - CompileTime: 139.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 415.881ms - PrepareTime: 146.443ms DataStreamSender (dst_id=14):(Total: 6s235ms, non-child: 6s235ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297804765) - NetworkThroughput(*): 56.33 MB/sec - OverallThroughput: 45.55 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s266ms - ThriftTransmitTime(*): 5s042ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s093ms, % non-child: 5.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 231.176us - GetResultsTime: 134.599ms - HTResizeTime: 161.288ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 357.99 K/sec - StreamingTime: 3s729ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s348ms, % non-child: 6.25%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 382.22 K/sec AGGREGATION_NODE (id=8):(Total: 31s413ms, non-child: 9s113ms, % non-child: 29.01%) ExecOption: Codegen Enabled - BuildTime: 8s384ms - GetNewBlockTime: 1.054ms - GetResultsTime: 574.770ms - HTResizeTime: 1s187ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 423.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.073us HASH_JOIN_NODE (id=7):(Total: 22s299ms, non-child: 13s539ms, % non-child: 60.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s964ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s632ms - GetNewBlockTime: 482.915us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s096ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.32 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.324us EXCHANGE_NODE (id=13):(Total: 2s035ms, non-child: 1s199ms, % non-child: 58.92%) BytesReceived(2s000ms): 7.68 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 11.08 MB, 101.55 MB, 228.65 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB - BytesReceived: 252.26 MB (264510733) - ConvertRowBatchTime: 453.448ms - DeserializeRowBatchTimer: 1s529ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 6.72 M/sec - SendersBlockedTimer: 41s097ms - SendersBlockedTotalTimer(*): 10m16s EXCHANGE_NODE (id=12):(Total: 6s725ms, non-child: 3s088ms, % non-child: 45.92%) BytesReceived(2s000ms): 7.73 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 42.74 MB, 109.22 MB, 189.31 MB, 255.92 MB, 326.89 MB, 395.22 MB, 461.00 MB, 543.39 MB, 627.21 MB, 699.49 MB, 772.80 MB, 834.23 MB - BytesReceived: 865.09 MB (907116465) - ConvertRowBatchTime: 1s568ms - DeserializeRowBatchTimer: 5s396ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 7.68 M/sec - SendersBlockedTimer: 47s373ms - SendersBlockedTotalTimer(*): 10m56s AGGREGATION_NODE (id=4):(Total: 33s787ms, non-child: 9s699ms, % non-child: 28.71%) ExecOption: Codegen Enabled - BuildTime: 8s903ms - GetNewBlockTime: 2.341ms - GetResultsTime: 636.259ms - HTResizeTime: 1s184ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 393.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.389us HASH_JOIN_NODE (id=3):(Total: 24s088ms, non-child: 13s230ms, % non-child: 54.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s183ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s613ms - GetNewBlockTime: 739.399us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s586ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.161us EXCHANGE_NODE (id=11):(Total: 3s027ms, non-child: 1s144ms, % non-child: 37.81%) BytesReceived(1s000ms): 12.74 MB, 77.95 MB, 144.22 MB, 211.50 MB, 250.13 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB - BytesReceived: 252.68 MB (264957834) - ConvertRowBatchTime: 252.556ms - DeserializeRowBatchTimer: 1s711ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 4.51 M/sec - SendersBlockedTimer: 31.488ms - SendersBlockedTotalTimer(*): 419.972ms EXCHANGE_NODE (id=10):(Total: 7s830ms, non-child: 2s997ms, % non-child: 38.28%) BytesReceived(1s000ms): 5.20 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 23.85 MB, 63.62 MB, 102.98 MB, 143.53 MB, 176.79 MB, 208.30 MB, 239.36 MB, 271.74 MB, 309.95 MB, 342.49 MB, 373.74 MB, 404.56 MB, 428.33 MB, 461.47 MB, 494.25 MB, 527.24 MB, 559.26 MB, 591.97 MB, 624.82 MB, 657.01 MB, 693.96 MB, 731.66 MB, 767.21 MB, 797.57 MB, 824.40 MB, 844.45 MB - BytesReceived: 865.33 MB (907363728) - ConvertRowBatchTime: 1s512ms - DeserializeRowBatchTimer: 5s687ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 6.59 M/sec - SendersBlockedTimer: 6s509ms - SendersBlockedTotalTimer(*): 1m37s Instance 2a427b598be90b44:8a531ae61488a9cc (host=vb0206.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.24 MB, 514.38 MB, 810.33 MB, 1.15 GB, 1.36 GB, 1.42 GB, 1.45 GB, 1.48 GB, 1.48 GB, 1.53 GB, 1.60 GB, 1.60 GB, 1.70 GB, 1.73 GB, 1.73 GB, 1.75 GB, 1.68 GB, 714.70 MB, 471.57 MB, 192.50 MB, 182.82 MB, 315.34 MB, 639.31 MB, 998.78 MB, 1.24 GB, 1.33 GB, 1.37 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.85 GB, 1.06 GB, 651.76 MB, 435.20 MB, 218.52 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2140415704) - PerHostPeakMemUsage: 3.05 GB (3271422744) - PrepareTime: 163.888ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 15s253ms - TotalNetworkSendTime: 1s054ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 677.979ms, non-child: 677.979ms, % non-child: 100.00%) - CodegenTime: 7.188ms - CompileTime: 130.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 401.345ms - PrepareTime: 144.778ms DataStreamSender (dst_id=14):(Total: 5s691ms, non-child: 5s691ms, % non-child: 100.00%) - BytesSent: 284.12 MB (297916837) - NetworkThroughput(*): 66.75 MB/sec - OverallThroughput: 49.92 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s171ms - ThriftTransmitTime(*): 4s256ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 3s949ms, % non-child: 5.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 918.825us - GetResultsTime: 137.738ms - HTResizeTime: 126.430ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278192) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 355.52 K/sec - StreamingTime: 3s596ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 3s163ms, % non-child: 4.50%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 378.65 K/sec AGGREGATION_NODE (id=8):(Total: 33s368ms, non-child: 8s792ms, % non-child: 26.35%) ExecOption: Codegen Enabled - BuildTime: 8s039ms - GetNewBlockTime: 516.241us - GetResultsTime: 624.778ms - HTResizeTime: 1s052ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 398.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.279us HASH_JOIN_NODE (id=7):(Total: 24s575ms, non-child: 13s655ms, % non-child: 55.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s027ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s661ms - GetNewBlockTime: 526.562us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s131ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.361us EXCHANGE_NODE (id=13):(Total: 3s888ms, non-child: 1s236ms, % non-child: 31.79%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 10.20 MB, 94.85 MB, 224.90 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB, 252.38 MB - BytesReceived: 252.38 MB (264643039) - ConvertRowBatchTime: 453.630ms - DeserializeRowBatchTimer: 1s537ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 3.52 M/sec - SendersBlockedTimer: 39s179ms - SendersBlockedTotalTimer(*): 9m8s EXCHANGE_NODE (id=12):(Total: 7s032ms, non-child: 2s697ms, % non-child: 38.36%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 39.01 MB, 105.68 MB, 185.69 MB, 252.54 MB, 323.73 MB, 392.89 MB, 457.82 MB, 539.02 MB, 623.57 MB, 696.25 MB, 769.70 MB, 831.69 MB - BytesReceived: 865.30 MB (907337989) - ConvertRowBatchTime: 1s428ms - DeserializeRowBatchTimer: 4s847ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 7.34 M/sec - SendersBlockedTimer: 47s419ms - SendersBlockedTotalTimer(*): 11m10s AGGREGATION_NODE (id=4):(Total: 33s699ms, non-child: 9s656ms, % non-child: 28.65%) ExecOption: Codegen Enabled - BuildTime: 8s960ms - GetNewBlockTime: 478.956us - GetResultsTime: 520.374ms - HTResizeTime: 1s160ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 394.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.228us HASH_JOIN_NODE (id=3):(Total: 24s043ms, non-child: 15s447ms, % non-child: 64.25%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s126ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s675ms - GetNewBlockTime: 680.696us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 11s781ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.840us EXCHANGE_NODE (id=11):(Total: 3s105ms, non-child: 1s131ms, % non-child: 36.44%) BytesReceived(1s000ms): 9.46 MB, 71.36 MB, 138.14 MB, 205.35 MB, 249.01 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB, 252.81 MB - BytesReceived: 252.81 MB (265088004) - ConvertRowBatchTime: 248.428ms - DeserializeRowBatchTimer: 1s702ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 4.40 M/sec - SendersBlockedTimer: 6.635ms - SendersBlockedTotalTimer(*): 73.641ms EXCHANGE_NODE (id=10):(Total: 5s489ms, non-child: 4s675ms, % non-child: 85.17%) BytesReceived(1s000ms): 5.07 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 20.42 MB, 59.77 MB, 99.49 MB, 140.26 MB, 172.97 MB, 206.20 MB, 236.09 MB, 268.48 MB, 306.74 MB, 339.57 MB, 371.10 MB, 401.84 MB, 426.28 MB, 458.52 MB, 491.31 MB, 524.30 MB, 556.43 MB, 588.98 MB, 621.81 MB, 653.72 MB, 690.43 MB, 728.27 MB, 764.45 MB, 794.85 MB, 822.78 MB, 841.61 MB - BytesReceived: 865.52 MB (907560618) - ConvertRowBatchTime: 1s709ms - DeserializeRowBatchTimer: 5s320ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 9.41 M/sec - SendersBlockedTimer: 28s320ms - SendersBlockedTotalTimer(*): 6m10s Instance 2a427b598be90b44:8a531ae61488a9d2 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 216.24 MB, 501.56 MB, 802.34 MB, 1.14 GB, 1.36 GB, 1.39 GB, 1.44 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.75 GB, 1.95 GB, 726.85 MB, 471.58 MB, 216.30 MB, 182.80 MB, 311.11 MB, 590.88 MB, 958.78 MB, 1.23 GB, 1.35 GB, 1.37 GB, 1.41 GB, 1.41 GB, 1.43 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.83 GB, 1.06 GB, 663.80 MB, 495.23 MB, 278.81 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2133715808) - PerHostPeakMemUsage: 3.06 GB (3286580264) - PrepareTime: 152.908ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 15s794ms - TotalNetworkSendTime: 961.765ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 665.882ms, non-child: 665.882ms, % non-child: 100.00%) - CodegenTime: 3.062ms - CompileTime: 138.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 384.088ms - PrepareTime: 142.350ms DataStreamSender (dst_id=14):(Total: 5s228ms, non-child: 5s228ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297740965) - NetworkThroughput(*): 73.29 MB/sec - OverallThroughput: 54.30 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s984ms - ThriftTransmitTime(*): 3s874ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 3s741ms, % non-child: 5.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.212ms - GetResultsTime: 90.398ms - HTResizeTime: 158.272ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 353.76 K/sec - StreamingTime: 3s446ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 3s731ms, % non-child: 5.27%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 375.57 K/sec AGGREGATION_NODE (id=8):(Total: 33s363ms, non-child: 9s542ms, % non-child: 28.60%) ExecOption: Codegen Enabled - BuildTime: 8s744ms - GetNewBlockTime: 592.532us - GetResultsTime: 621.961ms - HTResizeTime: 1s297ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 398.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 874.000ns HASH_JOIN_NODE (id=7):(Total: 23s821ms, non-child: 13s578ms, % non-child: 57.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s512ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s852ms - GetNewBlockTime: 519.910us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s340ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.17 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.913us EXCHANGE_NODE (id=13):(Total: 4s361ms, non-child: 1s183ms, % non-child: 27.14%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.15 MB, 85.77 MB, 219.38 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB - BytesReceived: 252.23 MB (264477258) - ConvertRowBatchTime: 320.221ms - DeserializeRowBatchTimer: 1s648ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 3.13 M/sec - SendersBlockedTimer: 39s232ms - SendersBlockedTotalTimer(*): 9m9s EXCHANGE_NODE (id=12):(Total: 5s881ms, non-child: 3s251ms, % non-child: 55.29%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 35.72 MB, 101.16 MB, 180.75 MB, 247.42 MB, 318.75 MB, 387.78 MB, 451.89 MB, 532.77 MB, 618.19 MB, 691.24 MB, 764.35 MB, 828.19 MB - BytesReceived: 864.69 MB (906696278) - ConvertRowBatchTime: 1s469ms - DeserializeRowBatchTimer: 5s103ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 8.78 M/sec - SendersBlockedTimer: 51s373ms - SendersBlockedTotalTimer(*): 11m49s AGGREGATION_NODE (id=4):(Total: 33s667ms, non-child: 9s621ms, % non-child: 28.58%) ExecOption: Codegen Enabled - BuildTime: 8s990ms - GetNewBlockTime: 621.766us - GetResultsTime: 480.416ms - HTResizeTime: 1s235ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 394.69 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.464us HASH_JOIN_NODE (id=3):(Total: 24s046ms, non-child: 14s358ms, % non-child: 59.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s114ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s675ms - GetNewBlockTime: 977.520us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s712ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.817us EXCHANGE_NODE (id=11):(Total: 2s116ms, non-child: 1s352ms, % non-child: 63.91%) BytesReceived(1s000ms): 5.23 MB, 62.29 MB, 129.65 MB, 196.37 MB, 246.70 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB - BytesReceived: 252.64 MB (264917166) - ConvertRowBatchTime: 458.325ms - DeserializeRowBatchTimer: 1s600ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 6.46 M/sec - SendersBlockedTimer: 987.545ms - SendersBlockedTotalTimer(*): 7s252ms EXCHANGE_NODE (id=10):(Total: 7s571ms, non-child: 3s067ms, % non-child: 40.51%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 17.37 MB, 54.64 MB, 94.52 MB, 134.22 MB, 168.77 MB, 202.47 MB, 231.86 MB, 264.49 MB, 301.83 MB, 335.22 MB, 366.81 MB, 397.56 MB, 423.53 MB, 454.00 MB, 486.83 MB, 519.82 MB, 552.18 MB, 584.66 MB, 617.44 MB, 649.21 MB, 685.26 MB, 722.96 MB, 759.62 MB, 790.41 MB, 820.06 MB, 837.06 MB, 862.40 MB - BytesReceived: 864.92 MB (906933104) - ConvertRowBatchTime: 1s471ms - DeserializeRowBatchTimer: 5s846ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 6.82 M/sec - SendersBlockedTimer: 6s571ms - SendersBlockedTotalTimer(*): 1m12s Instance 2a427b598be90b44:8a531ae61488a9d4 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.79 MB, 546.36 MB, 818.31 MB, 1.15 GB, 1.38 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.53 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.79 GB, 1.67 GB, 726.83 MB, 532.33 MB, 289.21 MB, 163.06 MB, 310.82 MB, 638.81 MB, 1022.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.86 GB, 1.06 GB, 615.68 MB, 411.15 MB, 204.37 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134395440) - PerHostPeakMemUsage: 3.06 GB (3285919576) - PrepareTime: 147.042ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 16s513ms - TotalNetworkSendTime: 1s229ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 697.416ms, non-child: 697.416ms, % non-child: 100.00%) - CodegenTime: 2.663ms - CompileTime: 148.058ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 409.857ms - PrepareTime: 138.535ms DataStreamSender (dst_id=14):(Total: 6s032ms, non-child: 6s032ms, % non-child: 100.00%) - BytesSent: 283.87 MB (297663003) - NetworkThroughput(*): 58.27 MB/sec - OverallThroughput: 47.05 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s234ms - ThriftTransmitTime(*): 4s871ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 4s103ms, % non-child: 5.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 190.678us - GetResultsTime: 141.096ms - HTResizeTime: 158.673ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255946) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 358.10 K/sec - StreamingTime: 3s749ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 3s657ms, % non-child: 5.26%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 382.41 K/sec AGGREGATION_NODE (id=8):(Total: 32s086ms, non-child: 9s099ms, % non-child: 28.36%) ExecOption: Codegen Enabled - BuildTime: 8s403ms - GetNewBlockTime: 486.201us - GetResultsTime: 576.404ms - HTResizeTime: 1s239ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 414.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.159us HASH_JOIN_NODE (id=7):(Total: 22s986ms, non-child: 13s116ms, % non-child: 57.06%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s476ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s565ms - GetNewBlockTime: 431.606us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s302ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.934us EXCHANGE_NODE (id=13):(Total: 3s217ms, non-child: 668.731ms, % non-child: 20.78%) BytesReceived(2s000ms): 7.65 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.89 MB, 100.80 MB, 228.17 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB, 252.15 MB - BytesReceived: 252.15 MB (264395978) - ConvertRowBatchTime: 346.692ms - DeserializeRowBatchTimer: 980.130ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 4.25 M/sec - SendersBlockedTimer: 40s412ms - SendersBlockedTotalTimer(*): 9m26s EXCHANGE_NODE (id=12):(Total: 6s652ms, non-child: 3s005ms, % non-child: 45.18%) BytesReceived(2s000ms): 7.67 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 42.36 MB, 108.70 MB, 188.68 MB, 255.28 MB, 326.18 MB, 394.54 MB, 460.17 MB, 542.41 MB, 626.20 MB, 698.60 MB, 771.92 MB, 833.49 MB - BytesReceived: 864.72 MB (906729592) - ConvertRowBatchTime: 1s507ms - DeserializeRowBatchTimer: 5s157ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 7.76 M/sec - SendersBlockedTimer: 47s282ms - SendersBlockedTotalTimer(*): 10m7s AGGREGATION_NODE (id=4):(Total: 33s736ms, non-child: 9s846ms, % non-child: 29.19%) ExecOption: Codegen Enabled - BuildTime: 9s119ms - GetNewBlockTime: 519.648us - GetResultsTime: 581.421ms - HTResizeTime: 1s316ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 393.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.207us HASH_JOIN_NODE (id=3):(Total: 23s890ms, non-child: 13s259ms, % non-child: 55.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s134ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s772ms - GetNewBlockTime: 1.337ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s529ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.16 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.412us EXCHANGE_NODE (id=11):(Total: 3s095ms, non-child: 1s155ms, % non-child: 37.32%) BytesReceived(1s000ms): 12.37 MB, 77.20 MB, 143.56 MB, 210.77 MB, 249.92 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB, 252.56 MB - BytesReceived: 252.56 MB (264830859) - ConvertRowBatchTime: 241.295ms - DeserializeRowBatchTimer: 1s730ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 4.41 M/sec - SendersBlockedTimer: 13.504ms - SendersBlockedTotalTimer(*): 166.015ms EXCHANGE_NODE (id=10):(Total: 7s535ms, non-child: 2s879ms, % non-child: 38.22%) BytesReceived(1s000ms): 5.12 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 23.34 MB, 63.11 MB, 102.63 MB, 143.10 MB, 176.21 MB, 207.78 MB, 238.79 MB, 271.22 MB, 309.46 MB, 342.07 MB, 373.42 MB, 404.22 MB, 427.80 MB, 461.09 MB, 493.98 MB, 526.96 MB, 559.02 MB, 591.62 MB, 624.43 MB, 656.58 MB, 693.50 MB, 731.14 MB, 766.63 MB, 796.92 MB, 823.72 MB, 843.71 MB - BytesReceived: 864.96 MB (906973818) - ConvertRowBatchTime: 1s493ms - DeserializeRowBatchTimer: 4s752ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 6.85 M/sec - SendersBlockedTimer: 9s266ms - SendersBlockedTotalTimer(*): 1m44s Instance 2a427b598be90b44:8a531ae61488a9d5 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.77 MB, 482.45 MB, 802.34 MB, 1.14 GB, 1.36 GB, 1.39 GB, 1.44 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.57 GB, 1.57 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.75 GB, 1.95 GB, 775.48 MB, 580.97 MB, 386.49 MB, 179.83 MB, 311.07 MB, 598.83 MB, 966.76 MB, 1.24 GB, 1.33 GB, 1.37 GB, 1.44 GB, 1.44 GB, 1.44 GB, 1.56 GB, 1.56 GB, 1.65 GB, 1.69 GB, 1.69 GB, 1.81 GB, 1.06 GB, 651.77 MB, 435.21 MB, 204.36 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135551760) - PerHostPeakMemUsage: 3.07 GB (3299130968) - PrepareTime: 170.265ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 13s786ms - TotalNetworkSendTime: 1s234ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 644.555ms, non-child: 644.555ms, % non-child: 100.00%) - CodegenTime: 4.734ms - CompileTime: 97.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 387.331ms - PrepareTime: 158.394ms DataStreamSender (dst_id=14):(Total: 5s922ms, non-child: 5s922ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297739803) - NetworkThroughput(*): 59.53 MB/sec - OverallThroughput: 47.94 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s119ms - ThriftTransmitTime(*): 4s769ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 3s937ms, % non-child: 5.34%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 246.204us - GetResultsTime: 144.518ms - HTResizeTime: 160.867ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 357.74 K/sec - StreamingTime: 3s557ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s482ms, % non-child: 6.43%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 381.09 K/sec AGGREGATION_NODE (id=8):(Total: 31s417ms, non-child: 9s840ms, % non-child: 31.32%) ExecOption: Codegen Enabled - BuildTime: 9s124ms - GetNewBlockTime: 625.364us - GetResultsTime: 533.970ms - HTResizeTime: 1s252ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 422.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.793us HASH_JOIN_NODE (id=7):(Total: 21s577ms, non-child: 13s189ms, % non-child: 61.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s386ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s619ms - GetNewBlockTime: 521.162us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s347ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.39 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.381us EXCHANGE_NODE (id=13):(Total: 2s655ms, non-child: 1s149ms, % non-child: 43.29%) BytesReceived(2s000ms): 7.60 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 86.47 MB, 219.84 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB - BytesReceived: 252.22 MB (264475258) - ConvertRowBatchTime: 280.808ms - DeserializeRowBatchTimer: 1s662ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 41s070ms - SendersBlockedTotalTimer(*): 9m36s EXCHANGE_NODE (id=12):(Total: 5s732ms, non-child: 4s634ms, % non-child: 80.84%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 36.05 MB, 101.89 MB, 181.53 MB, 248.21 MB, 319.50 MB, 388.72 MB, 452.73 MB, 533.47 MB, 618.71 MB, 691.69 MB, 764.87 MB, 828.52 MB - BytesReceived: 864.91 MB (906927601) - ConvertRowBatchTime: 1s619ms - DeserializeRowBatchTimer: 5s416ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 9.00 M/sec - SendersBlockedTimer: 1m5s - SendersBlockedTotalTimer(*): 13m45s AGGREGATION_NODE (id=4):(Total: 33s841ms, non-child: 9s321ms, % non-child: 27.55%) ExecOption: Codegen Enabled - BuildTime: 8s553ms - GetNewBlockTime: 481.910us - GetResultsTime: 612.707ms - HTResizeTime: 1s222ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 392.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.058us HASH_JOIN_NODE (id=3):(Total: 24s520ms, non-child: 14s834ms, % non-child: 60.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s097ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s710ms - GetNewBlockTime: 986.914us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s176ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.017us EXCHANGE_NODE (id=11):(Total: 2s159ms, non-child: 1s196ms, % non-child: 55.44%) BytesReceived(1s000ms): 5.52 MB, 62.99 MB, 130.32 MB, 197.12 MB, 246.92 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB - BytesReceived: 252.64 MB (264913670) - ConvertRowBatchTime: 465.298ms - DeserializeRowBatchTimer: 1s519ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 6.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s526ms, non-child: 2s949ms, % non-child: 39.19%) BytesReceived(1s000ms): 5.03 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 17.58 MB, 55.10 MB, 95.07 MB, 134.97 MB, 169.31 MB, 202.99 MB, 232.36 MB, 265.02 MB, 302.51 MB, 335.83 MB, 367.44 MB, 398.17 MB, 424.10 MB, 454.60 MB, 487.38 MB, 520.34 MB, 552.64 MB, 585.18 MB, 618.05 MB, 649.76 MB, 685.83 MB, 723.63 MB, 760.27 MB, 791.02 MB, 820.42 MB, 837.52 MB, 862.72 MB - BytesReceived: 865.12 MB (907144453) - ConvertRowBatchTime: 1s473ms - DeserializeRowBatchTimer: 5s647ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 6.86 M/sec - SendersBlockedTimer: 6s599ms - SendersBlockedTotalTimer(*): 46s401ms Instance 2a427b598be90b44:8a531ae61488a9ca (host=vb0224.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.26 MB, 482.41 MB, 794.34 MB, 1.13 GB, 1.36 GB, 1.39 GB, 1.44 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.75 GB, 1.95 GB, 739.00 MB, 544.51 MB, 277.07 MB, 166.86 MB, 310.84 MB, 598.80 MB, 982.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.43 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.83 GB, 1.06 GB, 615.67 MB, 423.17 MB, 216.41 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134081104) - PerHostPeakMemUsage: 3.07 GB (3294777432) - PrepareTime: 164.433ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 1m14s - TotalNetworkReceiveTime: 18s793ms - TotalNetworkSendTime: 870.429ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 626.916ms, non-child: 626.916ms, % non-child: 100.00%) - CodegenTime: 3.811ms - CompileTime: 117.751ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 364.309ms - PrepareTime: 142.005ms DataStreamSender (dst_id=14):(Total: 5s094ms, non-child: 5s094ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297802648) - NetworkThroughput(*): 73.20 MB/sec - OverallThroughput: 55.75 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s933ms - ThriftTransmitTime(*): 3s880ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 1m14s, non-child: 3s735ms, % non-child: 5.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 208.299us - GetResultsTime: 121.813ms - HTResizeTime: 157.880ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 353.96 K/sec - StreamingTime: 3s400ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 4s215ms, % non-child: 5.96%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 375.75 K/sec AGGREGATION_NODE (id=8):(Total: 32s779ms, non-child: 9s022ms, % non-child: 27.52%) ExecOption: Codegen Enabled - BuildTime: 8s312ms - GetNewBlockTime: 3.919ms - GetResultsTime: 576.756ms - HTResizeTime: 1s218ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 405.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.572us HASH_JOIN_NODE (id=7):(Total: 23s756ms, non-child: 12s739ms, % non-child: 53.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s326ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s615ms - GetNewBlockTime: 445.497us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s992ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.17 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.335us EXCHANGE_NODE (id=13):(Total: 4s042ms, non-child: 518.110ms, % non-child: 12.82%) BytesReceived(2s000ms): 7.61 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.17 MB, 87.77 MB, 220.66 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB, 252.22 MB - BytesReceived: 252.22 MB (264476512) - ConvertRowBatchTime: 246.831ms - DeserializeRowBatchTimer: 941.866ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 3.38 M/sec - SendersBlockedTimer: 39s734ms - SendersBlockedTotalTimer(*): 9m55s EXCHANGE_NODE (id=12):(Total: 6s975ms, non-child: 2s781ms, % non-child: 39.87%) BytesReceived(2s000ms): 7.57 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 36.32 MB, 102.38 MB, 182.00 MB, 248.60 MB, 319.91 MB, 389.02 MB, 453.24 MB, 534.18 MB, 619.43 MB, 692.50 MB, 765.72 MB, 829.10 MB - BytesReceived: 865.12 MB (907148430) - ConvertRowBatchTime: 1s478ms - DeserializeRowBatchTimer: 4s841ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 7.40 M/sec - SendersBlockedTimer: 47s339ms - SendersBlockedTotalTimer(*): 8m45s AGGREGATION_NODE (id=4):(Total: 33s748ms, non-child: 9s177ms, % non-child: 27.19%) ExecOption: Codegen Enabled - BuildTime: 8s505ms - GetNewBlockTime: 534.848us - GetResultsTime: 531.879ms - HTResizeTime: 1s246ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 393.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 909.000ns HASH_JOIN_NODE (id=3):(Total: 24s570ms, non-child: 13s003ms, % non-child: 52.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s237ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s774ms - GetNewBlockTime: 755.603us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s161ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.798us EXCHANGE_NODE (id=11):(Total: 3s044ms, non-child: 1s076ms, % non-child: 35.36%) BytesReceived(1s000ms): 6.10 MB, 64.26 MB, 131.44 MB, 198.37 MB, 247.24 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB - BytesReceived: 252.65 MB (264924413) - ConvertRowBatchTime: 251.865ms - DeserializeRowBatchTimer: 1s656ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s523ms, non-child: 2s736ms, % non-child: 32.10%) BytesReceived(1s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 18.01 MB, 55.96 MB, 95.75 MB, 135.82 MB, 169.98 MB, 203.65 MB, 232.99 MB, 265.48 MB, 303.34 MB, 336.37 MB, 367.95 MB, 398.67 MB, 424.43 MB, 455.27 MB, 488.08 MB, 521.05 MB, 553.33 MB, 585.80 MB, 618.68 MB, 650.42 MB, 686.61 MB, 724.38 MB, 761.06 MB, 791.65 MB, 820.88 MB, 838.27 MB, 863.13 MB - BytesReceived: 865.32 MB (907356486) - ConvertRowBatchTime: 1s439ms - DeserializeRowBatchTimer: 5s167ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 6s668ms - SendersBlockedTotalTimer(*): 1m33s Instance 2a427b598be90b44:8a531ae61488a9d3 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 204.18 MB, 546.36 MB, 826.34 MB, 1.15 GB, 1.36 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.52 GB, 1.58 GB, 1.58 GB, 1.67 GB, 1.70 GB, 1.70 GB, 1.78 GB, 1.67 GB, 726.86 MB, 532.35 MB, 337.85 MB, 161.15 MB, 311.44 MB, 639.22 MB, 1006.76 MB, 1.24 GB, 1.33 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.45 GB, 1.53 GB, 1.54 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.85 GB, 1.05 GB, 579.57 MB, 363.01 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135214752) - PerHostPeakMemUsage: 2.97 GB (3193899920) - PrepareTime: 153.119ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 14s944ms - TotalNetworkSendTime: 1s080ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 678.759ms, non-child: 678.759ms, % non-child: 100.00%) - CodegenTime: 4.673ms - CompileTime: 127.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 409.621ms - PrepareTime: 140.202ms DataStreamSender (dst_id=14):(Total: 5s377ms, non-child: 5s377ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297773682) - NetworkThroughput(*): 64.68 MB/sec - OverallThroughput: 52.81 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s993ms - ThriftTransmitTime(*): 4s390ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 1m13s, non-child: 3s775ms, % non-child: 5.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.113ms - GetResultsTime: 107.518ms - HTResizeTime: 163.887ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 358.93 K/sec - StreamingTime: 3s462ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 4s110ms, % non-child: 5.90%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 381.54 K/sec AGGREGATION_NODE (id=8):(Total: 31s778ms, non-child: 8s799ms, % non-child: 27.69%) ExecOption: Codegen Enabled - BuildTime: 8s159ms - GetNewBlockTime: 889.696us - GetResultsTime: 531.784ms - HTResizeTime: 1s265ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 418.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.153us HASH_JOIN_NODE (id=7):(Total: 22s979ms, non-child: 14s231ms, % non-child: 61.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s020ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s666ms - GetNewBlockTime: 592.824us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s710ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.246us EXCHANGE_NODE (id=13):(Total: 2s382ms, non-child: 1s255ms, % non-child: 52.70%) BytesReceived(2s000ms): 7.61 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 96.66 MB, 225.88 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB, 252.26 MB - BytesReceived: 252.26 MB (264512802) - ConvertRowBatchTime: 463.746ms - DeserializeRowBatchTimer: 1s529ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 5.74 M/sec - SendersBlockedTimer: 40s692ms - SendersBlockedTotalTimer(*): 10m10s EXCHANGE_NODE (id=12):(Total: 6s365ms, non-child: 3s245ms, % non-child: 50.98%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 40.09 MB, 106.55 MB, 186.70 MB, 253.46 MB, 324.51 MB, 393.37 MB, 458.63 MB, 540.11 MB, 624.61 MB, 697.02 MB, 770.32 MB, 832.09 MB - BytesReceived: 864.97 MB (906985669) - ConvertRowBatchTime: 1s364ms - DeserializeRowBatchTimer: 6s097ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 8.11 M/sec - SendersBlockedTimer: 47s424ms - SendersBlockedTotalTimer(*): 11m51s AGGREGATION_NODE (id=4):(Total: 33s778ms, non-child: 9s666ms, % non-child: 28.62%) ExecOption: Codegen Enabled - BuildTime: 8s931ms - GetNewBlockTime: 659.040us - GetResultsTime: 586.780ms - HTResizeTime: 1s303ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 393.46 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.219us HASH_JOIN_NODE (id=3):(Total: 24s112ms, non-child: 13s800ms, % non-child: 57.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s384ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s619ms - GetNewBlockTime: 823.750us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s958ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.714us EXCHANGE_NODE (id=11):(Total: 2s850ms, non-child: 589.448ms, % non-child: 20.68%) BytesReceived(1s000ms): 10.33 MB, 73.18 MB, 139.74 MB, 207.02 MB, 249.26 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB, 252.68 MB - BytesReceived: 252.68 MB (264952597) - ConvertRowBatchTime: 298.092ms - DeserializeRowBatchTimer: 943.310ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 4.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s461ms, non-child: 3s094ms, % non-child: 41.47%) BytesReceived(1s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 21.37 MB, 60.85 MB, 100.47 MB, 141.32 MB, 173.90 MB, 206.79 MB, 236.96 MB, 269.32 MB, 307.57 MB, 340.29 MB, 371.67 MB, 402.47 MB, 426.66 MB, 459.26 MB, 492.11 MB, 525.04 MB, 557.06 MB, 589.70 MB, 622.54 MB, 654.37 MB, 691.27 MB, 728.89 MB, 764.88 MB, 795.20 MB, 822.92 MB, 842.17 MB - BytesReceived: 865.20 MB (907224868) - ConvertRowBatchTime: 1s581ms - DeserializeRowBatchTimer: 5s564ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 6.92 M/sec - SendersBlockedTimer: 6s500ms - SendersBlockedTotalTimer(*): 1m30s Instance 2a427b598be90b44:8a531ae61488a9d0 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m18s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 151.28 MB, 482.46 MB, 754.33 MB, 1.12 GB, 1.32 GB, 1.39 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.51 GB, 1.58 GB, 1.58 GB, 1.66 GB, 1.70 GB, 1.70 GB, 1.73 GB, 1.95 GB, 775.49 MB, 580.97 MB, 386.48 MB, 191.98 MB, 278.81 MB, 566.88 MB, 918.76 MB, 1.21 GB, 1.32 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.54 GB, 1.54 GB, 1.63 GB, 1.66 GB, 1.66 GB, 1.81 GB, 1.34 GB, 639.75 MB, 387.08 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135127608) - PerHostPeakMemUsage: 3.03 GB (3252430024) - PrepareTime: 161.532ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 14s339ms - TotalNetworkSendTime: 1s015ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 613.159ms, non-child: 613.159ms, % non-child: 100.00%) - CodegenTime: 8.196ms - CompileTime: 106.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 361.341ms - PrepareTime: 142.345ms DataStreamSender (dst_id=14):(Total: 5s435ms, non-child: 5s435ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297749354) - NetworkThroughput(*): 65.02 MB/sec - OverallThroughput: 52.24 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s009ms - ThriftTransmitTime(*): 4s367ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 1m12s, non-child: 3s726ms, % non-child: 5.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 201.320us - GetResultsTime: 120.548ms - HTResizeTime: 158.482ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 361.24 K/sec - StreamingTime: 3s398ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m9s, non-child: 3s820ms, % non-child: 5.52%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 383.86 K/sec AGGREGATION_NODE (id=8):(Total: 31s522ms, non-child: 9s158ms, % non-child: 29.05%) ExecOption: Codegen Enabled - BuildTime: 8s541ms - GetNewBlockTime: 997.370us - GetResultsTime: 474.501ms - HTResizeTime: 1s258ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 421.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.891us HASH_JOIN_NODE (id=7):(Total: 22s364ms, non-child: 13s201ms, % non-child: 59.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s774ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s689ms - GetNewBlockTime: 869.729us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s924ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.31 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.438us EXCHANGE_NODE (id=13):(Total: 2s439ms, non-child: 809.138ms, % non-child: 33.17%) BytesReceived(2s000ms): 7.99 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 12.07 MB, 105.97 MB, 231.10 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB, 252.23 MB - BytesReceived: 252.23 MB (264481943) - ConvertRowBatchTime: 429.107ms - DeserializeRowBatchTimer: 1s075ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 5.60 M/sec - SendersBlockedTimer: 40s888ms - SendersBlockedTotalTimer(*): 9m33s EXCHANGE_NODE (id=12):(Total: 6s723ms, non-child: 3s042ms, % non-child: 45.25%) BytesReceived(2s000ms): 8.07 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.12 MB, 10.12 MB, 10.12 MB, 44.91 MB, 111.74 MB, 190.89 MB, 258.00 MB, 328.80 MB, 396.71 MB, 463.02 MB, 545.81 MB, 629.49 MB, 701.36 MB, 774.83 MB, 835.65 MB - BytesReceived: 864.71 MB (906715426) - ConvertRowBatchTime: 1s365ms - DeserializeRowBatchTimer: 5s633ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 7.68 M/sec - SendersBlockedTimer: 47s439ms - SendersBlockedTotalTimer(*): 9m35s AGGREGATION_NODE (id=4):(Total: 33s893ms, non-child: 9s501ms, % non-child: 28.03%) ExecOption: Codegen Enabled - BuildTime: 8s719ms - GetNewBlockTime: 1.114ms - GetResultsTime: 628.884ms - HTResizeTime: 1s240ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 392.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.196us HASH_JOIN_NODE (id=3):(Total: 24s392ms, non-child: 14s877ms, % non-child: 60.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s133ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s642ms - GetNewBlockTime: 1.059ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s253ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.636us EXCHANGE_NODE (id=11):(Total: 2s145ms, non-child: 1s198ms, % non-child: 55.87%) BytesReceived(1s000ms): 15.40 MB, 82.05 MB, 148.16 MB, 215.40 MB, 250.55 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB, 252.65 MB - BytesReceived: 252.65 MB (264922568) - ConvertRowBatchTime: 477.326ms - DeserializeRowBatchTimer: 1s511ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 6.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s369ms, non-child: 2s959ms, % non-child: 40.16%) BytesReceived(1s000ms): 5.91 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 25.86 MB, 66.05 MB, 104.42 MB, 145.39 MB, 178.71 MB, 209.54 MB, 241.17 MB, 273.81 MB, 311.64 MB, 344.28 MB, 375.42 MB, 406.22 MB, 430.07 MB, 463.21 MB, 496.10 MB, 529.02 MB, 561.02 MB, 593.76 MB, 626.53 MB, 658.86 MB, 695.62 MB, 733.85 MB, 768.76 MB, 799.08 MB, 825.04 MB, 846.11 MB - BytesReceived: 864.92 MB (906938396) - ConvertRowBatchTime: 1s640ms - DeserializeRowBatchTimer: 5s064ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 6s507ms - SendersBlockedTotalTimer(*): 1m18s Fragment F04: Instance 2a427b598be90b44:8a531ae61488a9de (host=vb0220.halxg.cloudera.com:22000):(Total: 45s529ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(1s000ms): 100.95 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.83 MB, 201.80 MB, 170.12 MB, 125.06 MB, 63.21 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 4 - AverageThreadTokens: 6.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.24 MB (212067040) - PerHostPeakMemUsage: 2.49 GB (2677500656) - PrepareTime: 141.495ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 4m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s252ms - TotalStorageWaitTime: 108.514ms CodeGen:(Total: 377.395ms, non-child: 377.395ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 232.889ms - PrepareTime: 139.225ms DataStreamSender (dst_id=13):(Total: 45s267ms, non-child: 45s267ms, % non-child: 100.00%) - BytesSent: 275.87 MB (289274438) - NetworkThroughput(*): 492.13 KB/sec - OverallThroughput: 6.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s286ms - ThriftTransmitTime(*): 9m34s - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=6):(Total: 381.892ms, non-child: 381.892ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 86.74 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.92 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 753.002ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.86 MB (211665632) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 39.18 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.23K (2233) - ScannerThreadsTotalWallClockTime: 4m30s - MaterializeTupleTime(*): 4m29s - ScannerThreadsSysTime: 168.971ms - ScannerThreadsUserTime: 5s542ms - ScannerThreadsVoluntaryContextSwitches: 14.54K (14542) - TotalRawHdfsReadTime(*): 114.164ms - TotalReadThroughput: 3.77 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e5 (host=vb0208.halxg.cloudera.com:22000):(Total: 45s397ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(1s000ms): 98.93 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.80 MB, 197.84 MB, 197.83 MB, 150.17 MB, 117.02 MB ThreadUsage(1s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.15 MB (207774424) - PerHostPeakMemUsage: 2.52 GB (2709334424) - PrepareTime: 149.711ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 4m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s244ms - TotalStorageWaitTime: 273.123ms CodeGen:(Total: 412.617ms, non-child: 412.617ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 254.475ms - PrepareTime: 142.925ms DataStreamSender (dst_id=13):(Total: 45s076ms, non-child: 45s076ms, % non-child: 100.00%) - BytesSent: 273.83 MB (287130675) - NetworkThroughput(*): 457.08 KB/sec - OverallThroughput: 6.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s189ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=6):(Total: 434.179ms, non-child: 434.179ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 85.98 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.95 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 826.064ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.76 MB (207364824) - PerReadThreadRawHdfsThroughput: 950.27 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 34.15 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.06K (2057) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 4m28s - ScannerThreadsSysTime: 194.967ms - ScannerThreadsUserTime: 5s987ms - ScannerThreadsVoluntaryContextSwitches: 14.29K (14295) - TotalRawHdfsReadTime(*): 180.961ms - TotalReadThroughput: 3.78 MB/sec Instance 2a427b598be90b44:8a531ae61488a9db (host=vb0214.halxg.cloudera.com:22000):(Total: 45s397ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(1s000ms): 105.23 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.39 MB, 210.41 MB, 210.41 MB, 210.36 MB, 162.66 MB, 138.64 MB, 59.78 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 4 - AverageThreadTokens: 6.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.66 MB (220889856) - PerHostPeakMemUsage: 2.48 GB (2666824392) - PrepareTime: 152.775ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 4m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s241ms - TotalStorageWaitTime: 121.585ms CodeGen:(Total: 531.956ms, non-child: 531.956ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.179ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 375.486ms - PrepareTime: 142.857ms DataStreamSender (dst_id=13):(Total: 45s143ms, non-child: 45s143ms, % non-child: 100.00%) - BytesSent: 297.99 MB (312460602) - NetworkThroughput(*): 530.80 KB/sec - OverallThroughput: 6.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s291ms - ThriftTransmitTime(*): 9m34s - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=6):(Total: 382.513ms, non-child: 382.513ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 93.59 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.93 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 546.596ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220406576) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 42.24 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1583) - ScannerThreadsTotalWallClockTime: 4m31s - MaterializeTupleTime(*): 4m30s - ScannerThreadsSysTime: 93.983ms - ScannerThreadsUserTime: 4s239ms - ScannerThreadsVoluntaryContextSwitches: 15.70K (15703) - TotalRawHdfsReadTime(*): 124.810ms - TotalReadThroughput: 4.07 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e2 (host=vb0224.halxg.cloudera.com:22000):(Total: 45s379ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(1s000ms): 101.80 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.54 MB, 203.29 MB, 164.21 MB, 117.07 MB ThreadUsage(1s000ms): 4, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6 - AverageThreadTokens: 7.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.77 MB (213666024) - PerHostPeakMemUsage: 2.50 GB (2686636688) - PrepareTime: 145.232ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 5m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s238ms - TotalStorageWaitTime: 132.758ms CodeGen:(Total: 392.895ms, non-child: 392.895ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.842ms - PrepareTime: 142.353ms DataStreamSender (dst_id=13):(Total: 45s095ms, non-child: 45s095ms, % non-child: 100.00%) - BytesSent: 282.78 MB (296518972) - NetworkThroughput(*): 504.72 KB/sec - OverallThroughput: 6.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s213ms - ThriftTransmitTime(*): 9m33s - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=6):(Total: 401.750ms, non-child: 401.750ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(1s000ms): 88.68 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.90 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 959.354ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.34 MB (213215512) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 38.05 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.28K (2283) - ScannerThreadsTotalWallClockTime: 5m12s - MaterializeTupleTime(*): 5m10s - ScannerThreadsSysTime: 152.973ms - ScannerThreadsUserTime: 7s009ms - ScannerThreadsVoluntaryContextSwitches: 14.95K (14954) - TotalRawHdfsReadTime(*): 134.896ms - TotalReadThroughput: 3.90 MB/sec Instance 2a427b598be90b44:8a531ae61488a9d8 (host=vb0212.halxg.cloudera.com:22000):(Total: 45s144ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(1s000ms): 96.60 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.59 MB, 176.62 MB, 168.72 MB, 137.19 MB, 97.05 MB ThreadUsage(1s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670944) - PerHostPeakMemUsage: 2.42 GB (2595532504) - PrepareTime: 145.614ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 3m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s248ms - TotalStorageWaitTime: 364.556ms CodeGen:(Total: 419.076ms, non-child: 419.076ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.650ms - PrepareTime: 142.207ms DataStreamSender (dst_id=13):(Total: 44s868ms, non-child: 44s868ms, % non-child: 100.00%) - BytesSent: 248.05 MB (260096589) - NetworkThroughput(*): 474.59 KB/sec - OverallThroughput: 5.53 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s071ms - ThriftTransmitTime(*): 8m55s - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=6):(Total: 404.204ms, non-child: 404.204ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:98.89% 1:0% 2:1.111% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.14 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 494.320ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 33.30 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1553) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 3m43s - ScannerThreadsSysTime: 95.984ms - ScannerThreadsUserTime: 3s573ms - ScannerThreadsVoluntaryContextSwitches: 12.93K (12933) - TotalRawHdfsReadTime(*): 122.738ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e0 (host=vb0206.halxg.cloudera.com:22000):(Total: 45s059ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(1s000ms): 88.53 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.99 MB, 176.95 MB, 176.85 MB, 176.80 MB, 137.06 MB, 101.11 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.06 MB (185662800) - PerHostPeakMemUsage: 2.55 GB (2739274168) - PrepareTime: 148.258ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 3m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s244ms - TotalStorageWaitTime: 100.870ms CodeGen:(Total: 446.205ms, non-child: 446.205ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 292.512ms - PrepareTime: 142.650ms DataStreamSender (dst_id=13):(Total: 44s796ms, non-child: 44s796ms, % non-child: 100.00%) - BytesSent: 248.61 MB (260687396) - NetworkThroughput(*): 414.90 KB/sec - OverallThroughput: 5.55 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s039ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=6):(Total: 382.246ms, non-child: 382.246ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 512.823ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 35.21 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1769) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 3m43s - ScannerThreadsSysTime: 108.981ms - ScannerThreadsUserTime: 4s173ms - ScannerThreadsVoluntaryContextSwitches: 12.93K (12933) - TotalRawHdfsReadTime(*): 115.477ms - TotalReadThroughput: 3.43 MB/sec Instance 2a427b598be90b44:8a531ae61488a9d7 (host=vb0226.halxg.cloudera.com:22000):(Total: 44s924ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(1s000ms): 71.78 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.38 MB, 168.37 MB, 168.37 MB, 168.26 MB, 144.44 MB, 95.43 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.57 MB (176758056) - PerHostPeakMemUsage: 2.56 GB (2750927384) - PrepareTime: 146.133ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 3m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s236ms - TotalStorageWaitTime: 133.284ms CodeGen:(Total: 404.847ms, non-child: 404.847ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.839ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.386ms - PrepareTime: 144.401ms DataStreamSender (dst_id=13):(Total: 44s645ms, non-child: 44s645ms, % non-child: 100.00%) - BytesSent: 227.21 MB (238247571) - NetworkThroughput(*): 407.18 KB/sec - OverallThroughput: 5.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s923ms - ThriftTransmitTime(*): 9m31s - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=6):(Total: 401.292ms, non-child: 401.292ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 132.54 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 746.384ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.12 MB (176282912) - PerReadThreadRawHdfsThroughput: 1007.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 30.68 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1772) - ScannerThreadsTotalWallClockTime: 3m42s - MaterializeTupleTime(*): 3m41s - ScannerThreadsSysTime: 145.975ms - ScannerThreadsUserTime: 5s982ms - ScannerThreadsVoluntaryContextSwitches: 11.90K (11900) - TotalRawHdfsReadTime(*): 141.595ms - TotalReadThroughput: 3.17 MB/sec Instance 2a427b598be90b44:8a531ae61488a9d9 (host=vb0204.halxg.cloudera.com:22000):(Total: 44s907ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.43 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.79 MB, 176.80 MB, 176.81 MB, 137.08 MB, 97.12 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 2.46 GB (2644450360) - PrepareTime: 147.510ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 3m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s241ms - TotalStorageWaitTime: 167.526ms CodeGen:(Total: 393.583ms, non-child: 393.583ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 243.212ms - PrepareTime: 145.081ms DataStreamSender (dst_id=13):(Total: 44s656ms, non-child: 44s656ms, % non-child: 100.00%) - BytesSent: 248.15 MB (260209130) - NetworkThroughput(*): 414.17 KB/sec - OverallThroughput: 5.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s970ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=6):(Total: 375.527ms, non-child: 375.527ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.00 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 494.314ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 35.85 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1485) - ScannerThreadsTotalWallClockTime: 3m43s - MaterializeTupleTime(*): 3m42s - ScannerThreadsSysTime: 110.980ms - ScannerThreadsUserTime: 3s468ms - ScannerThreadsVoluntaryContextSwitches: 13.09K (13090) - TotalRawHdfsReadTime(*): 147.243ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9df (host=vb0228.halxg.cloudera.com:22000):(Total: 44s901ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(1s000ms): 88.42 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.76 MB, 176.77 MB, 176.76 MB, 176.82 MB, 172.80 MB, 137.05 MB, 93.14 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638168) - PerHostPeakMemUsage: 2.43 GB (2607266816) - PrepareTime: 143.553ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 3m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s251ms - TotalStorageWaitTime: 332.864ms CodeGen:(Total: 410.842ms, non-child: 410.842ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.023ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.742ms - PrepareTime: 141.353ms DataStreamSender (dst_id=13):(Total: 44s658ms, non-child: 44s658ms, % non-child: 100.00%) - BytesSent: 248.67 MB (260752079) - NetworkThroughput(*): 415.00 KB/sec - OverallThroughput: 5.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s979ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=6):(Total: 368.053ms, non-child: 368.053ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 473.927ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 36.57 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.43K (1427) - ScannerThreadsTotalWallClockTime: 3m43s - MaterializeTupleTime(*): 3m42s - ScannerThreadsSysTime: 107.982ms - ScannerThreadsUserTime: 3s398ms - ScannerThreadsVoluntaryContextSwitches: 12.95K (12945) - TotalRawHdfsReadTime(*): 116.880ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e4 (host=vb0230.halxg.cloudera.com:22000):(Total: 44s879ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(1s000ms): 88.39 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.71 MB, 176.69 MB, 176.65 MB, 172.71 MB, 137.00 MB, 92.99 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646368) - PerHostPeakMemUsage: 2.46 GB (2646517720) - PrepareTime: 145.505ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 3m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s246ms - TotalStorageWaitTime: 212.217ms CodeGen:(Total: 422.456ms, non-child: 422.456ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.555ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 267.897ms - PrepareTime: 139.578ms DataStreamSender (dst_id=13):(Total: 44s619ms, non-child: 44s619ms, % non-child: 100.00%) - BytesSent: 248.39 MB (260453101) - NetworkThroughput(*): 477.57 KB/sec - OverallThroughput: 5.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s977ms - ThriftTransmitTime(*): 8m52s - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=6):(Total: 385.356ms, non-child: 385.356ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 461.625ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1003.72 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 34.93 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1347) - ScannerThreadsTotalWallClockTime: 3m43s - MaterializeTupleTime(*): 3m42s - ScannerThreadsSysTime: 68.987ms - ScannerThreadsUserTime: 3s290ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13014) - TotalRawHdfsReadTime(*): 155.411ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9da (host=vb0218.halxg.cloudera.com:22000):(Total: 44s846ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.36 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.66 MB, 176.63 MB, 176.62 MB, 160.89 MB, 137.15 MB, 81.28 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670944) - PerHostPeakMemUsage: 2.47 GB (2652351456) - PrepareTime: 142.524ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 3m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s248ms - TotalStorageWaitTime: 123.964ms CodeGen:(Total: 387.325ms, non-child: 387.325ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.531ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 241.717ms - PrepareTime: 140.978ms DataStreamSender (dst_id=13):(Total: 44s602ms, non-child: 44s602ms, % non-child: 100.00%) - BytesSent: 247.91 MB (259948117) - NetworkThroughput(*): 512.12 KB/sec - OverallThroughput: 5.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s942ms - ThriftTransmitTime(*): 8m15s - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=6):(Total: 364.038ms, non-child: 364.038ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 457.881ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 36.97 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1321) - ScannerThreadsTotalWallClockTime: 3m43s - MaterializeTupleTime(*): 3m42s - ScannerThreadsSysTime: 90.983ms - ScannerThreadsUserTime: 3s604ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13025) - TotalRawHdfsReadTime(*): 137.738ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e3 (host=vb0234.halxg.cloudera.com:22000):(Total: 44s828ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(1s000ms): 88.37 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.68 MB, 176.69 MB, 176.68 MB, 176.68 MB, 137.07 MB, 97.10 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.00 MB (185597264) - PerHostPeakMemUsage: 2.48 GB (2658682696) - PrepareTime: 148.381ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 3m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s250ms - TotalStorageWaitTime: 270.771ms CodeGen:(Total: 417.099ms, non-child: 417.099ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.908ms - PrepareTime: 143.827ms DataStreamSender (dst_id=13):(Total: 44s566ms, non-child: 44s566ms, % non-child: 100.00%) - BytesSent: 248.29 MB (260346986) - NetworkThroughput(*): 414.37 KB/sec - OverallThroughput: 5.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s944ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=6):(Total: 390.870ms, non-child: 390.870ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.00 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 466.246ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 34.45 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1346) - ScannerThreadsTotalWallClockTime: 3m43s - MaterializeTupleTime(*): 3m42s - ScannerThreadsSysTime: 94.983ms - ScannerThreadsUserTime: 3s267ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13005) - TotalRawHdfsReadTime(*): 133.201ms - TotalReadThroughput: 3.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e1 (host=vb0222.halxg.cloudera.com:22000):(Total: 44s800ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(1s000ms): 123.27 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.15 MB, 164.17 MB, 164.18 MB, 117.93 MB, 63.56 MB ThreadUsage(1s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.54 MB (172530968) - PerHostPeakMemUsage: 2.47 GB (2649613672) - PrepareTime: 144.976ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 3m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s235ms - TotalStorageWaitTime: 304.418ms CodeGen:(Total: 414.342ms, non-child: 414.342ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 266.270ms - PrepareTime: 143.351ms DataStreamSender (dst_id=13):(Total: 44s476ms, non-child: 44s476ms, % non-child: 100.00%) - BytesSent: 223.23 MB (234078835) - NetworkThroughput(*): 373.21 KB/sec - OverallThroughput: 5.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s819ms - ThriftTransmitTime(*): 10m12s - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=6):(Total: 449.803ms, non-child: 449.803ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 101.91 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 775.035ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.05 MB (172023112) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 26.86 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 146.976ms - ScannerThreadsUserTime: 5s487ms - ScannerThreadsVoluntaryContextSwitches: 11.63K (11634) - TotalRawHdfsReadTime(*): 124.655ms - TotalReadThroughput: 3.11 MB/sec Instance 2a427b598be90b44:8a531ae61488a9dc (host=vb0232.halxg.cloudera.com:22000):(Total: 44s778ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(1s000ms): 89.12 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.16 MB, 178.26 MB, 178.30 MB, 143.48 MB, 95.40 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 5 - AverageThreadTokens: 6.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.68 MB (187360000) - PerHostPeakMemUsage: 2.47 GB (2657225280) - PrepareTime: 142.455ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 4m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s248ms - TotalStorageWaitTime: 173.104ms CodeGen:(Total: 431.651ms, non-child: 431.651ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.686ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 282.944ms - PrepareTime: 140.213ms DataStreamSender (dst_id=13):(Total: 44s541ms, non-child: 44s541ms, % non-child: 100.00%) - BytesSent: 243.35 MB (255172230) - NetworkThroughput(*): 465.73 KB/sec - OverallThroughput: 5.46 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s917ms - ThriftTransmitTime(*): 8m55s - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=6):(Total: 360.779ms, non-child: 360.779ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.94 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 447.807ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.20 MB (186852096) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 36.48 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.10K (1101) - ScannerThreadsTotalWallClockTime: 4m24s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 79.984ms - ScannerThreadsUserTime: 3s505ms - ScannerThreadsVoluntaryContextSwitches: 12.78K (12783) - TotalRawHdfsReadTime(*): 120.169ms - TotalReadThroughput: 3.43 MB/sec Instance 2a427b598be90b44:8a531ae61488a9dd (host=vb0216.halxg.cloudera.com:22000):(Total: 44s496ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(1s000ms): 80.15 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.27 MB, 160.23 MB, 160.18 MB, 160.19 MB, 115.96 MB, 63.63 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.55 MB (168353056) - PerHostPeakMemUsage: 2.40 GB (2580749336) - PrepareTime: 150.084ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 3m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s239ms - TotalStorageWaitTime: 272.283ms CodeGen:(Total: 418.270ms, non-child: 418.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.790ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.874ms - PrepareTime: 142.673ms DataStreamSender (dst_id=13):(Total: 44s245ms, non-child: 44s245ms, % non-child: 100.00%) - BytesSent: 221.18 MB (231920780) - NetworkThroughput(*): 458.06 KB/sec - OverallThroughput: 5.00 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s744ms - ThriftTransmitTime(*): 8m14s - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=6):(Total: 377.451ms, non-child: 377.451ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 423.725ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.05 MB (167828856) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 31.72 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.06K (1064) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 3m39s - ScannerThreadsSysTime: 81.985ms - ScannerThreadsUserTime: 3s041ms - ScannerThreadsVoluntaryContextSwitches: 11.52K (11516) - TotalRawHdfsReadTime(*): 101.851ms - TotalReadThroughput: 3.12 MB/sec Fragment F03: Instance 2a427b598be90b44:8a531ae61488a9e7 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m12s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(2s000ms): 179.47 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.28 MB, 239.86 MB, 239.89 MB, 239.96 MB, 239.88 MB, 239.83 MB, 174.40 MB, 81.60 MB, 165.81 MB, 193.71 MB, 193.75 MB, 193.59 MB, 112.53 MB ThreadUsage(2s000ms): 8, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.33 MB (252009136) - PerHostPeakMemUsage: 3.07 GB (3299130968) - PrepareTime: 146.027ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 11m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s869ms - TotalStorageWaitTime: 376.165ms CodeGen:(Total: 389.659ms, non-child: 389.659ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.523ms - PrepareTime: 143.175ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 898.04 MB (941660422) - NetworkThroughput(*): 1.74 MB/sec - OverallThroughput: 12.55 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s985ms - ThriftTransmitTime(*): 8m36s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=5):(Total: 635.880ms, non-child: 635.880ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 154.00 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 328.53 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.72 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 1s850ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.89 MB (251542192) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 84.28 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.19K (10190) - ScannerThreadsTotalWallClockTime: 11m40s - MaterializeTupleTime(*): 11m38s - ScannerThreadsSysTime: 677.891ms - ScannerThreadsUserTime: 19s038ms - ScannerThreadsVoluntaryContextSwitches: 52.55K (52545) - TotalRawHdfsReadTime(*): 290.533ms - TotalReadThroughput: 5.10 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ea (host=vb0234.halxg.cloudera.com:22000):(Total: 1m12s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(2s000ms): 196.33 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 262.71 MB, 262.88 MB, 263.00 MB, 262.98 MB, 262.95 MB, 247.04 MB, 108.56 MB, 132.79 MB, 170.64 MB, 170.60 MB, 170.56 MB, 101.16 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8 - AverageThreadTokens: 11.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 3.06 GB (3286580264) - PrepareTime: 142.430ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 12m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s471ms - TotalStorageWaitTime: 450.020ms CodeGen:(Total: 402.334ms, non-child: 402.334ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.417ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.977ms - PrepareTime: 140.908ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 897.76 MB (941371276) - NetworkThroughput(*): 1.28 MB/sec - OverallThroughput: 12.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s100ms - ThriftTransmitTime(*): 11m38s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=5):(Total: 672.682ms, non-child: 672.682ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.39 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 292.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 2s032ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 79.66 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.98K (11977) - ScannerThreadsTotalWallClockTime: 12m35s - MaterializeTupleTime(*): 12m33s - ScannerThreadsSysTime: 740.881ms - ScannerThreadsUserTime: 21s125ms - ScannerThreadsVoluntaryContextSwitches: 52.38K (52383) - TotalRawHdfsReadTime(*): 280.435ms - TotalReadThroughput: 5.10 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f2 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m12s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(2s000ms): 195.97 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 261.27 MB, 262.56 MB, 263.01 MB, 263.04 MB, 263.07 MB, 262.88 MB, 258.93 MB, 124.28 MB, 119.89 MB, 170.61 MB, 170.55 MB, 170.67 MB, 107.16 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8 - AverageThreadTokens: 11.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.50 MB (276299880) - PerHostPeakMemUsage: 3.07 GB (3294777432) - PrepareTime: 142.503ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 12m55s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s134ms - TotalStorageWaitTime: 566.230ms CodeGen:(Total: 396.373ms, non-child: 396.373ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 249.662ms - PrepareTime: 139.770ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 897.84 MB (941454256) - NetworkThroughput(*): 1.47 MB/sec - OverallThroughput: 12.58 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s211ms - ThriftTransmitTime(*): 10m9s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=5):(Total: 728.191ms, non-child: 728.191ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.40 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 274.09 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 2s093ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 73.57 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.63K (12632) - ScannerThreadsTotalWallClockTime: 12m36s - MaterializeTupleTime(*): 12m33s - ScannerThreadsSysTime: 738.882ms - ScannerThreadsUserTime: 21s954ms - ScannerThreadsVoluntaryContextSwitches: 52.48K (52485) - TotalRawHdfsReadTime(*): 296.441ms - TotalReadThroughput: 5.10 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f0 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(2s000ms): 195.85 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 262.59 MB, 262.89 MB, 263.00 MB, 263.02 MB, 262.96 MB, 243.03 MB, 106.63 MB, 133.40 MB, 170.55 MB, 170.58 MB, 170.68 MB, 81.34 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8 - AverageThreadTokens: 11.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250776) - PerHostPeakMemUsage: 3.05 GB (3271422744) - PrepareTime: 145.665ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 12m53s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s372ms - TotalStorageWaitTime: 334.389ms CodeGen:(Total: 397.629ms, non-child: 397.629ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 248.693ms - PrepareTime: 140.732ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 898.15 MB (941781529) - NetworkThroughput(*): 1.29 MB/sec - OverallThroughput: 12.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s186ms - ThriftTransmitTime(*): 11m37s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=5):(Total: 692.409ms, non-child: 692.409ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.38 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 297.71 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.51 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 1s976ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 77.43 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.95K (11945) - ScannerThreadsTotalWallClockTime: 12m34s - MaterializeTupleTime(*): 12m32s - ScannerThreadsSysTime: 725.884ms - ScannerThreadsUserTime: 20s845ms - ScannerThreadsVoluntaryContextSwitches: 52.57K (52570) - TotalRawHdfsReadTime(*): 275.576ms - TotalReadThroughput: 5.13 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e8 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(2s000ms): 196.51 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.54 MB, 256.58 MB, 256.58 MB, 256.58 MB, 256.67 MB, 257.03 MB, 257.03 MB, 257.03 MB, 256.88 MB, 243.95 MB, 126.37 MB, 144.78 MB, 170.59 MB, 170.47 MB, 154.76 MB, 86.09 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 7 - AverageThreadTokens: 11.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 264.40 MB (277239096) - PerHostPeakMemUsage: 3.06 GB (3285919576) - PrepareTime: 149.814ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 12m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s365ms - TotalStorageWaitTime: 711.093ms CodeGen:(Total: 401.644ms, non-child: 401.644ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.626ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 246.812ms - PrepareTime: 143.405ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 886.54 MB (929601394) - NetworkThroughput(*): 1.52 MB/sec - OverallThroughput: 12.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s991ms - ThriftTransmitTime(*): 9m42s - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=5):(Total: 708.314ms, non-child: 708.314ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:99.31% 1:0.6944% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(2s000ms): 166.06 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 221.34 MB, 231.61 MB, 241.87 MB, 303.47 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 1s966ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.91 MB (276731184) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 74.69 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 13.04K (13040) - ScannerThreadsTotalWallClockTime: 12m33s - MaterializeTupleTime(*): 12m30s - ScannerThreadsSysTime: 773.877ms - ScannerThreadsUserTime: 20s269ms - ScannerThreadsVoluntaryContextSwitches: 51.76K (51757) - TotalRawHdfsReadTime(*): 311.251ms - TotalReadThroughput: 5.07 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f3 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(2s000ms): 219.60 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.80 MB, 255.79 MB, 255.74 MB, 255.74 MB, 255.74 MB, 257.47 MB, 257.54 MB, 257.51 MB, 257.51 MB, 257.52 MB, 241.55 MB, 116.99 MB, 143.35 MB, 170.59 MB, 170.56 MB, 154.73 MB, 58.62 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 7 - AverageThreadTokens: 11.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.96 MB (270491752) - PerHostPeakMemUsage: 3.02 GB (3244825656) - PrepareTime: 141.409ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 12m49s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s400ms - TotalStorageWaitTime: 748.856ms CodeGen:(Total: 419.788ms, non-child: 419.788ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.623ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 273.275ms - PrepareTime: 139.762ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 887.08 MB (930166566) - NetworkThroughput(*): 1.34 MB/sec - OverallThroughput: 12.48 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s004ms - ThriftTransmitTime(*): 11m3s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=5):(Total: 656.281ms, non-child: 656.281ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:99.31% 1:0% 2:0.6944% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 179.54 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 236.95 MB, 308.82 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.48 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 1s843ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.53 MB (270041240) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 80.71 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.41K (11412) - ScannerThreadsTotalWallClockTime: 12m31s - MaterializeTupleTime(*): 12m28s - ScannerThreadsSysTime: 701.888ms - ScannerThreadsUserTime: 19s361ms - ScannerThreadsVoluntaryContextSwitches: 51.83K (51833) - TotalRawHdfsReadTime(*): 305.691ms - TotalReadThroughput: 5.07 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ec (host=vb0226.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(2s000ms): 192.76 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 261.82 MB, 262.55 MB, 262.96 MB, 263.17 MB, 262.96 MB, 263.01 MB, 255.04 MB, 112.44 MB, 112.78 MB, 167.64 MB, 167.60 MB, 167.64 MB, 70.51 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8 - AverageThreadTokens: 11.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242576) - PerHostPeakMemUsage: 3.03 GB (3252430024) - PrepareTime: 145.321ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 12m49s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s589ms - TotalStorageWaitTime: 589.061ms CodeGen:(Total: 407.164ms, non-child: 407.164ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 258.559ms - PrepareTime: 141.950ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 892.68 MB (936043432) - NetworkThroughput(*): 1.37 MB/sec - OverallThroughput: 12.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s954ms - ThriftTransmitTime(*): 10m52s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=5):(Total: 647.613ms, non-child: 647.613ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 223.15 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 301.74 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.52 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 1s777ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 82.24 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.44K (10436) - ScannerThreadsTotalWallClockTime: 12m31s - MaterializeTupleTime(*): 12m28s - ScannerThreadsSysTime: 611.902ms - ScannerThreadsUserTime: 18s536ms - ScannerThreadsVoluntaryContextSwitches: 52.09K (52094) - TotalRawHdfsReadTime(*): 314.435ms - TotalReadThroughput: 5.14 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ef (host=vb0228.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(2s000ms): 195.76 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 260.99 MB, 261.00 MB, 261.00 MB, 261.00 MB, 261.00 MB, 262.90 MB, 263.08 MB, 263.02 MB, 262.99 MB, 263.03 MB, 257.00 MB, 110.42 MB, 102.93 MB, 141.49 MB, 141.51 MB, 121.35 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 6 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209808) - PerHostPeakMemUsage: 3.02 GB (3240372496) - PrepareTime: 142.981ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 12m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s184ms - TotalStorageWaitTime: 323.086ms CodeGen:(Total: 400.005ms, non-child: 400.005ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 253.882ms - PrepareTime: 139.780ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 836.95 MB (877609688) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 11.85 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s766ms - ThriftTransmitTime(*): 11m35s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=5):(Total: 686.465ms, non-child: 686.465ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 260.88 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.41 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 1s803ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 72.77 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.52K (11522) - ScannerThreadsTotalWallClockTime: 12m20s - MaterializeTupleTime(*): 12m18s - ScannerThreadsSysTime: 743.882ms - ScannerThreadsUserTime: 18s942ms - ScannerThreadsVoluntaryContextSwitches: 48.98K (48979) - TotalRawHdfsReadTime(*): 275.370ms - TotalReadThroughput: 4.82 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ed (host=vb0232.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(2s000ms): 196.21 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 261.94 MB, 262.77 MB, 262.97 MB, 263.05 MB, 262.92 MB, 262.96 MB, 262.88 MB, 136.09 MB, 105.93 MB, 147.52 MB, 147.48 MB, 135.49 MB, 40.00 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 5 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258968) - PerHostPeakMemUsage: 3.03 GB (3250022104) - PrepareTime: 141.920ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 12m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s176ms - TotalStorageWaitTime: 325.979ms CodeGen:(Total: 389.458ms, non-child: 389.458ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.627ms - PrepareTime: 139.967ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 849.33 MB (890590506) - NetworkThroughput(*): 1.68 MB/sec - OverallThroughput: 12.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s737ms - ThriftTransmitTime(*): 8m26s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=5):(Total: 673.060ms, non-child: 673.060ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 287.87 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 1s953ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 75.31 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.52K (13520) - ScannerThreadsTotalWallClockTime: 12m23s - MaterializeTupleTime(*): 12m20s - ScannerThreadsSysTime: 782.875ms - ScannerThreadsUserTime: 23s010ms - ScannerThreadsVoluntaryContextSwitches: 49.61K (49614) - TotalRawHdfsReadTime(*): 312.640ms - TotalReadThroughput: 4.89 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f4 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(2s000ms): 196.20 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 262.73 MB, 262.96 MB, 262.94 MB, 263.04 MB, 263.01 MB, 251.06 MB, 110.66 MB, 118.83 MB, 147.40 MB, 147.43 MB, 113.75 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.43 MB (276226152) - PerHostPeakMemUsage: 3.02 GB (3245598696) - PrepareTime: 138.719ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 12m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s415ms - TotalStorageWaitTime: 489.544ms CodeGen:(Total: 413.215ms, non-child: 413.215ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 268.714ms - PrepareTime: 137.014ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 848.21 MB (889407614) - NetworkThroughput(*): 1.22 MB/sec - OverallThroughput: 12.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s674ms - ThriftTransmitTime(*): 11m37s - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=5):(Total: 673.818ms, non-child: 673.818ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.41 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 287.47 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 1s957ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 75.13 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.96K (10955) - ScannerThreadsTotalWallClockTime: 12m21s - MaterializeTupleTime(*): 12m18s - ScannerThreadsSysTime: 734.883ms - ScannerThreadsUserTime: 20s274ms - ScannerThreadsVoluntaryContextSwitches: 49.44K (49437) - TotalRawHdfsReadTime(*): 269.625ms - TotalReadThroughput: 4.88 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f1 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(2s000ms): 196.25 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 262.73 MB, 263.03 MB, 262.90 MB, 262.93 MB, 262.87 MB, 237.00 MB, 102.68 MB, 120.31 MB, 147.48 MB, 147.49 MB, 109.78 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 3.02 GB (3246245568) - PrepareTime: 138.969ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 12m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s356ms - TotalStorageWaitTime: 683.985ms CodeGen:(Total: 378.009ms, non-child: 378.009ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.986ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 235.686ms - PrepareTime: 137.102ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 847.64 MB (888810900) - NetworkThroughput(*): 1.13 MB/sec - OverallThroughput: 12.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s603ms - ThriftTransmitTime(*): 12m31s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=5):(Total: 662.619ms, non-child: 662.619ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 287.48 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.41 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 1s875ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 76.36 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.51K (10507) - ScannerThreadsTotalWallClockTime: 12m20s - MaterializeTupleTime(*): 12m17s - ScannerThreadsSysTime: 628.898ms - ScannerThreadsUserTime: 19s526ms - ScannerThreadsVoluntaryContextSwitches: 49.49K (49493) - TotalRawHdfsReadTime(*): 266.881ms - TotalReadThroughput: 4.88 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e6 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m10s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(2s000ms): 192.28 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 256.35 MB, 257.56 MB, 258.01 MB, 258.06 MB, 257.91 MB, 258.02 MB, 243.93 MB, 105.44 MB, 136.65 MB, 147.49 MB, 147.38 MB, 99.95 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 258.51 MB (271065200) - PerHostPeakMemUsage: 3.00 GB (3217840104) - PrepareTime: 150.797ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 12m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s108ms - TotalStorageWaitTime: 447.189ms CodeGen:(Total: 430.011ms, non-child: 430.011ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.530ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 271.269ms - PrepareTime: 140.201ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 839.08 MB (879835207) - NetworkThroughput(*): 1.28 MB/sec - OverallThroughput: 11.93 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s589ms - ThriftTransmitTime(*): 10m56s - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=5):(Total: 688.737ms, non-child: 688.737ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 166.69 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 299.25 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s895ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.03 MB (270565528) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 72.71 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.21K (12212) - ScannerThreadsTotalWallClockTime: 12m17s - MaterializeTupleTime(*): 12m14s - ScannerThreadsSysTime: 759.879ms - ScannerThreadsUserTime: 22s471ms - ScannerThreadsVoluntaryContextSwitches: 48.97K (48974) - TotalRawHdfsReadTime(*): 293.819ms - TotalReadThroughput: 4.83 MB/sec Instance 2a427b598be90b44:8a531ae61488a9eb (host=vb0212.halxg.cloudera.com:22000):(Total: 1m10s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(2s000ms): 255.17 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 261.53 MB, 262.87 MB, 262.99 MB, 263.00 MB, 262.97 MB, 262.96 MB, 231.11 MB, 92.99 MB, 126.31 MB, 147.59 MB, 147.48 MB, 88.07 MB ThreadUsage(2s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 2.98 GB (3197951424) - PrepareTime: 144.298ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 12m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s074ms - TotalStorageWaitTime: 384.217ms CodeGen:(Total: 404.184ms, non-child: 404.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.870ms - PrepareTime: 142.513ms DataStreamSender (dst_id=12):(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - BytesSent: 847.77 MB (888955944) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 12.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s737ms - ThriftTransmitTime(*): 11m44s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=5):(Total: 605.793ms, non-child: 605.793ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:99.3% 1:0.7042% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 217.44 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 297.73 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s707ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 83.52 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.53K (9528) - ScannerThreadsTotalWallClockTime: 12m15s - MaterializeTupleTime(*): 12m12s - ScannerThreadsSysTime: 584.906ms - ScannerThreadsUserTime: 17s822ms - ScannerThreadsVoluntaryContextSwitches: 49.59K (49592) - TotalRawHdfsReadTime(*): 303.953ms - TotalReadThroughput: 4.92 MB/sec Instance 2a427b598be90b44:8a531ae61488a9e9 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m10s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(2s000ms): 196.78 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.35 MB, 262.36 MB, 262.39 MB, 262.39 MB, 262.39 MB, 262.97 MB, 262.90 MB, 262.94 MB, 262.91 MB, 263.02 MB, 229.02 MB, 92.92 MB, 137.71 MB, 147.51 MB, 147.52 MB, 86.12 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.55 MB (276357232) - PerHostPeakMemUsage: 2.86 GB (3073754000) - PrepareTime: 138.961ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 12m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s096ms - TotalStorageWaitTime: 384.247ms CodeGen:(Total: 390.737ms, non-child: 390.737ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 248.615ms - PrepareTime: 137.317ms DataStreamSender (dst_id=12):(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - BytesSent: 848.52 MB (889735375) - NetworkThroughput(*): 1.52 MB/sec - OverallThroughput: 12.17 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s495ms - ThriftTransmitTime(*): 9m19s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=5):(Total: 620.907ms, non-child: 620.907ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.40 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 313.13 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 1s769ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 81.54 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.10K (10103) - ScannerThreadsTotalWallClockTime: 12m13s - MaterializeTupleTime(*): 12m11s - ScannerThreadsSysTime: 616.900ms - ScannerThreadsUserTime: 18s291ms - ScannerThreadsVoluntaryContextSwitches: 49.61K (49611) - TotalRawHdfsReadTime(*): 294.497ms - TotalReadThroughput: 4.95 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ee (host=vb0216.halxg.cloudera.com:22000):(Total: 1m9s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(2s000ms): 196.02 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.65 MB, 261.71 MB, 261.71 MB, 261.71 MB, 262.63 MB, 262.89 MB, 263.00 MB, 262.88 MB, 263.09 MB, 260.96 MB, 138.10 MB, 101.92 MB, 124.31 MB, 124.38 MB, 65.14 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 6, 6, 6 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276283496) - PerHostPeakMemUsage: 2.81 GB (3021875288) - PrepareTime: 141.019ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 12m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 52s603ms - TotalStorageWaitTime: 297.811ms CodeGen:(Total: 381.289ms, non-child: 381.289ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.725ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 237.097ms - PrepareTime: 138.989ms DataStreamSender (dst_id=12):(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - BytesSent: 798.09 MB (836859805) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 11.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s256ms - ThriftTransmitTime(*): 10m12s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=5):(Total: 653.431ms, non-child: 653.431ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(2s000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 282.35 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.44 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s759ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 72.92 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.39K (10392) - ScannerThreadsTotalWallClockTime: 12m6s - MaterializeTupleTime(*): 12m3s - ScannerThreadsSysTime: 702.887ms - ScannerThreadsUserTime: 17s836ms - ScannerThreadsVoluntaryContextSwitches: 46.73K (46727) - TotalRawHdfsReadTime(*): 219.159ms - TotalReadThroughput: 4.73 MB/sec Fragment F01: Instance 2a427b598be90b44:8a531ae61488a9f9 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s648ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 210.53 MB, 210.40 MB, 210.34 MB, 162.64 MB, 162.64 MB, 162.66 MB, 122.62 MB, 114.72 MB, 58.81 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.65 MB (220881616) - PerHostPeakMemUsage: 1.55 GB (1661272384) - PrepareTime: 148.065ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 31s447ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 78.384ms - TotalStorageWaitTime: 142.963ms CodeGen:(Total: 403.119ms, non-child: 403.119ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 246.756ms - PrepareTime: 137.169ms DataStreamSender (dst_id=11):(Total: 4s352ms, non-child: 4s352ms, % non-child: 100.00%) - BytesSent: 298.66 MB (313167290) - NetworkThroughput(*): 37.31 MB/sec - OverallThroughput: 68.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s429ms - ThriftTransmitTime(*): 8s005ms - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=2):(Total: 415.685ms, non-child: 415.685ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.89 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 884.296ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220414768) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 38.87 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.56K (2563) - ScannerThreadsTotalWallClockTime: 26s722ms - MaterializeTupleTime(*): 25s603ms - ScannerThreadsSysTime: 171.971ms - ScannerThreadsUserTime: 6s491ms - ScannerThreadsVoluntaryContextSwitches: 15.69K (15691) - TotalRawHdfsReadTime(*): 163.694ms - TotalReadThroughput: 37.44 MB/sec Instance 2a427b598be90b44:8a531ae61488aa00 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s502ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 203.40 MB, 203.53 MB, 203.55 MB, 174.41 MB, 137.04 MB, 137.08 MB, 105.14 MB, 97.07 MB, 20.42 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 7, 6, 6, 6, 6, 2 - AverageThreadTokens: 5.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.80 MB (213698800) - PerHostPeakMemUsage: 1.53 GB (1640372344) - PrepareTime: 142.200ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 29s351ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 87.287ms - TotalStorageWaitTime: 413.698ms CodeGen:(Total: 408.003ms, non-child: 408.003ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.246ms - PrepareTime: 140.062ms DataStreamSender (dst_id=11):(Total: 4s229ms, non-child: 4s229ms, % non-child: 100.00%) - BytesSent: 282.51 MB (296233160) - NetworkThroughput(*): 34.41 MB/sec - OverallThroughput: 66.79 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s370ms - ThriftTransmitTime(*): 8s211ms - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=2):(Total: 383.153ms, non-child: 383.153ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.33 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 629.250ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.34 MB (213215464) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 39.90 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.02K (2015) - ScannerThreadsTotalWallClockTime: 25s035ms - MaterializeTupleTime(*): 23s808ms - ScannerThreadsSysTime: 139.975ms - ScannerThreadsUserTime: 4s685ms - ScannerThreadsVoluntaryContextSwitches: 14.76K (14763) - TotalRawHdfsReadTime(*): 140.145ms - TotalReadThroughput: 35.47 MB/sec Instance 2a427b598be90b44:8a531ae61488a9fc (host=vb0220.halxg.cloudera.com:22000):(Total: 4s388ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(500.000ms): 68.00 KB, 201.74 MB, 201.73 MB, 201.78 MB, 154.32 MB, 154.09 MB, 137.14 MB, 97.15 MB, 96.87 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.18 MB (212001496) - PerHostPeakMemUsage: 1.53 GB (1639075344) - PrepareTime: 142.373ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 27s810ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 97.371ms - TotalStorageWaitTime: 374.657ms CodeGen:(Total: 390.536ms, non-child: 390.536ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 243.559ms - PrepareTime: 137.693ms DataStreamSender (dst_id=11):(Total: 4s102ms, non-child: 4s102ms, % non-child: 100.00%) - BytesSent: 277.42 MB (290900584) - NetworkThroughput(*): 34.58 MB/sec - OverallThroughput: 67.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s303ms - ThriftTransmitTime(*): 8s023ms - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=2):(Total: 403.135ms, non-child: 403.135ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.62 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 542.135ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.76 MB (211559128) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 37.12 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.85K (1851) - ScannerThreadsTotalWallClockTime: 23s610ms - MaterializeTupleTime(*): 22s538ms - ScannerThreadsSysTime: 92.983ms - ScannerThreadsUserTime: 4s043ms - ScannerThreadsVoluntaryContextSwitches: 14.47K (14471) - TotalRawHdfsReadTime(*): 156.948ms - TotalReadThroughput: 38.55 MB/sec Instance 2a427b598be90b44:8a531ae61488aa03 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s183ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(500.000ms): 163.40 MB, 197.96 MB, 197.87 MB, 197.74 MB, 150.25 MB, 137.09 MB, 112.98 MB, 96.84 MB, 4.58 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6, 6, 1 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.13 MB (207749936) - PerHostPeakMemUsage: 1.49 GB (1604896496) - PrepareTime: 146.481ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 26s488ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 95.710ms - TotalStorageWaitTime: 114.552ms CodeGen:(Total: 388.750ms, non-child: 388.750ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 239.105ms - PrepareTime: 140.083ms DataStreamSender (dst_id=11):(Total: 3s913ms, non-child: 3s913ms, % non-child: 100.00%) - BytesSent: 273.46 MB (286740189) - NetworkThroughput(*): 34.32 MB/sec - OverallThroughput: 69.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s191ms - ThriftTransmitTime(*): 7s968ms - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=2):(Total: 384.922ms, non-child: 384.922ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 148.99 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 565.255ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.74 MB (207340336) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 38.52 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1558) - ScannerThreadsTotalWallClockTime: 22s236ms - MaterializeTupleTime(*): 21s498ms - ScannerThreadsSysTime: 123.978ms - ScannerThreadsUserTime: 4s071ms - ScannerThreadsVoluntaryContextSwitches: 14.32K (14320) - TotalRawHdfsReadTime(*): 139.825ms - TotalReadThroughput: 38.21 MB/sec Instance 2a427b598be90b44:8a531ae61488aa01 (host=vb0234.halxg.cloudera.com:22000):(Total: 4s106ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(500.000ms): 68.00 KB, 176.81 MB, 176.72 MB, 176.64 MB, 136.92 MB, 137.20 MB, 128.79 MB, 97.08 MB, 57.85 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.08 MB (185679184) - PerHostPeakMemUsage: 1.47 GB (1579753960) - PrepareTime: 143.194ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 23s605ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 69.399ms - TotalStorageWaitTime: 321.947ms CodeGen:(Total: 422.219ms, non-child: 422.219ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 271.831ms - PrepareTime: 140.124ms DataStreamSender (dst_id=11):(Total: 3s800ms, non-child: 3s800ms, % non-child: 100.00%) - BytesSent: 248.29 MB (260351160) - NetworkThroughput(*): 34.67 MB/sec - OverallThroughput: 65.34 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s103ms - ThriftTransmitTime(*): 7s161ms - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=2):(Total: 425.788ms, non-child: 425.788ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 582.443ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 31.63 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.93K (1927) - ScannerThreadsTotalWallClockTime: 19s576ms - MaterializeTupleTime(*): 18s508ms - ScannerThreadsSysTime: 142.975ms - ScannerThreadsUserTime: 4s350ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13010) - TotalRawHdfsReadTime(*): 119.822ms - TotalReadThroughput: 34.66 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f6 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s975ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(500.000ms): 612.00 KB, 176.70 MB, 176.71 MB, 136.97 MB, 137.07 MB, 136.98 MB, 97.10 MB, 89.30 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185654568) - PerHostPeakMemUsage: 1.45 GB (1551953368) - PrepareTime: 145.099ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 22s681ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 84.323ms - TotalStorageWaitTime: 388.158ms CodeGen:(Total: 418.542ms, non-child: 418.542ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.640ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.324ms - PrepareTime: 141.189ms DataStreamSender (dst_id=11):(Total: 3s687ms, non-child: 3s687ms, % non-child: 100.00%) - BytesSent: 247.95 MB (259996049) - NetworkThroughput(*): 34.40 MB/sec - OverallThroughput: 67.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s064ms - ThriftTransmitTime(*): 7s208ms - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=2):(Total: 409.039ms, non-child: 409.039ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 300.00 KB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 545.571ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.68 MB (185261352) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 32.90 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1599) - ScannerThreadsTotalWallClockTime: 18s871ms - MaterializeTupleTime(*): 17s808ms - ScannerThreadsSysTime: 118.980ms - ScannerThreadsUserTime: 4s016ms - ScannerThreadsVoluntaryContextSwitches: 12.96K (12958) - TotalRawHdfsReadTime(*): 115.237ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488a9fd (host=vb0228.halxg.cloudera.com:22000):(Total: 3s925ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(500.000ms): 68.00 KB, 176.73 MB, 176.76 MB, 137.14 MB, 137.10 MB, 137.01 MB, 97.06 MB, 81.26 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.06 MB (185662752) - PerHostPeakMemUsage: 1.42 GB (1525279056) - PrepareTime: 142.415ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 22s400ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 76.294ms - TotalStorageWaitTime: 363.288ms CodeGen:(Total: 416.079ms, non-child: 416.079ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 266.057ms - PrepareTime: 138.954ms DataStreamSender (dst_id=11):(Total: 3s643ms, non-child: 3s643ms, % non-child: 100.00%) - BytesSent: 248.63 MB (260707898) - NetworkThroughput(*): 34.87 MB/sec - OverallThroughput: 68.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s042ms - ThriftTransmitTime(*): 7s129ms - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=2):(Total: 402.669ms, non-child: 402.669ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 484.474ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 33.42 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1372) - ScannerThreadsTotalWallClockTime: 18s607ms - MaterializeTupleTime(*): 17s645ms - ScannerThreadsSysTime: 88.984ms - ScannerThreadsUserTime: 3s573ms - ScannerThreadsVoluntaryContextSwitches: 12.96K (12964) - TotalRawHdfsReadTime(*): 119.964ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488a9fe (host=vb0206.halxg.cloudera.com:22000):(Total: 3s872ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 176.74 MB, 176.84 MB, 137.16 MB, 136.92 MB, 137.03 MB, 97.10 MB, 89.16 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 1.41 GB (1518059296) - PrepareTime: 145.356ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 22s263ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 79.971ms - TotalStorageWaitTime: 167.933ms CodeGen:(Total: 450.979ms, non-child: 450.979ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.140ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 297.870ms - PrepareTime: 140.414ms DataStreamSender (dst_id=11):(Total: 3s581ms, non-child: 3s581ms, % non-child: 100.00%) - BytesSent: 248.42 MB (260490674) - NetworkThroughput(*): 35.16 MB/sec - OverallThroughput: 69.36 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s024ms - ThriftTransmitTime(*): 7s066ms - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=2):(Total: 405.940ms, non-child: 405.940ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 573.137ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 33.15 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.61K (1607) - ScannerThreadsTotalWallClockTime: 18s298ms - MaterializeTupleTime(*): 17s439ms - ScannerThreadsSysTime: 143.975ms - ScannerThreadsUserTime: 4s125ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13029) - TotalRawHdfsReadTime(*): 116.007ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488aa02 (host=vb0230.halxg.cloudera.com:22000):(Total: 3s859ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.87 MB, 176.59 MB, 136.84 MB, 137.05 MB, 137.07 MB, 97.04 MB, 80.25 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 1.38 GB (1479045632) - PrepareTime: 141.126ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 22s135ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.288ms - TotalStorageWaitTime: 178.343ms CodeGen:(Total: 396.439ms, non-child: 396.439ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.909ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.818ms - PrepareTime: 136.096ms DataStreamSender (dst_id=11):(Total: 3s584ms, non-child: 3s584ms, % non-child: 100.00%) - BytesSent: 248.38 MB (260445684) - NetworkThroughput(*): 37.09 MB/sec - OverallThroughput: 69.29 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s976ms - ThriftTransmitTime(*): 6s696ms - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=2):(Total: 393.933ms, non-child: 393.933ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 788.705ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1000.30 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 34.17 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.78K (1781) - ScannerThreadsTotalWallClockTime: 18s241ms - MaterializeTupleTime(*): 17s156ms - ScannerThreadsSysTime: 143.976ms - ScannerThreadsUserTime: 5s737ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13032) - TotalRawHdfsReadTime(*): 155.942ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f8 (host=vb0218.halxg.cloudera.com:22000):(Total: 3s852ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.68 MB, 176.87 MB, 137.09 MB, 137.04 MB, 137.02 MB, 96.99 MB, 65.61 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621832) - PerHostPeakMemUsage: 1.38 GB (1478599840) - PrepareTime: 140.873ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 22s075ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.494ms - TotalStorageWaitTime: 248.788ms CodeGen:(Total: 379.833ms, non-child: 379.833ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 236.894ms - PrepareTime: 138.304ms DataStreamSender (dst_id=11):(Total: 3s572ms, non-child: 3s572ms, % non-child: 100.00%) - BytesSent: 249.91 MB (262050015) - NetworkThroughput(*): 34.28 MB/sec - OverallThroughput: 69.96 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s978ms - ThriftTransmitTime(*): 7s290ms - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=2):(Total: 389.103ms, non-child: 389.103ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 470.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 34.59 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.34K (1339) - ScannerThreadsTotalWallClockTime: 18s295ms - MaterializeTupleTime(*): 17s439ms - ScannerThreadsSysTime: 94.983ms - ScannerThreadsUserTime: 3s384ms - ScannerThreadsVoluntaryContextSwitches: 13.04K (13036) - TotalRawHdfsReadTime(*): 130.312ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488a9fa (host=vb0232.halxg.cloudera.com:22000):(Total: 3s823ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(500.000ms): 0, 178.32 MB, 178.41 MB, 178.30 MB, 132.63 MB, 124.48 MB, 111.53 MB, 79.36 MB, 8.82 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 6, 6, 5, 5, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.68 MB (187360008) - PerHostPeakMemUsage: 1.37 GB (1470518520) - PrepareTime: 142.753ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 22s290ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 70.046ms - TotalStorageWaitTime: 172.205ms CodeGen:(Total: 448.209ms, non-child: 448.209ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.533ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 297.370ms - PrepareTime: 141.265ms DataStreamSender (dst_id=11):(Total: 3s542ms, non-child: 3s542ms, % non-child: 100.00%) - BytesSent: 243.03 MB (254839946) - NetworkThroughput(*): 37.30 MB/sec - OverallThroughput: 68.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s986ms - ThriftTransmitTime(*): 6s515ms - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=2):(Total: 403.024ms, non-child: 403.024ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 685.878ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.26 MB (186917640) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 32.65 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1825) - ScannerThreadsTotalWallClockTime: 18s366ms - MaterializeTupleTime(*): 17s342ms - ScannerThreadsSysTime: 147.974ms - ScannerThreadsUserTime: 5s427ms - ScannerThreadsVoluntaryContextSwitches: 12.57K (12575) - TotalRawHdfsReadTime(*): 106.812ms - TotalReadThroughput: 38.19 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f7 (host=vb0204.halxg.cloudera.com:22000):(Total: 3s820ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.71 MB, 176.63 MB, 144.99 MB, 137.07 MB, 137.08 MB, 97.22 MB, 89.33 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646416) - PerHostPeakMemUsage: 1.33 GB (1431693656) - PrepareTime: 143.639ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 21s866ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 100.699ms - TotalStorageWaitTime: 243.677ms CodeGen:(Total: 392.465ms, non-child: 392.465ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.503ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 245.668ms - PrepareTime: 141.341ms DataStreamSender (dst_id=11):(Total: 3s552ms, non-child: 3s552ms, % non-child: 100.00%) - BytesSent: 248.70 MB (260779306) - NetworkThroughput(*): 34.33 MB/sec - OverallThroughput: 70.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s004ms - ThriftTransmitTime(*): 7s244ms - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=2):(Total: 385.132ms, non-child: 385.132ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 479.620ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 34.95 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1444) - ScannerThreadsTotalWallClockTime: 18s104ms - MaterializeTupleTime(*): 17s235ms - ScannerThreadsSysTime: 96.983ms - ScannerThreadsUserTime: 3s404ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13013) - TotalRawHdfsReadTime(*): 136.136ms - TotalReadThroughput: 39.00 MB/sec Instance 2a427b598be90b44:8a531ae61488a9ff (host=vb0222.halxg.cloudera.com:22000):(Total: 3s716ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(500.000ms): 139.43 MB, 164.19 MB, 164.07 MB, 124.45 MB, 112.34 MB, 111.35 MB, 79.26 MB, 9.11 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 5, 5, 1 - AverageThreadTokens: 5.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.54 MB (172531064) - PerHostPeakMemUsage: 1.34 GB (1441209672) - PrepareTime: 140.640ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 20s118ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.004ms - TotalStorageWaitTime: 94.484ms CodeGen:(Total: 403.004ms, non-child: 403.004ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.492ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 259.277ms - PrepareTime: 139.207ms DataStreamSender (dst_id=11):(Total: 3s410ms, non-child: 3s410ms, % non-child: 100.00%) - BytesSent: 223.89 MB (234769793) - NetworkThroughput(*): 35.87 MB/sec - OverallThroughput: 65.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s886ms - ThriftTransmitTime(*): 6s241ms - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=2):(Total: 425.140ms, non-child: 425.140ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 118.39 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.12 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 662.657ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088608) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 28.42 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.80K (1803) - ScannerThreadsTotalWallClockTime: 16s273ms - MaterializeTupleTime(*): 15s455ms - ScannerThreadsSysTime: 155.973ms - ScannerThreadsUserTime: 4s737ms - ScannerThreadsVoluntaryContextSwitches: 11.84K (11837) - TotalRawHdfsReadTime(*): 107.602ms - TotalReadThroughput: 35.03 MB/sec Instance 2a427b598be90b44:8a531ae61488a9f5 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s618ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(500.000ms): 0, 33.25 MB, 168.26 MB, 168.12 MB, 128.55 MB, 128.50 MB, 111.34 MB, 79.44 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.55 MB (176741664) - PerHostPeakMemUsage: 1.35 GB (1448464272) - PrepareTime: 143.987ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 19s480ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 81.224ms - TotalStorageWaitTime: 378.061ms CodeGen:(Total: 417.638ms, non-child: 417.638ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 264.048ms - PrepareTime: 141.521ms DataStreamSender (dst_id=11):(Total: 3s311ms, non-child: 3s311ms, % non-child: 100.00%) - BytesSent: 227.41 MB (238459702) - NetworkThroughput(*): 34.33 MB/sec - OverallThroughput: 68.68 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s856ms - ThriftTransmitTime(*): 6s624ms - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=2):(Total: 424.899ms, non-child: 424.899ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:0% 3:14.29% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 8.49 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 4.71 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 447.772ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.12 MB (176282912) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 28.97 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1308) - ScannerThreadsTotalWallClockTime: 16s018ms - MaterializeTupleTime(*): 15s040ms - ScannerThreadsSysTime: 92.983ms - ScannerThreadsUserTime: 3s284ms - ScannerThreadsVoluntaryContextSwitches: 11.88K (11876) - TotalRawHdfsReadTime(*): 98.827ms - TotalReadThroughput: 40.77 MB/sec Instance 2a427b598be90b44:8a531ae61488a9fb (host=vb0216.halxg.cloudera.com:22000):(Total: 3s489ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(500.000ms): 0, 160.21 MB, 160.10 MB, 160.32 MB, 120.46 MB, 111.39 MB, 79.43 MB, 55.85 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.58 MB (168377632) - PerHostPeakMemUsage: 1.34 GB (1442998000) - PrepareTime: 147.137ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 18s288ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.928ms - TotalStorageWaitTime: 316.227ms CodeGen:(Total: 420.044ms, non-child: 420.044ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 265.179ms - PrepareTime: 140.316ms DataStreamSender (dst_id=11):(Total: 3s211ms, non-child: 3s211ms, % non-child: 100.00%) - BytesSent: 223.15 MB (233986920) - NetworkThroughput(*): 34.34 MB/sec - OverallThroughput: 69.48 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s819ms - ThriftTransmitTime(*): 6s498ms - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=2):(Total: 400.696ms, non-child: 400.696ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 427.490ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.09 MB (167869768) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 29.88 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.10K (1098) - ScannerThreadsTotalWallClockTime: 14s904ms - MaterializeTupleTime(*): 14s051ms - ScannerThreadsSysTime: 68.988ms - ScannerThreadsUserTime: 3s057ms - ScannerThreadsVoluntaryContextSwitches: 11.52K (11517) - TotalRawHdfsReadTime(*): 99.481ms - TotalReadThroughput: 39.70 MB/sec Fragment F00: Instance 2a427b598be90b44:8a531ae61488aa0a (host=vb0226.halxg.cloudera.com:22000):(Total: 33s313ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(1s000ms): 129.04 MB, 258.26 MB, 258.26 MB, 258.26 MB, 258.26 MB, 258.26 MB, 258.26 MB, 258.90 MB, 260.00 MB, 259.89 MB, 260.08 MB, 260.15 MB, 260.13 MB, 260.07 MB, 260.16 MB, 260.09 MB, 259.91 MB, 260.03 MB, 260.16 MB, 256.07 MB, 140.78 MB, 85.99 MB, 104.67 MB, 109.90 MB, 178.85 MB, 170.56 MB, 170.58 MB, 170.51 MB, 170.59 MB, 170.55 MB, 170.67 MB, 158.72 MB, 138.78 MB, 56.18 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 10.68 - BloomFilterBytes: 0 - PeakMemoryUsage: 260.43 MB (273080416) - PerHostPeakMemUsage: 2.56 GB (2750927384) - PrepareTime: 142.980ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 5m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s235ms - TotalStorageWaitTime: 405.712ms CodeGen:(Total: 396.344ms, non-child: 396.344ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.697ms - PrepareTime: 139.489ms DataStreamSender (dst_id=10):(Total: 32s632ms, non-child: 32s632ms, % non-child: 100.00%) - BytesSent: 892.84 MB (936210368) - NetworkThroughput(*): 8.65 MB/sec - OverallThroughput: 27.36 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s684ms - ThriftTransmitTime(*): 1m43s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=1):(Total: 732.443ms, non-child: 732.443ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 233.91 MB, 244.18 MB, 309.82 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 9.82 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 2s185ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 259.97 MB (272597136) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 72.71 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.23K (15234) - ScannerThreadsTotalWallClockTime: 5m27s - MaterializeTupleTime(*): 5m24s - ScannerThreadsSysTime: 896.856ms - ScannerThreadsUserTime: 22s806ms - ScannerThreadsVoluntaryContextSwitches: 52.17K (52173) - TotalRawHdfsReadTime(*): 312.185ms - TotalReadThroughput: 10.97 MB/sec Instance 2a427b598be90b44:8a531ae61488aa0e (host=vb0206.halxg.cloudera.com:22000):(Total: 33s110ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(1s000ms): 130.62 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 261.18 MB, 262.09 MB, 263.02 MB, 262.98 MB, 263.06 MB, 262.85 MB, 262.89 MB, 262.98 MB, 262.89 MB, 262.95 MB, 263.04 MB, 263.05 MB, 262.65 MB, 207.07 MB, 96.81 MB, 88.90 MB, 89.02 MB, 146.02 MB, 170.45 MB, 170.58 MB, 170.42 MB, 170.56 MB, 170.47 MB, 170.44 MB, 170.65 MB, 146.71 MB, 83.47 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 2.55 GB (2739274168) - PrepareTime: 144.054ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 5m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s539ms - TotalStorageWaitTime: 434.803ms CodeGen:(Total: 405.101ms, non-child: 405.101ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.957ms - PrepareTime: 140.755ms DataStreamSender (dst_id=10):(Total: 32s520ms, non-child: 32s520ms, % non-child: 100.00%) - BytesSent: 897.98 MB (941599051) - NetworkThroughput(*): 7.66 MB/sec - OverallThroughput: 27.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s888ms - ThriftTransmitTime(*): 1m57s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=1):(Total: 648.338ms, non-child: 648.338ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.92 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 225.84 MB, 317.27 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.79 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 1s943ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742816) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 82.70 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.61K (11608) - ScannerThreadsTotalWallClockTime: 5m24s - MaterializeTupleTime(*): 5m21s - ScannerThreadsSysTime: 701.887ms - ScannerThreadsUserTime: 20s528ms - ScannerThreadsVoluntaryContextSwitches: 52.56K (52560) - TotalRawHdfsReadTime(*): 300.970ms - TotalReadThroughput: 11.03 MB/sec Instance 2a427b598be90b44:8a531ae61488aa10 (host=vb0224.halxg.cloudera.com:22000):(Total: 32s924ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 130.80 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 261.54 MB, 262.26 MB, 262.96 MB, 262.86 MB, 262.89 MB, 263.04 MB, 263.05 MB, 263.13 MB, 262.86 MB, 263.18 MB, 263.04 MB, 263.05 MB, 250.99 MB, 171.49 MB, 92.89 MB, 88.92 MB, 89.22 MB, 177.66 MB, 170.55 MB, 170.56 MB, 170.60 MB, 170.66 MB, 170.55 MB, 170.65 MB, 170.66 MB, 87.38 MB, 59.71 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.55 MB (276357232) - PerHostPeakMemUsage: 2.50 GB (2686636688) - PrepareTime: 145.101ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 5m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s296ms - TotalStorageWaitTime: 905.681ms CodeGen:(Total: 394.164ms, non-child: 394.164ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 247.034ms - PrepareTime: 140.085ms DataStreamSender (dst_id=10):(Total: 32s246ms, non-child: 32s246ms, % non-child: 100.00%) - BytesSent: 897.29 MB (940874621) - NetworkThroughput(*): 6.94 MB/sec - OverallThroughput: 27.83 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s653ms - ThriftTransmitTime(*): 2m9s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=1):(Total: 730.608ms, non-child: 730.608ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.94 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 359.39 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.79 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 2s202ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 73.33 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.22K (13225) - ScannerThreadsTotalWallClockTime: 5m22s - MaterializeTupleTime(*): 5m18s - ScannerThreadsSysTime: 820.869ms - ScannerThreadsUserTime: 23s266ms - ScannerThreadsVoluntaryContextSwitches: 52.42K (52417) - TotalRawHdfsReadTime(*): 291.040ms - TotalReadThroughput: 11.03 MB/sec Instance 2a427b598be90b44:8a531ae61488aa06 (host=vb0208.halxg.cloudera.com:22000):(Total: 32s863ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(1s000ms): 182.15 MB, 261.90 MB, 261.90 MB, 261.90 MB, 261.90 MB, 261.90 MB, 261.90 MB, 262.71 MB, 262.88 MB, 263.05 MB, 262.95 MB, 263.05 MB, 262.87 MB, 263.07 MB, 263.02 MB, 263.20 MB, 263.05 MB, 262.80 MB, 263.29 MB, 207.24 MB, 92.71 MB, 88.96 MB, 88.90 MB, 161.70 MB, 164.59 MB, 164.51 MB, 164.55 MB, 164.64 MB, 164.55 MB, 164.48 MB, 164.69 MB, 103.58 MB, 52.66 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.47 MB (276267120) - PerHostPeakMemUsage: 2.52 GB (2709334424) - PrepareTime: 146.362ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 5m40s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s173ms - TotalStorageWaitTime: 524.701ms CodeGen:(Total: 392.196ms, non-child: 392.196ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 242.582ms - PrepareTime: 140.350ms DataStreamSender (dst_id=10):(Total: 32s188ms, non-child: 32s188ms, % non-child: 100.00%) - BytesSent: 886.04 MB (929083815) - NetworkThroughput(*): 7.24 MB/sec - OverallThroughput: 27.53 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s520ms - ThriftTransmitTime(*): 2m2s - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=1):(Total: 725.077ms, non-child: 725.077ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:96.97% 1:1.515% 2:0% 3:0% 4:0% 5:1.515% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 138.21 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 338.31 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 9.79 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 2s158ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 72.96 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.91K (12907) - ScannerThreadsTotalWallClockTime: 5m20s - MaterializeTupleTime(*): 5m17s - ScannerThreadsSysTime: 816.870ms - ScannerThreadsUserTime: 22s867ms - ScannerThreadsVoluntaryContextSwitches: 51.81K (51811) - TotalRawHdfsReadTime(*): 316.310ms - TotalReadThroughput: 11.06 MB/sec Instance 2a427b598be90b44:8a531ae61488aa05 (host=vb0204.halxg.cloudera.com:22000):(Total: 32s804ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(1s000ms): 119.25 MB, 238.44 MB, 238.44 MB, 238.44 MB, 238.44 MB, 238.44 MB, 238.44 MB, 239.25 MB, 239.95 MB, 239.90 MB, 239.66 MB, 239.96 MB, 239.87 MB, 239.83 MB, 239.86 MB, 239.92 MB, 239.89 MB, 219.90 MB, 116.94 MB, 81.70 MB, 81.77 MB, 120.67 MB, 193.71 MB, 193.71 MB, 193.57 MB, 193.74 MB, 193.59 MB, 193.57 MB, 193.79 MB, 193.72 MB, 173.78 MB, 78.89 MB, 67.13 MB ThreadUsage(1s000ms): 6, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.04 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.33 MB (252000952) - PerHostPeakMemUsage: 2.46 GB (2644450360) - PrepareTime: 142.556ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 5m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s505ms - TotalStorageWaitTime: 576.830ms CodeGen:(Total: 409.393ms, non-child: 409.393ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.334ms - PrepareTime: 140.475ms DataStreamSender (dst_id=10):(Total: 32s205ms, non-child: 32s205ms, % non-child: 100.00%) - BytesSent: 899.25 MB (942933639) - NetworkThroughput(*): 9.25 MB/sec - OverallThroughput: 27.92 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s699ms - ThriftTransmitTime(*): 1m37s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=1):(Total: 666.981ms, non-child: 666.981ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 102.67 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 256.66 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.18 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 1s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.89 MB (251542192) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 80.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.34K (10344) - ScannerThreadsTotalWallClockTime: 5m5s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 726.886ms - ScannerThreadsUserTime: 19s454ms - ScannerThreadsVoluntaryContextSwitches: 52.44K (52436) - TotalRawHdfsReadTime(*): 347.718ms - TotalReadThroughput: 11.03 MB/sec Instance 2a427b598be90b44:8a531ae61488aa11 (host=vb0222.halxg.cloudera.com:22000):(Total: 32s716ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(1s000ms): 243.71 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 263.19 MB, 262.93 MB, 263.08 MB, 263.01 MB, 262.91 MB, 263.13 MB, 262.92 MB, 262.93 MB, 263.05 MB, 262.94 MB, 263.05 MB, 246.95 MB, 167.47 MB, 92.84 MB, 88.96 MB, 110.35 MB, 172.15 MB, 164.94 MB, 165.01 MB, 165.05 MB, 165.00 MB, 165.00 MB, 165.09 MB, 153.11 MB, 72.08 MB, 49.48 MB ThreadUsage(1s000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 7, 6 - AverageThreadTokens: 10.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.44 MB (276234344) - PerHostPeakMemUsage: 2.47 GB (2649613672) - PrepareTime: 141.104ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 5m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s173ms - TotalStorageWaitTime: 465.399ms CodeGen:(Total: 410.380ms, non-child: 410.380ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.194ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 265.641ms - PrepareTime: 139.563ms DataStreamSender (dst_id=10):(Total: 32s114ms, non-child: 32s114ms, % non-child: 100.00%) - BytesSent: 888.23 MB (931375642) - NetworkThroughput(*): 6.86 MB/sec - OverallThroughput: 27.66 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s669ms - ThriftTransmitTime(*): 2m9s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=1):(Total: 665.449ms, non-child: 665.449ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 212.56 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 254.51 MB, 355.02 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.77 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 1s982ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 79.60 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.58K (12582) - ScannerThreadsTotalWallClockTime: 5m19s - MaterializeTupleTime(*): 5m16s - ScannerThreadsSysTime: 770.876ms - ScannerThreadsUserTime: 20s636ms - ScannerThreadsVoluntaryContextSwitches: 51.87K (51866) - TotalRawHdfsReadTime(*): 350.399ms - TotalReadThroughput: 11.07 MB/sec Instance 2a427b598be90b44:8a531ae61488aa08 (host=vb0234.halxg.cloudera.com:22000):(Total: 32s712ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(1s000ms): 130.79 MB, 261.51 MB, 261.51 MB, 261.51 MB, 261.51 MB, 261.51 MB, 261.51 MB, 262.20 MB, 262.93 MB, 262.97 MB, 263.06 MB, 263.08 MB, 262.75 MB, 263.01 MB, 263.01 MB, 262.92 MB, 263.03 MB, 262.99 MB, 239.01 MB, 139.99 MB, 88.95 MB, 88.94 MB, 96.69 MB, 177.21 MB, 170.65 MB, 170.53 MB, 170.61 MB, 170.54 MB, 170.55 MB, 170.63 MB, 166.59 MB, 79.41 MB, 59.78 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 2.48 GB (2658682696) - PrepareTime: 139.870ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 5m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s433ms - TotalStorageWaitTime: 700.355ms CodeGen:(Total: 398.402ms, non-child: 398.402ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.504ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.469ms - PrepareTime: 137.273ms DataStreamSender (dst_id=10):(Total: 32s146ms, non-child: 32s146ms, % non-child: 100.00%) - BytesSent: 897.63 MB (941229999) - NetworkThroughput(*): 9.17 MB/sec - OverallThroughput: 27.92 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s703ms - ThriftTransmitTime(*): 1m37s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=1):(Total: 630.589ms, non-child: 630.589ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.93 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 236.13 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.80 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 1s921ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 84.98 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.46K (11461) - ScannerThreadsTotalWallClockTime: 5m20s - MaterializeTupleTime(*): 5m17s - ScannerThreadsSysTime: 684.890ms - ScannerThreadsUserTime: 19s911ms - ScannerThreadsVoluntaryContextSwitches: 52.39K (52386) - TotalRawHdfsReadTime(*): 303.121ms - TotalReadThroughput: 11.20 MB/sec Instance 2a427b598be90b44:8a531ae61488aa0f (host=vb0220.halxg.cloudera.com:22000):(Total: 32s252ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(1s000ms): 130.84 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 262.28 MB, 263.03 MB, 262.90 MB, 263.15 MB, 262.87 MB, 263.13 MB, 262.83 MB, 263.16 MB, 262.98 MB, 262.90 MB, 262.96 MB, 258.93 MB, 187.26 MB, 100.63 MB, 88.88 MB, 89.11 MB, 141.40 MB, 147.50 MB, 147.48 MB, 147.49 MB, 147.61 MB, 147.53 MB, 147.50 MB, 88.06 MB, 52.50 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.50 MB (276299936) - PerHostPeakMemUsage: 2.49 GB (2677500656) - PrepareTime: 140.358ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 5m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s070ms - TotalStorageWaitTime: 964.627ms CodeGen:(Total: 381.804ms, non-child: 381.804ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.949ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 237.973ms - PrepareTime: 134.985ms DataStreamSender (dst_id=10):(Total: 31s555ms, non-child: 31s555ms, % non-child: 100.00%) - BytesSent: 847.21 MB (888359576) - NetworkThroughput(*): 6.31 MB/sec - OverallThroughput: 26.85 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s255ms - ThriftTransmitTime(*): 2m14s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=1):(Total: 754.169ms, non-child: 754.169ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.94 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 308.01 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.62 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 2s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873952) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 67.09 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.79K (13789) - ScannerThreadsTotalWallClockTime: 5m9s - MaterializeTupleTime(*): 5m6s - ScannerThreadsSysTime: 863.863ms - ScannerThreadsUserTime: 21s874ms - ScannerThreadsVoluntaryContextSwitches: 49.60K (49600) - TotalRawHdfsReadTime(*): 297.393ms - TotalReadThroughput: 10.74 MB/sec Instance 2a427b598be90b44:8a531ae61488aa04 (host=vb0214.halxg.cloudera.com:22000):(Total: 32s153ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(1s000ms): 130.97 MB, 261.87 MB, 261.87 MB, 261.87 MB, 261.87 MB, 261.87 MB, 261.87 MB, 262.48 MB, 263.02 MB, 263.03 MB, 262.94 MB, 262.89 MB, 262.89 MB, 263.04 MB, 263.08 MB, 263.09 MB, 262.98 MB, 262.98 MB, 262.83 MB, 191.28 MB, 96.86 MB, 88.76 MB, 88.98 MB, 158.96 MB, 142.63 MB, 142.37 MB, 142.56 MB, 142.51 MB, 142.53 MB, 142.47 MB, 78.83 MB, 43.15 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 10.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.43 MB (276226144) - PerHostPeakMemUsage: 2.48 GB (2666824392) - PrepareTime: 145.708ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 5m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s539ms - TotalStorageWaitTime: 309.044ms CodeGen:(Total: 380.793ms, non-child: 380.793ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 232.105ms - PrepareTime: 136.361ms DataStreamSender (dst_id=10):(Total: 31s547ms, non-child: 31s547ms, % non-child: 100.00%) - BytesSent: 840.98 MB (881832142) - NetworkThroughput(*): 6.93 MB/sec - OverallThroughput: 26.66 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s149ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=1):(Total: 676.652ms, non-child: 676.652ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:1.562% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.93 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 335.24 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.55 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s970ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 74.01 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.14K (13138) - ScannerThreadsTotalWallClockTime: 5m6s - MaterializeTupleTime(*): 5m3s - ScannerThreadsSysTime: 806.872ms - ScannerThreadsUserTime: 20s634ms - ScannerThreadsVoluntaryContextSwitches: 49.13K (49126) - TotalRawHdfsReadTime(*): 272.351ms - TotalReadThroughput: 10.63 MB/sec Instance 2a427b598be90b44:8a531ae61488aa07 (host=vb0230.halxg.cloudera.com:22000):(Total: 32s015ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(1s000ms): 130.76 MB, 261.45 MB, 261.45 MB, 261.45 MB, 261.45 MB, 261.45 MB, 261.45 MB, 262.08 MB, 263.25 MB, 262.94 MB, 263.14 MB, 263.02 MB, 262.98 MB, 263.07 MB, 263.02 MB, 263.00 MB, 263.09 MB, 262.96 MB, 243.06 MB, 147.76 MB, 89.02 MB, 89.06 MB, 114.09 MB, 148.17 MB, 147.44 MB, 147.50 MB, 147.54 MB, 147.49 MB, 147.42 MB, 127.68 MB, 56.44 MB, 52.60 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275304) - PerHostPeakMemUsage: 2.46 GB (2646517720) - PrepareTime: 141.444ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 5m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s200ms - TotalStorageWaitTime: 613.956ms CodeGen:(Total: 407.961ms, non-child: 407.961ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.496ms - PrepareTime: 137.109ms DataStreamSender (dst_id=10):(Total: 31s406ms, non-child: 31s406ms, % non-child: 100.00%) - BytesSent: 848.07 MB (889261227) - NetworkThroughput(*): 7.79 MB/sec - OverallThroughput: 27.00 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s215ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=1):(Total: 673.240ms, non-child: 673.240ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.92 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 256.65 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.47 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 1s963ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 75.20 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.26K (11264) - ScannerThreadsTotalWallClockTime: 5m5s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 807.872ms - ScannerThreadsUserTime: 20s098ms - ScannerThreadsVoluntaryContextSwitches: 49.59K (49585) - TotalRawHdfsReadTime(*): 314.840ms - TotalReadThroughput: 10.74 MB/sec Instance 2a427b598be90b44:8a531ae61488aa0b (host=vb0232.halxg.cloudera.com:22000):(Total: 32s008ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(1s000ms): 130.53 MB, 261.89 MB, 261.89 MB, 261.89 MB, 261.89 MB, 261.89 MB, 261.89 MB, 262.60 MB, 262.95 MB, 262.95 MB, 262.98 MB, 262.86 MB, 263.00 MB, 262.91 MB, 263.04 MB, 263.07 MB, 262.98 MB, 262.99 MB, 259.19 MB, 167.34 MB, 88.98 MB, 88.99 MB, 88.81 MB, 153.16 MB, 147.54 MB, 147.49 MB, 147.42 MB, 147.41 MB, 147.49 MB, 135.52 MB, 60.27 MB, 52.63 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209808) - PerHostPeakMemUsage: 2.47 GB (2657225280) - PrepareTime: 138.255ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 5m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s265ms - TotalStorageWaitTime: 409.002ms CodeGen:(Total: 393.127ms, non-child: 393.127ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.421ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 250.934ms - PrepareTime: 136.783ms DataStreamSender (dst_id=10):(Total: 31s434ms, non-child: 31s434ms, % non-child: 100.00%) - BytesSent: 849.15 MB (890397464) - NetworkThroughput(*): 6.61 MB/sec - OverallThroughput: 27.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s401ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=1):(Total: 638.021ms, non-child: 638.021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 287.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.55 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 1s817ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 79.44 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.30K (10305) - ScannerThreadsTotalWallClockTime: 5m5s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 667.893ms - ScannerThreadsUserTime: 18s792ms - ScannerThreadsVoluntaryContextSwitches: 49.68K (49684) - TotalRawHdfsReadTime(*): 269.348ms - TotalReadThroughput: 10.93 MB/sec Instance 2a427b598be90b44:8a531ae61488aa12 (host=vb0218.halxg.cloudera.com:22000):(Total: 31s972ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(1s000ms): 130.92 MB, 261.78 MB, 261.78 MB, 261.78 MB, 261.78 MB, 261.78 MB, 261.78 MB, 262.42 MB, 263.01 MB, 262.98 MB, 262.88 MB, 263.02 MB, 262.93 MB, 263.00 MB, 263.02 MB, 262.91 MB, 263.12 MB, 262.93 MB, 234.83 MB, 143.82 MB, 89.01 MB, 89.03 MB, 121.40 MB, 154.49 MB, 147.59 MB, 147.42 MB, 147.53 MB, 147.45 MB, 147.47 MB, 115.53 MB, 52.53 MB, 52.53 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 2.47 GB (2652351456) - PrepareTime: 139.269ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 5m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s123ms - TotalStorageWaitTime: 430.948ms CodeGen:(Total: 378.371ms, non-child: 378.371ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.373ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 236.949ms - PrepareTime: 137.095ms DataStreamSender (dst_id=10):(Total: 31s344ms, non-child: 31s344ms, % non-child: 100.00%) - BytesSent: 848.11 MB (889312595) - NetworkThroughput(*): 6.63 MB/sec - OverallThroughput: 27.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s240ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=1):(Total: 685.185ms, non-child: 685.185ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 112.94 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 266.93 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.45 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 2s051ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 73.89 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.02K (12019) - ScannerThreadsTotalWallClockTime: 5m5s - MaterializeTupleTime(*): 5m2s - ScannerThreadsSysTime: 766.878ms - ScannerThreadsUserTime: 21s710ms - ScannerThreadsVoluntaryContextSwitches: 49.70K (49698) - TotalRawHdfsReadTime(*): 257.983ms - TotalReadThroughput: 10.74 MB/sec Instance 2a427b598be90b44:8a531ae61488aa0d (host=vb0228.halxg.cloudera.com:22000):(Total: 31s793ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(1s000ms): 128.28 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.50 MB, 256.25 MB, 257.07 MB, 256.88 MB, 256.95 MB, 256.99 MB, 257.05 MB, 256.90 MB, 256.93 MB, 257.12 MB, 256.79 MB, 257.00 MB, 249.08 MB, 200.14 MB, 112.66 MB, 104.75 MB, 104.72 MB, 169.75 MB, 147.41 MB, 147.51 MB, 147.38 MB, 147.45 MB, 135.75 MB, 111.88 MB, 45.36 MB, 28.36 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 6, 3 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.42 MB (269926496) - PerHostPeakMemUsage: 2.43 GB (2607266816) - PrepareTime: 139.497ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 5m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s185ms - TotalStorageWaitTime: 529.194ms CodeGen:(Total: 403.883ms, non-child: 403.883ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 258.619ms - PrepareTime: 135.660ms DataStreamSender (dst_id=10):(Total: 31s168ms, non-child: 31s168ms, % non-child: 100.00%) - BytesSent: 836.82 MB (877467469) - NetworkThroughput(*): 7.29 MB/sec - OverallThroughput: 26.85 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s172ms - ThriftTransmitTime(*): 1m54s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=1):(Total: 686.128ms, non-child: 686.128ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 110.78 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 231.81 MB, 242.08 MB, 242.08 MB, 242.08 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.52 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 1s942ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 256.97 MB (269451408) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 72.80 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.71K (11710) - ScannerThreadsTotalWallClockTime: 5m2s - MaterializeTupleTime(*): 4m59s - ScannerThreadsSysTime: 862.862ms - ScannerThreadsUserTime: 19s976ms - ScannerThreadsVoluntaryContextSwitches: 48.93K (48932) - TotalRawHdfsReadTime(*): 297.825ms - TotalReadThroughput: 10.77 MB/sec Instance 2a427b598be90b44:8a531ae61488aa09 (host=vb0212.halxg.cloudera.com:22000):(Total: 31s206ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(500.000ms): 66.54 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.90 MB, 262.91 MB, 263.05 MB, 262.91 MB, 262.99 MB, 262.95 MB, 263.12 MB, 263.14 MB, 263.09 MB, 262.84 MB, 263.10 MB, 263.04 MB, 263.09 MB, 262.99 MB, 262.96 MB, 262.84 MB, 263.04 MB, 262.77 MB, 262.93 MB, 262.97 MB, 262.93 MB, 262.89 MB, 247.06 MB, 175.28 MB, 159.50 MB, 88.90 MB, 88.98 MB, 88.86 MB, 88.84 MB, 88.83 MB, 88.79 MB, 171.06 MB, 147.45 MB, 147.38 MB, 147.47 MB, 147.38 MB, 147.50 MB, 147.52 MB, 147.48 MB, 147.43 MB, 147.55 MB, 147.50 MB, 147.36 MB, 147.57 MB, 99.52 MB, 52.42 MB, 52.53 MB, 52.64 MB, 52.71 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.42 MB (276218048) - PerHostPeakMemUsage: 2.33 GB (2497060568) - PrepareTime: 141.452ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 5m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s706ms - TotalStorageWaitTime: 553.404ms CodeGen:(Total: 422.269ms, non-child: 422.269ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 273.394ms - PrepareTime: 137.430ms DataStreamSender (dst_id=10):(Total: 30s644ms, non-child: 30s644ms, % non-child: 100.00%) - BytesSent: 847.65 MB (888824315) - NetworkThroughput(*): 7.81 MB/sec - OverallThroughput: 27.66 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s227ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=1):(Total: 626.326ms, non-child: 626.326ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.41% 1:0% 2:0% 3:1.587% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 24.78 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 9.62 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s820ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 80.78 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.77K (9765) - ScannerThreadsTotalWallClockTime: 4m59s - MaterializeTupleTime(*): 4m56s - ScannerThreadsSysTime: 602.902ms - ScannerThreadsUserTime: 18s907ms - ScannerThreadsVoluntaryContextSwitches: 49.47K (49469) - TotalRawHdfsReadTime(*): 276.027ms - TotalReadThroughput: 11.08 MB/sec Instance 2a427b598be90b44:8a531ae61488aa0c (host=vb0216.halxg.cloudera.com:22000):(Total: 30s381ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 0, 260.96 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 261.85 MB, 263.13 MB, 263.20 MB, 262.80 MB, 262.86 MB, 262.84 MB, 262.86 MB, 263.05 MB, 262.83 MB, 263.06 MB, 262.89 MB, 262.95 MB, 263.12 MB, 263.13 MB, 262.96 MB, 263.09 MB, 262.95 MB, 262.95 MB, 263.07 MB, 262.91 MB, 263.05 MB, 262.85 MB, 262.93 MB, 254.89 MB, 183.17 MB, 167.23 MB, 96.47 MB, 88.81 MB, 89.02 MB, 88.94 MB, 89.04 MB, 89.01 MB, 129.57 MB, 124.28 MB, 124.54 MB, 124.47 MB, 124.37 MB, 124.30 MB, 124.44 MB, 124.55 MB, 124.30 MB, 124.19 MB, 124.30 MB, 108.16 MB, 60.88 MB, 45.20 MB, 45.27 MB, 24.48 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 10.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275304) - PerHostPeakMemUsage: 2.24 GB (2401730480) - PrepareTime: 144.114ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 5m6s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s601ms - TotalStorageWaitTime: 363.743ms CodeGen:(Total: 398.293ms, non-child: 398.293ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 247.892ms - PrepareTime: 137.320ms DataStreamSender (dst_id=10):(Total: 29s798ms, non-child: 29s798ms, % non-child: 100.00%) - BytesSent: 799.72 MB (838564757) - NetworkThroughput(*): 7.15 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s767ms - ThriftTransmitTime(*): 1m51s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=1):(Total: 644.114ms, non-child: 644.114ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 287.48 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.48 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s817ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 73.97 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.63K (10634) - ScannerThreadsTotalWallClockTime: 4m48s - MaterializeTupleTime(*): 4m45s - ScannerThreadsSysTime: 653.894ms - ScannerThreadsUserTime: 18s943ms - ScannerThreadsVoluntaryContextSwitches: 46.64K (46638) - TotalRawHdfsReadTime(*): 253.902ms - TotalReadThroughput: 10.77 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 16:EXCHANGE | 1 | 7.17us | 0ns | 7.17us | 0 | 36.00M | | 15:AGGREGATE | 15 | 5.28s | 0ns | 5.91s | 0 | 36.00M | | 14:EXCHANGE | 15 | 913.20ms | 0ns | 1.04s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 4.11s | 0ns | 4.61s | 395.39M | 36.00M | | 00:UNION | 15 | 4.08s | 0ns | 4.82s | 398.68M | 36.00M | | |--08:AGGREGATE | 15 | 9.66s | 0ns | 10.62s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.97s | 0ns | 15.76s | 774.31M | 18.00M | | | |--13:EXCHANGE | 15 | 1.13s | 0ns | 1.32s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 390.80ms | 0ns | 462.96ms | 204.99M | 45.00M | | | 12:EXCHANGE | 15 | 3.13s | 0ns | 5.24s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 682.37ms | 0ns | 757.22ms | 774.31M | 180.00M | | 04:AGGREGATE | 15 | 9.07s | 0ns | 9.58s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.56s | 0ns | 14.60s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 1.04s | 0ns | 1.38s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 401.60ms | 0ns | 498.86ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 3.08s | 0ns | 4.87s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 679.06ms | 0ns | 724.10ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=194abadfc94cbc81:89ceb14c5a96919a): Summary: Session ID: 35469ab5ea38f156:7ed80cfbbb271880 Session Type: BEESWAX Start Time: 2016-03-23 22:58:35.912893000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a57a5e1a62605356dd3271c1488741ea109c4b5a) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:60225 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=2 16:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 15:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 14:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--08:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--13:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 12:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 04:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 23.658ms - Analysis finished: 8.939ms (8.939ms) - Equivalence classes computed: 9.247ms (308.227us) - Single node plan created: 15.695ms (6.448ms) - Runtime filters computed: 15.932ms (236.544us) - Distributed plan created: 19.215ms (3.283ms) - Lineage info computed: 20.065ms (849.618us) - Planning finished: 23.658ms (3.592ms) Query Timeline: 1m25s - Start execution: 48.231us (48.231us) - Planning finished: 28.341ms (28.293ms) - Ready to start 90 remote fragments: 30.499ms (2.158ms) - All 90 remote fragments started: 46.463ms (15.963ms) - Rows available: 1m25s (1m25s) - First row fetched: 1m25s (7.687ms) ImpalaServer: - ClientFetchWaitTimer: 7.706ms - RowMaterializationTimer: 0.000ns Execution Profile 194abadfc94cbc81:89ceb14c5a96919a:(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 7ms Per Node Peak Memory Usage: vb0214.halxg.cloudera.com:22000(2.98 GB) vb0208.halxg.cloudera.com:22000(3.04 GB) vb0230.halxg.cloudera.com:22000(3.03 GB) vb0234.halxg.cloudera.com:22000(3.03 GB) vb0212.halxg.cloudera.com:22000(3.03 GB) vb0226.halxg.cloudera.com:22000(3.03 GB) vb0232.halxg.cloudera.com:22000(3.03 GB) vb0216.halxg.cloudera.com:22000(2.97 GB) vb0228.halxg.cloudera.com:22000(3.01 GB) vb0206.halxg.cloudera.com:22000(3.03 GB) vb0220.halxg.cloudera.com:22000(2.97 GB) vb0224.halxg.cloudera.com:22000(3.05 GB) vb0222.halxg.cloudera.com:22000(3.03 GB) vb0218.halxg.cloudera.com:22000(3.02 GB) vb0204.halxg.cloudera.com:22000(3.16 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F08:(Total: 1m25s, non-child: 273.106us, % non-child: 0.00%) MemoryUsage(2s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 23.285us - RowsProduced: 0 (0) - TotalCpuTime: 25.378ms - TotalNetworkReceiveTime: 1m25s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=16):(Total: 1m25s, non-child: 7.168us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 975.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1m25s - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F07:(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m25s max:1m25s mean: 1m25s stddev:17.206ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.54 MB (971550539) - PerHostPeakMemUsage: 3.03 GB (3250833822) - PrepareTime: 153.620ms - RowsProduced: 0 (0) - TotalCpuTime: 6s384ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 261.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 468.143ms, non-child: 468.143ms, % non-child: 100.00%) - CodegenTime: 2.228ms - CompileTime: 35.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 282.973ms - PrepareTime: 145.022ms DataStreamSender (dst_id=16):(Total: 17.852us, non-child: 17.852us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s280ms, % non-child: 6.18%) - BuildTime: 4s354ms - GetNewBlockTime: 1.237ms - GetResultsTime: 676.819ms - HTResizeTime: 1s370ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.729us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 1m20s, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759337) - ConvertRowBatchTime: 723.422ms - DeserializeRowBatchTimer: 673.286ms - FirstBatchArrivalWaitTime: 31s901ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 328.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m22s max:1m25s mean: 1m23s stddev:834.928ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2136448944) - PerHostPeakMemUsage: 3.03 GB (3250833822) - PrepareTime: 159.653ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 18s103ms - TotalNetworkSendTime: 1s183ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 671.327ms, non-child: 671.327ms, % non-child: 100.00%) - CodegenTime: 3.838ms - CompileTime: 123.322ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 401.206ms - PrepareTime: 143.356ms DataStreamSender (dst_id=14):(Total: 5s977ms, non-child: 5s977ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759337) - NetworkThroughput(*): 60.47 MB/sec - OverallThroughput: 47.95 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s184ms - ThriftTransmitTime(*): 4s765ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s111ms, % non-child: 5.35%) - GetNewBlockTime: 651.383us - GetResultsTime: 129.211ms - HTResizeTime: 152.368ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 343.35 K/sec - StreamingTime: 3s765ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 4s082ms, % non-child: 5.62%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 365.81 K/sec AGGREGATION_NODE (id=8):(Total: 36s299ms, non-child: 9s663ms, % non-child: 26.62%) - BuildTime: 8s908ms - GetNewBlockTime: 1.672ms - GetResultsTime: 607.657ms - HTResizeTime: 1s212ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 366.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.304us HASH_JOIN_NODE (id=7):(Total: 26s635ms, non-child: 13s967ms, % non-child: 52.44%) - BuildPartitionTime: 1s610ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s764ms - GetNewBlockTime: 586.611us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s741ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 1.94 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.201us EXCHANGE_NODE (id=13):(Total: 4s160ms, non-child: 4s160ms, % non-child: 100.00%) - BytesReceived: 251.95 MB (264183977) - ConvertRowBatchTime: 357.276ms - DeserializeRowBatchTimer: 1s546ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.52 M/sec - SendersBlockedTimer: 39s023ms - SendersBlockedTotalTimer(*): 7m41s EXCHANGE_NODE (id=12):(Total: 8s507ms, non-child: 8s507ms, % non-child: 100.00%) - BytesReceived: 864.82 MB (906828326) - ConvertRowBatchTime: 1s556ms - DeserializeRowBatchTimer: 5s531ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.14 M/sec - SendersBlockedTimer: 48s861ms - SendersBlockedTotalTimer(*): 9m17s AGGREGATION_NODE (id=4):(Total: 32s282ms, non-child: 9s071ms, % non-child: 28.10%) - BuildTime: 8s314ms - GetNewBlockTime: 1.100ms - GetResultsTime: 609.560ms - HTResizeTime: 1s234ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 411.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.313us HASH_JOIN_NODE (id=3):(Total: 23s211ms, non-child: 13s563ms, % non-child: 58.43%) - BuildPartitionTime: 1s704ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s702ms - GetNewBlockTime: 921.981us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s309ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.22 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.793us EXCHANGE_NODE (id=11):(Total: 2s635ms, non-child: 2s635ms, % non-child: 100.00%) - BytesReceived: 252.37 MB (264625380) - ConvertRowBatchTime: 381.252ms - DeserializeRowBatchTimer: 1s427ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 5.28 M/sec - SendersBlockedTimer: 52.040ms - SendersBlockedTotalTimer(*): 471.394ms EXCHANGE_NODE (id=10):(Total: 7s012ms, non-child: 7s012ms, % non-child: 100.00%) - BytesReceived: 864.75 MB (906754002) - ConvertRowBatchTime: 1s500ms - DeserializeRowBatchTimer: 5s279ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 7.43 M/sec - SendersBlockedTimer: 8s224ms - SendersBlockedTotalTimer(*): 1m43s Averaged Fragment F04:(Total: 44s588ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:44s305ms max:45s502ms mean: 44s893ms stddev:326.218ms execution rates: min:25.28 MB/sec max:33.42 MB/sec mean:28.61 MB/sec stddev:2.20 MB/sec num instances: 15 - AverageThreadTokens: 6.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.77 MB (190596044) - PerHostPeakMemUsage: 2.47 GB (2655270857) - PrepareTime: 147.431ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 4m2s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s785ms - TotalStorageWaitTime: 173.094ms CodeGen:(Total: 415.658ms, non-child: 415.658ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.258ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.476ms - PrepareTime: 142.470ms DataStreamSender (dst_id=13):(Total: 44s321ms, non-child: 44s321ms, % non-child: 100.00%) - BytesSent: 251.95 MB (264183977) - NetworkThroughput(*): 851.23 KB/sec - OverallThroughput: 5.68 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s035ms - ThriftTransmitTime(*): 7m48s - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=6):(Total: 390.796ms, non-child: 390.796ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.37 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 534.474ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.32 MB (190122588) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 35.14 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1522) - ScannerThreadsTotalWallClockTime: 3m58s - MaterializeTupleTime(*): 3m58s - ScannerThreadsSysTime: 109.380ms - ScannerThreadsUserTime: 3s961ms - ScannerThreadsVoluntaryContextSwitches: 13.24K (13238) - TotalRawHdfsReadTime(*): 130.108ms - TotalReadThroughput: 3.54 MB/sec Averaged Fragment F03:(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:1m12s max:1m15s mean: 1m14s stddev:683.307ms execution rates: min:56.05 MB/sec max:61.24 MB/sec mean:59.22 MB/sec stddev:1.57 MB/sec num instances: 15 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 261.05 MB (273728950) - PerHostPeakMemUsage: 3.02 GB (3238735743) - PrepareTime: 145.352ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 13m2s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s427ms - TotalStorageWaitTime: 464.310ms CodeGen:(Total: 403.016ms, non-child: 403.016ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 253.011ms - PrepareTime: 140.912ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 864.82 MB (906828326) - NetworkThroughput(*): 1.53 MB/sec - OverallThroughput: 11.83 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s473ms - ThriftTransmitTime(*): 9m41s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=5):(Total: 682.373ms, non-child: 682.373ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s993ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.61 MB (273264765) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 75.78 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.41K (12412) - ScannerThreadsTotalWallClockTime: 12m42s - MaterializeTupleTime(*): 12m40s - ScannerThreadsSysTime: 777.676ms - ScannerThreadsUserTime: 21s491ms - ScannerThreadsVoluntaryContextSwitches: 50.53K (50526) - TotalRawHdfsReadTime(*): 297.122ms - TotalReadThroughput: 4.81 MB/sec Averaged Fragment F01:(Total: 4s005ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.10 GB, max: 1.48 GB, avg: 1.25 GB, stddev: 107.42 MB completion times: min:3s873ms max:5s053ms mean: 4s298ms stddev:310.082ms execution rates: min:281.12 MB/sec max:314.58 MB/sec mean:298.81 MB/sec stddev:10.37 MB/sec num instances: 15 - AverageThreadTokens: 5.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190588394) - PerHostPeakMemUsage: 1.42 GB (1528580841) - PrepareTime: 145.544ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 23s526ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 111.267ms - TotalStorageWaitTime: 232.697ms CodeGen:(Total: 400.791ms, non-child: 400.791ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 250.179ms - PrepareTime: 140.052ms DataStreamSender (dst_id=11):(Total: 3s723ms, non-child: 3s723ms, % non-child: 100.00%) - BytesSent: 252.37 MB (264625380) - NetworkThroughput(*): 36.38 MB/sec - OverallThroughput: 67.80 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s062ms - ThriftTransmitTime(*): 6s935ms - UncompressedRowBatchSize: 599.61 MB (628733578) HDFS_SCAN_NODE (id=2):(Total: 401.597ms, non-child: 401.597ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 5.01 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 622.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.31 MB (190122551) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 34.08 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1820) - ScannerThreadsTotalWallClockTime: 19s572ms - MaterializeTupleTime(*): 18s607ms - ScannerThreadsSysTime: 137.776ms - ScannerThreadsUserTime: 4s645ms - ScannerThreadsVoluntaryContextSwitches: 13.21K (13207) - TotalRawHdfsReadTime(*): 135.260ms - TotalReadThroughput: 38.43 MB/sec Averaged Fragment F00:(Total: 31s043ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 151.59 MB completion times: min:29s595ms max:32s306ms mean: 31s506ms stddev:640.736ms execution rates: min:135.55 MB/sec max:143.30 MB/sec mean:139.41 MB/sec stddev:2.41 MB/sec num instances: 15 - AverageThreadTokens: 10.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 260.63 MB (273285686) - PerHostPeakMemUsage: 2.46 GB (2643274858) - PrepareTime: 143.224ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 5m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s673ms - TotalStorageWaitTime: 522.396ms CodeGen:(Total: 412.523ms, non-child: 412.523ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 264.473ms - PrepareTime: 137.941ms DataStreamSender (dst_id=10):(Total: 30s427ms, non-child: 30s427ms, % non-child: 100.00%) - BytesSent: 864.75 MB (906754002) - NetworkThroughput(*): 6.88 MB/sec - OverallThroughput: 28.41 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s021ms - ThriftTransmitTime(*): 2m6s - UncompressedRowBatchSize: 2.21 GB (2374947031) HDFS_SCAN_NODE (id=1):(Total: 679.062ms, non-child: 679.062ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.66 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s947ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 260.18 MB (272821483) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 76.07 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.28K (12283) - ScannerThreadsTotalWallClockTime: 5m - MaterializeTupleTime(*): 4m58s - ScannerThreadsSysTime: 757.012ms - ScannerThreadsUserTime: 21s789ms - ScannerThreadsVoluntaryContextSwitches: 50.51K (50509) - TotalRawHdfsReadTime(*): 289.677ms - TotalReadThroughput: 11.34 MB/sec Fragment F07: Instance 194abadfc94cbc81:89ceb14c5a96919d (host=vb0222.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 80.95 MB, 296.28 MB, 520.71 MB, 731.18 MB, 876.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.06 MB, 882.05 MB, 900.05 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.84 MB (971866624) - PerHostPeakMemUsage: 3.03 GB (3256207072) - PrepareTime: 145.455ms - RowsProduced: 0 (0) - TotalCpuTime: 6s941ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 149.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 433.089ms, non-child: 433.089ms, % non-child: 100.00%) - CodegenTime: 1.194ms - CompileTime: 30.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 258.446ms - PrepareTime: 142.407ms DataStreamSender (dst_id=16):(Total: 12.471us, non-child: 12.471us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s783ms, % non-child: 6.77%) ExecOption: Codegen Enabled - BuildTime: 4s846ms - GetNewBlockTime: 453.666us - GetResultsTime: 673.097ms - HTResizeTime: 1s498ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.534us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 1s010ms, % non-child: 1.27%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.29 MB, 47.61 MB, 83.54 MB, 117.25 MB, 139.81 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 157.19 MB, 192.72 MB, 232.33 MB, 273.44 MB - BytesReceived: 284.05 MB (297848577) - ConvertRowBatchTime: 805.135ms - DeserializeRowBatchTimer: 770.854ms - FirstBatchArrivalWaitTime: 31s932ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 330.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a4 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 80.48 MB, 312.60 MB, 547.48 MB, 827.01 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 906.05 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.28 MB (970229824) - PerHostPeakMemUsage: 3.03 GB (3255517192) - PrepareTime: 157.141ms - RowsProduced: 0 (0) - TotalCpuTime: 6s932ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 324.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 444.964ms, non-child: 444.964ms, % non-child: 100.00%) - CodegenTime: 2.550ms - CompileTime: 33.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 258.010ms - PrepareTime: 145.296ms DataStreamSender (dst_id=16):(Total: 26.078us, non-child: 26.078us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s736ms, % non-child: 6.71%) ExecOption: Codegen Enabled - BuildTime: 4s787ms - GetNewBlockTime: 428.586us - GetResultsTime: 688.161ms - HTResizeTime: 1s497ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.491us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 1s037ms, % non-child: 1.30%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.08 MB, 51.68 MB, 89.40 MB, 131.33 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 165.35 MB, 209.36 MB, 246.34 MB, 281.91 MB - BytesReceived: 283.96 MB (297749620) - ConvertRowBatchTime: 826.161ms - DeserializeRowBatchTimer: 671.619ms - FirstBatchArrivalWaitTime: 31s926ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 330.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a96919e (host=vb0224.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 57.20 MB, 255.14 MB, 489.09 MB, 716.88 MB, 876.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.05 MB, 900.05 MB, 665.37 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.03 MB (972057584) - PerHostPeakMemUsage: 3.05 GB (3271592736) - PrepareTime: 146.911ms - RowsProduced: 0 (0) - TotalCpuTime: 6s398ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 150.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 431.124ms, non-child: 431.124ms, % non-child: 100.00%) - CodegenTime: 1.300ms - CompileTime: 33.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.828ms - PrepareTime: 143.802ms DataStreamSender (dst_id=16):(Total: 12.352us, non-child: 12.352us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s291ms, % non-child: 6.19%) ExecOption: Codegen Enabled - BuildTime: 4s361ms - GetNewBlockTime: 380.342us - GetResultsTime: 684.991ms - HTResizeTime: 1s256ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.312us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 969.236ms, % non-child: 1.21%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.88 MB, 51.51 MB, 87.25 MB, 124.46 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 141.07 MB, 170.27 MB, 209.80 MB, 242.83 MB, 281.34 MB - BytesReceived: 284.01 MB (297803348) - ConvertRowBatchTime: 758.692ms - DeserializeRowBatchTimer: 734.709ms - FirstBatchArrivalWaitTime: 31s933ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 328.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a96919f (host=vb0220.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 47.18 MB, 251.73 MB, 473.71 MB, 727.50 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.04 MB, 894.05 MB, 693.68 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.12 MB (970055232) - PerHostPeakMemUsage: 2.97 GB (3190940824) - PrepareTime: 144.899ms - RowsProduced: 0 (0) - TotalCpuTime: 7s108ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 254.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 429.518ms, non-child: 429.518ms, % non-child: 100.00%) - CodegenTime: 1.272ms - CompileTime: 31.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 254.624ms - PrepareTime: 141.594ms DataStreamSender (dst_id=16):(Total: 11.396us, non-child: 11.396us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s907ms, % non-child: 6.91%) ExecOption: Codegen Enabled - BuildTime: 4s970ms - GetNewBlockTime: 428.668us - GetResultsTime: 677.910ms - HTResizeTime: 1s493ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.454us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 1s044ms, % non-child: 1.31%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 15.98 MB, 48.68 MB, 85.39 MB, 126.24 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 141.02 MB, 163.83 MB, 201.63 MB, 240.04 MB, 275.22 MB - BytesReceived: 283.82 MB (297605326) - ConvertRowBatchTime: 840.830ms - DeserializeRowBatchTimer: 736.621ms - FirstBatchArrivalWaitTime: 31s931ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 331.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a9 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 57.18 MB, 302.29 MB, 532.04 MB, 775.41 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 892.70 MB, 693.69 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.98 MB (972013936) - PerHostPeakMemUsage: 3.16 GB (3390424624) - PrepareTime: 157.995ms - RowsProduced: 0 (0) - TotalCpuTime: 6s977ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 147.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 447.256ms, non-child: 447.256ms, % non-child: 100.00%) - CodegenTime: 2.143ms - CompileTime: 28.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 263.904ms - PrepareTime: 152.861ms DataStreamSender (dst_id=16):(Total: 12.979us, non-child: 12.979us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s806ms, % non-child: 6.79%) ExecOption: Codegen Enabled - BuildTime: 4s855ms - GetNewBlockTime: 550.683us - GetResultsTime: 684.771ms - HTResizeTime: 1s519ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.745us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 1s029ms, % non-child: 1.29%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 19.07 MB, 57.08 MB, 95.32 MB, 131.36 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.83 MB, 159.33 MB, 188.32 MB, 218.26 MB, 259.85 MB - BytesReceived: 283.95 MB (297740088) - ConvertRowBatchTime: 812.218ms - DeserializeRowBatchTimer: 691.937ms - FirstBatchArrivalWaitTime: 31s940ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 330.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a3 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 45.23 MB, 250.56 MB, 479.01 MB, 721.41 MB, 878.25 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.05 MB, 884.06 MB, 750.31 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.30 MB (971293744) - PerHostPeakMemUsage: 3.03 GB (3248485240) - PrepareTime: 148.234ms - RowsProduced: 0 (0) - TotalCpuTime: 6s482ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 299.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 451.895ms, non-child: 451.895ms, % non-child: 100.00%) - CodegenTime: 1.225ms - CompileTime: 42.703ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 262.861ms - PrepareTime: 145.060ms DataStreamSender (dst_id=16):(Total: 12.714us, non-child: 12.714us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s357ms, % non-child: 6.27%) ExecOption: Codegen Enabled - BuildTime: 4s425ms - GetNewBlockTime: 459.088us - GetResultsTime: 676.245ms - HTResizeTime: 1s407ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.552us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 962.357ms, % non-child: 1.20%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.68 MB, 49.40 MB, 87.06 MB, 123.10 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.83 MB, 161.55 MB, 192.53 MB, 225.57 MB, 260.31 MB - BytesReceived: 284.08 MB (297875194) - ConvertRowBatchTime: 757.149ms - DeserializeRowBatchTimer: 758.712ms - FirstBatchArrivalWaitTime: 31s936ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 329.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a1 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 79.33 MB, 311.10 MB, 596.49 MB, 860.09 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 888.05 MB, 906.03 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 928.28 MB (973372480) - PerHostPeakMemUsage: 3.01 GB (3234129912) - PrepareTime: 168.252ms - RowsProduced: 0 (0) - TotalCpuTime: 5s460ms - TotalNetworkReceiveTime: 1m20s - TotalNetworkSendTime: 381.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 464.213ms, non-child: 464.213ms, % non-child: 100.00%) - CodegenTime: 4.488ms - CompileTime: 37.861ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 273.192ms - PrepareTime: 145.633ms DataStreamSender (dst_id=16):(Total: 39.250us, non-child: 39.250us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 4s563ms, % non-child: 5.34%) ExecOption: Codegen Enabled - BuildTime: 3s627ms - GetNewBlockTime: 7.248ms - GetResultsTime: 684.429ms - HTResizeTime: 1s244ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.898us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 689.228ms, % non-child: 0.85%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.15 MB, 49.67 MB, 96.13 MB, 137.28 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 159.21 MB, 198.63 MB, 247.97 MB, 283.97 MB - BytesReceived: 283.97 MB (297762392) - ConvertRowBatchTime: 537.734ms - DeserializeRowBatchTimer: 529.186ms - FirstBatchArrivalWaitTime: 31s891ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 325.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a6 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 59.37 MB, 267.31 MB, 477.53 MB, 753.80 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 906.04 MB, 679.52 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.90 MB (971926640) - PerHostPeakMemUsage: 3.03 GB (3253945912) - PrepareTime: 146.186ms - RowsProduced: 0 (0) - TotalCpuTime: 5s563ms - TotalNetworkReceiveTime: 1m20s - TotalNetworkSendTime: 283.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.219ms, non-child: 434.219ms, % non-child: 100.00%) - CodegenTime: 1.228ms - CompileTime: 33.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.273ms - PrepareTime: 143.030ms DataStreamSender (dst_id=16):(Total: 46.703us, non-child: 46.703us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 4s670ms, % non-child: 5.47%) ExecOption: Codegen Enabled - BuildTime: 3s791ms - GetNewBlockTime: 461.558us - GetResultsTime: 659.817ms - HTResizeTime: 1s301ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.830us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 702.329ms, % non-child: 0.87%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.79 MB, 50.65 MB, 86.55 MB, 129.27 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 141.24 MB, 164.31 MB, 208.80 MB, 254.21 MB, 283.95 MB - BytesReceived: 283.95 MB (297741330) - ConvertRowBatchTime: 557.695ms - DeserializeRowBatchTimer: 565.733ms - FirstBatchArrivalWaitTime: 31s936ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 326.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a8 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 61.80 MB, 263.20 MB, 455.82 MB, 641.53 MB, 823.71 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 906.06 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.51 MB (971511984) - PerHostPeakMemUsage: 3.04 GB (3263248168) - PrepareTime: 159.936ms - RowsProduced: 0 (0) - TotalCpuTime: 6s796ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 369.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 485.038ms, non-child: 485.038ms, % non-child: 100.00%) - CodegenTime: 4.656ms - CompileTime: 40.441ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 290.152ms - PrepareTime: 144.431ms DataStreamSender (dst_id=16):(Total: 13.414us, non-child: 13.414us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s624ms, % non-child: 6.58%) ExecOption: Codegen Enabled - BuildTime: 4s672ms - GetNewBlockTime: 543.099us - GetResultsTime: 695.594ms - HTResizeTime: 1s446ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.897us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 989.852ms, % non-child: 1.24%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.12 MB, 42.72 MB, 73.25 MB, 102.73 MB, 132.98 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.73 MB, 161.31 MB, 199.06 MB, 241.63 MB, 282.11 MB - BytesReceived: 283.87 MB (297663818) - ConvertRowBatchTime: 780.826ms - DeserializeRowBatchTimer: 717.304ms - FirstBatchArrivalWaitTime: 31s884ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 330.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a7 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 77.45 MB, 312.60 MB, 539.48 MB, 823.93 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.80 MB (969727872) - PerHostPeakMemUsage: 3.03 GB (3248363336) - PrepareTime: 155.928ms - RowsProduced: 0 (0) - TotalCpuTime: 6s493ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 294.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 454.721ms, non-child: 454.721ms, % non-child: 100.00%) - CodegenTime: 2.329ms - CompileTime: 32.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 271.578ms - PrepareTime: 145.649ms DataStreamSender (dst_id=16):(Total: 11.898us, non-child: 11.898us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s361ms, % non-child: 6.28%) ExecOption: Codegen Enabled - BuildTime: 4s443ms - GetNewBlockTime: 625.324us - GetResultsTime: 666.956ms - HTResizeTime: 1s349ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.373us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 974.087ms, % non-child: 1.22%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.54 MB, 50.71 MB, 87.44 MB, 131.85 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 156.44 MB, 187.28 MB, 216.92 MB, 245.84 MB - BytesReceived: 283.98 MB (297773051) - ConvertRowBatchTime: 763.170ms - DeserializeRowBatchTimer: 733.549ms - FirstBatchArrivalWaitTime: 31s922ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 329.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a2 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 1.70 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 47.18 MB, 251.99 MB, 517.24 MB, 828.60 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 906.05 MB, 750.31 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.78 MB (972848704) - PerHostPeakMemUsage: 2.97 GB (3192728424) - PrepareTime: 149.597ms - RowsProduced: 0 (0) - TotalCpuTime: 5s689ms - TotalNetworkReceiveTime: 1m20s - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.099ms, non-child: 477.099ms, % non-child: 100.00%) - CodegenTime: 1.414ms - CompileTime: 38.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 291.182ms - PrepareTime: 145.466ms DataStreamSender (dst_id=16):(Total: 13.835us, non-child: 13.835us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 4s745ms, % non-child: 5.56%) ExecOption: Codegen Enabled - BuildTime: 3s824ms - GetNewBlockTime: 585.096us - GetResultsTime: 685.933ms - HTResizeTime: 1s319ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.645us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 729.270ms, % non-child: 0.90%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.45 MB, 50.35 MB, 96.06 MB, 137.37 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 166.16 MB, 205.70 MB, 248.59 MB, 283.76 MB - BytesReceived: 283.89 MB (297682799) - ConvertRowBatchTime: 565.406ms - DeserializeRowBatchTimer: 562.809ms - FirstBatchArrivalWaitTime: 31s888ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 326.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a5 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 72.21 MB, 265.13 MB, 513.72 MB, 755.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.05 MB, 882.06 MB, 900.05 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 927.75 MB (972821424) - PerHostPeakMemUsage: 3.03 GB (3248216096) - PrepareTime: 161.521ms - RowsProduced: 0 (0) - TotalCpuTime: 6s090ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 276.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 470.580ms, non-child: 470.580ms, % non-child: 100.00%) - CodegenTime: 4.568ms - CompileTime: 34.075ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 280.571ms - PrepareTime: 145.299ms DataStreamSender (dst_id=16):(Total: 16.896us, non-child: 16.896us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s107ms, % non-child: 5.98%) ExecOption: Codegen Enabled - BuildTime: 4s207ms - GetNewBlockTime: 683.579us - GetResultsTime: 662.820ms - HTResizeTime: 1s352ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.829us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 792.076ms, % non-child: 0.99%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.79 MB, 45.01 MB, 81.84 MB, 119.96 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 155.97 MB, 187.82 MB, 228.61 MB, 275.10 MB - BytesReceived: 284.01 MB (297804942) - ConvertRowBatchTime: 618.595ms - DeserializeRowBatchTimer: 659.014ms - FirstBatchArrivalWaitTime: 31s883ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 328.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691aa (host=vb0214.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 59.18 MB, 304.96 MB, 576.89 MB, 829.95 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 892.20 MB, 651.21 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.82 MB (970791792) - PerHostPeakMemUsage: 2.98 GB (3202725480) - PrepareTime: 162.341ms - RowsProduced: 0 (0) - TotalCpuTime: 6s731ms - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 317.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.521ms, non-child: 481.521ms, % non-child: 100.00%) - CodegenTime: 2.514ms - CompileTime: 48.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 278.439ms - PrepareTime: 145.961ms DataStreamSender (dst_id=16):(Total: 10.241us, non-child: 10.241us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 5s524ms, % non-child: 6.47%) ExecOption: Codegen Enabled - BuildTime: 4s591ms - GetNewBlockTime: 4.909ms - GetResultsTime: 669.664ms - HTResizeTime: 1s404ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.900us EXCHANGE_NODE (id=14):(Total: 1m19s, non-child: 1s007ms, % non-child: 1.26%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.00 MB, 49.62 MB, 92.19 MB, 132.06 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 156.60 MB, 186.77 MB, 216.76 MB, 249.98 MB - BytesReceived: 283.93 MB (297720686) - ConvertRowBatchTime: 803.399ms - DeserializeRowBatchTimer: 730.035ms - FirstBatchArrivalWaitTime: 31s880ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 330.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a96919c (host=vb0218.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 69.95 MB, 338.30 MB, 629.19 MB, 872.49 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.05 MB, 894.06 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.55 MB (971555632) - PerHostPeakMemUsage: 3.02 GB (3247645384) - PrepareTime: 151.667ms - RowsProduced: 0 (0) - TotalCpuTime: 6s146ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 261.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 553.400ms, non-child: 553.400ms, % non-child: 100.00%) - CodegenTime: 1.242ms - CompileTime: 31.604ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 372.048ms - PrepareTime: 143.824ms DataStreamSender (dst_id=16):(Total: 14.943us, non-child: 14.943us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 4s999ms, % non-child: 5.86%) ExecOption: Codegen Enabled - BuildTime: 4s074ms - GetNewBlockTime: 413.150us - GetResultsTime: 689.520ms - HTResizeTime: 1s273ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.561us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 846.368ms, % non-child: 1.05%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.64 MB, 54.37 MB, 101.20 MB, 138.60 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.75 MB, 156.29 MB, 191.38 MB, 226.10 MB, 263.52 MB - BytesReceived: 283.91 MB (297702898) - ConvertRowBatchTime: 685.631ms - DeserializeRowBatchTimer: 619.209ms - FirstBatchArrivalWaitTime: 31s817ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 328.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 194abadfc94cbc81:89ceb14c5a9691a0 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 82.66 MB, 339.08 MB, 615.73 MB, 851.94 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 894.05 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.19 MB (971184624) - PerHostPeakMemUsage: 3.03 GB (3258336936) - PrepareTime: 148.243ms - RowsProduced: 0 (0) - TotalCpuTime: 5s948ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 266.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 247 (247) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 2.92 GB (3133636608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 563.502ms, non-child: 563.502ms, % non-child: 100.00%) - CodegenTime: 1.300ms - CompileTime: 36.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 380.494ms - PrepareTime: 145.019ms DataStreamSender (dst_id=16):(Total: 12.622us, non-child: 12.622us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m25s, non-child: 4s728ms, % non-child: 5.55%) ExecOption: Codegen Enabled - BuildTime: 3s837ms - GetNewBlockTime: 389.403us - GetResultsTime: 652.380ms - HTResizeTime: 1s188ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.917us EXCHANGE_NODE (id=14):(Total: 1m20s, non-child: 913.444ms, % non-child: 1.13%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.46 MB, 55.16 MB, 98.66 MB, 136.71 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 156.72 MB, 194.46 MB, 231.50 MB, 268.86 MB - BytesReceived: 284.11 MB (297915989) - ConvertRowBatchTime: 738.685ms - DeserializeRowBatchTimer: 618.007ms - FirstBatchArrivalWaitTime: 31s815ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 327.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance 194abadfc94cbc81:89ceb14c5a9691b6 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.96 MB, 514.60 MB, 794.35 MB, 1.14 GB, 1.32 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.92 GB, 1.04 GB, 581.00 MB, 386.51 MB, 187.40 MB, 182.80 MB, 374.83 MB, 646.80 MB, 1.01 GB, 1.24 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.52 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.01 MB, 567.55 MB, 411.14 MB, 254.73 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2137078704) - PerHostPeakMemUsage: 3.03 GB (3248363336) - PrepareTime: 154.876ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 19s526ms - TotalNetworkSendTime: 1s369ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 677.196ms, non-child: 677.196ms, % non-child: 100.00%) - CodegenTime: 4.114ms - CompileTime: 131.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 401.976ms - PrepareTime: 142.475ms DataStreamSender (dst_id=14):(Total: 6s557ms, non-child: 6s557ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297773051) - NetworkThroughput(*): 52.42 MB/sec - OverallThroughput: 43.30 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s337ms - ThriftTransmitTime(*): 5s417ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 1m17s, non-child: 4s352ms, % non-child: 5.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.915ms - GetResultsTime: 151.806ms - HTResizeTime: 135.003ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 338.67 K/sec - StreamingTime: 3s983ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 4s274ms, % non-child: 5.82%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 361.72 K/sec AGGREGATION_NODE (id=8):(Total: 36s964ms, non-child: 9s746ms, % non-child: 26.37%) ExecOption: Codegen Enabled - BuildTime: 8s834ms - GetNewBlockTime: 502.406us - GetResultsTime: 768.967ms - HTResizeTime: 1s237ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 359.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 986.000ns HASH_JOIN_NODE (id=7):(Total: 27s218ms, non-child: 13s183ms, % non-child: 48.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s166ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s650ms - GetNewBlockTime: 412.710us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s558ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 1.90 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.214us EXCHANGE_NODE (id=13):(Total: 5s123ms, non-child: 1s145ms, % non-child: 22.35%) BytesReceived(2s000ms): 7.58 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 15.80 MB, 119.41 MB, 237.16 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB - BytesReceived: 251.97 MB (264209774) - ConvertRowBatchTime: 243.604ms - DeserializeRowBatchTimer: 1s706ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 2.67 M/sec - SendersBlockedTimer: 38s515ms - SendersBlockedTotalTimer(*): 7m4s EXCHANGE_NODE (id=12):(Total: 8s910ms, non-child: 2s727ms, % non-child: 30.61%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 39.11 MB, 108.66 MB, 175.39 MB, 237.68 MB, 304.73 MB, 370.60 MB, 430.20 MB, 496.39 MB, 562.43 MB, 628.84 MB, 694.63 MB, 758.73 MB, 817.57 MB - BytesReceived: 864.90 MB (906911597) - ConvertRowBatchTime: 1s497ms - DeserializeRowBatchTimer: 5s009ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 5.79 M/sec - SendersBlockedTimer: 47s082ms - SendersBlockedTotalTimer(*): 11m46s AGGREGATION_NODE (id=4):(Total: 32s245ms, non-child: 8s793ms, % non-child: 27.27%) ExecOption: Codegen Enabled - BuildTime: 8s092ms - GetNewBlockTime: 586.284us - GetResultsTime: 572.698ms - HTResizeTime: 1s279ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 412.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.250us HASH_JOIN_NODE (id=3):(Total: 23s452ms, non-child: 14s006ms, % non-child: 59.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s002ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s581ms - GetNewBlockTime: 987.156us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s617ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.221us EXCHANGE_NODE (id=11):(Total: 2s328ms, non-child: 1s220ms, % non-child: 52.41%) BytesReceived(1s000ms): 5.54 MB, 62.62 MB, 132.48 MB, 200.39 MB, 246.71 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB, 252.39 MB - BytesReceived: 252.39 MB (264650423) - ConvertRowBatchTime: 442.198ms - DeserializeRowBatchTimer: 1s562ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 5.87 M/sec - SendersBlockedTimer: 6.097ms - SendersBlockedTotalTimer(*): 64.871ms EXCHANGE_NODE (id=10):(Total: 7s116ms, non-child: 3s178ms, % non-child: 44.66%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 14.93 MB, 46.30 MB, 79.52 MB, 110.85 MB, 142.68 MB, 174.60 MB, 205.70 MB, 236.29 MB, 269.14 MB, 303.81 MB, 343.33 MB, 381.60 MB, 414.05 MB, 450.20 MB, 489.86 MB, 531.39 MB, 567.39 MB, 601.70 MB, 640.93 MB, 682.74 MB, 720.86 MB, 758.98 MB, 795.51 MB, 826.45 MB, 849.45 MB - BytesReceived: 864.82 MB (906824740) - ConvertRowBatchTime: 1s375ms - DeserializeRowBatchTimer: 6s134ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 7.25 M/sec - SendersBlockedTimer: 6s529ms - SendersBlockedTotalTimer(*): 1m24s Instance 194abadfc94cbc81:89ceb14c5a9691b9 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 171.66 MB, 482.42 MB, 746.36 MB, 1.11 GB, 1.34 GB, 1.41 GB, 1.42 GB, 1.48 GB, 1.48 GB, 1.50 GB, 1.60 GB, 1.60 GB, 1.70 GB, 1.73 GB, 1.73 GB, 1.89 GB, 1.07 GB, 581.01 MB, 362.20 MB, 171.47 MB, 182.84 MB, 343.12 MB, 646.83 MB, 1014.78 MB, 1.24 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.54 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.63 GB, 748.02 MB, 567.56 MB, 411.15 MB, 218.51 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2140457904) - PerHostPeakMemUsage: 2.98 GB (3202725480) - PrepareTime: 159.258ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 1m22s - TotalNetworkReceiveTime: 16s292ms - TotalNetworkSendTime: 1s271ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 696.850ms, non-child: 696.850ms, % non-child: 100.00%) - CodegenTime: 2.883ms - CompileTime: 127.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 422.448ms - PrepareTime: 142.990ms DataStreamSender (dst_id=14):(Total: 6s499ms, non-child: 6s499ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297720686) - NetworkThroughput(*): 54.26 MB/sec - OverallThroughput: 43.68 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s374ms - ThriftTransmitTime(*): 5s232ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 1m17s, non-child: 4s432ms, % non-child: 5.74%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.520ms - GetResultsTime: 145.593ms - HTResizeTime: 134.414ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 341.11 K/sec - StreamingTime: 4s059ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 3s687ms, % non-child: 5.06%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 364.89 K/sec AGGREGATION_NODE (id=8):(Total: 36s961ms, non-child: 9s204ms, % non-child: 24.90%) ExecOption: Codegen Enabled - BuildTime: 8s289ms - GetNewBlockTime: 528.001us - GetResultsTime: 744.770ms - HTResizeTime: 1s190ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 359.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.096us HASH_JOIN_NODE (id=7):(Total: 27s756ms, non-child: 15s191ms, % non-child: 54.73%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s729ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s866ms - GetNewBlockTime: 485.831us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s698ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 1.86 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.097us EXCHANGE_NODE (id=13):(Total: 4s562ms, non-child: 1s197ms, % non-child: 26.25%) BytesReceived(2s000ms): 7.38 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 14.34 MB, 112.76 MB, 234.16 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB - BytesReceived: 251.90 MB (264137519) - ConvertRowBatchTime: 381.768ms - DeserializeRowBatchTimer: 1s588ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 2.99 M/sec - SendersBlockedTimer: 38s502ms - SendersBlockedTotalTimer(*): 8m20s EXCHANGE_NODE (id=12):(Total: 8s002ms, non-child: 2s837ms, % non-child: 35.46%) BytesReceived(2s000ms): 7.24 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 35.84 MB, 105.36 MB, 171.82 MB, 235.24 MB, 301.75 MB, 367.84 MB, 427.91 MB, 493.36 MB, 559.59 MB, 625.70 MB, 691.79 MB, 755.82 MB, 815.55 MB - BytesReceived: 864.80 MB (906809088) - ConvertRowBatchTime: 1s565ms - DeserializeRowBatchTimer: 5s156ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.45 M/sec - SendersBlockedTimer: 47s352ms - SendersBlockedTotalTimer(*): 11m10s AGGREGATION_NODE (id=4):(Total: 32s182ms, non-child: 9s582ms, % non-child: 29.77%) ExecOption: Codegen Enabled - BuildTime: 8s866ms - GetNewBlockTime: 632.761us - GetResultsTime: 544.472ms - HTResizeTime: 1s256ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 412.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.204us HASH_JOIN_NODE (id=3):(Total: 22s600ms, non-child: 14s600ms, % non-child: 64.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s505ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s781ms - GetNewBlockTime: 691.598us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s413ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.355us EXCHANGE_NODE (id=11):(Total: 2s812ms, non-child: 655.752ms, % non-child: 23.32%) BytesReceived(1s000ms): 4.52 MB, 56.34 MB, 125.88 MB, 194.10 MB, 244.42 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB, 252.32 MB - BytesReceived: 252.32 MB (264577547) - ConvertRowBatchTime: 339.171ms - DeserializeRowBatchTimer: 996.012ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 4.86 M/sec - SendersBlockedTimer: 30.231ms - SendersBlockedTotalTimer(*): 424.499ms EXCHANGE_NODE (id=10):(Total: 5s187ms, non-child: 4s869ms, % non-child: 93.87%) BytesReceived(1s000ms): 3.92 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 13.30 MB, 43.03 MB, 76.47 MB, 107.77 MB, 139.57 MB, 171.55 MB, 203.13 MB, 233.19 MB, 266.22 MB, 300.42 MB, 339.41 MB, 378.34 MB, 411.94 MB, 446.38 MB, 485.91 MB, 527.57 MB, 564.11 MB, 598.44 MB, 637.03 MB, 679.10 MB, 717.06 MB, 755.26 MB, 792.05 MB, 824.30 MB, 846.27 MB - BytesReceived: 864.73 MB (906737881) - ConvertRowBatchTime: 1s543ms - DeserializeRowBatchTimer: 5s384ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 9.95 M/sec - SendersBlockedTimer: 29s732ms - SendersBlockedTotalTimer(*): 6m18s Instance 194abadfc94cbc81:89ceb14c5a9691b2 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 120.04 MB, 501.12 MB, 744.36 MB, 1.09 GB, 1.32 GB, 1.38 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.69 GB, 1.70 GB, 1.70 GB, 1.88 GB, 1.07 GB, 641.79 MB, 435.13 MB, 240.62 MB, 166.92 MB, 312.09 MB, 638.89 MB, 998.78 MB, 1.20 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.75 GB, 1.63 GB, 746.02 MB, 579.57 MB, 411.14 MB, 218.52 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2138563504) - PerHostPeakMemUsage: 3.03 GB (3248485240) - PrepareTime: 155.859ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 1m20s - TotalNetworkReceiveTime: 15s990ms - TotalNetworkSendTime: 1s409ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 685.644ms, non-child: 685.644ms, % non-child: 100.00%) - CodegenTime: 4.779ms - CompileTime: 138.818ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 401.232ms - PrepareTime: 144.382ms DataStreamSender (dst_id=14):(Total: 6s783ms, non-child: 6s783ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297875194) - NetworkThroughput(*): 51.26 MB/sec - OverallThroughput: 41.88 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s435ms - ThriftTransmitTime(*): 5s541ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s429ms, % non-child: 5.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 203.904us - GetResultsTime: 145.518ms - HTResizeTime: 140.868ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270593) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 343.07 K/sec - StreamingTime: 4s057ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 4s386ms, % non-child: 6.06%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 367.08 K/sec AGGREGATION_NODE (id=8):(Total: 35s756ms, non-child: 10s129ms, % non-child: 28.33%) ExecOption: Codegen Enabled - BuildTime: 9s289ms - GetNewBlockTime: 506.625us - GetResultsTime: 686.689ms - HTResizeTime: 1s135ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 371.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.273us HASH_JOIN_NODE (id=7):(Total: 25s626ms, non-child: 13s940ms, % non-child: 54.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s977ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s562ms - GetNewBlockTime: 692.020us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s613ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.050us EXCHANGE_NODE (id=13):(Total: 3s174ms, non-child: 1s217ms, % non-child: 38.36%) BytesReceived(2s000ms): 8.02 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 21.58 MB, 136.86 MB, 243.73 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB - BytesReceived: 252.07 MB (264309424) - ConvertRowBatchTime: 453.692ms - DeserializeRowBatchTimer: 1s519ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 4.31 M/sec - SendersBlockedTimer: 39s635ms - SendersBlockedTotalTimer(*): 9m14s EXCHANGE_NODE (id=12):(Total: 8s510ms, non-child: 2s982ms, % non-child: 35.04%) BytesReceived(2s000ms): 8.00 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 48.44 MB, 116.85 MB, 183.28 MB, 245.34 MB, 313.16 MB, 378.58 MB, 438.24 MB, 504.49 MB, 570.81 MB, 637.13 MB, 702.86 MB, 766.88 MB, 824.92 MB - BytesReceived: 865.23 MB (907262047) - ConvertRowBatchTime: 1s637ms - DeserializeRowBatchTimer: 5s294ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 46s945ms - SendersBlockedTotalTimer(*): 6m16s AGGREGATION_NODE (id=4):(Total: 32s290ms, non-child: 9s423ms, % non-child: 29.18%) ExecOption: Codegen Enabled - BuildTime: 8s651ms - GetNewBlockTime: 642.026us - GetResultsTime: 625.617ms - HTResizeTime: 1s290ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 411.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.525us HASH_JOIN_NODE (id=3):(Total: 22s866ms, non-child: 14s034ms, % non-child: 61.37%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s238ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s678ms - GetNewBlockTime: 1.009ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s241ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.26 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.122us EXCHANGE_NODE (id=11):(Total: 2s076ms, non-child: 1s380ms, % non-child: 66.50%) BytesReceived(1s000ms): 14.79 MB, 79.96 MB, 149.58 MB, 215.98 MB, 250.29 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB, 252.48 MB - BytesReceived: 252.48 MB (264747494) - ConvertRowBatchTime: 503.813ms - DeserializeRowBatchTimer: 1s617ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 6.58 M/sec - SendersBlockedTimer: 613.232ms - SendersBlockedTotalTimer(*): 4s803ms EXCHANGE_NODE (id=10):(Total: 6s755ms, non-child: 2s863ms, % non-child: 42.39%) BytesReceived(1s000ms): 5.72 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 19.47 MB, 54.07 MB, 87.46 MB, 118.60 MB, 150.62 MB, 182.23 MB, 212.74 MB, 244.41 MB, 277.36 MB, 313.16 MB, 353.06 MB, 390.69 MB, 423.92 MB, 459.95 MB, 500.23 MB, 540.68 MB, 576.28 MB, 611.40 MB, 651.46 MB, 692.83 MB, 730.60 MB, 768.40 MB, 804.99 MB, 829.17 MB, 856.83 MB - BytesReceived: 865.16 MB (907189012) - ConvertRowBatchTime: 1s503ms - DeserializeRowBatchTimer: 5s162ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 7.64 M/sec - SendersBlockedTimer: 6s662ms - SendersBlockedTotalTimer(*): 1m26s Instance 194abadfc94cbc81:89ceb14c5a9691b8 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 162.97 MB, 482.40 MB, 746.39 MB, 1.09 GB, 1.32 GB, 1.38 GB, 1.41 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.90 GB, 1.07 GB, 581.00 MB, 386.51 MB, 192.01 MB, 182.91 MB, 343.38 MB, 638.82 MB, 974.76 MB, 1.23 GB, 1.35 GB, 1.37 GB, 1.42 GB, 1.44 GB, 1.44 GB, 1.51 GB, 1.56 GB, 1.56 GB, 1.69 GB, 1.69 GB, 1.69 GB, 1.75 GB, 1.64 GB, 760.05 MB, 603.63 MB, 447.23 MB, 254.61 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2136515504) - PerHostPeakMemUsage: 3.16 GB (3390424624) - PrepareTime: 169.425ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 1m22s - TotalNetworkReceiveTime: 15s470ms - TotalNetworkSendTime: 1s254ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 675.542ms, non-child: 675.542ms, % non-child: 100.00%) - CodegenTime: 4.124ms - CompileTime: 116.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 399.899ms - PrepareTime: 155.382ms DataStreamSender (dst_id=14):(Total: 5s989ms, non-child: 5s989ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297740088) - NetworkThroughput(*): 60.00 MB/sec - OverallThroughput: 47.40 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s195ms - ThriftTransmitTime(*): 4s732ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 1m17s, non-child: 4s143ms, % non-child: 5.34%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 313.574us - GetResultsTime: 113.202ms - HTResizeTime: 160.685ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 339.67 K/sec - StreamingTime: 3s799ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 4s823ms, % non-child: 6.57%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 361.82 K/sec AGGREGATION_NODE (id=8):(Total: 36s342ms, non-child: 10s620ms, % non-child: 29.22%) ExecOption: Codegen Enabled - BuildTime: 9s715ms - GetNewBlockTime: 727.808us - GetResultsTime: 663.446ms - HTResizeTime: 1s234ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 365.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.161us HASH_JOIN_NODE (id=7):(Total: 25s721ms, non-child: 15s761ms, % non-child: 61.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s723ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 2s059ms - GetNewBlockTime: 562.418us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 11s049ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.01 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.760us EXCHANGE_NODE (id=13):(Total: 4s006ms, non-child: 1s179ms, % non-child: 29.44%) BytesReceived(2s000ms): 9.14 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 25.15 MB, 144.34 MB, 245.82 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB, 251.92 MB - BytesReceived: 251.92 MB (264162025) - ConvertRowBatchTime: 375.186ms - DeserializeRowBatchTimer: 1s611ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.41 M/sec - SendersBlockedTimer: 39s065ms - SendersBlockedTotalTimer(*): 6m31s EXCHANGE_NODE (id=12):(Total: 5s954ms, non-child: 5s238ms, % non-child: 87.98%) BytesReceived(2s000ms): 9.06 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.10 MB, 51.84 MB, 120.16 MB, 186.83 MB, 249.11 MB, 316.71 MB, 382.05 MB, 441.10 MB, 507.87 MB, 574.02 MB, 640.36 MB, 705.89 MB, 769.83 MB, 827.70 MB - BytesReceived: 864.80 MB (906811055) - ConvertRowBatchTime: 1s849ms - DeserializeRowBatchTimer: 5s598ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 8.67 M/sec - SendersBlockedTimer: 1m12s - SendersBlockedTotalTimer(*): 12m54s AGGREGATION_NODE (id=4):(Total: 32s290ms, non-child: 9s197ms, % non-child: 28.48%) ExecOption: Codegen Enabled - BuildTime: 8s435ms - GetNewBlockTime: 551.348us - GetResultsTime: 607.674ms - HTResizeTime: 1s252ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 411.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.332us HASH_JOIN_NODE (id=3):(Total: 23s093ms, non-child: 12s885ms, % non-child: 55.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s649ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s742ms - GetNewBlockTime: 707.711us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s617ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.24 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.723us EXCHANGE_NODE (id=11):(Total: 2s692ms, non-child: 1s120ms, % non-child: 41.63%) BytesReceived(1s000ms): 20.81 MB, 87.55 MB, 157.14 MB, 221.94 MB, 250.97 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB, 252.35 MB - BytesReceived: 252.35 MB (264610061) - ConvertRowBatchTime: 355.055ms - DeserializeRowBatchTimer: 1s599ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 5.08 M/sec - SendersBlockedTimer: 3.463ms - SendersBlockedTotalTimer(*): 26.136ms EXCHANGE_NODE (id=10):(Total: 7s515ms, non-child: 3s057ms, % non-child: 40.68%) BytesReceived(1s000ms): 7.67 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 23.70 MB, 58.27 MB, 91.05 MB, 121.33 MB, 154.23 MB, 185.58 MB, 216.52 MB, 248.03 MB, 280.96 MB, 317.56 MB, 357.26 MB, 394.53 MB, 426.52 MB, 464.24 MB, 504.34 MB, 544.59 MB, 579.84 MB, 615.10 MB, 655.86 MB, 696.61 MB, 734.45 MB, 772.06 MB, 808.81 MB, 831.66 MB, 858.66 MB - BytesReceived: 864.72 MB (906721807) - ConvertRowBatchTime: 1s624ms - DeserializeRowBatchTimer: 5s139ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 6.87 M/sec - SendersBlockedTimer: 6s753ms - SendersBlockedTotalTimer(*): 1m21s Instance 194abadfc94cbc81:89ceb14c5a9691ab (host=vb0218.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.25 MB, 514.40 MB, 802.36 MB, 1.13 GB, 1.32 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.92 GB, 1.03 GB, 556.70 MB, 313.57 MB, 166.86 MB, 182.80 MB, 374.91 MB, 646.89 MB, 1.02 GB, 1.24 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.02 MB, 555.53 MB, 363.02 MB, 154.00 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135977904) - PerHostPeakMemUsage: 3.02 GB (3247645384) - PrepareTime: 150.700ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 19s537ms - TotalNetworkSendTime: 999.756ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 645.140ms, non-child: 645.140ms, % non-child: 100.00%) - CodegenTime: 2.842ms - CompileTime: 132.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 369.479ms - PrepareTime: 141.603ms DataStreamSender (dst_id=14):(Total: 5s748ms, non-child: 5s748ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297702898) - NetworkThroughput(*): 65.18 MB/sec - OverallThroughput: 49.39 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s113ms - ThriftTransmitTime(*): 4s355ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 1m17s, non-child: 3s904ms, % non-child: 5.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 191.513us - GetResultsTime: 135.470ms - HTResizeTime: 135.039ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 339.97 K/sec - StreamingTime: 3s561ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 3s994ms, % non-child: 5.43%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 360.99 K/sec AGGREGATION_NODE (id=8):(Total: 37s413ms, non-child: 9s108ms, % non-child: 24.35%) ExecOption: Codegen Enabled - BuildTime: 8s365ms - GetNewBlockTime: 464.599us - GetResultsTime: 631.113ms - HTResizeTime: 1s279ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 355.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 965.000ns HASH_JOIN_NODE (id=7):(Total: 28s305ms, non-child: 14s600ms, % non-child: 51.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s881ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s637ms - GetNewBlockTime: 537.509us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s237ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 1.82 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.285us EXCHANGE_NODE (id=13):(Total: 4s977ms, non-child: 1s199ms, % non-child: 24.10%) BytesReceived(2s000ms): 7.56 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 15.83 MB, 119.52 MB, 237.19 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB, 251.90 MB - BytesReceived: 251.90 MB (264141040) - ConvertRowBatchTime: 450.236ms - DeserializeRowBatchTimer: 1s531ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 2.75 M/sec - SendersBlockedTimer: 37s927ms - SendersBlockedTotalTimer(*): 5m41s EXCHANGE_NODE (id=12):(Total: 8s727ms, non-child: 3s167ms, % non-child: 36.29%) BytesReceived(2s000ms): 7.55 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 39.16 MB, 108.59 MB, 175.38 MB, 237.68 MB, 304.68 MB, 370.42 MB, 429.87 MB, 496.03 MB, 562.16 MB, 628.60 MB, 694.42 MB, 758.55 MB, 817.28 MB - BytesReceived: 864.53 MB (906529461) - ConvertRowBatchTime: 1s396ms - DeserializeRowBatchTimer: 6s365ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.91 M/sec - SendersBlockedTimer: 47s082ms - SendersBlockedTotalTimer(*): 6m7s AGGREGATION_NODE (id=4):(Total: 32s206ms, non-child: 8s736ms, % non-child: 27.13%) ExecOption: Codegen Enabled - BuildTime: 8s085ms - GetNewBlockTime: 1.123ms - GetResultsTime: 521.021ms - HTResizeTime: 1s230ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 412.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.422us HASH_JOIN_NODE (id=3):(Total: 23s470ms, non-child: 13s597ms, % non-child: 57.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s131ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s681ms - GetNewBlockTime: 813.458us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s958ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.918us EXCHANGE_NODE (id=11):(Total: 3s226ms, non-child: 485.216ms, % non-child: 15.04%) BytesReceived(1s000ms): 5.58 MB, 62.73 MB, 132.54 MB, 200.46 MB, 246.70 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB, 252.33 MB - BytesReceived: 252.33 MB (264590923) - ConvertRowBatchTime: 245.051ms - DeserializeRowBatchTimer: 898.753ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 4.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 6s646ms, non-child: 2s992ms, % non-child: 45.02%) BytesReceived(1s000ms): 5.04 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 14.90 MB, 46.31 MB, 79.42 MB, 110.68 MB, 142.49 MB, 174.53 MB, 205.60 MB, 236.21 MB, 268.98 MB, 303.66 MB, 343.10 MB, 381.29 MB, 413.64 MB, 449.87 MB, 489.49 MB, 531.15 MB, 567.23 MB, 601.55 MB, 640.90 MB, 682.73 MB, 720.89 MB, 758.91 MB, 795.36 MB, 826.18 MB, 849.14 MB - BytesReceived: 864.45 MB (906436474) - ConvertRowBatchTime: 1s546ms - DeserializeRowBatchTimer: 5s154ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 7.76 M/sec - SendersBlockedTimer: 6s647ms - SendersBlockedTotalTimer(*): 53s295ms Instance 194abadfc94cbc81:89ceb14c5a9691af (host=vb0206.halxg.cloudera.com:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.25 MB, 514.49 MB, 794.36 MB, 1.11 GB, 1.32 GB, 1.38 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.92 GB, 1.04 GB, 556.70 MB, 325.72 MB, 163.09 MB, 182.89 MB, 374.87 MB, 646.84 MB, 1.01 GB, 1.24 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.51 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 748.01 MB, 543.50 MB, 326.93 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2138307504) - PerHostPeakMemUsage: 3.03 GB (3258336936) - PrepareTime: 168.012ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 19s995ms - TotalNetworkSendTime: 1s074ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 623.098ms, non-child: 623.098ms, % non-child: 100.00%) - CodegenTime: 4.604ms - CompileTime: 108.821ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 364.609ms - PrepareTime: 145.389ms DataStreamSender (dst_id=14):(Total: 5s565ms, non-child: 5s565ms, % non-child: 100.00%) - BytesSent: 284.11 MB (297915989) - NetworkThroughput(*): 65.96 MB/sec - OverallThroughput: 51.05 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s072ms - ThriftTransmitTime(*): 4s307ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 1m17s, non-child: 3s756ms, % non-child: 4.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 221.136us - GetResultsTime: 142.518ms - HTResizeTime: 166.989ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278191) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 340.70 K/sec - StreamingTime: 3s403ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 4s283ms, % non-child: 5.82%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 361.06 K/sec AGGREGATION_NODE (id=8):(Total: 37s158ms, non-child: 9s563ms, % non-child: 25.74%) ExecOption: Codegen Enabled - BuildTime: 8s810ms - GetNewBlockTime: 6.763ms - GetResultsTime: 611.780ms - HTResizeTime: 1s247ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 357.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.261us HASH_JOIN_NODE (id=7):(Total: 27s594ms, non-child: 13s789ms, % non-child: 49.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s231ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s763ms - GetNewBlockTime: 1.658ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s930ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.87 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.398us EXCHANGE_NODE (id=13):(Total: 5s401ms, non-child: 1s146ms, % non-child: 21.23%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 15.48 MB, 117.60 MB, 236.48 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB, 252.10 MB - BytesReceived: 252.10 MB (264344944) - ConvertRowBatchTime: 254.886ms - DeserializeRowBatchTimer: 1s709ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 2.53 M/sec - SendersBlockedTimer: 38s169ms - SendersBlockedTotalTimer(*): 8m16s EXCHANGE_NODE (id=12):(Total: 8s403ms, non-child: 2s861ms, % non-child: 34.05%) BytesReceived(2s000ms): 7.58 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 37.95 MB, 107.58 MB, 174.20 MB, 236.94 MB, 303.97 MB, 370.01 MB, 429.70 MB, 495.75 MB, 561.68 MB, 627.93 MB, 693.93 MB, 758.11 MB, 817.12 MB - BytesReceived: 865.21 MB (907240145) - ConvertRowBatchTime: 1s530ms - DeserializeRowBatchTimer: 5s279ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.15 M/sec - SendersBlockedTimer: 47s295ms - SendersBlockedTotalTimer(*): 10m22s AGGREGATION_NODE (id=4):(Total: 32s210ms, non-child: 8s632ms, % non-child: 26.80%) ExecOption: Codegen Enabled - BuildTime: 8s010ms - GetNewBlockTime: 620.668us - GetResultsTime: 498.693ms - HTResizeTime: 1s163ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 412.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.360us HASH_JOIN_NODE (id=3):(Total: 23s577ms, non-child: 13s493ms, % non-child: 57.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s863ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s783ms - GetNewBlockTime: 1.164ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s960ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.932us EXCHANGE_NODE (id=11):(Total: 2s514ms, non-child: 1s155ms, % non-child: 45.94%) BytesReceived(1s000ms): 5.11 MB, 61.05 MB, 130.72 MB, 198.77 MB, 246.31 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB, 252.52 MB - BytesReceived: 252.52 MB (264785130) - ConvertRowBatchTime: 425.998ms - DeserializeRowBatchTimer: 1s544ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 5.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s568ms, non-child: 2s827ms, % non-child: 37.35%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 14.43 MB, 45.09 MB, 78.62 MB, 109.90 MB, 141.68 MB, 173.68 MB, 205.18 MB, 235.42 MB, 268.31 MB, 303.02 MB, 342.50 MB, 381.13 MB, 413.86 MB, 449.40 MB, 489.00 MB, 530.66 MB, 566.94 MB, 601.19 MB, 640.25 MB, 682.08 MB, 720.17 MB, 758.39 MB, 794.93 MB, 826.30 MB, 848.91 MB - BytesReceived: 865.15 MB (907171483) - ConvertRowBatchTime: 1s298ms - DeserializeRowBatchTimer: 5s471ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.82 M/sec - SendersBlockedTimer: 6s916ms - SendersBlockedTotalTimer(*): 1m29s Instance 194abadfc94cbc81:89ceb14c5a9691ae (host=vb0220.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 159.40 MB, 482.44 MB, 746.37 MB, 1.09 GB, 1.32 GB, 1.38 GB, 1.41 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.90 GB, 1.07 GB, 629.62 MB, 435.13 MB, 228.47 MB, 182.94 MB, 343.05 MB, 638.79 MB, 998.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.62 GB, 748.02 MB, 555.51 MB, 314.89 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134928304) - PerHostPeakMemUsage: 2.97 GB (3190940824) - PrepareTime: 152.879ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 18s252ms - TotalNetworkSendTime: 1s356ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 659.790ms, non-child: 659.790ms, % non-child: 100.00%) - CodegenTime: 3.130ms - CompileTime: 129.143ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 387.794ms - PrepareTime: 141.635ms DataStreamSender (dst_id=14):(Total: 6s448ms, non-child: 6s448ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297605326) - NetworkThroughput(*): 54.19 MB/sec - OverallThroughput: 44.02 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s372ms - ThriftTransmitTime(*): 5s237ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s327ms, % non-child: 5.66%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 197.412us - GetResultsTime: 154.541ms - HTResizeTime: 137.554ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 344.46 K/sec - StreamingTime: 3s960ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 3s892ms, % non-child: 5.39%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 368.17 K/sec AGGREGATION_NODE (id=8):(Total: 35s954ms, non-child: 9s432ms, % non-child: 26.24%) ExecOption: Codegen Enabled - BuildTime: 8s691ms - GetNewBlockTime: 1.044ms - GetResultsTime: 597.099ms - HTResizeTime: 1s143ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 369.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 927.000ns HASH_JOIN_NODE (id=7):(Total: 26s521ms, non-child: 13s413ms, % non-child: 50.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s301ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s938ms - GetNewBlockTime: 444.793us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s332ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 1.95 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.942us EXCHANGE_NODE (id=13):(Total: 4s155ms, non-child: 1s205ms, % non-child: 29.01%) BytesReceived(2s000ms): 8.82 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 24.46 MB, 142.54 MB, 245.22 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB, 251.83 MB - BytesReceived: 251.83 MB (264064944) - ConvertRowBatchTime: 280.539ms - DeserializeRowBatchTimer: 1s694ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 3.29 M/sec - SendersBlockedTimer: 39s341ms - SendersBlockedTotalTimer(*): 8m32s EXCHANGE_NODE (id=12):(Total: 8s953ms, non-child: 3s126ms, % non-child: 34.92%) BytesReceived(2s000ms): 8.79 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 51.09 MB, 119.46 MB, 185.95 MB, 248.11 MB, 315.77 MB, 381.07 MB, 440.29 MB, 507.03 MB, 573.22 MB, 639.46 MB, 705.01 MB, 768.87 MB, 826.76 MB - BytesReceived: 864.49 MB (906485249) - ConvertRowBatchTime: 1s489ms - DeserializeRowBatchTimer: 6s006ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 5.76 M/sec - SendersBlockedTimer: 47s407ms - SendersBlockedTotalTimer(*): 11m51s AGGREGATION_NODE (id=4):(Total: 32s308ms, non-child: 9s354ms, % non-child: 28.95%) ExecOption: Codegen Enabled - BuildTime: 8s574ms - GetNewBlockTime: 469.106us - GetResultsTime: 631.649ms - HTResizeTime: 1s246ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 411.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.083us HASH_JOIN_NODE (id=3):(Total: 22s954ms, non-child: 13s672ms, % non-child: 59.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s887ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s738ms - GetNewBlockTime: 943.561us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s222ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.260us EXCHANGE_NODE (id=11):(Total: 2s467ms, non-child: 838.882ms, % non-child: 33.99%) BytesReceived(1s000ms): 19.32 MB, 85.80 MB, 155.36 MB, 220.51 MB, 250.75 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB, 252.25 MB - BytesReceived: 252.25 MB (264506747) - ConvertRowBatchTime: 443.512ms - DeserializeRowBatchTimer: 1s111ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 5.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 6s814ms, non-child: 2s837ms, % non-child: 41.64%) BytesReceived(1s000ms): 7.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 22.70 MB, 57.33 MB, 90.09 MB, 120.42 MB, 153.34 MB, 184.75 MB, 215.68 MB, 247.06 MB, 279.98 MB, 316.55 MB, 356.23 MB, 393.58 MB, 425.68 MB, 463.34 MB, 503.23 MB, 543.65 MB, 578.96 MB, 614.15 MB, 654.70 MB, 695.62 MB, 733.19 MB, 770.81 MB, 807.44 MB, 830.67 MB, 857.83 MB - BytesReceived: 864.41 MB (906404744) - ConvertRowBatchTime: 1s521ms - DeserializeRowBatchTimer: 5s014ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 7.57 M/sec - SendersBlockedTimer: 6s715ms - SendersBlockedTotalTimer(*): 1m27s Instance 194abadfc94cbc81:89ceb14c5a9691ac (host=vb0222.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.26 MB, 518.46 MB, 810.36 MB, 1.13 GB, 1.35 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.93 GB, 775.51 MB, 593.17 MB, 398.65 MB, 240.65 MB, 166.89 MB, 374.87 MB, 686.83 MB, 1.03 GB, 1.24 GB, 1.34 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.53 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.79 GB, 1.35 GB, 748.02 MB, 555.51 MB, 314.90 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135517104) - PerHostPeakMemUsage: 3.03 GB (3256207072) - PrepareTime: 157.119ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 18s643ms - TotalNetworkSendTime: 1s325ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 681.670ms, non-child: 681.670ms, % non-child: 100.00%) - CodegenTime: 4.342ms - CompileTime: 128.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 409.840ms - PrepareTime: 142.150ms DataStreamSender (dst_id=14):(Total: 6s388ms, non-child: 6s388ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297848577) - NetworkThroughput(*): 54.40 MB/sec - OverallThroughput: 44.46 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s325ms - ThriftTransmitTime(*): 5s221ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s405ms, % non-child: 5.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 192.576us - GetResultsTime: 121.257ms - HTResizeTime: 143.798ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 345.34 K/sec - StreamingTime: 4s066ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m11s, non-child: 4s257ms, % non-child: 5.92%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 369.54 K/sec AGGREGATION_NODE (id=8):(Total: 35s350ms, non-child: 10s144ms, % non-child: 28.70%) ExecOption: Codegen Enabled - BuildTime: 9s412ms - GetNewBlockTime: 1.529ms - GetResultsTime: 582.147ms - HTResizeTime: 1s245ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 376.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.331us HASH_JOIN_NODE (id=7):(Total: 25s205ms, non-child: 12s798ms, % non-child: 50.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s232ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s774ms - GetNewBlockTime: 463.854us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s953ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.05 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.031us EXCHANGE_NODE (id=13):(Total: 3s616ms, non-child: 1s187ms, % non-child: 32.82%) BytesReceived(2s000ms): 7.58 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 17.57 MB, 126.71 MB, 240.06 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB, 252.02 MB - BytesReceived: 252.02 MB (264257908) - ConvertRowBatchTime: 275.119ms - DeserializeRowBatchTimer: 1s711ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.78 M/sec - SendersBlockedTimer: 39s950ms - SendersBlockedTotalTimer(*): 7m21s EXCHANGE_NODE (id=12):(Total: 8s789ms, non-child: 3s032ms, % non-child: 34.50%) BytesReceived(2s000ms): 7.54 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 42.87 MB, 111.98 MB, 178.64 MB, 240.55 MB, 308.31 MB, 374.02 MB, 433.47 MB, 499.69 MB, 565.82 MB, 632.38 MB, 698.14 MB, 762.17 MB, 820.76 MB - BytesReceived: 865.06 MB (907076358) - ConvertRowBatchTime: 1s704ms - DeserializeRowBatchTimer: 5s047ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 5.87 M/sec - SendersBlockedTimer: 47s234ms - SendersBlockedTotalTimer(*): 4m53s AGGREGATION_NODE (id=4):(Total: 32s339ms, non-child: 9s285ms, % non-child: 28.71%) ExecOption: Codegen Enabled - BuildTime: 8s460ms - GetNewBlockTime: 543.204us - GetResultsTime: 666.616ms - HTResizeTime: 1s204ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 411.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.153us HASH_JOIN_NODE (id=3):(Total: 23s053ms, non-child: 12s590ms, % non-child: 54.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s247ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s791ms - GetNewBlockTime: 795.514us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s705ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.24 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.982us EXCHANGE_NODE (id=11):(Total: 3s089ms, non-child: 1s135ms, % non-child: 36.76%) BytesReceived(1s000ms): 9.00 MB, 69.92 MB, 139.79 MB, 207.07 MB, 248.56 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB, 252.43 MB - BytesReceived: 252.43 MB (264694046) - ConvertRowBatchTime: 262.018ms - DeserializeRowBatchTimer: 1s696ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 4.42 M/sec - SendersBlockedTimer: 9.791ms - SendersBlockedTotalTimer(*): 116.389ms EXCHANGE_NODE (id=10):(Total: 7s373ms, non-child: 2s940ms, % non-child: 39.87%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 16.62 MB, 49.98 MB, 82.84 MB, 114.18 MB, 145.98 MB, 177.82 MB, 208.24 MB, 239.73 MB, 272.67 MB, 307.61 MB, 347.54 MB, 385.41 MB, 417.91 MB, 454.32 MB, 494.34 MB, 535.44 MB, 571.05 MB, 605.94 MB, 645.34 MB, 686.97 MB, 725.03 MB, 762.95 MB, 799.57 MB, 828.20 MB, 852.96 MB - BytesReceived: 865.00 MB (907014986) - ConvertRowBatchTime: 1s568ms - DeserializeRowBatchTimer: 5s001ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 6s781ms - SendersBlockedTotalTimer(*): 1m14s Instance 194abadfc94cbc81:89ceb14c5a9691ad (host=vb0224.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 165.55 MB, 482.53 MB, 754.35 MB, 1.11 GB, 1.32 GB, 1.38 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.91 GB, 1.07 GB, 629.64 MB, 435.12 MB, 240.64 MB, 166.96 MB, 343.23 MB, 647.84 MB, 1014.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.62 GB, 723.95 MB, 507.39 MB, 314.88 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134288304) - PerHostPeakMemUsage: 3.05 GB (3271592736) - PrepareTime: 151.747ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 17s529ms - TotalNetworkSendTime: 1s275ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 671.315ms, non-child: 671.315ms, % non-child: 100.00%) - CodegenTime: 3.581ms - CompileTime: 131.459ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 397.985ms - PrepareTime: 140.687ms DataStreamSender (dst_id=14):(Total: 6s298ms, non-child: 6s298ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297803348) - NetworkThroughput(*): 56.29 MB/sec - OverallThroughput: 45.09 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s323ms - ThriftTransmitTime(*): 5s045ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s243ms, % non-child: 5.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 354.097us - GetResultsTime: 142.331ms - HTResizeTime: 163.465ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 346.28 K/sec - StreamingTime: 3s887ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m11s, non-child: 3s872ms, % non-child: 5.39%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 369.77 K/sec AGGREGATION_NODE (id=8):(Total: 35s665ms, non-child: 9s818ms, % non-child: 27.53%) ExecOption: Codegen Enabled - BuildTime: 9s096ms - GetNewBlockTime: 476.830us - GetResultsTime: 585.255ms - HTResizeTime: 1s208ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 372.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.014us HASH_JOIN_NODE (id=7):(Total: 25s847ms, non-child: 14s748ms, % non-child: 57.06%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s032ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s792ms - GetNewBlockTime: 556.587us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s031ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.578us EXCHANGE_NODE (id=13):(Total: 3s124ms, non-child: 1s227ms, % non-child: 39.28%) BytesReceived(2s000ms): 9.44 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 25.80 MB, 145.63 MB, 246.18 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB - BytesReceived: 251.94 MB (264180189) - ConvertRowBatchTime: 458.965ms - DeserializeRowBatchTimer: 1s543ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.37 M/sec - SendersBlockedTimer: 39s626ms - SendersBlockedTotalTimer(*): 8m36s EXCHANGE_NODE (id=12):(Total: 7s974ms, non-child: 2s879ms, % non-child: 36.11%) BytesReceived(2s000ms): 9.31 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.12 MB, 52.43 MB, 120.52 MB, 187.31 MB, 249.62 MB, 317.16 MB, 382.42 MB, 441.48 MB, 508.44 MB, 574.65 MB, 641.05 MB, 706.61 MB, 770.53 MB, 828.24 MB - BytesReceived: 865.02 MB (907041296) - ConvertRowBatchTime: 1s572ms - DeserializeRowBatchTimer: 5s170ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 6.47 M/sec - SendersBlockedTimer: 47s276ms - SendersBlockedTotalTimer(*): 8m1s AGGREGATION_NODE (id=4):(Total: 32s348ms, non-child: 8s971ms, % non-child: 27.73%) ExecOption: Codegen Enabled - BuildTime: 8s130ms - GetNewBlockTime: 509.430us - GetResultsTime: 673.759ms - HTResizeTime: 1s150ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 410.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us HASH_JOIN_NODE (id=3):(Total: 23s377ms, non-child: 12s728ms, % non-child: 54.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s589ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s631ms - GetNewBlockTime: 821.602us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s638ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.21 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.293us EXCHANGE_NODE (id=11):(Total: 2s750ms, non-child: 1s128ms, % non-child: 41.03%) BytesReceived(1s000ms): 21.98 MB, 88.86 MB, 158.41 MB, 222.90 MB, 251.07 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB - BytesReceived: 252.36 MB (264616449) - ConvertRowBatchTime: 338.370ms - DeserializeRowBatchTimer: 1s605ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s898ms, non-child: 2s644ms, % non-child: 33.48%) BytesReceived(1s000ms): 8.18 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 24.34 MB, 59.04 MB, 91.58 MB, 121.98 MB, 154.72 MB, 186.14 MB, 217.09 MB, 248.57 MB, 281.59 MB, 318.22 MB, 358.08 MB, 395.28 MB, 426.92 MB, 465.28 MB, 505.19 MB, 545.53 MB, 580.69 MB, 616.10 MB, 656.98 MB, 697.49 MB, 735.36 MB, 772.94 MB, 809.68 MB, 832.35 MB, 859.16 MB - BytesReceived: 864.94 MB (906955042) - ConvertRowBatchTime: 1s446ms - DeserializeRowBatchTimer: 4s806ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 6.54 M/sec - SendersBlockedTimer: 6s619ms - SendersBlockedTotalTimer(*): 1m39s Instance 194abadfc94cbc81:89ceb14c5a9691b4 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.30 MB, 514.42 MB, 794.37 MB, 1.13 GB, 1.35 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.93 GB, 787.65 MB, 629.64 MB, 422.99 MB, 200.01 MB, 182.81 MB, 374.81 MB, 686.79 MB, 1.03 GB, 1.24 GB, 1.34 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.53 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.78 GB, 1.56 GB, 748.02 MB, 555.51 MB, 350.99 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135414704) - PerHostPeakMemUsage: 3.03 GB (3248216096) - PrepareTime: 169.674ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 18s979ms - TotalNetworkSendTime: 1s159ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 665.537ms, non-child: 665.537ms, % non-child: 100.00%) - CodegenTime: 3.692ms - CompileTime: 112.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 397.983ms - PrepareTime: 144.139ms DataStreamSender (dst_id=14):(Total: 5s894ms, non-child: 5s894ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297804942) - NetworkThroughput(*): 58.53 MB/sec - OverallThroughput: 48.18 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s131ms - ThriftTransmitTime(*): 4s852ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s109ms, % non-child: 5.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.591ms - GetResultsTime: 83.433ms - HTResizeTime: 158.964ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 344.62 K/sec - StreamingTime: 3s799ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 4s248ms, % non-child: 5.87%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 367.21 K/sec AGGREGATION_NODE (id=8):(Total: 35s747ms, non-child: 9s787ms, % non-child: 27.38%) ExecOption: Codegen Enabled - BuildTime: 9s053ms - GetNewBlockTime: 502.943us - GetResultsTime: 589.627ms - HTResizeTime: 1s233ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 371.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.113us HASH_JOIN_NODE (id=7):(Total: 25s960ms, non-child: 13s587ms, % non-child: 52.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s421ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s580ms - GetNewBlockTime: 400.270us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s763ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.99 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.085us EXCHANGE_NODE (id=13):(Total: 3s819ms, non-child: 509.274ms, % non-child: 13.33%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 16.97 MB, 124.12 MB, 239.04 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB, 251.97 MB - BytesReceived: 251.97 MB (264213224) - ConvertRowBatchTime: 258.209ms - DeserializeRowBatchTimer: 912.667ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 3.58 M/sec - SendersBlockedTimer: 39s559ms - SendersBlockedTotalTimer(*): 8m34s EXCHANGE_NODE (id=12):(Total: 8s553ms, non-child: 2s997ms, % non-child: 35.04%) BytesReceived(2s000ms): 7.57 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 41.68 MB, 110.87 MB, 177.49 MB, 239.56 MB, 307.10 MB, 372.72 MB, 432.10 MB, 498.31 MB, 564.49 MB, 630.97 MB, 696.83 MB, 760.90 MB, 819.60 MB - BytesReceived: 865.01 MB (907027757) - ConvertRowBatchTime: 1s547ms - DeserializeRowBatchTimer: 5s574ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 46s999ms - SendersBlockedTotalTimer(*): 8m37s AGGREGATION_NODE (id=4):(Total: 32s393ms, non-child: 9s409ms, % non-child: 29.05%) ExecOption: Codegen Enabled - BuildTime: 8s530ms - GetNewBlockTime: 3.777ms - GetResultsTime: 730.660ms - HTResizeTime: 1s241ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 410.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.117us HASH_JOIN_NODE (id=3):(Total: 22s984ms, non-child: 12s299ms, % non-child: 53.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s163ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s813ms - GetNewBlockTime: 750.905us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s503ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.184us EXCHANGE_NODE (id=11):(Total: 3s191ms, non-child: 1s108ms, % non-child: 34.74%) BytesReceived(1s000ms): 7.81 MB, 67.40 MB, 137.20 MB, 204.74 MB, 247.92 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB, 252.40 MB - BytesReceived: 252.40 MB (264657767) - ConvertRowBatchTime: 253.484ms - DeserializeRowBatchTimer: 1s680ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 4.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s492ms, non-child: 3s098ms, % non-child: 41.36%) BytesReceived(1s000ms): 5.07 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 16.01 MB, 48.81 MB, 81.84 MB, 113.05 MB, 144.90 MB, 176.76 MB, 207.27 MB, 238.58 MB, 271.46 MB, 306.42 MB, 346.27 MB, 384.32 MB, 416.50 MB, 452.93 MB, 492.57 MB, 534.02 MB, 569.93 MB, 604.51 MB, 643.87 MB, 685.64 MB, 723.79 MB, 761.69 MB, 798.28 MB, 828.15 MB, 851.86 MB - BytesReceived: 864.95 MB (906960955) - ConvertRowBatchTime: 1s618ms - DeserializeRowBatchTimer: 5s184ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 6.89 M/sec - SendersBlockedTimer: 6s786ms - SendersBlockedTotalTimer(*): 1m41s Instance 194abadfc94cbc81:89ceb14c5a9691b3 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.31 MB, 546.42 MB, 810.36 MB, 1.15 GB, 1.35 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.50 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.93 GB, 775.51 MB, 581.01 MB, 386.51 MB, 160.80 MB, 182.79 MB, 406.86 MB, 686.80 MB, 1.03 GB, 1.24 GB, 1.34 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.53 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.79 GB, 1.36 GB, 687.85 MB, 459.28 MB, 262.63 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135619504) - PerHostPeakMemUsage: 3.03 GB (3255517192) - PrepareTime: 180.480ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 19s321ms - TotalNetworkSendTime: 1s129ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 672.556ms, non-child: 672.556ms, % non-child: 100.00%) - CodegenTime: 4.828ms - CompileTime: 131.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 391.658ms - PrepareTime: 142.897ms DataStreamSender (dst_id=14):(Total: 5s814ms, non-child: 5s814ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297749620) - NetworkThroughput(*): 64.97 MB/sec - OverallThroughput: 48.83 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s204ms - ThriftTransmitTime(*): 4s370ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 4s002ms, % non-child: 5.25%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 229.647us - GetResultsTime: 148.423ms - HTResizeTime: 155.877ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 345.51 K/sec - StreamingTime: 3s637ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 3s398ms, % non-child: 4.70%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 367.68 K/sec AGGREGATION_NODE (id=8):(Total: 36s609ms, non-child: 9s028ms, % non-child: 24.66%) ExecOption: Codegen Enabled - BuildTime: 8s321ms - GetNewBlockTime: 8.941ms - GetResultsTime: 547.682ms - HTResizeTime: 1s189ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 362.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.770us HASH_JOIN_NODE (id=7):(Total: 27s581ms, non-child: 13s849ms, % non-child: 50.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s833ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s672ms - GetNewBlockTime: 550.822us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s433ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 1.87 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.206us EXCHANGE_NODE (id=13):(Total: 4s255ms, non-child: 857.594ms, % non-child: 20.15%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 18.07 MB, 128.59 MB, 240.67 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB - BytesReceived: 251.94 MB (264174281) - ConvertRowBatchTime: 451.804ms - DeserializeRowBatchTimer: 1s115ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.21 M/sec - SendersBlockedTimer: 38s705ms - SendersBlockedTotalTimer(*): 8m23s EXCHANGE_NODE (id=12):(Total: 9s477ms, non-child: 3s020ms, % non-child: 31.87%) BytesReceived(2s000ms): 7.57 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 43.83 MB, 112.87 MB, 179.42 MB, 241.39 MB, 309.04 MB, 374.69 MB, 434.28 MB, 500.42 MB, 566.50 MB, 632.99 MB, 698.63 MB, 762.65 MB, 821.17 MB - BytesReceived: 864.62 MB (906621897) - ConvertRowBatchTime: 1s407ms - DeserializeRowBatchTimer: 5s985ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 5.45 M/sec - SendersBlockedTimer: 47s171ms - SendersBlockedTotalTimer(*): 8m46s AGGREGATION_NODE (id=4):(Total: 32s276ms, non-child: 8s786ms, % non-child: 27.22%) ExecOption: Codegen Enabled - BuildTime: 8s044ms - GetNewBlockTime: 430.180us - GetResultsTime: 601.440ms - HTResizeTime: 1s205ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 411.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.464us HASH_JOIN_NODE (id=3):(Total: 23s490ms, non-child: 13s731ms, % non-child: 58.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s921ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s656ms - GetNewBlockTime: 992.382us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s276ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.541us EXCHANGE_NODE (id=11):(Total: 2s400ms, non-child: 872.054ms, % non-child: 36.33%) BytesReceived(1s000ms): 9.89 MB, 71.70 MB, 141.57 MB, 208.61 MB, 248.85 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB - BytesReceived: 252.36 MB (264618296) - ConvertRowBatchTime: 450.833ms - DeserializeRowBatchTimer: 1s164ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 5.69 M/sec - SendersBlockedTimer: 20.417ms - SendersBlockedTotalTimer(*): 273.585ms EXCHANGE_NODE (id=10):(Total: 7s358ms, non-child: 3s045ms, % non-child: 41.39%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 17.21 MB, 50.83 MB, 83.68 MB, 114.98 MB, 146.79 MB, 178.57 MB, 208.83 MB, 240.56 MB, 273.42 MB, 308.60 MB, 348.56 MB, 386.40 MB, 418.77 MB, 455.29 MB, 495.18 MB, 536.31 MB, 571.63 MB, 606.74 MB, 646.03 MB, 687.53 MB, 725.62 MB, 763.62 MB, 800.16 MB, 827.94 MB, 853.35 MB - BytesReceived: 864.56 MB (906554048) - ConvertRowBatchTime: 1s439ms - DeserializeRowBatchTimer: 5s713ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 7.01 M/sec - SendersBlockedTimer: 6s672ms - SendersBlockedTotalTimer(*): 1m26s Instance 194abadfc94cbc81:89ceb14c5a9691b1 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 119.45 MB, 483.43 MB, 738.43 MB, 1.09 GB, 1.32 GB, 1.38 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.58 GB, 1.58 GB, 1.68 GB, 1.70 GB, 1.70 GB, 1.87 GB, 1.07 GB, 629.62 MB, 410.82 MB, 171.47 MB, 182.80 MB, 311.68 MB, 638.79 MB, 982.76 MB, 1.21 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.75 GB, 1.63 GB, 745.02 MB, 507.38 MB, 302.86 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2137309104) - PerHostPeakMemUsage: 2.97 GB (3192728424) - PrepareTime: 153.705ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 17s708ms - TotalNetworkSendTime: 961.358ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 642.201ms, non-child: 642.201ms, % non-child: 100.00%) - CodegenTime: 4.012ms - CompileTime: 110.116ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 388.730ms - PrepareTime: 142.055ms DataStreamSender (dst_id=14):(Total: 5s266ms, non-child: 5s266ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297682799) - NetworkThroughput(*): 69.38 MB/sec - OverallThroughput: 53.90 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s879ms - ThriftTransmitTime(*): 4s091ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 3s543ms, % non-child: 4.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 188.488us - GetResultsTime: 130.995ms - HTResizeTime: 167.075ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 343.55 K/sec - StreamingTime: 3s208ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 4s050ms, % non-child: 5.54%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 363.19 K/sec AGGREGATION_NODE (id=8):(Total: 36s855ms, non-child: 10s026ms, % non-child: 27.21%) ExecOption: Codegen Enabled - BuildTime: 9s389ms - GetNewBlockTime: 1.439ms - GetResultsTime: 511.064ms - HTResizeTime: 1s174ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 360.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.220us HASH_JOIN_NODE (id=7):(Total: 26s829ms, non-child: 14s177ms, % non-child: 52.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s782ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s868ms - GetNewBlockTime: 561.563us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s661ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.025us EXCHANGE_NODE (id=13):(Total: 4s657ms, non-child: 1s277ms, % non-child: 27.43%) BytesReceived(2s000ms): 7.96 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.08 MB, 21.44 MB, 136.62 MB, 243.51 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB, 251.88 MB - BytesReceived: 251.88 MB (264119760) - ConvertRowBatchTime: 408.986ms - DeserializeRowBatchTimer: 1s636ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 2.93 M/sec - SendersBlockedTimer: 38s348ms - SendersBlockedTotalTimer(*): 5m6s EXCHANGE_NODE (id=12):(Total: 7s994ms, non-child: 2s972ms, % non-child: 37.18%) BytesReceived(2s000ms): 8.04 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 48.26 MB, 116.60 MB, 183.06 MB, 245.06 MB, 312.76 MB, 378.09 MB, 437.71 MB, 503.96 MB, 570.29 MB, 636.65 MB, 702.24 MB, 766.17 MB, 824.26 MB - BytesReceived: 864.66 MB (906661095) - ConvertRowBatchTime: 1s518ms - DeserializeRowBatchTimer: 5s677ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 6.46 M/sec - SendersBlockedTimer: 47s336ms - SendersBlockedTotalTimer(*): 10m14s AGGREGATION_NODE (id=4):(Total: 32s260ms, non-child: 8s555ms, % non-child: 26.52%) ExecOption: Codegen Enabled - BuildTime: 7s857ms - GetNewBlockTime: 594.044us - GetResultsTime: 549.878ms - HTResizeTime: 1s229ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 411.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.124us HASH_JOIN_NODE (id=3):(Total: 23s704ms, non-child: 14s407ms, % non-child: 60.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s067ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s669ms - GetNewBlockTime: 1.234ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s857ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.18 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.801us EXCHANGE_NODE (id=11):(Total: 2s297ms, non-child: 1s263ms, % non-child: 54.98%) BytesReceived(1s000ms): 14.68 MB, 79.81 MB, 149.38 MB, 215.77 MB, 250.11 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB, 252.31 MB - BytesReceived: 252.31 MB (264563580) - ConvertRowBatchTime: 470.275ms - DeserializeRowBatchTimer: 1s568ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 5.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s000ms, non-child: 3s211ms, % non-child: 45.88%) BytesReceived(1s000ms): 5.73 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 19.51 MB, 54.01 MB, 87.39 MB, 118.56 MB, 150.54 MB, 182.24 MB, 212.84 MB, 244.28 MB, 277.16 MB, 312.94 MB, 352.90 MB, 390.44 MB, 423.66 MB, 459.69 MB, 499.98 MB, 540.44 MB, 576.00 MB, 611.00 MB, 651.01 MB, 692.38 MB, 730.09 MB, 767.77 MB, 804.35 MB, 828.59 MB, 856.21 MB - BytesReceived: 864.59 MB (906590739) - ConvertRowBatchTime: 1s426ms - DeserializeRowBatchTimer: 6s003ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 7.37 M/sec - SendersBlockedTimer: 6s626ms - SendersBlockedTotalTimer(*): 1m26s Instance 194abadfc94cbc81:89ceb14c5a9691b7 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 205.65 MB, 514.44 MB, 802.33 MB, 1.14 GB, 1.35 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.93 GB, 799.04 MB, 629.60 MB, 471.58 MB, 301.40 MB, 176.29 MB, 390.51 MB, 690.85 MB, 1.03 GB, 1.24 GB, 1.34 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.52 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.78 GB, 1.57 GB, 699.90 MB, 507.39 MB, 278.80 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134595504) - PerHostPeakMemUsage: 3.04 GB (3263248168) - PrepareTime: 165.359ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 15s509ms - TotalNetworkSendTime: 1s293ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 706.303ms, non-child: 706.303ms, % non-child: 100.00%) - CodegenTime: 4.222ms - CompileTime: 137.039ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 416.918ms - PrepareTime: 142.526ms DataStreamSender (dst_id=14):(Total: 6s338ms, non-child: 6s338ms, % non-child: 100.00%) - BytesSent: 283.87 MB (297663818) - NetworkThroughput(*): 54.13 MB/sec - OverallThroughput: 44.79 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s304ms - ThriftTransmitTime(*): 5s244ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 1m15s, non-child: 4s607ms, % non-child: 6.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 224.486us - GetResultsTime: 127.874ms - HTResizeTime: 163.972ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255945) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 348.60 K/sec - StreamingTime: 4s256ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m10s, non-child: 4s027ms, % non-child: 5.67%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 374.33 K/sec AGGREGATION_NODE (id=8):(Total: 34s493ms, non-child: 9s673ms, % non-child: 28.04%) ExecOption: Codegen Enabled - BuildTime: 9s003ms - GetNewBlockTime: 547.956us - GetResultsTime: 546.557ms - HTResizeTime: 1s200ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 385.15 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.255us HASH_JOIN_NODE (id=7):(Total: 24s819ms, non-child: 14s283ms, % non-child: 57.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s158ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s592ms - GetNewBlockTime: 560.724us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s745ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.981us EXCHANGE_NODE (id=13):(Total: 1s879ms, non-child: 1s323ms, % non-child: 70.43%) BytesReceived(2s000ms): 7.59 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.13 MB, 16.73 MB, 123.39 MB, 238.68 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB, 251.86 MB - BytesReceived: 251.86 MB (264093473) - ConvertRowBatchTime: 488.844ms - DeserializeRowBatchTimer: 1s586ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 7.27 M/sec - SendersBlockedTimer: 40s748ms - SendersBlockedTotalTimer(*): 9m33s EXCHANGE_NODE (id=12):(Total: 8s655ms, non-child: 2s889ms, % non-child: 33.39%) BytesReceived(2s000ms): 7.57 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 41.30 MB, 110.39 MB, 176.92 MB, 238.90 MB, 306.30 MB, 372.02 MB, 431.29 MB, 497.64 MB, 563.78 MB, 630.29 MB, 696.13 MB, 760.29 MB, 818.98 MB - BytesReceived: 864.63 MB (906634358) - ConvertRowBatchTime: 1s607ms - DeserializeRowBatchTimer: 5s023ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 5.96 M/sec - SendersBlockedTimer: 46s989ms - SendersBlockedTotalTimer(*): 9m26s AGGREGATION_NODE (id=4):(Total: 32s460ms, non-child: 9s131ms, % non-child: 28.13%) ExecOption: Codegen Enabled - BuildTime: 8s174ms - GetNewBlockTime: 3.913ms - GetResultsTime: 822.110ms - HTResizeTime: 1s235ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 409.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.754us HASH_JOIN_NODE (id=3):(Total: 23s329ms, non-child: 13s800ms, % non-child: 59.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s973ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s572ms - GetNewBlockTime: 1.074ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s405ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.21 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.641us EXCHANGE_NODE (id=11):(Total: 2s333ms, non-child: 861.948ms, % non-child: 36.93%) BytesReceived(1s000ms): 7.43 MB, 66.60 MB, 136.48 MB, 204.05 MB, 247.63 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB, 252.27 MB - BytesReceived: 252.27 MB (264528203) - ConvertRowBatchTime: 463.542ms - DeserializeRowBatchTimer: 1s100ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 5.85 M/sec - SendersBlockedTimer: 36.113ms - SendersBlockedTotalTimer(*): 508.869ms EXCHANGE_NODE (id=10):(Total: 7s194ms, non-child: 2s967ms, % non-child: 41.24%) BytesReceived(1s000ms): 5.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 15.91 MB, 48.45 MB, 81.41 MB, 112.62 MB, 144.41 MB, 176.17 MB, 206.79 MB, 238.08 MB, 271.03 MB, 305.81 MB, 345.64 MB, 383.53 MB, 415.61 MB, 452.18 MB, 491.77 MB, 533.14 MB, 569.09 MB, 603.61 MB, 642.99 MB, 684.67 MB, 722.89 MB, 760.82 MB, 797.48 MB, 827.50 MB, 851.14 MB - BytesReceived: 864.58 MB (906575224) - ConvertRowBatchTime: 1s560ms - DeserializeRowBatchTimer: 5s109ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 7.17 M/sec - SendersBlockedTimer: 6s562ms - SendersBlockedTotalTimer(*): 1m31s Instance 194abadfc94cbc81:89ceb14c5a9691b5 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 161.28 MB, 482.39 MB, 746.36 MB, 1.09 GB, 1.32 GB, 1.38 GB, 1.41 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.58 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.89 GB, 1.07 GB, 629.63 MB, 435.14 MB, 204.16 MB, 182.86 MB, 342.84 MB, 638.82 MB, 998.78 MB, 1.23 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.50 GB, 1.53 GB, 1.53 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.76 GB, 1.63 GB, 748.01 MB, 519.42 MB, 278.81 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2134723504) - PerHostPeakMemUsage: 3.03 GB (3253945912) - PrepareTime: 159.194ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 19s994ms - TotalNetworkSendTime: 1s039ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 731.144ms, non-child: 731.144ms, % non-child: 100.00%) - CodegenTime: 3.568ms - CompileTime: 94.707ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 488.684ms - PrepareTime: 144.331ms DataStreamSender (dst_id=14):(Total: 5s316ms, non-child: 5s316ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741330) - NetworkThroughput(*): 67.04 MB/sec - OverallThroughput: 53.40 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s911ms - ThriftTransmitTime(*): 4s235ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 3s839ms, % non-child: 5.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 250.819us - GetResultsTime: 115.188ms - HTResizeTime: 158.367ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 345.19 K/sec - StreamingTime: 3s505ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m12s, non-child: 4s207ms, % non-child: 5.80%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 366.50 K/sec AGGREGATION_NODE (id=8):(Total: 36s136ms, non-child: 8s998ms, % non-child: 24.90%) ExecOption: Codegen Enabled - BuildTime: 8s329ms - GetNewBlockTime: 629.584us - GetResultsTime: 523.202ms - HTResizeTime: 1s230ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 367.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.212us HASH_JOIN_NODE (id=7):(Total: 27s137ms, non-child: 12s617ms, % non-child: 46.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s274ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s834ms - GetNewBlockTime: 503.756us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s677ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 1.90 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.901us EXCHANGE_NODE (id=13):(Total: 4s411ms, non-child: 1s148ms, % non-child: 26.03%) BytesReceived(2s000ms): 9.00 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 24.80 MB, 143.57 MB, 245.60 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB - BytesReceived: 251.93 MB (264171569) - ConvertRowBatchTime: 268.643ms - DeserializeRowBatchTimer: 1s678ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 3.10 M/sec - SendersBlockedTimer: 39s115ms - SendersBlockedTotalTimer(*): 7m10s EXCHANGE_NODE (id=12):(Total: 10s108ms, non-child: 3s114ms, % non-child: 30.81%) BytesReceived(2s000ms): 8.96 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.16 MB, 51.47 MB, 119.63 MB, 186.16 MB, 248.47 MB, 316.05 MB, 381.32 MB, 440.50 MB, 507.33 MB, 573.55 MB, 639.90 MB, 705.47 MB, 769.38 MB, 827.29 MB - BytesReceived: 864.61 MB (906604722) - ConvertRowBatchTime: 1s417ms - DeserializeRowBatchTimer: 6s197ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.11 M/sec - SendersBlockedTimer: 47s298ms - SendersBlockedTotalTimer(*): 11m1s AGGREGATION_NODE (id=4):(Total: 32s170ms, non-child: 9s428ms, % non-child: 29.31%) ExecOption: Codegen Enabled - BuildTime: 8s707ms - GetNewBlockTime: 1.695ms - GetResultsTime: 562.812ms - HTResizeTime: 1s304ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 413.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.506us HASH_JOIN_NODE (id=3):(Total: 22s742ms, non-child: 13s446ms, % non-child: 59.12%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s197ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s811ms - GetNewBlockTime: 828.886us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s582ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.27 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.293us EXCHANGE_NODE (id=11):(Total: 3s095ms, non-child: 1s127ms, % non-child: 36.44%) BytesReceived(1s000ms): 20.19 MB, 86.87 MB, 156.45 MB, 221.38 MB, 250.93 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB - BytesReceived: 252.36 MB (264613803) - ConvertRowBatchTime: 244.287ms - DeserializeRowBatchTimer: 1s697ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 4.41 M/sec - SendersBlockedTimer: 61.256ms - SendersBlockedTotalTimer(*): 852.925ms EXCHANGE_NODE (id=10):(Total: 6s200ms, non-child: 2s807ms, % non-child: 45.27%) BytesReceived(1s000ms): 7.44 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 23.32 MB, 57.78 MB, 90.51 MB, 120.70 MB, 153.67 MB, 185.08 MB, 215.94 MB, 247.43 MB, 280.37 MB, 316.98 MB, 356.48 MB, 393.83 MB, 425.91 MB, 463.58 MB, 503.70 MB, 544.01 MB, 579.30 MB, 614.45 MB, 655.17 MB, 696.04 MB, 733.78 MB, 771.45 MB, 808.18 MB, 831.16 MB, 858.24 MB - BytesReceived: 864.54 MB (906532273) - ConvertRowBatchTime: 1s504ms - DeserializeRowBatchTimer: 4s941ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 8.32 M/sec - SendersBlockedTimer: 6s824ms - SendersBlockedTotalTimer(*): 1m28s Instance 194abadfc94cbc81:89ceb14c5a9691b0 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 203.41 MB, 515.03 MB, 802.36 MB, 1.15 GB, 1.34 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.58 GB, 1.57 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.92 GB, 994.76 MB, 593.16 MB, 337.89 MB, 163.10 MB, 182.81 MB, 374.87 MB, 646.81 MB, 1014.76 MB, 1.24 GB, 1.33 GB, 1.34 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.52 GB, 1.53 GB, 1.56 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.77 GB, 1.63 GB, 723.94 MB, 507.38 MB, 242.57 MB ThreadUsage(2s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2137437104) - PerHostPeakMemUsage: 3.01 GB (3234129912) - PrepareTime: 146.503ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 1m18s - TotalNetworkReceiveTime: 18s798ms - TotalNetworkSendTime: 826.256ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 635.923ms, non-child: 635.923ms, % non-child: 100.00%) - CodegenTime: 2.839ms - CompileTime: 118.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 378.855ms - PrepareTime: 137.705ms DataStreamSender (dst_id=14):(Total: 4s748ms, non-child: 4s748ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297762392) - NetworkThroughput(*): 79.10 MB/sec - OverallThroughput: 59.81 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s781ms - ThriftTransmitTime(*): 3s589ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 1m16s, non-child: 3s568ms, % non-child: 4.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 175.500us - GetResultsTime: 80.010ms - HTResizeTime: 163.454ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 343.48 K/sec - StreamingTime: 3s295ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 1m13s, non-child: 3s838ms, % non-child: 5.25%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 363.23 K/sec AGGREGATION_NODE (id=8):(Total: 37s079ms, non-child: 9s672ms, % non-child: 26.09%) ExecOption: Codegen Enabled - BuildTime: 9s027ms - GetNewBlockTime: 488.690us - GetResultsTime: 525.464ms - HTResizeTime: 1s238ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 358.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 979.000ns HASH_JOIN_NODE (id=7):(Total: 27s406ms, non-child: 13s563ms, % non-child: 49.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s415ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s873ms - GetNewBlockTime: 407.747us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s439ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.88 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.469us EXCHANGE_NODE (id=13):(Total: 5s245ms, non-child: 1s137ms, % non-child: 21.68%) BytesReceived(2s000ms): 7.58 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 16.11 MB, 120.78 MB, 237.72 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB, 251.94 MB - BytesReceived: 251.94 MB (264179586) - ConvertRowBatchTime: 308.660ms - DeserializeRowBatchTimer: 1s651ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 2.61 M/sec - SendersBlockedTimer: 38s135ms - SendersBlockedTotalTimer(*): 6m59s EXCHANGE_NODE (id=12):(Total: 8s597ms, non-child: 3s110ms, % non-child: 36.18%) BytesReceived(2s000ms): 7.56 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.09 MB, 39.85 MB, 109.25 MB, 176.00 MB, 238.22 MB, 305.50 MB, 371.34 MB, 430.75 MB, 496.95 MB, 563.17 MB, 629.67 MB, 695.35 MB, 759.27 MB, 817.96 MB - BytesReceived: 864.70 MB (906708768) - ConvertRowBatchTime: 1s600ms - DeserializeRowBatchTimer: 5s584ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 6.00 M/sec - SendersBlockedTimer: 47s326ms - SendersBlockedTotalTimer(*): 7m44s AGGREGATION_NODE (id=4):(Total: 32s254ms, non-child: 8s784ms, % non-child: 27.24%) ExecOption: Codegen Enabled - BuildTime: 8s103ms - GetNewBlockTime: 421.850us - GetResultsTime: 534.299ms - HTResizeTime: 1s220ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.06 MB (832628736) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 412.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.235us HASH_JOIN_NODE (id=3):(Total: 23s469ms, non-child: 14s154ms, % non-child: 60.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s124ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s600ms - GetNewBlockTime: 1.012ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s635ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.631us EXCHANGE_NODE (id=11):(Total: 2s247ms, non-child: 1s291ms, % non-child: 57.47%) BytesReceived(1s000ms): 6.15 MB, 63.96 MB, 133.77 MB, 201.63 MB, 247.05 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB, 252.36 MB - BytesReceived: 252.36 MB (264620243) - ConvertRowBatchTime: 481.170ms - DeserializeRowBatchTimer: 1s565ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 6.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s067ms, non-child: 2s902ms, % non-child: 41.06%) BytesReceived(1s000ms): 5.05 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 15.22 MB, 47.02 MB, 80.13 MB, 111.44 MB, 143.27 MB, 175.26 MB, 206.17 MB, 236.93 MB, 269.82 MB, 304.56 MB, 344.22 MB, 382.24 MB, 414.30 MB, 450.96 MB, 490.56 MB, 531.98 MB, 567.96 MB, 602.27 MB, 641.66 MB, 683.39 MB, 721.57 MB, 759.59 MB, 796.08 MB, 826.77 MB, 849.95 MB - BytesReceived: 864.64 MB (906640626) - ConvertRowBatchTime: 1s532ms - DeserializeRowBatchTimer: 4s971ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 7.30 M/sec - SendersBlockedTimer: 6s530ms - SendersBlockedTotalTimer(*): 1m5s Fragment F04: Instance 194abadfc94cbc81:89ceb14c5a9691c5 (host=vb0224.halxg.cloudera.com:22000):(Total: 45s215ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(1s000ms): 101.74 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.67 MB, 203.58 MB, 203.45 MB, 203.53 MB, 137.12 MB, 116.94 MB ThreadUsage(1s000ms): 4, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6 - AverageThreadTokens: 7.81 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.78 MB (213682408) - PerHostPeakMemUsage: 2.53 GB (2712076464) - PrepareTime: 141.770ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 5m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s785ms - TotalStorageWaitTime: 117.917ms CodeGen:(Total: 386.596ms, non-child: 386.596ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 241.775ms - PrepareTime: 140.280ms DataStreamSender (dst_id=13):(Total: 44s950ms, non-child: 44s950ms, % non-child: 100.00%) - BytesSent: 281.69 MB (295372354) - NetworkThroughput(*): 486.10 KB/sec - OverallThroughput: 6.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s379ms - ThriftTransmitTime(*): 9m53s - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=6):(Total: 385.234ms, non-child: 385.234ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(1s000ms): 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.89 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 580.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.34 MB (213215464) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 39.68 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.07K (2071) - ScannerThreadsTotalWallClockTime: 5m10s - MaterializeTupleTime(*): 5m9s - ScannerThreadsSysTime: 149.972ms - ScannerThreadsUserTime: 4s407ms - ScannerThreadsVoluntaryContextSwitches: 14.96K (14960) - TotalRawHdfsReadTime(*): 125.014ms - TotalReadThroughput: 3.94 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691be (host=vb0214.halxg.cloudera.com:22000):(Total: 45s111ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(1s000ms): 105.19 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.30 MB, 210.25 MB, 210.31 MB, 210.31 MB, 206.30 MB, 162.65 MB, 126.69 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.68 MB (220914432) - PerHostPeakMemUsage: 2.50 GB (2680066544) - PrepareTime: 152.170ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 4m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s784ms - TotalStorageWaitTime: 282.037ms CodeGen:(Total: 428.135ms, non-child: 428.135ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.724ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 269.834ms - PrepareTime: 142.675ms DataStreamSender (dst_id=13):(Total: 44s844ms, non-child: 44s844ms, % non-child: 100.00%) - BytesSent: 298.12 MB (312604718) - NetworkThroughput(*): 757.58 KB/sec - OverallThroughput: 6.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s365ms - ThriftTransmitTime(*): 6m42s - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=6):(Total: 393.260ms, non-child: 393.260ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 93.59 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 556.430ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220406576) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 41.08 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.47K (1469) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 4m28s - ScannerThreadsSysTime: 113.979ms - ScannerThreadsUserTime: 3s974ms - ScannerThreadsVoluntaryContextSwitches: 15.62K (15623) - TotalRawHdfsReadTime(*): 162.942ms - TotalReadThroughput: 4.11 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c1 (host=vb0220.halxg.cloudera.com:22000):(Total: 45s053ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(1s000ms): 100.92 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.94 MB, 201.95 MB, 201.91 MB, 201.86 MB, 201.88 MB, 154.17 MB, 117.05 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.13 MB (211944240) - PerHostPeakMemUsage: 2.49 GB (2678828056) - PrepareTime: 140.109ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 4m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s787ms - TotalStorageWaitTime: 93.978ms CodeGen:(Total: 385.677ms, non-child: 385.677ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.875ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 242.132ms - PrepareTime: 138.653ms DataStreamSender (dst_id=13):(Total: 44s797ms, non-child: 44s797ms, % non-child: 100.00%) - BytesSent: 275.68 MB (289075883) - NetworkThroughput(*): 643.22 KB/sec - OverallThroughput: 6.15 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s276ms - ThriftTransmitTime(*): 7m18s - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=6):(Total: 374.189ms, non-child: 374.189ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.97 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 593.819ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.70 MB (211493632) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 39.99 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.84K (1837) - ScannerThreadsTotalWallClockTime: 4m27s - MaterializeTupleTime(*): 4m27s - ScannerThreadsSysTime: 141.976ms - ScannerThreadsUserTime: 4s375ms - ScannerThreadsVoluntaryContextSwitches: 14.60K (14600) - TotalRawHdfsReadTime(*): 108.851ms - TotalReadThroughput: 3.86 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c8 (host=vb0208.halxg.cloudera.com:22000):(Total: 44s818ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(1s000ms): 98.96 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.85 MB, 197.79 MB, 197.82 MB, 173.90 MB, 143.61 MB, 96.90 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.22 MB (207848152) - PerHostPeakMemUsage: 2.47 GB (2653354352) - PrepareTime: 151.686ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s788ms - TotalStorageWaitTime: 237.990ms CodeGen:(Total: 415.831ms, non-child: 415.831ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.961ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.660ms - PrepareTime: 142.067ms DataStreamSender (dst_id=13):(Total: 44s543ms, non-child: 44s543ms, % non-child: 100.00%) - BytesSent: 273.48 MB (286764359) - NetworkThroughput(*): 637.39 KB/sec - OverallThroughput: 6.14 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s172ms - ThriftTransmitTime(*): 7m19s - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=6):(Total: 403.967ms, non-child: 403.967ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 85.98 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.97 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 508.005ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.76 MB (207364824) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 36.71 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1651) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m25s - ScannerThreadsSysTime: 104.981ms - ScannerThreadsUserTime: 3s678ms - ScannerThreadsVoluntaryContextSwitches: 14.36K (14361) - TotalRawHdfsReadTime(*): 155.217ms - TotalReadThroughput: 3.82 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691bb (host=vb0212.halxg.cloudera.com:22000):(Total: 44s734ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.44 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.78 MB, 176.66 MB, 176.71 MB, 156.87 MB, 136.88 MB, 77.33 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670944) - PerHostPeakMemUsage: 2.46 GB (2645124424) - PrepareTime: 150.008ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 3m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s780ms - TotalStorageWaitTime: 92.004ms CodeGen:(Total: 397.802ms, non-child: 397.802ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.831ms - PrepareTime: 143.126ms DataStreamSender (dst_id=13):(Total: 44s446ms, non-child: 44s446ms, % non-child: 100.00%) - BytesSent: 247.82 MB (259855764) - NetworkThroughput(*): 783.53 KB/sec - OverallThroughput: 5.58 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s081ms - ThriftTransmitTime(*): 5m23s - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=6):(Total: 415.586ms, non-child: 415.586ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 787.652ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 32.38 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.19K (2189) - ScannerThreadsTotalWallClockTime: 3m42s - MaterializeTupleTime(*): 3m41s - ScannerThreadsSysTime: 168.971ms - ScannerThreadsUserTime: 5s686ms - ScannerThreadsVoluntaryContextSwitches: 13.07K (13066) - TotalRawHdfsReadTime(*): 109.821ms - TotalReadThroughput: 3.47 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691bd (host=vb0218.halxg.cloudera.com:22000):(Total: 44s610ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.44 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.81 MB, 176.87 MB, 176.74 MB, 156.88 MB, 137.09 MB, 77.47 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 176.99 MB (185589064) - PerHostPeakMemUsage: 2.46 GB (2645601224) - PrepareTime: 143.758ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 3m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s784ms - TotalStorageWaitTime: 85.288ms CodeGen:(Total: 509.828ms, non-child: 509.828ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.276ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 360.318ms - PrepareTime: 140.117ms DataStreamSender (dst_id=13):(Total: 44s372ms, non-child: 44s372ms, % non-child: 100.00%) - BytesSent: 248.27 MB (260334075) - NetworkThroughput(*): 429.19 KB/sec - OverallThroughput: 5.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s059ms - ThriftTransmitTime(*): 9m52s - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=6):(Total: 362.591ms, non-child: 362.591ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 472.037ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 37.12 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1548) - ScannerThreadsTotalWallClockTime: 3m42s - MaterializeTupleTime(*): 3m41s - ScannerThreadsSysTime: 64.989ms - ScannerThreadsUserTime: 3s865ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13047) - TotalRawHdfsReadTime(*): 98.007ms - TotalReadThroughput: 3.47 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691bf (host=vb0232.halxg.cloudera.com:22000):(Total: 44s515ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(1s000ms): 81.04 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.41 MB, 178.40 MB, 178.33 MB, 178.39 MB, 117.94 MB, 79.45 MB ThreadUsage(1s000ms): 4, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 5, 5 - AverageThreadTokens: 6.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.77 MB (187458224) - PerHostPeakMemUsage: 2.47 GB (2650512888) - PrepareTime: 144.031ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 4m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s790ms - TotalStorageWaitTime: 176.472ms CodeGen:(Total: 392.515ms, non-child: 392.515ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.420ms - PrepareTime: 142.512ms DataStreamSender (dst_id=13):(Total: 44s252ms, non-child: 44s252ms, % non-child: 100.00%) - BytesSent: 242.66 MB (254445394) - NetworkThroughput(*): 449.11 KB/sec - OverallThroughput: 5.48 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s976ms - ThriftTransmitTime(*): 9m13s - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=6):(Total: 387.016ms, non-child: 387.016ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 146.14 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.92 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 481.817ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.32 MB (186983088) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 34.01 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1369) - ScannerThreadsTotalWallClockTime: 4m22s - MaterializeTupleTime(*): 4m22s - ScannerThreadsSysTime: 125.977ms - ScannerThreadsUserTime: 3s504ms - ScannerThreadsVoluntaryContextSwitches: 12.78K (12778) - TotalRawHdfsReadTime(*): 132.791ms - TotalReadThroughput: 3.43 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c7 (host=vb0230.halxg.cloudera.com:22000):(Total: 44s495ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(1s000ms): 88.30 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.53 MB, 176.63 MB, 176.70 MB, 156.91 MB, 128.87 MB, 49.62 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638224) - PerHostPeakMemUsage: 2.43 GB (2610401200) - PrepareTime: 147.976ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 3m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s790ms - TotalStorageWaitTime: 236.591ms CodeGen:(Total: 407.671ms, non-child: 407.671ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.566ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.704ms - PrepareTime: 142.632ms DataStreamSender (dst_id=13):(Total: 44s240ms, non-child: 44s240ms, % non-child: 100.00%) - BytesSent: 248.55 MB (260625580) - NetworkThroughput(*): 459.33 KB/sec - OverallThroughput: 5.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s987ms - ThriftTransmitTime(*): 9m14s - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=6):(Total: 378.561ms, non-child: 378.561ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 488.216ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 911.26 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 35.56 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1436) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 94.984ms - ScannerThreadsUserTime: 3s498ms - ScannerThreadsVoluntaryContextSwitches: 13.00K (12997) - TotalRawHdfsReadTime(*): 171.179ms - TotalReadThroughput: 3.47 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c2 (host=vb0228.halxg.cloudera.com:22000):(Total: 44s432ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(1s000ms): 88.38 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.69 MB, 176.67 MB, 176.67 MB, 176.70 MB, 156.87 MB, 117.05 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638224) - PerHostPeakMemUsage: 2.46 GB (2641327888) - PrepareTime: 150.890ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 3m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s788ms - TotalStorageWaitTime: 171.927ms CodeGen:(Total: 413.580ms, non-child: 413.580ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.075ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.119ms - PrepareTime: 142.769ms DataStreamSender (dst_id=13):(Total: 44s154ms, non-child: 44s154ms, % non-child: 100.00%) - BytesSent: 248.87 MB (260962460) - NetworkThroughput(*): 430.17 KB/sec - OverallThroughput: 5.64 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s961ms - ThriftTransmitTime(*): 9m52s - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=6):(Total: 399.398ms, non-child: 399.398ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 78.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 465.212ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 33.70 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.23K (1230) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 80.986ms - ScannerThreadsUserTime: 3s334ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13024) - TotalRawHdfsReadTime(*): 121.480ms - TotalReadThroughput: 3.51 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c6 (host=vb0234.halxg.cloudera.com:22000):(Total: 44s429ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(1s000ms): 88.31 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.89 MB, 176.93 MB, 176.90 MB, 176.71 MB, 156.94 MB, 137.07 MB, 77.44 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 2.50 GB (2684255416) - PrepareTime: 141.933ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 3m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s794ms - TotalStorageWaitTime: 87.669ms CodeGen:(Total: 389.512ms, non-child: 389.512ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.244ms - PrepareTime: 140.427ms DataStreamSender (dst_id=13):(Total: 44s196ms, non-child: 44s196ms, % non-child: 100.00%) - BytesSent: 248.19 MB (260244749) - NetworkThroughput(*): 492.96 KB/sec - OverallThroughput: 5.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s979ms - ThriftTransmitTime(*): 8m35s - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=6):(Total: 356.088ms, non-child: 356.088ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 463.619ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130864) - PerReadThreadRawHdfsThroughput: 1.53 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 37.82 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.34K (1341) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 91.984ms - ScannerThreadsUserTime: 3s640ms - ScannerThreadsVoluntaryContextSwitches: 13.07K (13073) - TotalRawHdfsReadTime(*): 99.882ms - TotalReadThroughput: 3.51 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c3 (host=vb0206.halxg.cloudera.com:22000):(Total: 44s393ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(1s000ms): 88.40 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.73 MB, 176.69 MB, 156.85 MB, 117.08 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.11 MB (185711912) - PerHostPeakMemUsage: 2.48 GB (2662389560) - PrepareTime: 150.528ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 3m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s790ms - TotalStorageWaitTime: 93.242ms CodeGen:(Total: 409.164ms, non-child: 409.164ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.063ms - PrepareTime: 143.382ms DataStreamSender (dst_id=13):(Total: 44s126ms, non-child: 44s126ms, % non-child: 100.00%) - BytesSent: 247.93 MB (259972258) - NetworkThroughput(*): 5.17 MB/sec - OverallThroughput: 5.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s955ms - ThriftTransmitTime(*): 47s950ms - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=6):(Total: 389.484ms, non-child: 389.484ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 77.99 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 473.715ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 34.56 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1321) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 83.986ms - ScannerThreadsUserTime: 3s692ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13019) - TotalRawHdfsReadTime(*): 112.757ms - TotalReadThroughput: 3.51 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ba (host=vb0226.halxg.cloudera.com:22000):(Total: 44s377ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(1s000ms): 84.13 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.19 MB, 168.18 MB, 168.28 MB, 148.20 MB, 103.93 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.51 MB (176692552) - PerHostPeakMemUsage: 2.47 GB (2656418848) - PrepareTime: 152.318ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 3m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s777ms - TotalStorageWaitTime: 293.691ms CodeGen:(Total: 434.721ms, non-child: 434.721ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 275.526ms - PrepareTime: 143.289ms DataStreamSender (dst_id=13):(Total: 44s029ms, non-child: 44s029ms, % non-child: 100.00%) - BytesSent: 226.87 MB (237895277) - NetworkThroughput(*): 452.59 KB/sec - OverallThroughput: 5.15 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s839ms - ThriftTransmitTime(*): 8m33s - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=6):(Total: 462.963ms, non-child: 462.963ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 71.35 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 770.043ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217416) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 26.59 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1667) - ScannerThreadsTotalWallClockTime: 3m39s - MaterializeTupleTime(*): 3m38s - ScannerThreadsSysTime: 142.976ms - ScannerThreadsUserTime: 5s628ms - ScannerThreadsVoluntaryContextSwitches: 11.90K (11897) - TotalRawHdfsReadTime(*): 133.673ms - TotalReadThroughput: 3.21 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691bc (host=vb0204.halxg.cloudera.com:22000):(Total: 44s364ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(1s000ms): 88.28 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.54 MB, 176.53 MB, 176.56 MB, 156.92 MB, 137.02 MB, 73.06 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621840) - PerHostPeakMemUsage: 2.49 GB (2677346720) - PrepareTime: 152.126ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 3m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s777ms - TotalStorageWaitTime: 131.888ms CodeGen:(Total: 452.585ms, non-child: 452.585ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.448ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 293.537ms - PrepareTime: 149.805ms DataStreamSender (dst_id=13):(Total: 44s118ms, non-child: 44s118ms, % non-child: 100.00%) - BytesSent: 247.83 MB (259864776) - NetworkThroughput(*): 491.93 KB/sec - OverallThroughput: 5.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s936ms - ThriftTransmitTime(*): 8m35s - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=6):(Total: 378.759ms, non-child: 378.759ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 468.425ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 919.67 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 35.54 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 3m40s - ScannerThreadsSysTime: 106.981ms - ScannerThreadsUserTime: 3s279ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13051) - TotalRawHdfsReadTime(*): 169.615ms - TotalReadThroughput: 3.51 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c0 (host=vb0216.halxg.cloudera.com:22000):(Total: 44s266ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(1s000ms): 43.26 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.29 MB, 160.32 MB, 160.28 MB, 156.32 MB, 115.85 MB, 47.27 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 3 - AverageThreadTokens: 5.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.55 MB (168353056) - PerHostPeakMemUsage: 2.41 GB (2582533808) - PrepareTime: 148.230ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 3m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s781ms - TotalStorageWaitTime: 354.582ms CodeGen:(Total: 408.923ms, non-child: 408.923ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.864ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.308ms - PrepareTime: 143.027ms DataStreamSender (dst_id=13):(Total: 43s981ms, non-child: 43s981ms, % non-child: 100.00%) - BytesSent: 220.58 MB (231297637) - NetworkThroughput(*): 516.55 KB/sec - OverallThroughput: 5.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s834ms - ThriftTransmitTime(*): 7m17s - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=6):(Total: 409.985ms, non-child: 409.985ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:98.88% 1:1.124% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 105.46 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 460.918ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.12 MB (167894304) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 29.21 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1421) - ScannerThreadsTotalWallClockTime: 3m38s - MaterializeTupleTime(*): 3m37s - ScannerThreadsSysTime: 90.984ms - ScannerThreadsUserTime: 3s721ms - ScannerThreadsVoluntaryContextSwitches: 11.35K (11354) - TotalRawHdfsReadTime(*): 100.107ms - TotalReadThroughput: 3.12 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c4 (host=vb0222.halxg.cloudera.com:22000):(Total: 44s015ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(1s000ms): 82.18 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.30 MB, 164.37 MB, 164.26 MB, 138.32 MB, 95.32 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.55 MB (172539216) - PerHostPeakMemUsage: 2.47 GB (2648825464) - PrepareTime: 143.941ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 3m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s781ms - TotalStorageWaitTime: 141.138ms CodeGen:(Total: 402.328ms, non-child: 402.328ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.674ms - PrepareTime: 142.296ms DataStreamSender (dst_id=13):(Total: 43s773ms, non-child: 43s773ms, % non-child: 100.00%) - BytesSent: 222.63 MB (233444376) - NetworkThroughput(*): 444.11 KB/sec - OverallThroughput: 5.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s732ms - ThriftTransmitTime(*): 8m33s - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=6):(Total: 364.862ms, non-child: 364.862ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(1s000ms): 70.05 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 447.206ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.05 MB (172023112) - PerReadThreadRawHdfsThroughput: 932.33 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 33.12 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.05K (1047) - ScannerThreadsTotalWallClockTime: 3m37s - MaterializeTupleTime(*): 3m37s - ScannerThreadsSysTime: 76.986ms - ScannerThreadsUserTime: 3s135ms - ScannerThreadsVoluntaryContextSwitches: 11.73K (11726) - TotalRawHdfsReadTime(*): 150.276ms - TotalReadThroughput: 3.18 MB/sec Fragment F03: Instance 194abadfc94cbc81:89ceb14c5a9691ca (host=vb0204.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(2s000ms): 178.77 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 238.55 MB, 239.55 MB, 239.88 MB, 239.87 MB, 239.86 MB, 239.83 MB, 238.01 MB, 111.06 MB, 81.61 MB, 194.00 MB, 193.71 MB, 193.72 MB, 193.75 MB, 191.70 MB ThreadUsage(2s000ms): 8, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.33 MB (252009144) - PerHostPeakMemUsage: 3.16 GB (3390424624) - PrepareTime: 156.150ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 12m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 55s311ms - TotalStorageWaitTime: 412.089ms CodeGen:(Total: 425.489ms, non-child: 425.489ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 266.304ms - PrepareTime: 153.215ms DataStreamSender (dst_id=12):(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - BytesSent: 897.97 MB (941589787) - NetworkThroughput(*): 1.46 MB/sec - OverallThroughput: 12.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s800ms - ThriftTransmitTime(*): 10m13s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=5):(Total: 663.939ms, non-child: 663.939ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 205.33 MB, 246.39 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.69 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 1s902ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.89 MB (251542240) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 80.72 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.43K (12431) - ScannerThreadsTotalWallClockTime: 12m5s - MaterializeTupleTime(*): 12m3s - ScannerThreadsSysTime: 730.884ms - ScannerThreadsUserTime: 22s502ms - ScannerThreadsVoluntaryContextSwitches: 52.44K (52435) - TotalRawHdfsReadTime(*): 335.818ms - TotalReadThroughput: 4.93 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d5 (host=vb0224.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(2s000ms): 196.17 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 261.91 MB, 262.68 MB, 263.03 MB, 263.02 MB, 263.05 MB, 262.93 MB, 262.98 MB, 177.65 MB, 88.84 MB, 155.90 MB, 170.64 MB, 170.54 MB, 170.58 MB, 115.06 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.43 MB (276226192) - PerHostPeakMemUsage: 3.05 GB (3271592736) - PrepareTime: 141.839ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 13m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s273ms - TotalStorageWaitTime: 515.385ms CodeGen:(Total: 400.508ms, non-child: 400.508ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.255ms - PrepareTime: 140.301ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 897.33 MB (940923691) - NetworkThroughput(*): 1.59 MB/sec - OverallThroughput: 12.18 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s597ms - ThriftTransmitTime(*): 9m24s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=5):(Total: 712.361ms, non-child: 712.361ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.44 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 2s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 75.21 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.89K (13887) - ScannerThreadsTotalWallClockTime: 12m57s - MaterializeTupleTime(*): 12m54s - ScannerThreadsSysTime: 840.866ms - ScannerThreadsUserTime: 22s792ms - ScannerThreadsVoluntaryContextSwitches: 52.45K (52452) - TotalRawHdfsReadTime(*): 288.356ms - TotalReadThroughput: 4.96 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691cb (host=vb0208.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(2s000ms): 175.60 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 234.11 MB, 251.43 MB, 256.92 MB, 256.97 MB, 256.96 MB, 257.08 MB, 256.98 MB, 175.61 MB, 104.80 MB, 167.94 MB, 170.54 MB, 170.56 MB, 156.69 MB, 99.65 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 7 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 264.36 MB (277198176) - PerHostPeakMemUsage: 3.04 GB (3263248168) - PrepareTime: 151.485ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 13m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s351ms - TotalStorageWaitTime: 609.879ms CodeGen:(Total: 413.416ms, non-child: 413.416ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.140ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.327ms - PrepareTime: 140.906ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 886.32 MB (929377492) - NetworkThroughput(*): 1.74 MB/sec - OverallThroughput: 12.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s671ms - ThriftTransmitTime(*): 8m28s - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=5):(Total: 757.217ms, non-child: 757.217ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(2s000ms): 150.60 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 200.81 MB, 216.20 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 221.33 MB, 241.86 MB, 241.86 MB, 349.66 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.45 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 2s145ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.91 MB (276731232) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 69.86 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 14.72K (14718) - ScannerThreadsTotalWallClockTime: 12m54s - MaterializeTupleTime(*): 12m51s - ScannerThreadsSysTime: 913.856ms - ScannerThreadsUserTime: 22s430ms - ScannerThreadsVoluntaryContextSwitches: 51.77K (51765) - TotalRawHdfsReadTime(*): 319.462ms - TotalReadThroughput: 4.90 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d6 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(2s000ms): 196.18 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.56 MB, 261.52 MB, 261.51 MB, 261.51 MB, 261.51 MB, 261.51 MB, 262.95 MB, 263.07 MB, 263.04 MB, 262.96 MB, 263.11 MB, 262.97 MB, 147.81 MB, 88.87 MB, 151.67 MB, 165.08 MB, 165.07 MB, 165.10 MB, 98.36 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 7 - AverageThreadTokens: 11.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258968) - PerHostPeakMemUsage: 3.03 GB (3256207072) - PrepareTime: 141.040ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 13m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s373ms - TotalStorageWaitTime: 412.154ms CodeGen:(Total: 401.654ms, non-child: 401.654ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.530ms - PrepareTime: 139.422ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 887.44 MB (930549753) - NetworkThroughput(*): 1.55 MB/sec - OverallThroughput: 12.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s652ms - ThriftTransmitTime(*): 9m33s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=5):(Total: 732.047ms, non-child: 732.047ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.40 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 335.57 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.44 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 2s235ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 72.36 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 15.31K (15315) - ScannerThreadsTotalWallClockTime: 12m54s - MaterializeTupleTime(*): 12m51s - ScannerThreadsSysTime: 870.863ms - ScannerThreadsUserTime: 23s388ms - ScannerThreadsVoluntaryContextSwitches: 51.94K (51944) - TotalRawHdfsReadTime(*): 331.312ms - TotalReadThroughput: 4.90 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d3 (host=vb0206.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(2s000ms): 195.85 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.11 MB, 261.10 MB, 261.07 MB, 261.07 MB, 261.07 MB, 261.07 MB, 262.49 MB, 263.07 MB, 263.04 MB, 262.95 MB, 263.02 MB, 262.95 MB, 143.85 MB, 89.01 MB, 166.51 MB, 170.54 MB, 170.58 MB, 170.59 MB, 99.32 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275312) - PerHostPeakMemUsage: 3.03 GB (3258336936) - PrepareTime: 141.523ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 13m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s407ms - TotalStorageWaitTime: 320.573ms CodeGen:(Total: 385.962ms, non-child: 385.962ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 241.282ms - PrepareTime: 139.918ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 898.28 MB (941917292) - NetworkThroughput(*): 1.43 MB/sec - OverallThroughput: 12.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s716ms - ThriftTransmitTime(*): 10m28s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=5):(Total: 703.055ms, non-child: 703.055ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:99.32% 1:0.6757% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 169.39 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 354.19 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 2s024ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 76.26 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.50K (11504) - ScannerThreadsTotalWallClockTime: 12m55s - MaterializeTupleTime(*): 12m52s - ScannerThreadsSysTime: 760.880ms - ScannerThreadsUserTime: 20s984ms - ScannerThreadsVoluntaryContextSwitches: 52.56K (52559) - TotalRawHdfsReadTime(*): 252.214ms - TotalReadThroughput: 4.96 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691cf (host=vb0226.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(2s000ms): 193.89 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.50 MB, 258.54 MB, 258.58 MB, 258.58 MB, 258.58 MB, 258.56 MB, 259.98 MB, 260.00 MB, 260.01 MB, 259.99 MB, 259.99 MB, 257.95 MB, 125.12 MB, 100.04 MB, 177.06 MB, 170.61 MB, 170.50 MB, 164.61 MB, 89.37 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 260.51 MB (273162352) - PerHostPeakMemUsage: 3.03 GB (3255517192) - PrepareTime: 149.903ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 13m13s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s431ms - TotalStorageWaitTime: 471.142ms CodeGen:(Total: 427.921ms, non-child: 427.921ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 273.779ms - PrepareTime: 141.385ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 892.75 MB (936121060) - NetworkThroughput(*): 1.60 MB/sec - OverallThroughput: 12.16 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s730ms - ThriftTransmitTime(*): 9m19s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=5):(Total: 692.062ms, non-child: 692.062ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 167.73 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 223.65 MB, 239.04 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.45 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 2s037ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 260.03 MB (272662728) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 76.95 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.08K (12080) - ScannerThreadsTotalWallClockTime: 12m53s - MaterializeTupleTime(*): 12m51s - ScannerThreadsSysTime: 895.856ms - ScannerThreadsUserTime: 21s342ms - ScannerThreadsVoluntaryContextSwitches: 52.09K (52085) - TotalRawHdfsReadTime(*): 334.567ms - TotalReadThroughput: 4.93 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691cd (host=vb0234.halxg.cloudera.com:22000):(Total: 1m14s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(2s000ms): 196.02 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.63 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 262.61 MB, 263.14 MB, 263.06 MB, 263.03 MB, 262.94 MB, 262.89 MB, 146.12 MB, 88.88 MB, 150.09 MB, 170.62 MB, 170.55 MB, 170.59 MB, 97.20 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 8, 8, 8, 8 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 3.03 GB (3253945912) - PrepareTime: 144.370ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 13m13s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s754ms - TotalStorageWaitTime: 396.157ms CodeGen:(Total: 408.141ms, non-child: 408.141ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 259.887ms - PrepareTime: 140.368ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 897.61 MB (941211466) - NetworkThroughput(*): 2.33 MB/sec - OverallThroughput: 12.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s700ms - ThriftTransmitTime(*): 6m24s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=5):(Total: 656.505ms, non-child: 656.505ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 1s928ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 81.62 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.82K (9818) - ScannerThreadsTotalWallClockTime: 12m53s - MaterializeTupleTime(*): 12m51s - ScannerThreadsSysTime: 689.890ms - ScannerThreadsUserTime: 19s654ms - ScannerThreadsVoluntaryContextSwitches: 52.43K (52434) - TotalRawHdfsReadTime(*): 275.329ms - TotalReadThroughput: 4.99 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d0 (host=vb0232.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(2s000ms): 190.68 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 261.38 MB, 262.62 MB, 263.10 MB, 263.01 MB, 262.99 MB, 263.11 MB, 263.00 MB, 203.37 MB, 89.00 MB, 139.48 MB, 147.57 MB, 147.49 MB, 147.54 MB, 62.37 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 7, 7, 7, 7 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 3.03 GB (3248485240) - PrepareTime: 143.428ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 13m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s317ms - TotalStorageWaitTime: 324.328ms CodeGen:(Total: 383.740ms, non-child: 383.740ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 237.241ms - PrepareTime: 141.666ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 850.40 MB (891713606) - NetworkThroughput(*): 1.29 MB/sec - OverallThroughput: 11.64 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s563ms - ThriftTransmitTime(*): 10m57s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=5):(Total: 686.184ms, non-child: 686.184ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 221.54 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 226.67 MB, 339.61 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 2s004ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 73.87 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.51K (13511) - ScannerThreadsTotalWallClockTime: 12m44s - MaterializeTupleTime(*): 12m42s - ScannerThreadsSysTime: 747.880ms - ScannerThreadsUserTime: 21s173ms - ScannerThreadsVoluntaryContextSwitches: 49.72K (49715) - TotalRawHdfsReadTime(*): 279.854ms - TotalReadThroughput: 4.73 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ce (host=vb0212.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(2s000ms): 196.20 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 261.58 MB, 262.73 MB, 262.87 MB, 262.97 MB, 262.96 MB, 263.03 MB, 262.95 MB, 163.81 MB, 88.88 MB, 137.23 MB, 147.52 MB, 147.40 MB, 133.46 MB, 52.54 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 3.03 GB (3248216096) - PrepareTime: 152.165ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 13m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s588ms - TotalStorageWaitTime: 519.809ms CodeGen:(Total: 445.413ms, non-child: 445.413ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 283.291ms - PrepareTime: 141.207ms DataStreamSender (dst_id=12):(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - BytesSent: 847.94 MB (889134345) - NetworkThroughput(*): 1.39 MB/sec - OverallThroughput: 11.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s413ms - ThriftTransmitTime(*): 10m11s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=5):(Total: 683.446ms, non-child: 683.446ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.40 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 323.40 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s995ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742912) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 74.03 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.83K (12826) - ScannerThreadsTotalWallClockTime: 12m42s - MaterializeTupleTime(*): 12m39s - ScannerThreadsSysTime: 777.877ms - ScannerThreadsUserTime: 23s554ms - ScannerThreadsVoluntaryContextSwitches: 49.45K (49449) - TotalRawHdfsReadTime(*): 294.231ms - TotalReadThroughput: 4.72 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691cc (host=vb0230.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(2s000ms): 196.02 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.34 MB, 261.32 MB, 262.73 MB, 263.11 MB, 262.92 MB, 262.91 MB, 262.95 MB, 262.98 MB, 157.96 MB, 88.88 MB, 136.84 MB, 147.50 MB, 147.41 MB, 131.64 MB, 52.48 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276283496) - PerHostPeakMemUsage: 3.03 GB (3248363336) - PrepareTime: 141.603ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 13m1s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s382ms - TotalStorageWaitTime: 597.771ms CodeGen:(Total: 391.616ms, non-child: 391.616ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 247.095ms - PrepareTime: 140.109ms DataStreamSender (dst_id=12):(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - BytesSent: 848.01 MB (889198333) - NetworkThroughput(*): 1.30 MB/sec - OverallThroughput: 11.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s193ms - ThriftTransmitTime(*): 10m50s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=5):(Total: 699.110ms, non-child: 699.110ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.39 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 323.39 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 2s015ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 72.42 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.99K (12995) - ScannerThreadsTotalWallClockTime: 12m42s - MaterializeTupleTime(*): 12m39s - ScannerThreadsSysTime: 855.865ms - ScannerThreadsUserTime: 23s550ms - ScannerThreadsVoluntaryContextSwitches: 49.55K (49546) - TotalRawHdfsReadTime(*): 326.182ms - TotalReadThroughput: 4.72 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d2 (host=vb0228.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(2s000ms): 192.10 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.11 MB, 256.13 MB, 256.89 MB, 257.03 MB, 257.04 MB, 256.96 MB, 256.96 MB, 257.03 MB, 158.33 MB, 104.77 MB, 142.28 MB, 147.48 MB, 143.50 MB, 121.87 MB, 43.79 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 6, 5 - AverageThreadTokens: 11.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.48 MB (269983840) - PerHostPeakMemUsage: 3.01 GB (3234129912) - PrepareTime: 137.198ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 12m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s622ms - TotalStorageWaitTime: 351.173ms CodeGen:(Total: 378.720ms, non-child: 378.720ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.461ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 238.529ms - PrepareTime: 135.732ms DataStreamSender (dst_id=12):(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - BytesSent: 836.52 MB (877154507) - NetworkThroughput(*): 1.27 MB/sec - OverallThroughput: 11.47 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s375ms - ThriftTransmitTime(*): 10m57s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=5):(Total: 652.385ms, non-child: 652.385ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(2s000ms): 166.15 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 221.54 MB, 236.94 MB, 242.07 MB, 319.07 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 1s990ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.03 MB (269516904) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 76.57 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.86K (11856) - ScannerThreadsTotalWallClockTime: 12m40s - MaterializeTupleTime(*): 12m37s - ScannerThreadsSysTime: 831.869ms - ScannerThreadsUserTime: 20s397ms - ScannerThreadsVoluntaryContextSwitches: 48.99K (48986) - TotalRawHdfsReadTime(*): 238.263ms - TotalReadThroughput: 4.66 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d7 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(2s000ms): 196.30 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.72 MB, 262.70 MB, 263.07 MB, 262.93 MB, 262.98 MB, 262.97 MB, 263.20 MB, 147.79 MB, 88.86 MB, 155.00 MB, 147.40 MB, 147.52 MB, 113.88 MB, 44.15 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 5 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258920) - PerHostPeakMemUsage: 3.02 GB (3247645384) - PrepareTime: 145.782ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 12m58s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s714ms - TotalStorageWaitTime: 561.464ms CodeGen:(Total: 383.873ms, non-child: 383.873ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.062ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 231.529ms - PrepareTime: 139.107ms DataStreamSender (dst_id=12):(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - BytesSent: 847.73 MB (888910032) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 11.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s319ms - ThriftTransmitTime(*): 11m46s - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=5):(Total: 686.611ms, non-child: 686.611ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 169.41 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 1s938ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 73.73 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.57K (11568) - ScannerThreadsTotalWallClockTime: 12m39s - MaterializeTupleTime(*): 12m36s - ScannerThreadsSysTime: 735.882ms - ScannerThreadsUserTime: 22s412ms - ScannerThreadsVoluntaryContextSwitches: 49.43K (49433) - TotalRawHdfsReadTime(*): 295.883ms - TotalReadThroughput: 4.72 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691c9 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m13s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(2s000ms): 192.46 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 257.64 MB, 257.88 MB, 257.94 MB, 258.01 MB, 257.98 MB, 258.00 MB, 152.93 MB, 107.08 MB, 143.27 MB, 147.41 MB, 147.45 MB, 109.84 MB, 31.97 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 4 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 258.49 MB (271048808) - PerHostPeakMemUsage: 2.98 GB (3202725480) - PrepareTime: 151.020ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 12m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s358ms - TotalStorageWaitTime: 510.685ms CodeGen:(Total: 427.338ms, non-child: 427.338ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 270.298ms - PrepareTime: 142.063ms DataStreamSender (dst_id=12):(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - BytesSent: 838.70 MB (879444464) - NetworkThroughput(*): 1.99 MB/sec - OverallThroughput: 11.54 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s441ms - ThriftTransmitTime(*): 7m2s - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=5):(Total: 666.303ms, non-child: 666.303ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 166.69 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 247.92 MB, 326.95 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s942ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.03 MB (270565480) - PerReadThreadRawHdfsThroughput: 958.77 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 75.16 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.99K (11993) - ScannerThreadsTotalWallClockTime: 12m35s - MaterializeTupleTime(*): 12m32s - ScannerThreadsSysTime: 723.884ms - ScannerThreadsUserTime: 20s660ms - ScannerThreadsVoluntaryContextSwitches: 49.00K (48998) - TotalRawHdfsReadTime(*): 360.309ms - TotalReadThroughput: 4.67 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d4 (host=vb0220.halxg.cloudera.com:22000):(Total: 1m12s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(2s000ms): 196.14 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 261.71 MB, 262.76 MB, 262.98 MB, 262.92 MB, 263.01 MB, 262.91 MB, 263.05 MB, 151.89 MB, 88.88 MB, 150.87 MB, 147.49 MB, 147.58 MB, 111.80 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 2.97 GB (3190183064) - PrepareTime: 141.185ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 12m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54s038ms - TotalStorageWaitTime: 656.759ms CodeGen:(Total: 399.160ms, non-child: 399.160ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.345ms - PrepareTime: 138.943ms DataStreamSender (dst_id=12):(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - BytesSent: 847.45 MB (888616058) - NetworkThroughput(*): 1.69 MB/sec - OverallThroughput: 11.71 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s426ms - ThriftTransmitTime(*): 8m21s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=5):(Total: 644.381ms, non-child: 644.381ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(2s000ms): 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 246.40 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 1s883ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 78.52 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.30K (11304) - ScannerThreadsTotalWallClockTime: 12m36s - MaterializeTupleTime(*): 12m33s - ScannerThreadsSysTime: 694.889ms - ScannerThreadsUserTime: 19s593ms - ScannerThreadsVoluntaryContextSwitches: 49.47K (49470) - TotalRawHdfsReadTime(*): 291.959ms - TotalReadThroughput: 4.78 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d1 (host=vb0216.halxg.cloudera.com:22000):(Total: 1m11s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(2s000ms): 196.20 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.05 MB, 262.68 MB, 262.93 MB, 263.00 MB, 263.08 MB, 262.89 MB, 262.96 MB, 187.41 MB, 88.99 MB, 122.70 MB, 124.42 MB, 124.31 MB, 74.81 MB ThreadUsage(2s000ms): 9, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 6, 6, 6 - AverageThreadTokens: 11.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275304) - PerHostPeakMemUsage: 2.81 GB (3012015000) - PrepareTime: 141.596ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 12m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s493ms - TotalStorageWaitTime: 305.278ms CodeGen:(Total: 372.293ms, non-child: 372.293ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.754ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 227.478ms - PrepareTime: 139.337ms DataStreamSender (dst_id=12):(Total: 1m11s, non-child: 1m11s, % non-child: 100.00%) - BytesSent: 797.81 MB (836563007) - NetworkThroughput(*): 1.18 MB/sec - OverallThroughput: 11.17 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s504ms - ThriftTransmitTime(*): 11m18s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=5):(Total: 599.983ms, non-child: 599.983ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:99.31% 1:0.6944% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(2s000ms): 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 225.89 MB, 323.44 MB, 328.55 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s711ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 79.42 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.38K (10385) - ScannerThreadsTotalWallClockTime: 12m24s - MaterializeTupleTime(*): 12m22s - ScannerThreadsSysTime: 593.903ms - ScannerThreadsUserTime: 17s929ms - ScannerThreadsVoluntaryContextSwitches: 46.63K (46630) - TotalRawHdfsReadTime(*): 233.088ms - TotalReadThroughput: 4.56 MB/sec Fragment F01: Instance 194abadfc94cbc81:89ceb14c5a9691dc (host=vb0214.halxg.cloudera.com:22000):(Total: 4s760ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 210.20 MB, 210.26 MB, 210.17 MB, 186.38 MB, 162.70 MB, 162.44 MB, 154.58 MB, 114.78 MB, 99.00 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.70 MB (220939016) - PerHostPeakMemUsage: 1.54 GB (1656416128) - PrepareTime: 148.020ms - RowsProduced: 16.16M (16156992) - TotalCpuTime: 32s034ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 111.245ms - TotalStorageWaitTime: 184.957ms CodeGen:(Total: 391.256ms, non-child: 391.256ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 239.206ms - PrepareTime: 139.199ms DataStreamSender (dst_id=11):(Total: 4s383ms, non-child: 4s383ms, % non-child: 100.00%) - BytesSent: 298.09 MB (312572632) - NetworkThroughput(*): 38.56 MB/sec - OverallThroughput: 68.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s421ms - ThriftTransmitTime(*): 7s730ms - UncompressedRowBatchSize: 708.91 MB (743347884) HDFS_SCAN_NODE (id=2):(Total: 498.860ms, non-child: 498.860ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:2/506.15 MB 10:1/253.10 MB 4:1/253.09 MB 2:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196272508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196272508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196272508) - DecompressionTime: 943.622ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.26 MB (220472072) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457981) - RowsReturned: 16.16M (16156992) - RowsReturnedRate: 32.39 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.86K (2862) - ScannerThreadsTotalWallClockTime: 27s278ms - MaterializeTupleTime(*): 26s013ms - ScannerThreadsSysTime: 183.969ms - ScannerThreadsUserTime: 6s933ms - ScannerThreadsVoluntaryContextSwitches: 15.82K (15819) - TotalRawHdfsReadTime(*): 175.254ms - TotalReadThroughput: 37.44 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e3 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s454ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB MemoryUsage(500.000ms): 0, 203.13 MB, 203.39 MB, 203.35 MB, 191.36 MB, 137.16 MB, 136.97 MB, 129.12 MB, 96.88 MB, 48.85 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 7, 6, 6, 6, 6, 5 - AverageThreadTokens: 6.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.73 MB (213625064) - PerHostPeakMemUsage: 1.53 GB (1641026656) - PrepareTime: 141.624ms - RowsProduced: 15.29M (15285970) - TotalCpuTime: 29s088ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 119.561ms - TotalStorageWaitTime: 434.651ms CodeGen:(Total: 405.868ms, non-child: 405.868ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.964ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.762ms - PrepareTime: 138.258ms DataStreamSender (dst_id=11):(Total: 4s190ms, non-child: 4s190ms, % non-child: 100.00%) - BytesSent: 282.18 MB (295887508) - NetworkThroughput(*): 35.81 MB/sec - OverallThroughput: 67.35 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s328ms - ThriftTransmitTime(*): 7s880ms - UncompressedRowBatchSize: 670.69 MB (703274068) HDFS_SCAN_NODE (id=2):(Total: 378.453ms, non-child: 378.453ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 5:1/78.16 MB 3:1/253.08 MB 1:2/506.16 MB 0:1/93.74 MB 7:1/253.09 MB 9:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB, 177.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.67 - BytesRead: 177.35 MB (185967772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.35 MB (185967772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.35 MB (185967772) - DecompressionTime: 565.496ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 203.34 MB (213215464) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 33.55M (33551302) - RowsReturned: 15.29M (15285970) - RowsReturnedRate: 40.39 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.92K (1920) - ScannerThreadsTotalWallClockTime: 24s884ms - MaterializeTupleTime(*): 23s729ms - ScannerThreadsSysTime: 130.977ms - ScannerThreadsUserTime: 4s238ms - ScannerThreadsVoluntaryContextSwitches: 14.79K (14788) - TotalRawHdfsReadTime(*): 149.039ms - TotalReadThroughput: 39.41 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691df (host=vb0220.halxg.cloudera.com:22000):(Total: 4s290ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB MemoryUsage(500.000ms): 0, 201.48 MB, 201.70 MB, 201.94 MB, 170.12 MB, 154.06 MB, 137.10 MB, 105.00 MB, 97.03 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.25 MB (212075184) - PerHostPeakMemUsage: 1.52 GB (1630710400) - PrepareTime: 141.325ms - RowsProduced: 14.96M (14962628) - TotalCpuTime: 27s049ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 103.645ms - TotalStorageWaitTime: 317.660ms CodeGen:(Total: 400.918ms, non-child: 400.918ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.034ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.094ms - PrepareTime: 137.745ms DataStreamSender (dst_id=11):(Total: 3s989ms, non-child: 3s989ms, % non-child: 100.00%) - BytesSent: 276.48 MB (289912142) - NetworkThroughput(*): 38.60 MB/sec - OverallThroughput: 69.31 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s225ms - ThriftTransmitTime(*): 7s162ms - UncompressedRowBatchSize: 656.51 MB (688397808) HDFS_SCAN_NODE (id=2):(Total: 420.762ms, non-child: 420.762ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.08 MB 4:2/506.17 MB 6:1/253.08 MB 0:1/253.08 MB 2:1/141.46 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB, 173.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.62 - BytesRead: 173.48 MB (181908393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.48 MB (181908393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.48 MB (181908393) - DecompressionTime: 827.495ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.76 MB (211559128) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.85M (32847582) - RowsReturned: 14.96M (14962628) - RowsReturnedRate: 35.56 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.35K (2351) - ScannerThreadsTotalWallClockTime: 22s881ms - MaterializeTupleTime(*): 21s626ms - ScannerThreadsSysTime: 172.971ms - ScannerThreadsUserTime: 6s071ms - ScannerThreadsVoluntaryContextSwitches: 14.38K (14385) - TotalRawHdfsReadTime(*): 167.233ms - TotalReadThroughput: 43.37 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e6 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s152ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB MemoryUsage(500.000ms): 68.00 KB, 197.84 MB, 197.60 MB, 197.99 MB, 150.31 MB, 137.07 MB, 121.01 MB, 97.17 MB, 38.16 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 4 - AverageThreadTokens: 5.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.16 MB (207782656) - PerHostPeakMemUsage: 1.46 GB (1571878544) - PrepareTime: 147.024ms - RowsProduced: 14.83M (14828696) - TotalCpuTime: 25s831ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 104.140ms - TotalStorageWaitTime: 128.527ms CodeGen:(Total: 389.351ms, non-child: 389.351ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 239.445ms - PrepareTime: 136.961ms DataStreamSender (dst_id=11):(Total: 3s872ms, non-child: 3s872ms, % non-child: 100.00%) - BytesSent: 274.12 MB (287433381) - NetworkThroughput(*): 39.18 MB/sec - OverallThroughput: 70.78 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s148ms - ThriftTransmitTime(*): 6s995ms - UncompressedRowBatchSize: 650.63 MB (682235900) HDFS_SCAN_NODE (id=2):(Total: 408.219ms, non-child: 408.219ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 10:1/253.09 MB 0:1/253.07 MB 4:1/253.10 MB 8:2/382.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB, 171.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.25 - BytesRead: 171.96 MB (180315819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.96 MB (180315819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.96 MB (180315819) - DecompressionTime: 796.894ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 197.70 MB (207299376) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.56M (32557758) - RowsReturned: 14.83M (14828696) - RowsReturnedRate: 36.33 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.08K (2078) - ScannerThreadsTotalWallClockTime: 21s632ms - MaterializeTupleTime(*): 20s623ms - ScannerThreadsSysTime: 210.965ms - ScannerThreadsUserTime: 6s248ms - ScannerThreadsVoluntaryContextSwitches: 14.49K (14486) - TotalRawHdfsReadTime(*): 158.155ms - TotalReadThroughput: 38.21 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e4 (host=vb0234.halxg.cloudera.com:22000):(Total: 4s130ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB MemoryUsage(500.000ms): 0, 176.55 MB, 176.65 MB, 176.79 MB, 137.09 MB, 137.16 MB, 137.08 MB, 96.95 MB, 81.33 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646408) - PerHostPeakMemUsage: 1.48 GB (1587422240) - PrepareTime: 144.554ms - RowsProduced: 13.47M (13467007) - TotalCpuTime: 23s782ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.550ms - TotalStorageWaitTime: 194.561ms CodeGen:(Total: 412.318ms, non-child: 412.318ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 260.915ms - PrepareTime: 142.606ms DataStreamSender (dst_id=11):(Total: 3s861ms, non-child: 3s861ms, % non-child: 100.00%) - BytesSent: 248.91 MB (261005502) - NetworkThroughput(*): 35.68 MB/sec - OverallThroughput: 64.47 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s124ms - ThriftTransmitTime(*): 6s976ms - UncompressedRowBatchSize: 590.88 MB (619587566) HDFS_SCAN_NODE (id=2):(Total: 391.307ms, non-child: 391.307ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 1:1/253.07 MB 4:1/253.09 MB 7:2/506.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569399) - DecompressionTime: 595.465ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550132) - RowsReturned: 13.47M (13467007) - RowsReturnedRate: 34.42 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1989) - ScannerThreadsTotalWallClockTime: 19s644ms - MaterializeTupleTime(*): 18s745ms - ScannerThreadsSysTime: 177.970ms - ScannerThreadsUserTime: 4s821ms - ScannerThreadsVoluntaryContextSwitches: 12.97K (12973) - TotalRawHdfsReadTime(*): 126.277ms - TotalReadThroughput: 39.00 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e0 (host=vb0228.halxg.cloudera.com:22000):(Total: 4s088ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB MemoryUsage(500.000ms): 68.00 KB, 176.65 MB, 176.56 MB, 168.88 MB, 137.12 MB, 137.18 MB, 97.11 MB, 97.06 MB, 48.12 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 1.44 GB (1543266128) - PrepareTime: 147.887ms - RowsProduced: 13.46M (13458155) - TotalCpuTime: 23s553ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 110.989ms - TotalStorageWaitTime: 132.948ms CodeGen:(Total: 391.848ms, non-child: 391.848ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.186ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.227ms - PrepareTime: 139.991ms DataStreamSender (dst_id=11):(Total: 3s820ms, non-child: 3s820ms, % non-child: 100.00%) - BytesSent: 248.23 MB (260293101) - NetworkThroughput(*): 35.01 MB/sec - OverallThroughput: 64.98 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s091ms - ThriftTransmitTime(*): 7s089ms - UncompressedRowBatchSize: 590.50 MB (619180302) HDFS_SCAN_NODE (id=2):(Total: 384.377ms, non-child: 384.377ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.08 MB 0:1/253.13 MB 4:1/253.09 MB 6:2/506.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB, 156.00 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 156.00 MB (163573937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.00 MB (163573937) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.00 MB (163573937) - DecompressionTime: 593.803ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29550012) - RowsReturned: 13.46M (13458155) - RowsReturnedRate: 35.01 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.92K (1917) - ScannerThreadsTotalWallClockTime: 19s429ms - MaterializeTupleTime(*): 18s630ms - ScannerThreadsSysTime: 163.973ms - ScannerThreadsUserTime: 4s419ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13020) - TotalRawHdfsReadTime(*): 129.505ms - TotalReadThroughput: 34.67 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e1 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s011ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 176.78 MB, 176.68 MB, 176.76 MB, 137.07 MB, 137.00 MB, 105.02 MB, 97.12 MB, 31.21 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.09 MB (185687328) - PerHostPeakMemUsage: 1.46 GB (1570186104) - PrepareTime: 147.615ms - RowsProduced: 13.46M (13458708) - TotalCpuTime: 23s100ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 113.840ms - TotalStorageWaitTime: 173.262ms CodeGen:(Total: 406.790ms, non-child: 406.790ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 256.035ms - PrepareTime: 141.607ms DataStreamSender (dst_id=11):(Total: 3s734ms, non-child: 3s734ms, % non-child: 100.00%) - BytesSent: 248.24 MB (260301045) - NetworkThroughput(*): 35.73 MB/sec - OverallThroughput: 66.47 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s074ms - ThriftTransmitTime(*): 6s947ms - UncompressedRowBatchSize: 590.52 MB (619205748) HDFS_SCAN_NODE (id=2):(Total: 395.335ms, non-child: 395.335ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 3:1/253.07 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.62 - BytesRead: 155.98 MB (163557376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163557376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163557376) - DecompressionTime: 514.190ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29547432) - RowsReturned: 13.46M (13458708) - RowsReturnedRate: 34.04 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1650) - ScannerThreadsTotalWallClockTime: 19s082ms - MaterializeTupleTime(*): 18s322ms - ScannerThreadsSysTime: 99.984ms - ScannerThreadsUserTime: 3s776ms - ScannerThreadsVoluntaryContextSwitches: 12.99K (12995) - TotalRawHdfsReadTime(*): 113.894ms - TotalReadThroughput: 34.66 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691da (host=vb0204.halxg.cloudera.com:22000):(Total: 3s964ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB MemoryUsage(500.000ms): 0, 176.76 MB, 176.73 MB, 176.77 MB, 136.91 MB, 137.02 MB, 105.01 MB, 96.86 MB, 58.08 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 1.37 GB (1471197112) - PrepareTime: 144.599ms - RowsProduced: 13.46M (13461348) - TotalCpuTime: 22s951ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 115.138ms - TotalStorageWaitTime: 69.428ms CodeGen:(Total: 386.058ms, non-child: 386.058ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 238.249ms - PrepareTime: 143.142ms DataStreamSender (dst_id=11):(Total: 3s713ms, non-child: 3s713ms, % non-child: 100.00%) - BytesSent: 248.72 MB (260797520) - NetworkThroughput(*): 35.92 MB/sec - OverallThroughput: 66.98 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s061ms - ThriftTransmitTime(*): 6s925ms - UncompressedRowBatchSize: 590.64 MB (619327200) HDFS_SCAN_NODE (id=2):(Total: 373.745ms, non-child: 373.745ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 7:1/253.07 MB 5:1/253.11 MB 1:1/253.10 MB 9:1/253.08 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163567389) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163567389) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163567389) - DecompressionTime: 519.859ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549800) - RowsReturned: 13.46M (13461348) - RowsReturnedRate: 36.02 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1696) - ScannerThreadsTotalWallClockTime: 18s890ms - MaterializeTupleTime(*): 18s251ms - ScannerThreadsSysTime: 112.980ms - ScannerThreadsUserTime: 3s832ms - ScannerThreadsVoluntaryContextSwitches: 13.04K (13037) - TotalRawHdfsReadTime(*): 98.487ms - TotalReadThroughput: 39.00 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691db (host=vb0218.halxg.cloudera.com:22000):(Total: 3s935ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.65 MB, 176.69 MB, 176.78 MB, 137.10 MB, 136.92 MB, 96.98 MB, 97.01 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 1.38 GB (1478618496) - PrepareTime: 145.646ms - RowsProduced: 13.46M (13459711) - TotalCpuTime: 22s524ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 108.519ms - TotalStorageWaitTime: 189.261ms CodeGen:(Total: 374.058ms, non-child: 374.058ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 224.461ms - PrepareTime: 138.773ms DataStreamSender (dst_id=11):(Total: 3s644ms, non-child: 3s644ms, % non-child: 100.00%) - BytesSent: 248.35 MB (260416411) - NetworkThroughput(*): 38.04 MB/sec - OverallThroughput: 68.14 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s004ms - ThriftTransmitTime(*): 6s528ms - UncompressedRowBatchSize: 590.56 MB (619251894) HDFS_SCAN_NODE (id=2):(Total: 397.217ms, non-child: 397.217ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 1:1/253.09 MB 7:2/506.17 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163560850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163560850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163560850) - DecompressionTime: 809.771ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548273) - RowsReturned: 13.46M (13459711) - RowsReturnedRate: 33.88 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.13K (2128) - ScannerThreadsTotalWallClockTime: 18s617ms - MaterializeTupleTime(*): 17s539ms - ScannerThreadsSysTime: 148.975ms - ScannerThreadsUserTime: 5s897ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13014) - TotalRawHdfsReadTime(*): 124.547ms - TotalReadThroughput: 39.00 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e5 (host=vb0230.halxg.cloudera.com:22000):(Total: 3s812ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.57 MB, 176.71 MB, 168.88 MB, 136.98 MB, 137.09 MB, 97.11 MB, 89.23 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.01 MB (185613648) - PerHostPeakMemUsage: 1.38 GB (1478625880) - PrepareTime: 143.654ms - RowsProduced: 13.46M (13460283) - TotalCpuTime: 21s677ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 110.022ms - TotalStorageWaitTime: 353.767ms CodeGen:(Total: 408.635ms, non-child: 408.635ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.929ms - PrepareTime: 139.053ms DataStreamSender (dst_id=11):(Total: 3s525ms, non-child: 3s525ms, % non-child: 100.00%) - BytesSent: 248.23 MB (260286652) - NetworkThroughput(*): 35.56 MB/sec - OverallThroughput: 70.40 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s982ms - ThriftTransmitTime(*): 6s980ms - UncompressedRowBatchSize: 590.59 MB (619278202) HDFS_SCAN_NODE (id=2):(Total: 406.007ms, non-child: 406.007ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.08 MB 7:1/253.07 MB 9:1/253.09 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163565955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163565955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163565955) - DecompressionTime: 506.022ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1014.54 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549653) - RowsReturned: 13.46M (13460283) - RowsReturnedRate: 33.15 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1484) - ScannerThreadsTotalWallClockTime: 18s032ms - MaterializeTupleTime(*): 17s026ms - ScannerThreadsSysTime: 103.981ms - ScannerThreadsUserTime: 3s679ms - ScannerThreadsVoluntaryContextSwitches: 12.91K (12912) - TotalRawHdfsReadTime(*): 153.752ms - TotalReadThroughput: 39.00 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691dd (host=vb0232.halxg.cloudera.com:22000):(Total: 3s734ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB MemoryUsage(500.000ms): 0, 114.56 MB, 178.36 MB, 178.30 MB, 162.37 MB, 111.37 MB, 111.35 MB, 79.36 MB, 4.71 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 5, 5, 5, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.65 MB (187327232) - PerHostPeakMemUsage: 1.39 GB (1490028808) - PrepareTime: 142.954ms - RowsProduced: 13.16M (13160561) - TotalCpuTime: 21s501ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 123.253ms - TotalStorageWaitTime: 311.927ms CodeGen:(Total: 405.985ms, non-child: 405.985ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.311ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 255.183ms - PrepareTime: 140.617ms DataStreamSender (dst_id=11):(Total: 3s471ms, non-child: 3s471ms, % non-child: 100.00%) - BytesSent: 243.74 MB (255583602) - NetworkThroughput(*): 34.81 MB/sec - OverallThroughput: 70.21 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s894ms - ThriftTransmitTime(*): 7s002ms - UncompressedRowBatchSize: 577.44 MB (605488654) HDFS_SCAN_NODE (id=2):(Total: 385.450ms, non-child: 385.450ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 1:1/253.07 MB 2:1/129.89 MB 5:1/95.86 MB 8:2/506.18 MB 4:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:12.5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 76.37 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB, 152.76 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 152.76 MB (160184826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 152.76 MB (160184826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152.76 MB (160184826) - DecompressionTime: 441.197ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 178.20 MB (186852144) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.90M (28900101) - RowsReturned: 13.16M (13160561) - RowsReturnedRate: 34.14 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.10K (1105) - ScannerThreadsTotalWallClockTime: 17s909ms - MaterializeTupleTime(*): 16s940ms - ScannerThreadsSysTime: 90.983ms - ScannerThreadsUserTime: 3s188ms - ScannerThreadsVoluntaryContextSwitches: 12.68K (12678) - TotalRawHdfsReadTime(*): 126.286ms - TotalReadThroughput: 38.19 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e2 (host=vb0222.halxg.cloudera.com:22000):(Total: 3s730ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 164.16 MB, 164.18 MB, 148.39 MB, 111.34 MB, 111.34 MB, 79.30 MB, 47.93 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 4.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.59 MB (172588368) - PerHostPeakMemUsage: 1.34 GB (1441423240) - PrepareTime: 143.797ms - RowsProduced: 12.08M (12083913) - TotalCpuTime: 19s720ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 98.635ms - TotalStorageWaitTime: 286.146ms CodeGen:(Total: 420.016ms, non-child: 420.016ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.287ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 268.687ms - PrepareTime: 140.711ms DataStreamSender (dst_id=11):(Total: 3s450ms, non-child: 3s450ms, % non-child: 100.00%) - BytesSent: 223.49 MB (234346381) - NetworkThroughput(*): 35.54 MB/sec - OverallThroughput: 64.78 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s907ms - ThriftTransmitTime(*): 6s288ms - UncompressedRowBatchSize: 530.20 MB (555954434) HDFS_SCAN_NODE (id=2):(Total: 401.681ms, non-child: 401.681ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 6:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB, 140.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.43 - BytesRead: 140.11 MB (146913104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.11 MB (146913104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.11 MB (146913104) - DecompressionTime: 479.121ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088656) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.52M (26522840) - RowsReturned: 12.08M (12083913) - RowsReturnedRate: 30.08 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.47K (1465) - ScannerThreadsTotalWallClockTime: 16s065ms - MaterializeTupleTime(*): 15s136ms - ScannerThreadsSysTime: 109.981ms - ScannerThreadsUserTime: 3s535ms - ScannerThreadsVoluntaryContextSwitches: 11.66K (11664) - TotalRawHdfsReadTime(*): 116.605ms - TotalReadThroughput: 35.03 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d9 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s715ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.89 MB, 176.69 MB, 144.97 MB, 137.22 MB, 137.09 MB, 97.06 MB, 65.65 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621792) - PerHostPeakMemUsage: 1.38 GB (1478628928) - PrepareTime: 150.396ms - RowsProduced: 13.46M (13458651) - TotalCpuTime: 21s251ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 114.635ms - TotalStorageWaitTime: 177.834ms CodeGen:(Total: 429.276ms, non-child: 429.276ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.694ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 271.760ms - PrepareTime: 141.448ms DataStreamSender (dst_id=11):(Total: 3s447ms, non-child: 3s447ms, % non-child: 100.00%) - BytesSent: 248.37 MB (260430879) - NetworkThroughput(*): 35.66 MB/sec - OverallThroughput: 72.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s944ms - ThriftTransmitTime(*): 6s964ms - UncompressedRowBatchSize: 590.52 MB (619203126) HDFS_SCAN_NODE (id=2):(Total: 394.068ms, non-child: 394.068ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 5:2/506.17 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163562851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163562851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163562851) - DecompressionTime: 475.243ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548744) - RowsReturned: 13.46M (13458651) - RowsReturnedRate: 34.15 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.43K (1431) - ScannerThreadsTotalWallClockTime: 17s518ms - MaterializeTupleTime(*): 16s768ms - ScannerThreadsSysTime: 83.985ms - ScannerThreadsUserTime: 3s712ms - ScannerThreadsVoluntaryContextSwitches: 12.96K (12959) - TotalRawHdfsReadTime(*): 149.870ms - TotalReadThroughput: 39.00 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691de (host=vb0216.halxg.cloudera.com:22000):(Total: 3s712ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB MemoryUsage(500.000ms): 0, 122.38 MB, 160.33 MB, 160.23 MB, 120.48 MB, 111.31 MB, 95.28 MB, 79.36 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 160.53 MB (168328528) - PerHostPeakMemUsage: 1.35 GB (1445181144) - PrepareTime: 144.787ms - RowsProduced: 11.97M (11974520) - TotalCpuTime: 19s527ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 118.996ms - TotalStorageWaitTime: 304.963ms CodeGen:(Total: 393.002ms, non-child: 393.002ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.894ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 244.804ms - PrepareTime: 140.346ms DataStreamSender (dst_id=11):(Total: 3s456ms, non-child: 3s456ms, % non-child: 100.00%) - BytesSent: 220.96 MB (231688669) - NetworkThroughput(*): 33.67 MB/sec - OverallThroughput: 63.93 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s911ms - ThriftTransmitTime(*): 6s561ms - UncompressedRowBatchSize: 525.40 MB (550921500) HDFS_SCAN_NODE (id=2):(Total: 377.761ms, non-child: 377.761ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 3:3/620.39 MB 0:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 98.51 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB, 138.94 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 138.94 MB (145689771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.94 MB (145689771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.94 MB (145689771) - DecompressionTime: 505.534ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 160.12 MB (167894304) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.30M (26300251) - RowsReturned: 11.97M (11974520) - RowsReturnedRate: 31.70 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1543) - ScannerThreadsTotalWallClockTime: 15s956ms - MaterializeTupleTime(*): 15s072ms - ScannerThreadsSysTime: 120.979ms - ScannerThreadsUserTime: 3s765ms - ScannerThreadsVoluntaryContextSwitches: 11.49K (11489) - TotalRawHdfsReadTime(*): 102.158ms - TotalReadThroughput: 39.70 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691d8 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s591ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 168.32 MB, 168.08 MB, 128.55 MB, 128.54 MB, 111.29 MB, 79.38 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.51 MB (176692552) - PerHostPeakMemUsage: 1.34 GB (1444102808) - PrepareTime: 149.278ms - RowsProduced: 12.31M (12309852) - TotalCpuTime: 19s295ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 108.841ms - TotalStorageWaitTime: 230.557ms CodeGen:(Total: 396.491ms, non-child: 396.491ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 243.934ms - PrepareTime: 140.316ms DataStreamSender (dst_id=11):(Total: 3s287ms, non-child: 3s287ms, % non-child: 100.00%) - BytesSent: 227.38 MB (238425287) - NetworkThroughput(*): 37.95 MB/sec - OverallThroughput: 69.15 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s821ms - ThriftTransmitTime(*): 5s991ms - UncompressedRowBatchSize: 540.11 MB (566349396) HDFS_SCAN_NODE (id=2):(Total: 410.716ms, non-child: 410.716ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:2/506.15 MB 3:2/397.98 MB 4:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB, 142.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 142.70 MB (149636353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.70 MB (149636353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.70 MB (149636353) - DecompressionTime: 763.080ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217416) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 27.02M (27018139) - RowsReturned: 12.31M (12309852) - RowsReturnedRate: 29.97 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1683) - ScannerThreadsTotalWallClockTime: 15s762ms - MaterializeTupleTime(*): 14s686ms - ScannerThreadsSysTime: 153.974ms - ScannerThreadsUserTime: 5s569ms - ScannerThreadsVoluntaryContextSwitches: 11.90K (11897) - TotalRawHdfsReadTime(*): 137.840ms - TotalReadThroughput: 40.77 MB/sec Fragment F00: Instance 194abadfc94cbc81:89ceb14c5a9691e8 (host=vb0204.halxg.cloudera.com:22000):(Total: 31s717ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB MemoryUsage(1s000ms): 118.90 MB, 238.81 MB, 238.81 MB, 238.81 MB, 238.81 MB, 238.81 MB, 238.81 MB, 239.04 MB, 239.91 MB, 239.66 MB, 239.92 MB, 239.94 MB, 239.85 MB, 239.94 MB, 239.85 MB, 239.94 MB, 239.89 MB, 239.93 MB, 192.25 MB, 89.53 MB, 81.80 MB, 105.25 MB, 196.92 MB, 193.60 MB, 193.72 MB, 193.66 MB, 193.52 MB, 193.82 MB, 193.64 MB, 185.70 MB, 114.40 MB, 74.95 MB ThreadUsage(1s000ms): 6, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 10.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 240.32 MB (251992848) - PerHostPeakMemUsage: 2.49 GB (2677346720) - PrepareTime: 148.699ms - RowsProduced: 53.59M (53594868) - TotalCpuTime: 5m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s860ms - TotalStorageWaitTime: 564.660ms CodeGen:(Total: 477.657ms, non-child: 477.657ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.859ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 316.647ms - PrepareTime: 145.376ms DataStreamSender (dst_id=10):(Total: 31s079ms, non-child: 31s079ms, % non-child: 100.00%) - BytesSent: 897.67 MB (941272460) - NetworkThroughput(*): 7.33 MB/sec - OverallThroughput: 28.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s264ms - ThriftTransmitTime(*): 2m2s - UncompressedRowBatchSize: 2.30 GB (2465782664) HDFS_SCAN_NODE (id=1):(Total: 704.955ms, non-child: 704.955ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.42 MB 8:2/506.79 MB 4:4/1013.59 MB 2:3/760.17 MB 7:1/253.39 MB 0:1/253.41 MB 6:2/506.82 MB 1:4/1013.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 205.34 MB, 318.26 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.31 - BytesRead: 369.59 MB (387543632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387543632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387543632) - DecompressionTime: 2s017ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 239.89 MB (251542288) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581315) - RowsReturned: 53.59M (53594868) - RowsReturnedRate: 76.03 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.32K (13318) - ScannerThreadsTotalWallClockTime: 4m55s - MaterializeTupleTime(*): 4m53s - ScannerThreadsSysTime: 890.859ms - ScannerThreadsUserTime: 22s808ms - ScannerThreadsVoluntaryContextSwitches: 52.44K (52443) - TotalRawHdfsReadTime(*): 310.137ms - TotalReadThroughput: 11.55 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f3 (host=vb0224.halxg.cloudera.com:22000):(Total: 31s598ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 130.49 MB, 261.47 MB, 261.47 MB, 261.47 MB, 261.47 MB, 261.47 MB, 261.47 MB, 261.97 MB, 263.06 MB, 262.98 MB, 262.82 MB, 262.93 MB, 263.08 MB, 263.03 MB, 263.11 MB, 262.99 MB, 262.80 MB, 262.73 MB, 263.13 MB, 227.10 MB, 120.46 MB, 89.03 MB, 104.67 MB, 168.95 MB, 170.60 MB, 170.52 MB, 170.67 MB, 170.55 MB, 170.54 MB, 166.70 MB, 99.00 MB, 63.78 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.44 MB (276234344) - PerHostPeakMemUsage: 2.53 GB (2712076464) - PrepareTime: 140.890ms - RowsProduced: 53.57M (53573688) - TotalCpuTime: 5m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s715ms - TotalStorageWaitTime: 903.501ms CodeGen:(Total: 397.803ms, non-child: 397.803ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.740ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 252.814ms - PrepareTime: 137.390ms DataStreamSender (dst_id=10):(Total: 30s964ms, non-child: 30s964ms, % non-child: 100.00%) - BytesSent: 897.55 MB (941154460) - NetworkThroughput(*): 8.22 MB/sec - OverallThroughput: 28.99 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s358ms - ThriftTransmitTime(*): 1m49s - UncompressedRowBatchSize: 2.30 GB (2464808220) HDFS_SCAN_NODE (id=1):(Total: 695.021ms, non-child: 695.021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.39 MB 10:1/253.41 MB 4:1/253.38 MB 2:2/506.80 MB 1:4/1013.56 MB 7:3/760.21 MB 8:2/506.79 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 266.94 MB, 328.53 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.92 - BytesRead: 369.60 MB (387556500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387556500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387556500) - DecompressionTime: 1s988ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580976) - RowsReturned: 53.57M (53573688) - RowsReturnedRate: 77.08 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 13.70K (13698) - ScannerThreadsTotalWallClockTime: 5m12s - MaterializeTupleTime(*): 5m8s - ScannerThreadsSysTime: 822.868ms - ScannerThreadsUserTime: 23s557ms - ScannerThreadsVoluntaryContextSwitches: 52.37K (52371) - TotalRawHdfsReadTime(*): 296.028ms - TotalReadThroughput: 11.73 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691eb (host=vb0234.halxg.cloudera.com:22000):(Total: 31s570ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB MemoryUsage(1s000ms): 130.62 MB, 260.86 MB, 260.86 MB, 260.86 MB, 260.86 MB, 260.86 MB, 260.86 MB, 261.33 MB, 262.86 MB, 263.14 MB, 263.11 MB, 263.14 MB, 262.99 MB, 263.11 MB, 263.04 MB, 262.91 MB, 263.04 MB, 263.09 MB, 263.07 MB, 211.09 MB, 108.52 MB, 88.75 MB, 96.70 MB, 173.88 MB, 170.68 MB, 170.49 MB, 170.59 MB, 170.68 MB, 170.59 MB, 170.69 MB, 102.97 MB, 59.74 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.55 MB (276349040) - PerHostPeakMemUsage: 2.50 GB (2684255416) - PrepareTime: 141.299ms - RowsProduced: 53.59M (53586378) - TotalCpuTime: 5m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s551ms - TotalStorageWaitTime: 387.207ms CodeGen:(Total: 509.059ms, non-child: 509.059ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 362.607ms - PrepareTime: 138.767ms DataStreamSender (dst_id=10):(Total: 30s955ms, non-child: 30s955ms, % non-child: 100.00%) - BytesSent: 897.47 MB (941061809) - NetworkThroughput(*): 6.31 MB/sec - OverallThroughput: 28.99 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s394ms - ThriftTransmitTime(*): 2m22s - UncompressedRowBatchSize: 2.30 GB (2465392064) HDFS_SCAN_NODE (id=1):(Total: 671.628ms, non-child: 671.628ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:2/506.79 MB 10:4/1013.54 MB 9:1/253.41 MB 7:1/253.40 MB 4:3/760.16 MB 8:2/506.77 MB 3:2/506.78 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 307.99 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.72 - BytesRead: 369.59 MB (387540563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540563) - DecompressionTime: 2s020ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581205) - RowsReturned: 53.59M (53586378) - RowsReturnedRate: 79.79 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.82K (12822) - ScannerThreadsTotalWallClockTime: 5m10s - MaterializeTupleTime(*): 5m7s - ScannerThreadsSysTime: 830.867ms - ScannerThreadsUserTime: 23s754ms - ScannerThreadsVoluntaryContextSwitches: 52.42K (52425) - TotalRawHdfsReadTime(*): 293.594ms - TotalReadThroughput: 11.55 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ed (host=vb0226.halxg.cloudera.com:22000):(Total: 31s548ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB MemoryUsage(1s000ms): 129.13 MB, 258.20 MB, 258.20 MB, 258.20 MB, 258.20 MB, 258.20 MB, 258.20 MB, 259.02 MB, 260.06 MB, 259.88 MB, 260.04 MB, 259.91 MB, 260.04 MB, 260.14 MB, 260.02 MB, 260.05 MB, 259.86 MB, 259.98 MB, 260.02 MB, 212.13 MB, 101.68 MB, 104.69 MB, 128.36 MB, 174.59 MB, 170.49 MB, 170.49 MB, 170.65 MB, 170.60 MB, 166.59 MB, 142.85 MB, 63.68 MB, 43.10 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 260.47 MB (273121384) - PerHostPeakMemUsage: 2.47 GB (2656418848) - PrepareTime: 145.520ms - RowsProduced: 53.26M (53257626) - TotalCpuTime: 5m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s676ms - TotalStorageWaitTime: 373.019ms CodeGen:(Total: 391.186ms, non-child: 391.186ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 242.655ms - PrepareTime: 136.226ms DataStreamSender (dst_id=10):(Total: 30s912ms, non-child: 30s912ms, % non-child: 100.00%) - BytesSent: 892.56 MB (935916904) - NetworkThroughput(*): 6.57 MB/sec - OverallThroughput: 28.87 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s307ms - ThriftTransmitTime(*): 2m15s - UncompressedRowBatchSize: 2.28 GB (2450266900) HDFS_SCAN_NODE (id=1):(Total: 683.495ms, non-child: 683.495ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 4:1/253.41 MB 8:1/253.41 MB 5:3/760.16 MB 7:1/253.41 MB 3:1/253.39 MB 0:2/506.77 MB 2:2/479.22 MB 1:2/506.81 MB 10:1/253.38 MB 9:2/506.82 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 111.82 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 223.64 MB, 244.17 MB, 274.97 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB, 367.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.79 - BytesRead: 367.37 MB (385215155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.37 MB (385215155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.37 MB (385215155) - DecompressionTime: 1s996ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 260.03 MB (272662680) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123828150) - RowsReturned: 53.26M (53257626) - RowsReturnedRate: 77.92 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.96K (11955) - ScannerThreadsTotalWallClockTime: 5m11s - MaterializeTupleTime(*): 5m8s - ScannerThreadsSysTime: 753.881ms - ScannerThreadsUserTime: 20s899ms - ScannerThreadsVoluntaryContextSwitches: 52.23K (52226) - TotalRawHdfsReadTime(*): 288.851ms - TotalReadThroughput: 11.48 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e9 (host=vb0208.halxg.cloudera.com:22000):(Total: 31s475ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(1s000ms): 131.47 MB, 262.86 MB, 262.86 MB, 262.86 MB, 262.86 MB, 262.86 MB, 262.86 MB, 262.94 MB, 263.13 MB, 262.99 MB, 262.86 MB, 262.98 MB, 262.91 MB, 262.86 MB, 263.05 MB, 262.97 MB, 263.20 MB, 262.89 MB, 263.02 MB, 187.29 MB, 92.82 MB, 89.12 MB, 126.18 MB, 165.01 MB, 164.60 MB, 164.55 MB, 164.53 MB, 164.71 MB, 164.51 MB, 152.07 MB, 64.36 MB, 48.83 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 7, 7, 6 - AverageThreadTokens: 10.61 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.41 MB (276209760) - PerHostPeakMemUsage: 2.47 GB (2653354352) - PrepareTime: 144.459ms - RowsProduced: 52.90M (52901839) - TotalCpuTime: 5m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s616ms - TotalStorageWaitTime: 454.088ms CodeGen:(Total: 388.510ms, non-child: 388.510ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.822ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 240.794ms - PrepareTime: 136.534ms DataStreamSender (dst_id=10):(Total: 30s871ms, non-child: 30s871ms, % non-child: 100.00%) - BytesSent: 886.01 MB (929050964) - NetworkThroughput(*): 7.68 MB/sec - OverallThroughput: 28.70 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s229ms - ThriftTransmitTime(*): 1m55s - UncompressedRowBatchSize: 2.27 GB (2433897918) HDFS_SCAN_NODE (id=1):(Total: 673.991ms, non-child: 673.991ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 1:1/253.39 MB 3:2/506.79 MB 5:3/760.21 MB 6:4/1013.56 MB 7:2/260.76 MB 9:1/253.40 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 113.32 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 226.64 MB, 275.32 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB, 365.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.76 - BytesRead: 365.06 MB (382794382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.06 MB (382794382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.06 MB (382794382) - DecompressionTime: 1s983ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.96M (122959072) - RowsReturned: 52.90M (52901839) - RowsReturnedRate: 78.49 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.39K (12387) - ScannerThreadsTotalWallClockTime: 5m8s - MaterializeTupleTime(*): 5m5s - ScannerThreadsSysTime: 784.875ms - ScannerThreadsUserTime: 23s007ms - ScannerThreadsVoluntaryContextSwitches: 51.88K (51884) - TotalRawHdfsReadTime(*): 291.154ms - TotalReadThroughput: 11.41 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f4 (host=vb0222.halxg.cloudera.com:22000):(Total: 31s426ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB MemoryUsage(1s000ms): 128.25 MB, 256.43 MB, 256.43 MB, 256.43 MB, 256.43 MB, 256.43 MB, 256.43 MB, 256.80 MB, 257.45 MB, 257.39 MB, 257.39 MB, 257.56 MB, 257.55 MB, 257.57 MB, 257.49 MB, 257.48 MB, 257.63 MB, 257.53 MB, 257.29 MB, 201.72 MB, 112.52 MB, 104.76 MB, 151.65 MB, 170.58 MB, 170.60 MB, 170.53 MB, 170.49 MB, 170.55 MB, 158.70 MB, 138.83 MB, 60.89 MB, 27.88 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 7, 4 - AverageThreadTokens: 10.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.99 MB (270524528) - PerHostPeakMemUsage: 2.47 GB (2648825464) - PrepareTime: 141.535ms - RowsProduced: 52.97M (52967696) - TotalCpuTime: 5m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s550ms - TotalStorageWaitTime: 552.652ms CodeGen:(Total: 408.248ms, non-child: 408.248ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.473ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 261.297ms - PrepareTime: 138.494ms DataStreamSender (dst_id=10):(Total: 30s787ms, non-child: 30s787ms, % non-child: 100.00%) - BytesSent: 887.49 MB (930604187) - NetworkThroughput(*): 6.90 MB/sec - OverallThroughput: 28.83 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s211ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.27 GB (2436927856) HDFS_SCAN_NODE (id=1):(Total: 702.373ms, non-child: 702.373ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/253.39 MB 4:1/253.39 MB 0:1/253.40 MB 9:1/253.40 MB 10:2/506.82 MB 8:1/253.41 MB 7:2/506.82 MB 6:3/760.17 MB 5:1/199.72 MB 3:3/760.18 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 110.78 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 242.09 MB, 242.09 MB, 303.69 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB, 365.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.70 - BytesRead: 365.29 MB (383037882) - BytesReadDataNodeCache: 0 - BytesReadLocal: 365.29 MB (383037882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 365.29 MB (383037882) - DecompressionTime: 1s999ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.57 MB (270082152) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112182) - RowsReturned: 52.97M (52967696) - RowsReturnedRate: 75.41 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.49K (12495) - ScannerThreadsTotalWallClockTime: 5m8s - MaterializeTupleTime(*): 5m5s - ScannerThreadsSysTime: 778.876ms - ScannerThreadsUserTime: 21s080ms - ScannerThreadsVoluntaryContextSwitches: 51.74K (51740) - TotalRawHdfsReadTime(*): 308.211ms - TotalReadThroughput: 11.42 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f1 (host=vb0206.halxg.cloudera.com:22000):(Total: 31s298ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(1s000ms): 130.55 MB, 261.04 MB, 261.04 MB, 261.04 MB, 261.04 MB, 261.04 MB, 261.04 MB, 262.10 MB, 263.08 MB, 263.07 MB, 263.07 MB, 263.08 MB, 262.87 MB, 263.07 MB, 263.00 MB, 263.06 MB, 263.01 MB, 262.96 MB, 263.02 MB, 195.27 MB, 89.04 MB, 88.99 MB, 140.91 MB, 170.64 MB, 170.67 MB, 170.42 MB, 170.62 MB, 170.67 MB, 170.54 MB, 146.53 MB, 59.87 MB, 49.49 MB ThreadUsage(1s000ms): 6, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 10.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242576) - PerHostPeakMemUsage: 2.48 GB (2662389560) - PrepareTime: 145.825ms - RowsProduced: 53.62M (53615629) - TotalCpuTime: 5m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s942ms - TotalStorageWaitTime: 348.648ms CodeGen:(Total: 489.618ms, non-child: 489.618ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.634ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 339.857ms - PrepareTime: 138.606ms DataStreamSender (dst_id=10):(Total: 30s702ms, non-child: 30s702ms, % non-child: 100.00%) - BytesSent: 898.35 MB (941993254) - NetworkThroughput(*): 6.59 MB/sec - OverallThroughput: 29.26 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s080ms - ThriftTransmitTime(*): 2m16s - UncompressedRowBatchSize: 2.30 GB (2466737830) HDFS_SCAN_NODE (id=1):(Total: 665.515ms, non-child: 665.515ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:2/506.78 MB 3:1/253.40 MB 7:3/760.19 MB 8:2/506.81 MB 2:1/253.41 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 112.92 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 225.85 MB, 297.71 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB, 369.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.79 - BytesRead: 369.57 MB (387519085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.57 MB (387519085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.57 MB (387519085) - DecompressionTime: 2s038ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581042) - RowsReturned: 53.62M (53615629) - RowsReturnedRate: 80.56 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.26K (11261) - ScannerThreadsTotalWallClockTime: 5m7s - MaterializeTupleTime(*): 5m4s - ScannerThreadsSysTime: 717.886ms - ScannerThreadsUserTime: 21s547ms - ScannerThreadsVoluntaryContextSwitches: 52.39K (52394) - TotalRawHdfsReadTime(*): 279.972ms - TotalReadThroughput: 11.55 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f2 (host=vb0220.halxg.cloudera.com:22000):(Total: 30s992ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB MemoryUsage(500.000ms): 0, 260.88 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 261.44 MB, 262.05 MB, 262.91 MB, 262.96 MB, 263.17 MB, 263.05 MB, 263.05 MB, 263.13 MB, 263.06 MB, 263.23 MB, 263.38 MB, 263.15 MB, 263.16 MB, 263.09 MB, 262.95 MB, 263.13 MB, 262.98 MB, 262.86 MB, 263.15 MB, 263.17 MB, 263.06 MB, 262.71 MB, 263.11 MB, 262.97 MB, 263.09 MB, 223.05 MB, 167.25 MB, 104.70 MB, 89.16 MB, 89.02 MB, 89.00 MB, 88.93 MB, 177.45 MB, 147.38 MB, 147.52 MB, 147.43 MB, 147.27 MB, 147.45 MB, 147.41 MB, 147.47 MB, 147.41 MB, 147.59 MB, 147.46 MB, 147.53 MB, 123.52 MB, 60.47 MB, 52.41 MB, 52.55 MB, 52.53 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 10.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.46 MB (276258928) - PerHostPeakMemUsage: 2.49 GB (2678828056) - PrepareTime: 139.384ms - RowsProduced: 50.60M (50598446) - TotalCpuTime: 5m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s574ms - TotalStorageWaitTime: 924.626ms CodeGen:(Total: 401.300ms, non-child: 401.300ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.371ms - PrepareTime: 135.938ms DataStreamSender (dst_id=10):(Total: 30s329ms, non-child: 30s329ms, % non-child: 100.00%) - BytesSent: 847.52 MB (888692016) - NetworkThroughput(*): 6.63 MB/sec - OverallThroughput: 27.94 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s979ms - ThriftTransmitTime(*): 2m7s - UncompressedRowBatchSize: 2.17 GB (2327923840) HDFS_SCAN_NODE (id=1):(Total: 724.097ms, non-child: 724.097ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:3/760.20 MB 8:2/506.78 MB 10:2/506.79 MB 0:3/760.18 MB 4:2/506.78 MB 6:2/506.79 MB 2:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 225.88 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB, 349.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.69 - BytesRead: 349.08 MB (366034515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.08 MB (366034515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.08 MB (366034515) - DecompressionTime: 1s957ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808408) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659481) - RowsReturned: 50.60M (50598446) - RowsReturnedRate: 69.88 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 13.18K (13184) - ScannerThreadsTotalWallClockTime: 5m - MaterializeTupleTime(*): 4m56s - ScannerThreadsSysTime: 740.881ms - ScannerThreadsUserTime: 20s626ms - ScannerThreadsVoluntaryContextSwitches: 49.48K (49481) - TotalRawHdfsReadTime(*): 325.561ms - TotalReadThroughput: 11.26 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f0 (host=vb0228.halxg.cloudera.com:22000):(Total: 30s915ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB MemoryUsage(500.000ms): 68.00 KB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 240.26 MB, 256.51 MB, 257.05 MB, 256.98 MB, 256.98 MB, 257.07 MB, 256.85 MB, 256.83 MB, 256.92 MB, 257.09 MB, 257.09 MB, 256.99 MB, 257.03 MB, 257.18 MB, 257.05 MB, 257.05 MB, 256.94 MB, 256.96 MB, 257.11 MB, 256.85 MB, 257.12 MB, 257.06 MB, 257.09 MB, 256.91 MB, 249.05 MB, 201.14 MB, 143.73 MB, 104.86 MB, 104.85 MB, 104.76 MB, 104.60 MB, 120.31 MB, 161.17 MB, 147.60 MB, 147.31 MB, 147.56 MB, 147.57 MB, 147.43 MB, 147.31 MB, 147.44 MB, 147.41 MB, 131.56 MB, 131.51 MB, 131.64 MB, 115.75 MB, 45.29 MB, 45.30 MB, 45.38 MB, 45.27 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 10.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 257.45 MB (269959312) - PerHostPeakMemUsage: 2.46 GB (2641327888) - PrepareTime: 146.100ms - RowsProduced: 49.95M (49951915) - TotalCpuTime: 5m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s718ms - TotalStorageWaitTime: 555.607ms CodeGen:(Total: 392.975ms, non-child: 392.975ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 243.596ms - PrepareTime: 138.338ms DataStreamSender (dst_id=10):(Total: 30s257ms, non-child: 30s257ms, % non-child: 100.00%) - BytesSent: 836.63 MB (877270662) - NetworkThroughput(*): 5.95 MB/sec - OverallThroughput: 27.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s830ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.14 GB (2298178366) HDFS_SCAN_NODE (id=1):(Total: 709.729ms, non-child: 709.729ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 5:3/512.08 MB 0:4/951.82 MB 7:1/253.39 MB 10:4/1013.58 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 205.97 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 221.55 MB, 242.08 MB, 242.08 MB, 242.08 MB, 242.08 MB, 242.08 MB, 262.62 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.60 - BytesRead: 344.74 MB (361486539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361486539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361486539) - DecompressionTime: 1s888ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 256.97 MB (269451408) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100773) - RowsReturned: 49.95M (49951915) - RowsReturnedRate: 70.38 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.51K (12512) - ScannerThreadsTotalWallClockTime: 4m57s - MaterializeTupleTime(*): 4m54s - ScannerThreadsSysTime: 688.890ms - ScannerThreadsUserTime: 20s082ms - ScannerThreadsVoluntaryContextSwitches: 48.92K (48924) - TotalRawHdfsReadTime(*): 263.293ms - TotalReadThroughput: 10.94 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ee (host=vb0232.halxg.cloudera.com:22000):(Total: 30s874ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(500.000ms): 0, 238.29 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 263.04 MB, 262.94 MB, 263.35 MB, 262.95 MB, 263.01 MB, 263.13 MB, 263.18 MB, 263.09 MB, 263.12 MB, 263.30 MB, 263.05 MB, 263.00 MB, 263.08 MB, 263.17 MB, 263.17 MB, 263.08 MB, 262.94 MB, 262.91 MB, 263.05 MB, 263.07 MB, 263.28 MB, 263.09 MB, 262.98 MB, 263.06 MB, 199.04 MB, 151.56 MB, 96.75 MB, 89.07 MB, 88.92 MB, 88.75 MB, 120.11 MB, 183.42 MB, 148.41 MB, 147.59 MB, 147.28 MB, 147.46 MB, 147.58 MB, 147.61 MB, 147.40 MB, 147.43 MB, 147.45 MB, 147.38 MB, 139.53 MB, 115.73 MB, 60.50 MB, 52.57 MB, 46.33 MB, 45.13 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.48 MB (276275304) - PerHostPeakMemUsage: 2.47 GB (2650512888) - PrepareTime: 141.784ms - RowsProduced: 50.69M (50685802) - TotalCpuTime: 5m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s733ms - TotalStorageWaitTime: 508.152ms CodeGen:(Total: 400.212ms, non-child: 400.212ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 251.635ms - PrepareTime: 139.768ms DataStreamSender (dst_id=10):(Total: 30s277ms, non-child: 30s277ms, % non-child: 100.00%) - BytesSent: 849.40 MB (890658629) - NetworkThroughput(*): 6.64 MB/sec - OverallThroughput: 28.05 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s911ms - ThriftTransmitTime(*): 2m7s - UncompressedRowBatchSize: 2.17 GB (2331942900) HDFS_SCAN_NODE (id=1):(Total: 661.698ms, non-child: 661.698ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 5:1/253.38 MB 8:1/253.40 MB 3:1/253.40 MB 2:1/253.39 MB 4:3/760.19 MB 6:2/506.80 MB 9:3/760.16 MB 1:2/506.78 MB 7:1/253.38 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 204.21 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 226.68 MB, 267.74 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB, 349.88 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.68 - BytesRead: 349.88 MB (366872000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.88 MB (366872000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.88 MB (366872000) - DecompressionTime: 1s915ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852014) - RowsReturned: 50.69M (50685802) - RowsReturnedRate: 76.60 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 12.55K (12552) - ScannerThreadsTotalWallClockTime: 4m57s - MaterializeTupleTime(*): 4m55s - ScannerThreadsSysTime: 806.872ms - ScannerThreadsUserTime: 22s115ms - ScannerThreadsVoluntaryContextSwitches: 49.56K (49562) - TotalRawHdfsReadTime(*): 287.610ms - TotalReadThroughput: 11.29 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691f5 (host=vb0218.halxg.cloudera.com:22000):(Total: 30s858ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(500.000ms): 68.00 KB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 261.49 MB, 262.87 MB, 263.05 MB, 263.20 MB, 263.11 MB, 262.97 MB, 262.95 MB, 263.00 MB, 263.14 MB, 262.98 MB, 263.17 MB, 262.83 MB, 263.08 MB, 262.65 MB, 262.77 MB, 262.99 MB, 262.81 MB, 262.80 MB, 263.08 MB, 262.82 MB, 262.90 MB, 262.88 MB, 262.91 MB, 263.16 MB, 222.83 MB, 199.23 MB, 112.56 MB, 88.88 MB, 88.58 MB, 88.79 MB, 88.91 MB, 182.88 MB, 154.84 MB, 147.45 MB, 147.41 MB, 147.40 MB, 147.56 MB, 147.45 MB, 147.40 MB, 147.59 MB, 147.54 MB, 147.67 MB, 147.74 MB, 131.50 MB, 68.23 MB, 52.48 MB, 52.61 MB, 45.27 MB, 12.00 KB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 1 - AverageThreadTokens: 10.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250728) - PerHostPeakMemUsage: 2.46 GB (2645601224) - PrepareTime: 142.062ms - RowsProduced: 50.63M (50626273) - TotalCpuTime: 5m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s590ms - TotalStorageWaitTime: 362.533ms CodeGen:(Total: 369.622ms, non-child: 369.622ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 224.413ms - PrepareTime: 135.021ms DataStreamSender (dst_id=10):(Total: 30s246ms, non-child: 30s246ms, % non-child: 100.00%) - BytesSent: 848.35 MB (889558748) - NetworkThroughput(*): 7.01 MB/sec - OverallThroughput: 28.05 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s953ms - ThriftTransmitTime(*): 2m - UncompressedRowBatchSize: 2.17 GB (2329204110) HDFS_SCAN_NODE (id=1):(Total: 667.616ms, non-child: 667.616ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:1/253.39 MB 1:2/506.77 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 0, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB, 349.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.69 - BytesRead: 349.07 MB (366023623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.07 MB (366023623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.07 MB (366023623) - DecompressionTime: 1s899ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 262.97 MB (275742864) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660086) - RowsReturned: 50.63M (50626273) - RowsReturnedRate: 75.83 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.50K (12496) - ScannerThreadsTotalWallClockTime: 4m57s - MaterializeTupleTime(*): 4m54s - ScannerThreadsSysTime: 780.874ms - ScannerThreadsUserTime: 22s158ms - ScannerThreadsVoluntaryContextSwitches: 49.55K (49547) - TotalRawHdfsReadTime(*): 261.206ms - TotalReadThroughput: 11.26 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ec (host=vb0212.halxg.cloudera.com:22000):(Total: 30s824ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB MemoryUsage(500.000ms): 68.00 KB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 261.73 MB, 262.94 MB, 263.02 MB, 263.07 MB, 263.14 MB, 262.90 MB, 263.13 MB, 263.04 MB, 262.81 MB, 263.00 MB, 262.98 MB, 263.09 MB, 263.05 MB, 262.87 MB, 262.85 MB, 262.74 MB, 262.94 MB, 262.83 MB, 262.93 MB, 262.93 MB, 263.20 MB, 262.84 MB, 262.93 MB, 255.03 MB, 223.01 MB, 183.55 MB, 112.48 MB, 88.87 MB, 88.87 MB, 88.93 MB, 89.13 MB, 152.89 MB, 154.63 MB, 147.49 MB, 147.52 MB, 147.50 MB, 147.37 MB, 147.54 MB, 147.74 MB, 147.78 MB, 147.48 MB, 147.53 MB, 147.33 MB, 115.67 MB, 76.13 MB, 52.56 MB, 45.24 MB, 45.21 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 10.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276242536) - PerHostPeakMemUsage: 2.46 GB (2645124424) - PrepareTime: 147.411ms - RowsProduced: 50.60M (50595157) - TotalCpuTime: 5m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s741ms - TotalStorageWaitTime: 453.249ms CodeGen:(Total: 410.057ms, non-child: 410.057ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 257.725ms - PrepareTime: 136.948ms DataStreamSender (dst_id=10):(Total: 30s232ms, non-child: 30s232ms, % non-child: 100.00%) - BytesSent: 847.34 MB (888503763) - NetworkThroughput(*): 7.87 MB/sec - OverallThroughput: 28.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s858ms - ThriftTransmitTime(*): 1m47s - UncompressedRowBatchSize: 2.17 GB (2327772530) HDFS_SCAN_NODE (id=1):(Total: 664.096ms, non-child: 664.096ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:2/506.81 MB 1:2/506.79 MB 0:1/253.40 MB 2:1/253.39 MB 8:3/760.17 MB 6:3/760.20 MB 5:3/760.19 MB 3:1/253.40 MB 10:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 0, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 308.00 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 349.06 MB (366018017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366018017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366018017) - DecompressionTime: 1s945ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659798) - RowsReturned: 50.60M (50595157) - RowsReturnedRate: 76.19 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.48K (12477) - ScannerThreadsTotalWallClockTime: 4m56s - MaterializeTupleTime(*): 4m54s - ScannerThreadsSysTime: 725.884ms - ScannerThreadsUserTime: 22s850ms - ScannerThreadsVoluntaryContextSwitches: 49.49K (49490) - TotalRawHdfsReadTime(*): 296.590ms - TotalReadThroughput: 11.26 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691e7 (host=vb0214.halxg.cloudera.com:22000):(Total: 30s777ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB MemoryUsage(500.000ms): 68.00 KB, 255.95 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 256.91 MB, 257.87 MB, 257.89 MB, 258.02 MB, 257.93 MB, 257.95 MB, 258.10 MB, 258.14 MB, 257.93 MB, 257.90 MB, 257.90 MB, 258.15 MB, 258.01 MB, 257.90 MB, 258.14 MB, 257.83 MB, 258.03 MB, 258.11 MB, 258.23 MB, 258.00 MB, 258.14 MB, 257.80 MB, 257.97 MB, 258.15 MB, 257.96 MB, 250.13 MB, 170.14 MB, 99.65 MB, 83.98 MB, 84.10 MB, 102.57 MB, 120.55 MB, 136.20 MB, 147.91 MB, 147.42 MB, 147.45 MB, 147.36 MB, 147.47 MB, 147.37 MB, 147.63 MB, 147.45 MB, 147.65 MB, 147.41 MB, 139.40 MB, 83.94 MB, 52.58 MB, 45.22 MB, 45.31 MB, 3.20 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 1 - AverageThreadTokens: 10.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 258.49 MB (271048816) - PerHostPeakMemUsage: 2.50 GB (2680066544) - PrepareTime: 142.911ms - RowsProduced: 50.08M (50078337) - TotalCpuTime: 5m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s784ms - TotalStorageWaitTime: 335.968ms CodeGen:(Total: 381.746ms, non-child: 381.746ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.511ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 235.802ms - PrepareTime: 137.839ms DataStreamSender (dst_id=10):(Total: 30s186ms, non-child: 30s186ms, % non-child: 100.00%) - BytesSent: 839.00 MB (879752872) - NetworkThroughput(*): 6.52 MB/sec - OverallThroughput: 27.79 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s884ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.15 GB (2303994766) HDFS_SCAN_NODE (id=1):(Total: 659.009ms, non-child: 659.009ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.41 MB 3:2/506.79 MB 0:1/253.42 MB 1:2/506.75 MB 5:2/487.72 MB 4:2/506.78 MB 9:2/506.77 MB 8:1/253.38 MB 6:2/481.03 MB 7:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 0, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 222.25 MB, 242.79 MB, 263.32 MB, 283.86 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB, 345.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.58 - BytesRead: 345.45 MB (362234756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.45 MB (362234756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.45 MB (362234756) - DecompressionTime: 1s906ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.03 MB (270565480) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.43M (116434165) - RowsReturned: 50.08M (50078337) - RowsReturnedRate: 75.99 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 12.21K (12212) - ScannerThreadsTotalWallClockTime: 4m58s - MaterializeTupleTime(*): 4m56s - ScannerThreadsSysTime: 775.876ms - ScannerThreadsUserTime: 22s459ms - ScannerThreadsVoluntaryContextSwitches: 49.05K (49054) - TotalRawHdfsReadTime(*): 257.413ms - TotalReadThroughput: 10.97 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ea (host=vb0230.halxg.cloudera.com:22000):(Total: 30s593ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB MemoryUsage(500.000ms): 68.00 KB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 261.92 MB, 262.84 MB, 262.99 MB, 263.17 MB, 262.91 MB, 262.90 MB, 262.90 MB, 262.88 MB, 263.18 MB, 262.91 MB, 262.85 MB, 262.93 MB, 263.14 MB, 262.96 MB, 262.87 MB, 263.02 MB, 263.06 MB, 262.95 MB, 262.93 MB, 262.95 MB, 262.98 MB, 263.11 MB, 262.81 MB, 262.91 MB, 191.15 MB, 167.25 MB, 88.96 MB, 89.05 MB, 88.72 MB, 88.86 MB, 88.78 MB, 146.79 MB, 147.49 MB, 147.56 MB, 147.64 MB, 147.37 MB, 147.54 MB, 147.58 MB, 147.41 MB, 147.49 MB, 147.54 MB, 147.38 MB, 139.60 MB, 83.77 MB, 52.57 MB, 52.65 MB, 45.39 MB, 10.40 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 1 - AverageThreadTokens: 10.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.45 MB (276250728) - PerHostPeakMemUsage: 2.43 GB (2610401200) - PrepareTime: 139.165ms - RowsProduced: 50.63M (50626120) - TotalCpuTime: 5m8s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s618ms - TotalStorageWaitTime: 666.654ms CodeGen:(Total: 388.347ms, non-child: 388.347ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.363ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 246.287ms - PrepareTime: 137.278ms DataStreamSender (dst_id=10):(Total: 30s018ms, non-child: 30s018ms, % non-child: 100.00%) - BytesSent: 847.41 MB (888570841) - NetworkThroughput(*): 6.59 MB/sec - OverallThroughput: 28.23 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s845ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.17 GB (2329197064) HDFS_SCAN_NODE (id=1):(Total: 646.906ms, non-child: 646.906ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 2:1/253.38 MB 7:1/253.42 MB 5:1/253.38 MB 6:2/506.81 MB 8:2/506.80 MB 4:4/1013.58 MB 9:3/760.19 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 0, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 225.86 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.49 - BytesRead: 349.05 MB (366010564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366010564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366010564) - DecompressionTime: 1s914ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.03 MB (275808360) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660145) - RowsReturned: 50.63M (50626120) - RowsReturnedRate: 78.26 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.44K (10440) - ScannerThreadsTotalWallClockTime: 4m50s - MaterializeTupleTime(*): 4m47s - ScannerThreadsSysTime: 628.898ms - ScannerThreadsUserTime: 19s891ms - ScannerThreadsVoluntaryContextSwitches: 49.48K (49482) - TotalRawHdfsReadTime(*): 311.718ms - TotalReadThroughput: 11.26 MB/sec Instance 194abadfc94cbc81:89ceb14c5a9691ef (host=vb0216.halxg.cloudera.com:22000):(Total: 29s177ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 0, 261.06 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.77 MB, 261.70 MB, 262.97 MB, 262.91 MB, 263.02 MB, 262.95 MB, 262.97 MB, 262.95 MB, 262.91 MB, 262.98 MB, 262.73 MB, 262.90 MB, 263.29 MB, 263.04 MB, 262.97 MB, 262.97 MB, 263.00 MB, 263.00 MB, 263.09 MB, 263.13 MB, 262.97 MB, 262.91 MB, 263.03 MB, 262.98 MB, 263.07 MB, 183.21 MB, 151.53 MB, 88.97 MB, 88.97 MB, 88.70 MB, 89.04 MB, 104.74 MB, 125.29 MB, 124.38 MB, 124.36 MB, 124.54 MB, 124.41 MB, 124.43 MB, 124.37 MB, 124.41 MB, 124.48 MB, 124.34 MB, 76.65 MB, 45.36 MB, 45.08 MB, 17.21 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 10.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 263.52 MB (276324464) - PerHostPeakMemUsage: 2.24 GB (2402593832) - PrepareTime: 141.321ms - RowsProduced: 47.65M (47647960) - TotalCpuTime: 4m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s434ms - TotalStorageWaitTime: 445.375ms CodeGen:(Total: 381.501ms, non-child: 381.501ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.49 MB (1559356) - OptimizationTime: 233.598ms - PrepareTime: 136.597ms DataStreamSender (dst_id=10):(Total: 28s592ms, non-child: 28s592ms, % non-child: 100.00%) - BytesSent: 798.46 MB (837248465) - NetworkThroughput(*): 6.33 MB/sec - OverallThroughput: 27.93 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 9s210ms - ThriftTransmitTime(*): 2m6s - UncompressedRowBatchSize: 2.04 GB (2192178440) HDFS_SCAN_NODE (id=1):(Total: 655.804ms, non-child: 655.804ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:1/253.40 MB 4:2/506.81 MB 9:1/253.41 MB 7:1/253.39 MB 6:4/1013.60 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 225.87 MB, 246.41 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.53 - BytesRead: 328.55 MB (344511591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.55 MB (344511591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.55 MB (344511591) - DecompressionTime: 1s746ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 263.09 MB (275873904) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738687) - RowsReturned: 47.65M (47647960) - RowsReturnedRate: 72.66 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 10.45K (10448) - ScannerThreadsTotalWallClockTime: 4m39s - MaterializeTupleTime(*): 4m36s - ScannerThreadsSysTime: 626.898ms - ScannerThreadsUserTime: 19s992ms - ScannerThreadsVoluntaryContextSwitches: 46.62K (46620) - TotalRawHdfsReadTime(*): 273.813ms - TotalReadThroughput: 11.14 MB/sec ================================================================================