================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 20:EXCHANGE | 1 | 11.97us | 0ns | 11.97us | 0 | 36.00M | | 19:AGGREGATE | 15 | 5.20s | 0ns | 5.62s | 0 | 36.00M | | 18:EXCHANGE | 15 | 977.24ms | 0ns | 1.11s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 4.45s | 0ns | 5.02s | 395.39M | 36.00M | | 00:UNION | 15 | 1.48s | 0ns | 1.74s | 398.68M | 36.00M | | |--17:AGGREGATE | 15 | 2.97s | 0ns | 3.56s | 199.34M | 18.00M | | | 16:EXCHANGE | 15 | 355.22ms | 0ns | 439.88ms | 199.34M | 18.00M | | | 08:AGGREGATE | 15 | 9.32s | 0ns | 10.39s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.66s | 0ns | 14.92s | 774.31M | 18.00M | | | |--15:EXCHANGE | 15 | 742.71ms | 0ns | 1.37s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 464.67ms | 0ns | 494.82ms | 204.99M | 45.00M | | | 14:EXCHANGE | 15 | 3.06s | 0ns | 4.00s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 713.08ms | 0ns | 783.10ms | 774.31M | 180.00M | | 13:AGGREGATE | 15 | 2.97s | 0ns | 3.36s | 199.34M | 18.00M | | 12:EXCHANGE | 15 | 361.34ms | 0ns | 475.90ms | 199.34M | 18.00M | | 04:AGGREGATE | 15 | 9.24s | 0ns | 10.32s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.74s | 0ns | 15.11s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 747.08ms | 0ns | 1.48s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 459.12ms | 0ns | 513.84ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 3.05s | 0ns | 4.54s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 700.10ms | 0ns | 877.06ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=704a43b40e790124:4123ec6c75fea596): Summary: Session ID: 524983969c17c6b3:6d46121601b319a1 Session Type: BEESWAX Start Time: 2016-03-23 01:05:08.772417000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 45089593363bb86c9944d70021d78b0963ed3d0f) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:39942 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=3 20:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 19:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 18:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--17:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 16:EXCHANGE [HASH(l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 08:AGGREGATE [STREAMING] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--15:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 14:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 13:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 12:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=8B cardinality=17999891 | 04:AGGREGATE [STREAMING] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 3 Request Pool: default-pool Planner Timeline: 28.709ms - Analysis finished: 12.682ms (12.682ms) - Equivalence classes computed: 13.025ms (342.955us) - Single node plan created: 19.380ms (6.354ms) - Runtime filters computed: 19.625ms (244.374us) - Distributed plan created: 23.779ms (4.154ms) - Lineage info computed: 24.636ms (856.868us) - Planning finished: 28.709ms (4.073ms) Query Timeline: 1m1s - Start execution: 32.980us (32.980us) - Planning finished: 33.832ms (33.799ms) - Ready to start 120 remote fragments: 37.213ms (3.380ms) - All 120 remote fragments started: 50.167ms (12.953ms) - Rows available: 1m1s (1m1s) - First row fetched: 1m1s (27.304ms) ImpalaServer: - ClientFetchWaitTimer: 27.315ms - RowMaterializationTimer: 0.000ns Execution Profile 704a43b40e790124:4123ec6c75fea596:(Total: 1m1s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 120, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 2ms, 99.9th %-ile: 3ms Per Node Peak Memory Usage: vb0208.halxg.cloudera.com:22000(3.88 GB) vb0230.halxg.cloudera.com:22000(3.94 GB) vb0214.halxg.cloudera.com:22000(3.86 GB) vb0212.halxg.cloudera.com:22000(3.86 GB) vb0234.halxg.cloudera.com:22000(3.91 GB) vb0226.halxg.cloudera.com:22000(3.94 GB) vb0232.halxg.cloudera.com:22000(3.93 GB) vb0216.halxg.cloudera.com:22000(3.83 GB) vb0206.halxg.cloudera.com:22000(3.94 GB) vb0220.halxg.cloudera.com:22000(3.83 GB) vb0228.halxg.cloudera.com:22000(3.86 GB) vb0224.halxg.cloudera.com:22000(3.93 GB) vb0222.halxg.cloudera.com:22000(3.94 GB) vb0218.halxg.cloudera.com:22000(3.83 GB) vb0204.halxg.cloudera.com:22000(3.86 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F10:(Total: 1m1s, non-child: 695.081us, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 61.064us - RowsProduced: 0 (0) - TotalCpuTime: 43.229ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m1s, non-child: 11.966us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.887us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1m1s - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F09:(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m1s max:1m1s mean: 1m1s stddev:14.515ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.89 MB (969816986) - PerHostPeakMemUsage: 3.89 GB (4176025735) - PrepareTime: 190.590ms - RowsProduced: 0 (0) - TotalCpuTime: 6s468ms - TotalNetworkReceiveTime: 54s750ms - TotalNetworkSendTime: 190.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 613.430ms, non-child: 613.430ms, % non-child: 100.00%) - CodegenTime: 1.443ms - CompileTime: 29.825ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 395.538ms - PrepareTime: 181.181ms DataStreamSender (dst_id=20):(Total: 13.701us, non-child: 13.701us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s204ms, % non-child: 8.56%) - BuildTime: 4s256ms - GetNewBlockTime: 775.561us - GetResultsTime: 694.457ms - HTResizeTime: 1s032ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.225us EXCHANGE_NODE (id=18):(Total: 55s587ms, non-child: 55s587ms, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759371) - ConvertRowBatchTime: 777.881ms - DeserializeRowBatchTimer: 742.361ms - FirstBatchArrivalWaitTime: 39s938ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 474.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F08:(Total: 58s727ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:57s249ms max:1m mean: 59s221ms stddev:1s026ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902171499) - PerHostPeakMemUsage: 3.89 GB (4176025735) - PrepareTime: 192.266ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 18s383ms - TotalNetworkReceiveTime: 39s630ms - TotalNetworkSendTime: 1s206ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 640.136ms, non-child: 640.136ms, % non-child: 100.00%) - CodegenTime: 3.849ms - CompileTime: 57.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 395.955ms - PrepareTime: 179.320ms DataStreamSender (dst_id=18):(Total: 6s539ms, non-child: 6s539ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759371) - NetworkThroughput(*): 56.14 MB/sec - OverallThroughput: 44.36 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s348ms - ThriftTransmitTime(*): 5s174ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 52s151ms, non-child: 4s451ms, % non-child: 8.54%) - GetNewBlockTime: 173.841us - GetResultsTime: 130.632ms - HTResizeTime: 111.257ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 505.46 K/sec - StreamingTime: 4s070ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s699ms, non-child: 1s482ms, % non-child: 3.11%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 557.29 K/sec AGGREGATION_NODE (id=17):(Total: 5s663ms, non-child: 2s974ms, % non-child: 52.51%) - BuildTime: 2s277ms - GetNewBlockTime: 643.757us - GetResultsTime: 671.641ms - HTResizeTime: 876.343ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 2.39 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.074us EXCHANGE_NODE (id=16):(Total: 2s689ms, non-child: 2s689ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139883541) - ConvertRowBatchTime: 301.014ms - DeserializeRowBatchTimer: 313.402ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 5.56 M/sec - SendersBlockedTimer: 10s470ms - SendersBlockedTotalTimer(*): 10s470ms AGGREGATION_NODE (id=13):(Total: 40s554ms, non-child: 2s973ms, % non-child: 7.33%) - BuildTime: 2s269ms - GetNewBlockTime: 472.173us - GetResultsTime: 666.770ms - HTResizeTime: 812.156ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 327.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.219us EXCHANGE_NODE (id=12):(Total: 37s580ms, non-child: 37s580ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139880720) - ConvertRowBatchTime: 308.475ms - DeserializeRowBatchTimer: 291.336ms - FirstBatchArrivalWaitTime: 35s300ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 353.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 50s501ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:49s210ms max:52s195ms mean: 51s001ms stddev:920.111ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070758741) - PerHostPeakMemUsage: 3.89 GB (4176025735) - PrepareTime: 196.242ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 36s520ms - TotalNetworkReceiveTime: 11s569ms - TotalNetworkSendTime: 10s614ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 675.058ms, non-child: 675.058ms, % non-child: 100.00%) - CodegenTime: 1.108ms - CompileTime: 55.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 428.585ms - PrepareTime: 180.958ms DataStreamSender (dst_id=16):(Total: 14s056ms, non-child: 14s056ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139883541) - NetworkThroughput(*): 10.47 MB/sec - OverallThroughput: 9.53 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 798.571ms - ThriftTransmitTime(*): 12s796ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=8):(Total: 36s425ms, non-child: 9s321ms, % non-child: 25.59%) - GetNewBlockTime: 1.613ms - GetResultsTime: 472.127ms - HTResizeTime: 1s033ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 364.84 K/sec - StreamingTime: 8s537ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s104ms, non-child: 13s663ms, % non-child: 50.41%) - BuildPartitionTime: 1s453ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s993ms - GetNewBlockTime: 1.662ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s544ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 1.90 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.410us EXCHANGE_NODE (id=15):(Total: 3s721ms, non-child: 3s721ms, % non-child: 100.00%) - BytesReceived: 298.20 MB (312683411) - ConvertRowBatchTime: 324.060ms - DeserializeRowBatchTimer: 1s196ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.70 M/sec - SendersBlockedTimer: 180.004us - SendersBlockedTotalTimer(*): 622.234us EXCHANGE_NODE (id=14):(Total: 9s719ms, non-child: 9s719ms, % non-child: 100.00%) - BytesReceived: 1.07 GB (1145931092) - ConvertRowBatchTime: 1s356ms - DeserializeRowBatchTimer: 5s696ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 8s957ms - SendersBlockedTotalTimer(*): 1m54s Averaged Fragment F05:(Total: 4s493ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:4s037ms max:5s887ms mean: 4s884ms stddev:543.567ms execution rates: min:239.55 MB/sec max:284.93 MB/sec mean:263.63 MB/sec stddev:11.26 MB/sec num instances: 15 - AverageThreadTokens: 5.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.77 MB (190595500) - PerHostPeakMemUsage: 1.71 GB (1837146521) - PrepareTime: 184.426ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 26s762ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.347ms - TotalStorageWaitTime: 154.704ms CodeGen:(Total: 548.337ms, non-child: 548.337ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 359.768ms - PrepareTime: 177.754ms DataStreamSender (dst_id=15):(Total: 4s190ms, non-child: 4s190ms, % non-child: 100.00%) - BytesSent: 298.20 MB (312683411) - NetworkThroughput(*): 57.10 MB/sec - OverallThroughput: 71.38 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s532ms - ThriftTransmitTime(*): 5s232ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=6):(Total: 464.668ms, non-child: 464.668ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.07 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 485.990ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.33 MB (190134018) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 29.39 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1695) - ScannerThreadsTotalWallClockTime: 22s077ms - MaterializeTupleTime(*): 21s359ms - ScannerThreadsSysTime: 61.521ms - ScannerThreadsUserTime: 4s165ms - ScannerThreadsVoluntaryContextSwitches: 13.27K (13271) - TotalRawHdfsReadTime(*): 116.051ms - TotalReadThroughput: 33.53 MB/sec Averaged Fragment F04:(Total: 34s895ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:33s305ms max:36s438ms mean: 35s382ms stddev:843.212ms execution rates: min:119.80 MB/sec max:127.93 MB/sec mean:124.13 MB/sec stddev:2.55 MB/sec num instances: 15 - AverageThreadTokens: 8.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 192.91 MB (202283884) - PerHostPeakMemUsage: 3.87 GB (4156144714) - PrepareTime: 186.799ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s977ms - TotalStorageWaitTime: 401.447ms CodeGen:(Total: 545.239ms, non-child: 545.239ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 354.367ms - PrepareTime: 176.569ms DataStreamSender (dst_id=14):(Total: 34s295ms, non-child: 34s295ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1145931092) - NetworkThroughput(*): 7.84 MB/sec - OverallThroughput: 31.85 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s001ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=5):(Total: 713.075ms, non-child: 713.075ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.62 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s435ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.47 MB (201821863) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 72.53 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.65K (7651) - ScannerThreadsTotalWallClockTime: 4m24s - MaterializeTupleTime(*): 4m22s - ScannerThreadsSysTime: 237.693ms - ScannerThreadsUserTime: 17s457ms - ScannerThreadsVoluntaryContextSwitches: 49.93K (49933) - TotalRawHdfsReadTime(*): 263.009ms - TotalReadThroughput: 10.14 MB/sec Averaged Fragment F02:(Total: 39s454ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:39s460ms max:40s512ms mean: 39s959ms stddev:300.409ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068881408) - PerHostPeakMemUsage: 3.89 GB (4176025735) - PrepareTime: 189.924ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 36s234ms - TotalNetworkReceiveTime: 11s093ms - TotalNetworkSendTime: 72.237ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 677.301ms, non-child: 677.301ms, % non-child: 100.00%) - CodegenTime: 996.466us - CompileTime: 60.252ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 431.644ms - PrepareTime: 177.220ms DataStreamSender (dst_id=12):(Total: 3s505ms, non-child: 3s505ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139880720) - NetworkThroughput(*): 62.54 MB/sec - OverallThroughput: 38.33 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 756.605ms - ThriftTransmitTime(*): 2s169ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=4):(Total: 35s930ms, non-child: 9s238ms, % non-child: 25.71%) - GetNewBlockTime: 1.004ms - GetResultsTime: 480.169ms - HTResizeTime: 1s105ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 369.87 K/sec - StreamingTime: 8s452ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s691ms, non-child: 13s742ms, % non-child: 51.49%) - BuildPartitionTime: 1s463ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 2s137ms - GetNewBlockTime: 1.613ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s464ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.500us EXCHANGE_NODE (id=11):(Total: 3s302ms, non-child: 3s302ms, % non-child: 100.00%) - BytesReceived: 298.29 MB (312779548) - ConvertRowBatchTime: 320.617ms - DeserializeRowBatchTimer: 1s189ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 4.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s646ms, non-child: 9s646ms, % non-child: 100.00%) - BytesReceived: 1.06 GB (1142925748) - ConvertRowBatchTime: 1s346ms - DeserializeRowBatchTimer: 5s705ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 5.40 M/sec - SendersBlockedTimer: 8s632ms - SendersBlockedTotalTimer(*): 1m38s Averaged Fragment F01:(Total: 4s423ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:3s897ms max:5s477ms mean: 4s821ms stddev:402.629ms execution rates: min:242.00 MB/sec max:289.10 MB/sec mean:266.51 MB/sec stddev:14.43 MB/sec num instances: 15 - AverageThreadTokens: 5.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.75 MB (190579539) - PerHostPeakMemUsage: 1.71 GB (1833276140) - PrepareTime: 184.452ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 26s275ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24.942ms - TotalStorageWaitTime: 162.416ms CodeGen:(Total: 554.696ms, non-child: 554.696ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 366.132ms - PrepareTime: 175.501ms DataStreamSender (dst_id=11):(Total: 4s124ms, non-child: 4s124ms, % non-child: 100.00%) - BytesSent: 298.29 MB (312779548) - NetworkThroughput(*): 57.43 MB/sec - OverallThroughput: 72.44 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s495ms - ThriftTransmitTime(*): 5s206ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=2):(Total: 459.118ms, non-child: 459.118ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 5.01 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 486.049ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.33 MB (190137160) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 29.86 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1604) - ScannerThreadsTotalWallClockTime: 21s641ms - MaterializeTupleTime(*): 20s914ms - ScannerThreadsSysTime: 46.990ms - ScannerThreadsUserTime: 4s212ms - ScannerThreadsVoluntaryContextSwitches: 13.22K (13220) - TotalRawHdfsReadTime(*): 122.115ms - TotalReadThroughput: 34.29 MB/sec Averaged Fragment F00:(Total: 34s338ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:32s565ms max:35s937ms mean: 34s820ms stddev:899.782ms execution rates: min:122.27 MB/sec max:129.53 MB/sec mean:126.14 MB/sec stddev:2.42 MB/sec num instances: 15 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 192.68 MB (202043406) - PerHostPeakMemUsage: 3.85 GB (4136101957) - PrepareTime: 182.596ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s436ms - TotalStorageWaitTime: 384.005ms CodeGen:(Total: 533.569ms, non-child: 533.569ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.130ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 346.395ms - PrepareTime: 173.663ms DataStreamSender (dst_id=10):(Total: 33s748ms, non-child: 33s748ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1142925748) - NetworkThroughput(*): 9.13 MB/sec - OverallThroughput: 32.28 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s944ms - ThriftTransmitTime(*): 2m4s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=1):(Total: 700.097ms, non-child: 700.097ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s475ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.24 MB (201579199) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 74.02 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.66K (7656) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m15s - ScannerThreadsSysTime: 233.760ms - ScannerThreadsUserTime: 17s384ms - ScannerThreadsVoluntaryContextSwitches: 50.00K (49998) - TotalRawHdfsReadTime(*): 267.852ms - TotalReadThroughput: 10.27 MB/sec Fragment F09: Instance 704a43b40e790124:4123ec6c75fea5a4 (host=vb0214.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 7.64 MB, 144.58 MB, 346.57 MB, 524.36 MB, 684.65 MB, 855.23 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 894.06 MB, 906.06 MB, 906.06 MB, 877.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.57 MB (969482352) - PerHostPeakMemUsage: 3.86 GB (4145067752) - PrepareTime: 180.719ms - RowsProduced: 0 (0) - TotalCpuTime: 5s414ms - TotalNetworkReceiveTime: 55s829ms - TotalNetworkSendTime: 498.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 518.194ms, non-child: 518.194ms, % non-child: 100.00%) - CodegenTime: 1.282ms - CompileTime: 21.748ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 317.769ms - PrepareTime: 172.344ms DataStreamSender (dst_id=20):(Total: 13.194us, non-child: 13.194us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 4s448ms, % non-child: 7.30%) ExecOption: Codegen Enabled - BuildTime: 3s499ms - GetNewBlockTime: 460.933us - GetResultsTime: 717.644ms - HTResizeTime: 1s051ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.244us EXCHANGE_NODE (id=18):(Total: 56s453ms, non-child: 715.290ms, % non-child: 1.27%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.27 MB, 39.33 MB, 70.83 MB, 94.97 MB, 125.31 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 147.78 MB, 178.51 MB, 210.12 MB, 237.60 MB, 257.26 MB, 279.25 MB, 283.88 MB, 283.88 MB - BytesReceived: 283.88 MB (297664517) - ConvertRowBatchTime: 582.974ms - DeserializeRowBatchTimer: 581.723ms - FirstBatchArrivalWaitTime: 40s034ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 466.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a5 (host=vb0230.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 99.77 MB, 192.67 MB, 306.54 MB, 483.83 MB, 603.94 MB, 720.88 MB, 862.43 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.04 MB, 882.06 MB, 894.04 MB, 906.04 MB, 821.09 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.96 MB (970944560) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 180.798ms - RowsProduced: 0 (0) - TotalCpuTime: 6s797ms - TotalNetworkReceiveTime: 54s438ms - TotalNetworkSendTime: 154.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 551.878ms, non-child: 551.878ms, % non-child: 100.00%) - CodegenTime: 1.430ms - CompileTime: 24.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.781ms - PrepareTime: 172.007ms DataStreamSender (dst_id=20):(Total: 13.673us, non-child: 13.673us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s621ms, % non-child: 9.24%) ExecOption: Codegen Enabled - BuildTime: 4s664ms - GetNewBlockTime: 421.991us - GetResultsTime: 709.821ms - HTResizeTime: 1s066ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 885.000ns EXCHANGE_NODE (id=18):(Total: 55s238ms, non-child: 928.122ms, % non-child: 1.68%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.39 MB, 24.27 MB, 41.31 MB, 62.13 MB, 87.78 MB, 106.36 MB, 126.92 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 149.30 MB, 170.93 MB, 186.95 MB, 204.32 MB, 222.71 MB, 251.32 MB, 280.61 MB, 283.95 MB - BytesReceived: 283.95 MB (297739903) - ConvertRowBatchTime: 745.680ms - DeserializeRowBatchTimer: 684.803ms - FirstBatchArrivalWaitTime: 40s001ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 477.17 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a0 (host=vb0226.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.64 MB, 95.73 MB, 208.67 MB, 338.35 MB, 434.53 MB, 547.47 MB, 664.42 MB, 773.36 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.05 MB, 894.06 MB, 736.15 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.22 MB (970164352) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 185.116ms - RowsProduced: 0 (0) - TotalCpuTime: 6s702ms - TotalNetworkReceiveTime: 54s529ms - TotalNetworkSendTime: 139.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 570.526ms, non-child: 570.526ms, % non-child: 100.00%) - CodegenTime: 1.295ms - CompileTime: 32.155ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 355.176ms - PrepareTime: 181.605ms DataStreamSender (dst_id=20):(Total: 12.475us, non-child: 12.475us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s393ms, % non-child: 8.86%) ExecOption: Codegen Enabled - BuildTime: 4s430ms - GetNewBlockTime: 365.549us - GetResultsTime: 706.428ms - HTResizeTime: 1s029ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.788us EXCHANGE_NODE (id=18):(Total: 55s449ms, non-child: 1s082ms, % non-child: 1.95%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.65 MB, 18.47 MB, 36.27 MB, 55.49 MB, 72.30 MB, 89.55 MB, 108.03 MB, 125.84 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 143.06 MB, 160.53 MB, 177.72 MB, 194.82 MB, 210.99 MB, 227.38 MB, 243.06 MB, 261.78 MB - BytesReceived: 283.96 MB (297749125) - ConvertRowBatchTime: 856.248ms - DeserializeRowBatchTimer: 794.075ms - FirstBatchArrivalWaitTime: 39s983ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 475.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a3 (host=vb0212.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 116.05 MB, 259.36 MB, 402.32 MB, 560.48 MB, 708.89 MB, 845.82 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.05 MB, 906.05 MB, 764.46 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.60 MB (968462080) - PerHostPeakMemUsage: 3.86 GB (4145505000) - PrepareTime: 197.220ms - RowsProduced: 0 (0) - TotalCpuTime: 6s562ms - TotalNetworkReceiveTime: 54s676ms - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 600.795ms, non-child: 600.795ms, % non-child: 100.00%) - CodegenTime: 1.422ms - CompileTime: 37.702ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.105ms - PrepareTime: 180.791ms DataStreamSender (dst_id=20):(Total: 12.473us, non-child: 12.473us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s264ms, % non-child: 8.65%) ExecOption: Codegen Enabled - BuildTime: 4s294ms - GetNewBlockTime: 350.055us - GetResultsTime: 712.235ms - HTResizeTime: 993.077ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.107us EXCHANGE_NODE (id=18):(Total: 55s563ms, non-child: 1s012ms, % non-child: 1.82%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.81 MB, 19.03 MB, 41.99 MB, 66.04 MB, 90.27 MB, 114.88 MB, 135.98 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 142.32 MB, 156.24 MB, 172.89 MB, 191.70 MB, 216.30 MB, 238.46 MB, 257.36 MB, 279.48 MB - BytesReceived: 283.98 MB (297773971) - ConvertRowBatchTime: 829.854ms - DeserializeRowBatchTimer: 683.572ms - FirstBatchArrivalWaitTime: 39s950ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 474.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea599 (host=vb0222.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 95.73 MB, 212.65 MB, 325.61 MB, 470.02 MB, 587.96 MB, 716.89 MB, 829.82 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 894.06 MB, 792.78 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.82 MB (969744240) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 184.352ms - RowsProduced: 0 (0) - TotalCpuTime: 6s318ms - TotalNetworkReceiveTime: 54s878ms - TotalNetworkSendTime: 254.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 558.738ms, non-child: 558.738ms, % non-child: 100.00%) - CodegenTime: 1.317ms - CompileTime: 27.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.007ms - PrepareTime: 180.898ms DataStreamSender (dst_id=20):(Total: 12.625us, non-child: 12.625us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s078ms, % non-child: 8.35%) ExecOption: Codegen Enabled - BuildTime: 4s155ms - GetNewBlockTime: 669.392us - GetResultsTime: 672.464ms - HTResizeTime: 961.543ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.329us EXCHANGE_NODE (id=18):(Total: 55s739ms, non-child: 1s016ms, % non-child: 1.82%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.76 MB, 18.26 MB, 36.79 MB, 55.10 MB, 75.23 MB, 95.20 MB, 115.58 MB, 134.64 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 141.84 MB, 155.95 MB, 175.01 MB, 194.78 MB, 211.78 MB, 229.60 MB, 246.58 MB, 266.45 MB - BytesReceived: 284.05 MB (297848025) - ConvertRowBatchTime: 802.824ms - DeserializeRowBatchTimer: 786.253ms - FirstBatchArrivalWaitTime: 39s991ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 473.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea598 (host=vb0218.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.65 MB, 116.35 MB, 226.91 MB, 362.07 MB, 536.78 MB, 706.89 MB, 862.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.07 MB, 906.06 MB, 906.06 MB, 821.10 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.38 MB (970333488) - PerHostPeakMemUsage: 3.83 GB (4116367584) - PrepareTime: 201.083ms - RowsProduced: 0 (0) - TotalCpuTime: 6s379ms - TotalNetworkReceiveTime: 54s851ms - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 614.771ms, non-child: 614.771ms, % non-child: 100.00%) - CodegenTime: 1.480ms - CompileTime: 35.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 379.879ms - PrepareTime: 184.736ms DataStreamSender (dst_id=20):(Total: 14.483us, non-child: 14.483us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s282ms, % non-child: 8.69%) ExecOption: Codegen Enabled - BuildTime: 4s329ms - GetNewBlockTime: 425.264us - GetResultsTime: 706.260ms - HTResizeTime: 1s012ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.367us EXCHANGE_NODE (id=18):(Total: 55s529ms, non-child: 790.791ms, % non-child: 1.42%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.90 MB, 28.25 MB, 49.19 MB, 71.71 MB, 99.51 MB, 128.09 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.75 MB, 146.53 MB, 172.86 MB, 199.38 MB, 220.22 MB, 245.71 MB, 270.40 MB, 283.91 MB, 283.91 MB - BytesReceived: 283.91 MB (297701762) - ConvertRowBatchTime: 632.929ms - DeserializeRowBatchTimer: 666.107ms - FirstBatchArrivalWaitTime: 39s935ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 474.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59f (host=vb0232.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 24.87 MB, 152.20 MB, 277.72 MB, 426.55 MB, 547.49 MB, 682.64 MB, 821.83 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.04 MB, 906.05 MB, 679.52 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.78 MB (968653040) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 187.780ms - RowsProduced: 0 (0) - TotalCpuTime: 6s688ms - TotalNetworkReceiveTime: 54s503ms - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 567.402ms, non-child: 567.402ms, % non-child: 100.00%) - CodegenTime: 1.410ms - CompileTime: 31.971ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.649ms - PrepareTime: 183.767ms DataStreamSender (dst_id=20):(Total: 12.343us, non-child: 12.343us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s380ms, % non-child: 8.85%) ExecOption: Codegen Enabled - BuildTime: 4s449ms - GetNewBlockTime: 339.905us - GetResultsTime: 666.317ms - HTResizeTime: 1s042ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.108us EXCHANGE_NODE (id=18):(Total: 55s426ms, non-child: 1s070ms, % non-child: 1.93%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.27 MB, 25.17 MB, 45.59 MB, 68.92 MB, 89.54 MB, 109.85 MB, 132.51 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 143.86 MB, 164.07 MB, 183.52 MB, 201.76 MB, 219.91 MB, 236.23 MB, 253.42 MB, 275.90 MB - BytesReceived: 284.08 MB (297874755) - ConvertRowBatchTime: 857.593ms - DeserializeRowBatchTimer: 696.612ms - FirstBatchArrivalWaitTime: 39s985ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 475.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59c (host=vb0220.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 79.72 MB, 192.89 MB, 302.38 MB, 415.68 MB, 528.85 MB, 641.73 MB, 758.05 MB, 862.07 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.07 MB, 894.04 MB, 906.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.92 MB (970900912) - PerHostPeakMemUsage: 3.83 GB (4109676800) - PrepareTime: 189.924ms - RowsProduced: 0 (0) - TotalCpuTime: 6s424ms - TotalNetworkReceiveTime: 54s792ms - TotalNetworkSendTime: 155.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 607.423ms, non-child: 607.423ms, % non-child: 100.00%) - CodegenTime: 1.341ms - CompileTime: 33.912ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.541ms - PrepareTime: 181.953ms DataStreamSender (dst_id=20):(Total: 12.082us, non-child: 12.082us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s173ms, % non-child: 8.51%) ExecOption: Codegen Enabled - BuildTime: 4s226ms - GetNewBlockTime: 361.888us - GetResultsTime: 692.073ms - HTResizeTime: 1s076ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.353us EXCHANGE_NODE (id=18):(Total: 55s622ms, non-child: 964.410ms, % non-child: 1.73%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.79 MB, 22.55 MB, 38.56 MB, 56.25 MB, 74.43 MB, 92.08 MB, 109.57 MB, 128.72 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 144.86 MB, 162.54 MB, 178.77 MB, 194.97 MB, 212.75 MB, 232.63 MB, 250.33 MB, 280.11 MB - BytesReceived: 284.12 MB (297916603) - ConvertRowBatchTime: 776.042ms - DeserializeRowBatchTimer: 803.017ms - FirstBatchArrivalWaitTime: 39s942ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 474.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59a (host=vb0224.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 83.72 MB, 213.33 MB, 321.61 MB, 426.53 MB, 551.49 MB, 737.13 MB, 890.25 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.06 MB, 906.05 MB, 906.04 MB, 906.04 MB, 877.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.30 MB (971293744) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 186.253ms - RowsProduced: 0 (0) - TotalCpuTime: 5s990ms - TotalNetworkReceiveTime: 55s216ms - TotalNetworkSendTime: 157.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 616.723ms, non-child: 616.723ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 18.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 413.911ms - PrepareTime: 180.798ms DataStreamSender (dst_id=20):(Total: 13.573us, non-child: 13.573us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 4s859ms, % non-child: 8.00%) ExecOption: Codegen Enabled - BuildTime: 3s943ms - GetNewBlockTime: 406.778us - GetResultsTime: 682.421ms - HTResizeTime: 1s014ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 971.000ns EXCHANGE_NODE (id=18):(Total: 55s912ms, non-child: 802.898ms, % non-child: 1.44%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.87 MB, 24.64 MB, 43.92 MB, 60.31 MB, 79.07 MB, 102.81 MB, 133.16 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 147.05 MB, 176.24 MB, 205.58 MB, 235.44 MB, 262.71 MB, 284.01 MB, 284.01 MB, 284.01 MB - BytesReceived: 284.01 MB (297803429) - ConvertRowBatchTime: 647.173ms - DeserializeRowBatchTimer: 665.864ms - FirstBatchArrivalWaitTime: 39s948ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 471.49 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59b (host=vb0228.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 95.74 MB, 212.67 MB, 321.60 MB, 464.26 MB, 547.48 MB, 660.41 MB, 810.82 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.07 MB, 882.06 MB, 882.04 MB, 882.05 MB, 882.05 MB, 906.06 MB, 906.04 MB, 792.78 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.35 MB (969247744) - PerHostPeakMemUsage: 3.86 GB (4146282224) - PrepareTime: 191.970ms - RowsProduced: 0 (0) - TotalCpuTime: 6s920ms - TotalNetworkReceiveTime: 54s300ms - TotalNetworkSendTime: 148.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 651.960ms, non-child: 651.960ms, % non-child: 100.00%) - CodegenTime: 1.379ms - CompileTime: 27.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 434.803ms - PrepareTime: 181.426ms DataStreamSender (dst_id=20):(Total: 12.768us, non-child: 12.768us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s531ms, % non-child: 9.10%) ExecOption: Codegen Enabled - BuildTime: 4s577ms - GetNewBlockTime: 360.675us - GetResultsTime: 696.224ms - HTResizeTime: 1s094ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.160us EXCHANGE_NODE (id=18):(Total: 55s225ms, non-child: 1s072ms, % non-child: 1.94%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.71 MB, 18.24 MB, 36.73 MB, 54.56 MB, 74.27 MB, 88.70 MB, 106.97 MB, 129.10 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.99 MB, 157.47 MB, 176.98 MB, 198.31 MB, 216.25 MB, 243.85 MB, 272.73 MB, 283.82 MB - BytesReceived: 283.82 MB (297606148) - ConvertRowBatchTime: 855.849ms - DeserializeRowBatchTimer: 828.296ms - FirstBatchArrivalWaitTime: 39s901ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 477.06 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a6 (host=vb0208.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 115.97 MB, 294.95 MB, 414.64 MB, 499.01 MB, 603.95 MB, 741.12 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 894.06 MB, 764.48 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.11 MB (969002224) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 190.789ms - RowsProduced: 0 (0) - TotalCpuTime: 6s376ms - TotalNetworkReceiveTime: 54s843ms - TotalNetworkSendTime: 331.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 648.098ms, non-child: 648.098ms, % non-child: 100.00%) - CodegenTime: 1.341ms - CompileTime: 32.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.049ms - PrepareTime: 181.175ms DataStreamSender (dst_id=20):(Total: 16.730us, non-child: 16.730us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s047ms, % non-child: 8.31%) ExecOption: Codegen Enabled - BuildTime: 4s102ms - GetNewBlockTime: 431.979us - GetResultsTime: 693.223ms - HTResizeTime: 1s014ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 932.000ns EXCHANGE_NODE (id=18):(Total: 55s708ms, non-child: 1s009ms, % non-child: 1.81%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.98 MB, 19.78 MB, 47.55 MB, 65.83 MB, 81.74 MB, 99.11 MB, 120.02 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 141.94 MB, 154.92 MB, 170.79 MB, 186.68 MB, 202.65 MB, 219.25 MB, 237.37 MB, 259.04 MB - BytesReceived: 283.93 MB (297721672) - ConvertRowBatchTime: 804.445ms - DeserializeRowBatchTimer: 869.574ms - FirstBatchArrivalWaitTime: 39s904ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 473.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a1 (host=vb0204.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 77.73 MB, 187.58 MB, 299.60 MB, 414.53 MB, 539.73 MB, 700.74 MB, 845.81 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.05 MB, 882.04 MB, 894.04 MB, 906.03 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.80 MB (969722416) - PerHostPeakMemUsage: 3.86 GB (4144608464) - PrepareTime: 210.076ms - RowsProduced: 0 (0) - TotalCpuTime: 6s546ms - TotalNetworkReceiveTime: 54s667ms - TotalNetworkSendTime: 147.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 665.169ms, non-child: 665.169ms, % non-child: 100.00%) - CodegenTime: 1.306ms - CompileTime: 29.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.498ms - PrepareTime: 197.352ms DataStreamSender (dst_id=20):(Total: 13.505us, non-child: 13.505us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s213ms, % non-child: 8.58%) ExecOption: Codegen Enabled - BuildTime: 4s247ms - GetNewBlockTime: 346.257us - GetResultsTime: 687.953ms - HTResizeTime: 1s062ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.115us EXCHANGE_NODE (id=18):(Total: 55s542ms, non-child: 1s009ms, % non-child: 1.82%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.58 MB, 21.42 MB, 38.81 MB, 57.29 MB, 76.41 MB, 98.18 MB, 124.62 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 144.56 MB, 161.59 MB, 180.03 MB, 197.43 MB, 215.69 MB, 234.57 MB, 254.05 MB, 277.36 MB - BytesReceived: 284.01 MB (297804865) - ConvertRowBatchTime: 813.512ms - DeserializeRowBatchTimer: 824.798ms - FirstBatchArrivalWaitTime: 39s888ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 474.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59e (host=vb0216.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 23.88 MB, 132.21 MB, 245.15 MB, 357.85 MB, 487.02 MB, 603.96 MB, 724.89 MB, 845.82 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.07 MB, 894.07 MB, 906.04 MB, 679.53 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.28 MB (969182272) - PerHostPeakMemUsage: 3.83 GB (4111212800) - PrepareTime: 179.150ms - RowsProduced: 0 (0) - TotalCpuTime: 6s412ms - TotalNetworkReceiveTime: 54s811ms - TotalNetworkSendTime: 142.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 652.541ms, non-child: 652.541ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 24.421ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 450.928ms - PrepareTime: 169.616ms DataStreamSender (dst_id=20):(Total: 11.406us, non-child: 11.406us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s092ms, % non-child: 8.38%) ExecOption: Codegen Enabled - BuildTime: 4s151ms - GetNewBlockTime: 401.687us - GetResultsTime: 698.275ms - HTResizeTime: 976.161ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.222us EXCHANGE_NODE (id=18):(Total: 55s653ms, non-child: 985.866ms, % non-child: 1.77%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.80 MB, 21.83 MB, 40.10 MB, 57.72 MB, 78.32 MB, 98.56 MB, 117.67 MB, 135.93 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 143.87 MB, 163.97 MB, 190.49 MB, 209.91 MB, 228.13 MB, 246.95 MB, 266.66 MB, 283.89 MB - BytesReceived: 283.89 MB (297680894) - ConvertRowBatchTime: 775.429ms - DeserializeRowBatchTimer: 780.029ms - FirstBatchArrivalWaitTime: 39s901ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 473.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea59d (host=vb0206.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.65 MB, 164.64 MB, 341.84 MB, 538.59 MB, 692.92 MB, 859.44 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.07 MB, 882.06 MB, 882.07 MB, 882.06 MB, 906.05 MB, 906.03 MB, 906.03 MB, 821.09 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.42 MB (970377136) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 192.882ms - RowsProduced: 0 (0) - TotalCpuTime: 6s460ms - TotalNetworkReceiveTime: 54s747ms - TotalNetworkSendTime: 143.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 651.171ms, non-child: 651.171ms, % non-child: 100.00%) - CodegenTime: 1.463ms - CompileTime: 49.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 411.452ms - PrepareTime: 189.256ms DataStreamSender (dst_id=20):(Total: 17.157us, non-child: 17.157us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s119ms, % non-child: 8.43%) ExecOption: Codegen Enabled - BuildTime: 4s182ms - GetNewBlockTime: 400.947us - GetResultsTime: 682.312ms - HTResizeTime: 971.783ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.118us EXCHANGE_NODE (id=18):(Total: 55s625ms, non-child: 1s114ms, % non-child: 2.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.26 MB, 40.82 MB, 71.57 MB, 98.66 MB, 125.71 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 149.94 MB, 179.54 MB, 209.26 MB, 238.31 MB, 271.11 MB, 283.97 MB, 283.97 MB, 283.97 MB - BytesReceived: 283.97 MB (297763007) - ConvertRowBatchTime: 817.005ms - DeserializeRowBatchTimer: 595.382ms - FirstBatchArrivalWaitTime: 39s898ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 473.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a2 (host=vb0234.halxg.cloudera.com:22000):(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 87.72 MB, 226.40 MB, 360.83 MB, 475.15 MB, 587.02 MB, 700.09 MB, 821.83 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.06 MB, 882.04 MB, 882.07 MB, 882.05 MB, 882.06 MB, 894.05 MB, 906.04 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.82 MB (969744240) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 200.733ms - RowsProduced: 0 (0) - TotalCpuTime: 7s039ms - TotalNetworkReceiveTime: 54s180ms - TotalNetworkSendTime: 160.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 726.061ms, non-child: 726.061ms, % non-child: 100.00%) - CodegenTime: 2.478ms - CompileTime: 21.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 513.527ms - PrepareTime: 179.995ms DataStreamSender (dst_id=20):(Total: 17.038us, non-child: 17.038us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 1m, non-child: 5s560ms, % non-child: 9.16%) ExecOption: Codegen Enabled - BuildTime: 4s586ms - GetNewBlockTime: 5.890ms - GetResultsTime: 693.210ms - HTResizeTime: 1s127ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.690us EXCHANGE_NODE (id=18):(Total: 55s117ms, non-child: 1s083ms, % non-child: 1.97%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.93 MB, 26.42 MB, 47.42 MB, 67.43 MB, 85.15 MB, 101.71 MB, 121.12 MB, 138.69 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 144.45 MB, 160.84 MB, 180.80 MB, 202.62 MB, 219.13 MB, 235.94 MB, 252.53 MB, 273.83 MB - BytesReceived: 283.95 MB (297741893) - ConvertRowBatchTime: 870.658ms - DeserializeRowBatchTimer: 875.307ms - FirstBatchArrivalWaitTime: 39s812ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 478.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F08: Instance 704a43b40e790124:4123ec6c75fea5b5 (host=vb0208.halxg.cloudera.com:22000):(Total: 59s984ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 134.94 MB, 367.46 MB, 582.62 MB, 772.21 MB, 810.79 MB, 719.92 MB, 549.74 MB, 452.49 MB, 403.87 MB, 306.61 MB, 185.04 MB, 113.26 MB, 307.95 MB, 485.35 MB, 711.93 MB, 792.14 MB, 808.38 MB, 748.02 MB, 651.77 MB, 555.51 MB, 507.39 MB, 411.14 MB, 314.89 MB, 170.26 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 189.782ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 19s788ms - TotalNetworkReceiveTime: 39s340ms - TotalNetworkSendTime: 1s396ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 682.972ms, non-child: 682.972ms, % non-child: 100.00%) - CodegenTime: 3.597ms - CompileTime: 45.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 451.590ms - PrepareTime: 179.487ms DataStreamSender (dst_id=18):(Total: 7s241ms, non-child: 7s241ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297721672) - NetworkThroughput(*): 48.09 MB/sec - OverallThroughput: 39.21 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s544ms - ThriftTransmitTime(*): 5s904ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 52s699ms, non-child: 4s855ms, % non-child: 9.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 181.384us - GetResultsTime: 162.788ms - HTResizeTime: 127.961ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 500.11 K/sec - StreamingTime: 4s438ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s844ms, non-child: 1s592ms, % non-child: 3.33%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 555.46 K/sec AGGREGATION_NODE (id=17):(Total: 5s753ms, non-child: 3s073ms, % non-child: 53.43%) ExecOption: Codegen Enabled - BuildTime: 2s263ms - GetNewBlockTime: 318.064us - GetResultsTime: 787.820ms - HTResizeTime: 846.777ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 2.31 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.038us EXCHANGE_NODE (id=16):(Total: 2s679ms, non-child: 375.131ms, % non-child: 14.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.19 MB, 49.45 MB, 82.10 MB, 116.59 MB, 133.38 MB - BytesReceived: 133.38 MB (139856260) - ConvertRowBatchTime: 317.823ms - DeserializeRowBatchTimer: 342.030ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 4.96 M/sec - SendersBlockedTimer: 10s491ms - SendersBlockedTotalTimer(*): 10s491ms AGGREGATION_NODE (id=13):(Total: 40s498ms, non-child: 3s100ms, % non-child: 7.66%) ExecOption: Codegen Enabled - BuildTime: 2s404ms - GetNewBlockTime: 301.976us - GetResultsTime: 674.074ms - HTResizeTime: 824.300ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 328.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.301us EXCHANGE_NODE (id=12):(Total: 37s397ms, non-child: 448.413ms, % non-child: 1.20%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20.80 MB, 58.49 MB, 95.55 MB, 128.61 MB - BytesReceived: 133.38 MB (139855385) - ConvertRowBatchTime: 388.468ms - DeserializeRowBatchTimer: 233.626ms - FirstBatchArrivalWaitTime: 35s250ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 355.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5af (host=vb0226.halxg.cloudera.com:22000):(Total: 59s852ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 128.77 MB, 295.74 MB, 481.62 MB, 673.49 MB, 810.79 MB, 744.23 MB, 647.00 MB, 525.41 MB, 452.47 MB, 355.22 MB, 257.99 MB, 160.73 MB, 118.36 MB, 316.61 MB, 501.98 MB, 675.20 MB, 816.39 MB, 699.89 MB, 603.64 MB, 531.43 MB, 459.27 MB, 363.02 MB, 266.76 MB, 170.26 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 218.533ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 20s941ms - TotalNetworkReceiveTime: 38s082ms - TotalNetworkSendTime: 1s360ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 679.545ms, non-child: 679.545ms, % non-child: 100.00%) - CodegenTime: 8.687ms - CompileTime: 55.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.750ms - PrepareTime: 181.302ms DataStreamSender (dst_id=18):(Total: 7s659ms, non-child: 7s659ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297749125) - NetworkThroughput(*): 45.21 MB/sec - OverallThroughput: 37.07 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s658ms - ThriftTransmitTime(*): 6s280ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 52s150ms, non-child: 5s016ms, % non-child: 9.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 157.161us - GetResultsTime: 141.334ms - HTResizeTime: 91.944ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 505.42 K/sec - StreamingTime: 4s596ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s134ms, non-child: 1s743ms, % non-child: 3.70%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 563.87 K/sec AGGREGATION_NODE (id=17):(Total: 4s781ms, non-child: 3s210ms, % non-child: 67.14%) ExecOption: Codegen Enabled - BuildTime: 2s394ms - GetNewBlockTime: 4.402ms - GetResultsTime: 780.424ms - HTResizeTime: 789.453ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 2.78 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.864us EXCHANGE_NODE (id=16):(Total: 1s571ms, non-child: 372.784ms, % non-child: 23.73%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 20.50 MB, 51.42 MB, 82.97 MB, 114.12 MB - BytesReceived: 133.40 MB (139880967) - ConvertRowBatchTime: 319.054ms - DeserializeRowBatchTimer: 282.793ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 8.46 M/sec - SendersBlockedTimer: 11s485ms - SendersBlockedTotalTimer(*): 11s485ms AGGREGATION_NODE (id=13):(Total: 40s609ms, non-child: 3s362ms, % non-child: 8.28%) ExecOption: Codegen Enabled - BuildTime: 2s539ms - GetNewBlockTime: 3.370ms - GetResultsTime: 780.122ms - HTResizeTime: 864.712ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 327.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.859us EXCHANGE_NODE (id=12):(Total: 37s246ms, non-child: 457.682ms, % non-child: 1.23%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.41 MB, 46.42 MB, 78.02 MB, 110.45 MB - BytesReceived: 133.39 MB (139870564) - ConvertRowBatchTime: 381.315ms - DeserializeRowBatchTimer: 361.387ms - FirstBatchArrivalWaitTime: 35s241ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 356.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5b1 (host=vb0234.halxg.cloudera.com:22000):(Total: 59s657ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 71.77 MB, 296.18 MB, 497.60 MB, 714.39 MB, 809.77 MB, 744.21 MB, 622.66 MB, 501.09 MB, 403.82 MB, 306.60 MB, 209.32 MB, 112.08 MB, 180.64 MB, 372.41 MB, 568.55 MB, 752.21 MB, 826.26 MB, 748.03 MB, 651.76 MB, 555.52 MB, 459.28 MB, 363.03 MB, 266.76 MB, 170.26 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 180.194ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 18s845ms - TotalNetworkReceiveTime: 39s839ms - TotalNetworkSendTime: 1s453ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 610.835ms, non-child: 610.835ms, % non-child: 100.00%) - CodegenTime: 3.108ms - CompileTime: 69.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 364.634ms - PrepareTime: 168.824ms DataStreamSender (dst_id=18):(Total: 7s435ms, non-child: 7s435ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741893) - NetworkThroughput(*): 47.61 MB/sec - OverallThroughput: 38.19 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s654ms - ThriftTransmitTime(*): 5s963ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 52s174ms, non-child: 4s749ms, % non-child: 9.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 176.557us - GetResultsTime: 152.236ms - HTResizeTime: 99.387ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 505.17 K/sec - StreamingTime: 4s353ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s424ms, non-child: 1s622ms, % non-child: 3.42%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 560.40 K/sec AGGREGATION_NODE (id=17):(Total: 5s190ms, non-child: 2s800ms, % non-child: 53.96%) ExecOption: Codegen Enabled - BuildTime: 2s023ms - GetNewBlockTime: 287.879us - GetResultsTime: 755.715ms - HTResizeTime: 819.468ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 2.56 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.037us EXCHANGE_NODE (id=16):(Total: 2s389ms, non-child: 284.993ms, % non-child: 11.93%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.19 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 14.14 MB, 44.27 MB, 77.60 MB, 110.60 MB, 133.38 MB - BytesReceived: 133.38 MB (139863920) - ConvertRowBatchTime: 245.133ms - DeserializeRowBatchTimer: 207.467ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 5.56 M/sec - SendersBlockedTimer: 10s977ms - SendersBlockedTotalTimer(*): 10s977ms AGGREGATION_NODE (id=13):(Total: 40s611ms, non-child: 2s662ms, % non-child: 6.56%) ExecOption: Codegen Enabled - BuildTime: 1s925ms - GetNewBlockTime: 226.300us - GetResultsTime: 718.433ms - HTResizeTime: 700.530ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 327.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.101us EXCHANGE_NODE (id=12):(Total: 37s949ms, non-child: 276.189ms, % non-child: 0.73%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 846.69 KB, 27.71 MB, 63.46 MB, 99.62 MB, 129.78 MB - BytesReceived: 133.39 MB (139866337) - ConvertRowBatchTime: 227.935ms - DeserializeRowBatchTimer: 374.758ms - FirstBatchArrivalWaitTime: 35s344ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 350.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a8 (host=vb0222.halxg.cloudera.com:22000):(Total: 59s622ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 131.12 MB, 352.76 MB, 584.97 MB, 772.17 MB, 810.78 MB, 744.21 MB, 646.96 MB, 549.72 MB, 403.83 MB, 306.57 MB, 209.33 MB, 112.08 MB, 194.54 MB, 384.91 MB, 568.37 MB, 720.28 MB, 808.38 MB, 748.02 MB, 651.77 MB, 507.41 MB, 459.27 MB, 363.02 MB, 266.78 MB, 141.98 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 202.147ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 20s089ms - TotalNetworkReceiveTime: 38s750ms - TotalNetworkSendTime: 1s263ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 637.252ms, non-child: 637.252ms, % non-child: 100.00%) - CodegenTime: 3.619ms - CompileTime: 51.933ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 388.860ms - PrepareTime: 184.402ms DataStreamSender (dst_id=18):(Total: 7s340ms, non-child: 7s340ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297848025) - NetworkThroughput(*): 50.38 MB/sec - OverallThroughput: 38.70 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s728ms - ThriftTransmitTime(*): 5s638ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 52s244ms, non-child: 4s852ms, % non-child: 9.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 175.253us - GetResultsTime: 148.161ms - HTResizeTime: 116.989ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 504.69 K/sec - StreamingTime: 4s438ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s392ms, non-child: 1s582ms, % non-child: 3.34%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 561.00 K/sec AGGREGATION_NODE (id=17):(Total: 5s198ms, non-child: 3s560ms, % non-child: 68.49%) ExecOption: Codegen Enabled - BuildTime: 2s774ms - GetNewBlockTime: 1.268ms - GetResultsTime: 757.560ms - HTResizeTime: 1s071ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 2.56 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.319us EXCHANGE_NODE (id=16):(Total: 1s637ms, non-child: 439.878ms, % non-child: 26.86%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.58 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 32.15 MB, 63.33 MB, 94.41 MB, 120.54 MB - BytesReceived: 133.46 MB (139941224) - ConvertRowBatchTime: 379.754ms - DeserializeRowBatchTimer: 470.951ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 8.12 M/sec - SendersBlockedTimer: 11s015ms - SendersBlockedTotalTimer(*): 11s015ms AGGREGATION_NODE (id=13):(Total: 40s612ms, non-child: 2s840ms, % non-child: 6.99%) ExecOption: Codegen Enabled - BuildTime: 2s084ms - GetNewBlockTime: 294.332us - GetResultsTime: 736.351ms - HTResizeTime: 801.892ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 327.33 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.085us EXCHANGE_NODE (id=12):(Total: 37s771ms, non-child: 288.518ms, % non-child: 0.76%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.20 MB, 55.85 MB, 94.54 MB, 128.82 MB - BytesReceived: 133.45 MB (139930495) - ConvertRowBatchTime: 251.772ms - DeserializeRowBatchTimer: 217.348ms - FirstBatchArrivalWaitTime: 35s298ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 351.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5b0 (host=vb0204.halxg.cloudera.com:22000):(Total: 59s480ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 75.13 MB, 287.72 MB, 494.09 MB, 691.47 MB, 810.77 MB, 744.22 MB, 646.96 MB, 549.70 MB, 452.46 MB, 355.22 MB, 233.65 MB, 115.17 MB, 225.37 MB, 404.70 MB, 578.27 MB, 760.05 MB, 818.27 MB, 748.03 MB, 651.78 MB, 555.52 MB, 459.26 MB, 363.03 MB, 266.77 MB, 141.95 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.86 GB (4144608464) - PrepareTime: 208.774ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 19s411ms - TotalNetworkReceiveTime: 39s247ms - TotalNetworkSendTime: 1s357ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 696.725ms, non-child: 696.725ms, % non-child: 100.00%) - CodegenTime: 3.336ms - CompileTime: 65.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.059ms - PrepareTime: 191.516ms DataStreamSender (dst_id=18):(Total: 7s114ms, non-child: 7s114ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297804865) - NetworkThroughput(*): 50.52 MB/sec - OverallThroughput: 39.92 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s556ms - ThriftTransmitTime(*): 5s621ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 52s326ms, non-child: 4s684ms, % non-child: 8.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 223.267us - GetResultsTime: 136.764ms - HTResizeTime: 112.231ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 503.82 K/sec - StreamingTime: 4s274ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s642ms, non-child: 1s609ms, % non-child: 3.38%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 557.96 K/sec AGGREGATION_NODE (id=17):(Total: 5s508ms, non-child: 3s355ms, % non-child: 60.91%) ExecOption: Codegen Enabled - BuildTime: 2s591ms - GetNewBlockTime: 300.211us - GetResultsTime: 738.999ms - HTResizeTime: 995.961ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 2.41 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.040us EXCHANGE_NODE (id=16):(Total: 2s152ms, non-child: 399.396ms, % non-child: 18.55%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.78 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 20.88 MB, 50.63 MB, 82.23 MB, 113.08 MB, 133.43 MB - BytesReceived: 133.43 MB (139907128) - ConvertRowBatchTime: 348.568ms - DeserializeRowBatchTimer: 298.104ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 6.17 M/sec - SendersBlockedTimer: 10s684ms - SendersBlockedTotalTimer(*): 10s684ms AGGREGATION_NODE (id=13):(Total: 40s525ms, non-child: 2s821ms, % non-child: 6.96%) ExecOption: Codegen Enabled - BuildTime: 2s093ms - GetNewBlockTime: 220.315us - GetResultsTime: 704.128ms - HTResizeTime: 833.268ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 327.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.321us EXCHANGE_NODE (id=12):(Total: 37s703ms, non-child: 269.333ms, % non-child: 0.71%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.48 MB, 27.96 MB, 62.42 MB, 97.28 MB, 128.62 MB - BytesReceived: 133.42 MB (139902454) - ConvertRowBatchTime: 231.990ms - DeserializeRowBatchTimer: 205.218ms - FirstBatchArrivalWaitTime: 35s257ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 352.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5ae (host=vb0232.halxg.cloudera.com:22000):(Total: 59s418ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 143.06 MB, 334.22 MB, 506.42 MB, 687.49 MB, 786.49 MB, 695.59 MB, 574.05 MB, 452.49 MB, 355.22 MB, 233.66 MB, 112.12 MB, 194.54 MB, 388.40 MB, 598.43 MB, 776.38 MB, 792.16 MB, 787.22 MB, 699.89 MB, 603.65 MB, 507.38 MB, 411.14 MB, 314.89 MB, 218.66 MB, 89.36 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 203.095ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 18s879ms - TotalNetworkReceiveTime: 39s856ms - TotalNetworkSendTime: 1s213ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 681.330ms, non-child: 681.330ms, % non-child: 100.00%) - CodegenTime: 4.698ms - CompileTime: 62.927ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 421.520ms - PrepareTime: 186.004ms DataStreamSender (dst_id=18):(Total: 6s805ms, non-child: 6s805ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297874755) - NetworkThroughput(*): 53.03 MB/sec - OverallThroughput: 41.74 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s481ms - ThriftTransmitTime(*): 5s356ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 52s577ms, non-child: 4s516ms, % non-child: 8.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 155.967us - GetResultsTime: 150.425ms - HTResizeTime: 119.815ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270593) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 501.53 K/sec - StreamingTime: 4s099ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 48s061ms, non-child: 1s548ms, % non-child: 3.22%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 553.23 K/sec AGGREGATION_NODE (id=17):(Total: 5s918ms, non-child: 3s242ms, % non-child: 54.79%) ExecOption: Codegen Enabled - BuildTime: 2s490ms - GetNewBlockTime: 235.628us - GetResultsTime: 728.356ms - HTResizeTime: 911.401ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 932.000ns EXCHANGE_NODE (id=16):(Total: 2s675ms, non-child: 419.738ms, % non-child: 15.69%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 31.67 MB, 65.58 MB, 99.65 MB, 129.27 MB, 133.46 MB - BytesReceived: 133.46 MB (139945536) - ConvertRowBatchTime: 364.186ms - DeserializeRowBatchTimer: 284.185ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 10s301ms - SendersBlockedTotalTimer(*): 10s301ms AGGREGATION_NODE (id=13):(Total: 40s594ms, non-child: 2s794ms, % non-child: 6.89%) ExecOption: Codegen Enabled - BuildTime: 2s005ms - GetNewBlockTime: 238.497us - GetResultsTime: 640.982ms - HTResizeTime: 785.255ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 327.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.189us EXCHANGE_NODE (id=12):(Total: 37s799ms, non-child: 269.127ms, % non-child: 0.71%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21.19 MB, 52.21 MB, 83.30 MB, 114.54 MB - BytesReceived: 133.45 MB (139932620) - ConvertRowBatchTime: 227.631ms - DeserializeRowBatchTimer: 297.741ms - FirstBatchArrivalWaitTime: 35s247ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 351.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5ab (host=vb0220.halxg.cloudera.com:22000):(Total: 59s241ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 76.69 MB, 300.06 MB, 497.61 MB, 722.46 MB, 809.77 MB, 744.22 MB, 646.97 MB, 574.03 MB, 452.48 MB, 379.52 MB, 282.27 MB, 185.03 MB, 110.98 MB, 283.46 MB, 502.66 MB, 704.82 MB, 826.27 MB, 748.03 MB, 651.77 MB, 555.51 MB, 483.33 MB, 363.02 MB, 266.78 MB, 141.96 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4109676800) - PrepareTime: 173.831ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 20s112ms - TotalNetworkReceiveTime: 38s266ms - TotalNetworkSendTime: 1s313ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 576.310ms, non-child: 576.310ms, % non-child: 100.00%) - CodegenTime: 3.014ms - CompileTime: 48.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 357.813ms - PrepareTime: 168.797ms DataStreamSender (dst_id=18):(Total: 7s197ms, non-child: 7s197ms, % non-child: 100.00%) - BytesSent: 284.12 MB (297916603) - NetworkThroughput(*): 49.32 MB/sec - OverallThroughput: 39.47 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s554ms - ThriftTransmitTime(*): 5s760ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 52s003ms, non-child: 4s888ms, % non-child: 9.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 154.070us - GetResultsTime: 86.926ms - HTResizeTime: 107.894ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278191) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 507.15 K/sec - StreamingTime: 4s557ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s114ms, non-child: 1s688ms, % non-child: 3.58%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 564.43 K/sec AGGREGATION_NODE (id=17):(Total: 4s719ms, non-child: 3s079ms, % non-child: 65.26%) ExecOption: Codegen Enabled - BuildTime: 2s301ms - GetNewBlockTime: 398.235us - GetResultsTime: 756.232ms - HTResizeTime: 843.098ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 2.82 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.032us EXCHANGE_NODE (id=16):(Total: 1s639ms, non-child: 392.799ms, % non-child: 23.95%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.56 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.93 MB, 64.91 MB, 101.04 MB, 130.67 MB - BytesReceived: 133.47 MB (139957897) - ConvertRowBatchTime: 337.759ms - DeserializeRowBatchTimer: 233.566ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 8.11 M/sec - SendersBlockedTimer: 11s523ms - SendersBlockedTotalTimer(*): 11s523ms AGGREGATION_NODE (id=13):(Total: 40s706ms, non-child: 3s311ms, % non-child: 8.13%) ExecOption: Codegen Enabled - BuildTime: 2s520ms - GetNewBlockTime: 261.904us - GetResultsTime: 768.021ms - HTResizeTime: 838.001ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 326.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.391us EXCHANGE_NODE (id=12):(Total: 37s395ms, non-child: 456.602ms, % non-child: 1.22%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.02 MB, 28.61 MB, 63.95 MB, 99.65 MB, 129.97 MB - BytesReceived: 133.46 MB (139943493) - ConvertRowBatchTime: 397.887ms - DeserializeRowBatchTimer: 231.329ms - FirstBatchArrivalWaitTime: 35s389ms - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 355.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5b2 (host=vb0212.halxg.cloudera.com:22000):(Total: 59s113ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 128.92 MB, 336.19 MB, 538.26 MB, 731.98 MB, 810.78 MB, 744.21 MB, 598.32 MB, 476.78 MB, 330.88 MB, 209.34 MB, 96.83 MB, 223.62 MB, 417.18 MB, 618.81 MB, 776.13 MB, 792.13 MB, 820.39 MB, 748.00 MB, 651.77 MB, 555.52 MB, 411.14 MB, 314.88 MB, 170.25 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.86 GB (4145505000) - PrepareTime: 183.388ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 18s705ms - TotalNetworkReceiveTime: 39s717ms - TotalNetworkSendTime: 1s162ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 615.098ms, non-child: 615.098ms, % non-child: 100.00%) - CodegenTime: 3.116ms - CompileTime: 71.244ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 364.383ms - PrepareTime: 177.924ms DataStreamSender (dst_id=18):(Total: 6s621ms, non-child: 6s621ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297773971) - NetworkThroughput(*): 54.76 MB/sec - OverallThroughput: 42.89 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s442ms - ThriftTransmitTime(*): 5s186ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 52s457ms, non-child: 4s312ms, % non-child: 8.22%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 173.484us - GetResultsTime: 159.800ms - HTResizeTime: 111.585ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 502.53 K/sec - StreamingTime: 3s912ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 48s144ms, non-child: 1s415ms, % non-child: 2.94%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 552.10 K/sec AGGREGATION_NODE (id=17):(Total: 6s184ms, non-child: 3s048ms, % non-child: 49.29%) ExecOption: Codegen Enabled - BuildTime: 2s310ms - GetNewBlockTime: 249.131us - GetResultsTime: 714.492ms - HTResizeTime: 946.210ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.004us EXCHANGE_NODE (id=16):(Total: 3s136ms, non-child: 334.900ms, % non-child: 10.68%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.41 MB, 34.68 MB, 68.13 MB, 102.06 MB, 130.58 MB, 133.42 MB - BytesReceived: 133.42 MB (139896842) - ConvertRowBatchTime: 288.553ms - DeserializeRowBatchTimer: 248.872ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 4.24 M/sec - SendersBlockedTimer: 10s013ms - SendersBlockedTotalTimer(*): 10s013ms AGGREGATION_NODE (id=13):(Total: 40s545ms, non-child: 3s249ms, % non-child: 8.01%) ExecOption: Codegen Enabled - BuildTime: 2s574ms - GetNewBlockTime: 248.888us - GetResultsTime: 645.167ms - HTResizeTime: 888.662ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 327.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.340us EXCHANGE_NODE (id=12):(Total: 37s296ms, non-child: 465.505ms, % non-child: 1.25%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.61 MB, 53.02 MB, 87.31 MB, 121.80 MB - BytesReceived: 133.41 MB (139888820) - ConvertRowBatchTime: 394.099ms - DeserializeRowBatchTimer: 331.927ms - FirstBatchArrivalWaitTime: 35s326ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 356.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5ad (host=vb0216.halxg.cloudera.com:22000):(Total: 58s747ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 134.93 MB, 349.05 MB, 538.50 MB, 732.73 MB, 786.46 MB, 695.59 MB, 598.32 MB, 501.07 MB, 403.84 MB, 306.58 MB, 209.32 MB, 98.52 MB, 229.05 MB, 401.62 MB, 582.26 MB, 759.89 MB, 788.23 MB, 699.89 MB, 555.51 MB, 459.27 MB, 363.03 MB, 266.78 MB, 141.97 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4111212800) - PrepareTime: 192.818ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 18s554ms - TotalNetworkReceiveTime: 39s431ms - TotalNetworkSendTime: 1s285ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 672.795ms, non-child: 672.795ms, % non-child: 100.00%) - CodegenTime: 3.800ms - CompileTime: 62.677ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 421.911ms - PrepareTime: 179.908ms DataStreamSender (dst_id=18):(Total: 7s023ms, non-child: 7s023ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297680894) - NetworkThroughput(*): 51.51 MB/sec - OverallThroughput: 40.42 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s493ms - ThriftTransmitTime(*): 5s511ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 51s686ms, non-child: 4s554ms, % non-child: 8.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.541us - GetResultsTime: 134.344ms - HTResizeTime: 86.212ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 509.87 K/sec - StreamingTime: 4s164ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s132ms, non-child: 1s530ms, % non-child: 3.25%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 563.80 K/sec AGGREGATION_NODE (id=17):(Total: 5s053ms, non-child: 2s469ms, % non-child: 48.88%) ExecOption: Codegen Enabled - BuildTime: 1s792ms - GetNewBlockTime: 284.728us - GetResultsTime: 659.326ms - HTResizeTime: 636.121ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 2.63 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 951.000ns EXCHANGE_NODE (id=16):(Total: 2s583ms, non-child: 291.428ms, % non-child: 11.28%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.37 MB, 35.79 MB, 66.76 MB, 98.52 MB, 128.62 MB - BytesReceived: 133.39 MB (139871182) - ConvertRowBatchTime: 238.026ms - DeserializeRowBatchTimer: 391.322ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 5.14 M/sec - SendersBlockedTimer: 11s036ms - SendersBlockedTotalTimer(*): 11s036ms AGGREGATION_NODE (id=13):(Total: 40s549ms, non-child: 3s115ms, % non-child: 7.68%) ExecOption: Codegen Enabled - BuildTime: 2s385ms - GetNewBlockTime: 294.653us - GetResultsTime: 705.602ms - HTResizeTime: 854.398ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 327.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.088us EXCHANGE_NODE (id=12):(Total: 37s433ms, non-child: 369.228ms, % non-child: 0.99%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21.25 MB, 54.45 MB, 87.98 MB, 121.31 MB - BytesReceived: 133.39 MB (139868405) - ConvertRowBatchTime: 321.029ms - DeserializeRowBatchTimer: 233.180ms - FirstBatchArrivalWaitTime: 35s265ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 354.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5aa (host=vb0228.halxg.cloudera.com:22000):(Total: 58s391ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.80 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 126.53 MB, 334.20 MB, 530.07 MB, 736.07 MB, 810.77 MB, 744.21 MB, 646.97 MB, 549.71 MB, 403.84 MB, 355.23 MB, 257.96 MB, 112.08 MB, 146.06 MB, 327.92 MB, 526.34 MB, 744.09 MB, 806.15 MB, 748.02 MB, 627.71 MB, 507.39 MB, 411.14 MB, 266.76 MB, 89.35 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.86 GB (4146282224) - PrepareTime: 196.343ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 18s755ms - TotalNetworkReceiveTime: 38s918ms - TotalNetworkSendTime: 1s156ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 591.174ms, non-child: 591.174ms, % non-child: 100.00%) - CodegenTime: 3.146ms - CompileTime: 40.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 357.990ms - PrepareTime: 180.555ms DataStreamSender (dst_id=18):(Total: 6s665ms, non-child: 6s665ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297606148) - NetworkThroughput(*): 57.29 MB/sec - OverallThroughput: 42.58 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s462ms - ThriftTransmitTime(*): 4s953ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 51s678ms, non-child: 4s581ms, % non-child: 8.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 183.491us - GetResultsTime: 147.245ms - HTResizeTime: 132.138ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 509.80 K/sec - StreamingTime: 4s174ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s096ms, non-child: 1s540ms, % non-child: 3.27%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 564.06 K/sec AGGREGATION_NODE (id=17):(Total: 4s873ms, non-child: 3s276ms, % non-child: 67.24%) ExecOption: Codegen Enabled - BuildTime: 2s580ms - GetNewBlockTime: 309.551us - GetResultsTime: 643.276ms - HTResizeTime: 1s019ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 2.73 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 990.000ns EXCHANGE_NODE (id=16):(Total: 1s596ms, non-child: 420.878ms, % non-child: 26.36%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.14 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 23.73 MB, 54.06 MB, 86.56 MB, 124.07 MB - BytesReceived: 133.34 MB (139813252) - ConvertRowBatchTime: 359.089ms - DeserializeRowBatchTimer: 305.629ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 8.32 M/sec - SendersBlockedTimer: 11s233ms - SendersBlockedTotalTimer(*): 11s233ms AGGREGATION_NODE (id=13):(Total: 40s682ms, non-child: 2s741ms, % non-child: 6.74%) ExecOption: Codegen Enabled - BuildTime: 1s948ms - GetNewBlockTime: 259.339us - GetResultsTime: 769.908ms - HTResizeTime: 754.411ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 326.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.130us EXCHANGE_NODE (id=12):(Total: 37s941ms, non-child: 269.776ms, % non-child: 0.71%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.09 MB, 51.95 MB, 86.46 MB, 121.09 MB - BytesReceived: 133.34 MB (139814875) - ConvertRowBatchTime: 235.196ms - DeserializeRowBatchTimer: 206.874ms - FirstBatchArrivalWaitTime: 35s335ms - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 350.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5b4 (host=vb0230.halxg.cloudera.com:22000):(Total: 58s341ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 129.25 MB, 319.76 MB, 497.61 MB, 691.48 MB, 810.77 MB, 744.20 MB, 646.96 MB, 549.69 MB, 403.84 MB, 306.59 MB, 209.34 MB, 93.98 MB, 235.32 MB, 420.86 MB, 610.08 MB, 759.90 MB, 806.16 MB, 699.91 MB, 603.64 MB, 507.38 MB, 435.22 MB, 290.84 MB, 141.95 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 184.856ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 18s456ms - TotalNetworkReceiveTime: 39s246ms - TotalNetworkSendTime: 1s102ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 608.593ms, non-child: 608.593ms, % non-child: 100.00%) - CodegenTime: 4.772ms - CompileTime: 62.408ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.267ms - PrepareTime: 171.274ms DataStreamSender (dst_id=18):(Total: 6s197ms, non-child: 6s197ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297739903) - NetworkThroughput(*): 60.32 MB/sec - OverallThroughput: 45.82 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s268ms - ThriftTransmitTime(*): 4s707ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 52s110ms, non-child: 4s817ms, % non-child: 9.24%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 186.223us - GetResultsTime: 85.050ms - HTResizeTime: 125.798ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 505.81 K/sec - StreamingTime: 4s493ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s293ms, non-child: 1s508ms, % non-child: 3.19%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 561.98 K/sec AGGREGATION_NODE (id=17):(Total: 5s209ms, non-child: 2s590ms, % non-child: 49.72%) ExecOption: Codegen Enabled - BuildTime: 1s919ms - GetNewBlockTime: 387.228us - GetResultsTime: 651.200ms - HTResizeTime: 747.262ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 2.55 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 963.000ns EXCHANGE_NODE (id=16):(Total: 2s619ms, non-child: 291.718ms, % non-child: 11.14%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.29 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 20.16 MB, 53.69 MB, 85.66 MB, 116.70 MB, 133.38 MB - BytesReceived: 133.38 MB (139864092) - ConvertRowBatchTime: 234.363ms - DeserializeRowBatchTimer: 379.104ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 10s923ms - SendersBlockedTotalTimer(*): 10s923ms AGGREGATION_NODE (id=13):(Total: 40s574ms, non-child: 3s285ms, % non-child: 8.10%) ExecOption: Codegen Enabled - BuildTime: 2s592ms - GetNewBlockTime: 240.521us - GetResultsTime: 670.604ms - HTResizeTime: 865.969ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 327.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.045us EXCHANGE_NODE (id=12):(Total: 37s289ms, non-child: 459.565ms, % non-child: 1.23%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.05 MB, 32.98 MB, 65.63 MB, 97.68 MB, 128.01 MB - BytesReceived: 133.39 MB (139864786) - ConvertRowBatchTime: 394.582ms - DeserializeRowBatchTimer: 254.597ms - FirstBatchArrivalWaitTime: 35s328ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 356.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a7 (host=vb0218.halxg.cloudera.com:22000):(Total: 57s776ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.17 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 130.20 MB, 303.73 MB, 489.61 MB, 683.48 MB, 810.79 MB, 744.18 MB, 622.65 MB, 501.08 MB, 355.20 MB, 209.33 MB, 117.83 MB, 287.46 MB, 499.61 MB, 719.67 MB, 792.14 MB, 792.14 MB, 810.15 MB, 723.97 MB, 579.59 MB, 459.26 MB, 314.90 MB, 218.65 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4116367584) - PrepareTime: 187.504ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 16s880ms - TotalNetworkReceiveTime: 40s303ms - TotalNetworkSendTime: 1s074ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 635.776ms, non-child: 635.776ms, % non-child: 100.00%) - CodegenTime: 3.350ms - CompileTime: 86.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 366.540ms - PrepareTime: 181.544ms DataStreamSender (dst_id=18):(Total: 5s296ms, non-child: 5s296ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297701762) - NetworkThroughput(*): 64.80 MB/sec - OverallThroughput: 53.60 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s892ms - ThriftTransmitTime(*): 4s381ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 52s453ms, non-child: 4s323ms, % non-child: 8.24%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 187.247us - GetResultsTime: 78.249ms - HTResizeTime: 114.959ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 502.44 K/sec - StreamingTime: 4s007ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 48s129ms, non-child: 1s232ms, % non-child: 2.56%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 552.13 K/sec AGGREGATION_NODE (id=17):(Total: 6s390ms, non-child: 2s604ms, % non-child: 40.76%) ExecOption: Codegen Enabled - BuildTime: 2s008ms - GetNewBlockTime: 340.484us - GetResultsTime: 577.786ms - HTResizeTime: 768.837ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.035us EXCHANGE_NODE (id=16):(Total: 3s786ms, non-child: 303.557ms, % non-child: 8.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.81 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 15.71 MB, 47.29 MB, 83.69 MB, 121.80 MB, 133.37 MB, 133.37 MB - BytesReceived: 133.37 MB (139849284) - ConvertRowBatchTime: 260.274ms - DeserializeRowBatchTimer: 219.712ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 3.51 M/sec - SendersBlockedTimer: 9s681ms - SendersBlockedTotalTimer(*): 9s681ms AGGREGATION_NODE (id=13):(Total: 40s505ms, non-child: 3s290ms, % non-child: 8.12%) ExecOption: Codegen Enabled - BuildTime: 2s634ms - GetNewBlockTime: 246.490us - GetResultsTime: 539.666ms - HTResizeTime: 873.015ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 328.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.091us EXCHANGE_NODE (id=12):(Total: 37s215ms, non-child: 475.904ms, % non-child: 1.28%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.31 MB, 48.41 MB, 80.12 MB, 112.04 MB - BytesReceived: 133.38 MB (139861801) - ConvertRowBatchTime: 407.040ms - DeserializeRowBatchTimer: 325.913ms - FirstBatchArrivalWaitTime: 35s301ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 357.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5b3 (host=vb0214.halxg.cloudera.com:22000):(Total: 57s511ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 76.68 MB, 287.73 MB, 494.20 MB, 679.49 MB, 810.79 MB, 719.90 MB, 525.39 MB, 379.51 MB, 233.63 MB, 92.41 MB, 242.98 MB, 433.12 MB, 614.73 MB, 776.13 MB, 792.14 MB, 792.14 MB, 804.16 MB, 699.90 MB, 531.47 MB, 363.01 MB, 218.64 MB, 117.64 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.86 GB (4145067752) - PrepareTime: 182.067ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 15s343ms - TotalNetworkReceiveTime: 41s793ms - TotalNetworkSendTime: 846.973ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 622.901ms, non-child: 622.901ms, % non-child: 100.00%) - CodegenTime: 2.958ms - CompileTime: 37.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 407.572ms - PrepareTime: 171.593ms DataStreamSender (dst_id=18):(Total: 5s059ms, non-child: 5s059ms, % non-child: 100.00%) - BytesSent: 283.88 MB (297664517) - NetworkThroughput(*): 80.71 MB/sec - OverallThroughput: 56.11 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s881ms - ThriftTransmitTime(*): 3s517ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 52s421ms, non-child: 3s493ms, % non-child: 6.67%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 133.461us - GetResultsTime: 154.964ms - HTResizeTime: 97.990ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255945) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 502.67 K/sec - StreamingTime: 3s113ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 48s927ms, non-child: 1s220ms, % non-child: 2.50%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 543.05 K/sec AGGREGATION_NODE (id=17):(Total: 7s316ms, non-child: 2s740ms, % non-child: 37.45%) ExecOption: Codegen Enabled - BuildTime: 2s192ms - GetNewBlockTime: 293.777us - GetResultsTime: 530.029ms - HTResizeTime: 868.363ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 1.82 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 894.000ns EXCHANGE_NODE (id=16):(Total: 4s576ms, non-child: 349.510ms, % non-child: 7.64%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.46 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 23.40 MB, 55.36 MB, 87.28 MB, 119.92 MB, 133.36 MB, 133.36 MB, 133.36 MB - BytesReceived: 133.36 MB (139839696) - ConvertRowBatchTime: 280.565ms - DeserializeRowBatchTimer: 396.209ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 2.90 M/sec - SendersBlockedTimer: 8s680ms - SendersBlockedTotalTimer(*): 8s680ms AGGREGATION_NODE (id=13):(Total: 40s390ms, non-child: 2s628ms, % non-child: 6.51%) ExecOption: Codegen Enabled - BuildTime: 2s112ms - GetNewBlockTime: 377.433us - GetResultsTime: 499.391ms - HTResizeTime: 825.415ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 328.92 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 912.000ns EXCHANGE_NODE (id=12):(Total: 37s761ms, non-child: 285.740ms, % non-child: 0.76%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.92 MB, 27.47 MB, 62.14 MB, 96.53 MB, 126.96 MB - BytesReceived: 133.36 MB (139837437) - ConvertRowBatchTime: 234.033ms - DeserializeRowBatchTimer: 418.492ms - FirstBatchArrivalWaitTime: 35s317ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 351.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5a9 (host=vb0224.halxg.cloudera.com:22000):(Total: 57s085ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 73.41 MB, 255.27 MB, 443.48 MB, 607.05 MB, 770.53 MB, 744.21 MB, 646.97 MB, 549.69 MB, 452.48 MB, 355.22 MB, 185.02 MB, 133.54 MB, 291.44 MB, 477.71 MB, 662.05 MB, 784.14 MB, 794.53 MB, 723.96 MB, 555.54 MB, 387.08 MB, 242.71 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 187.310ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 16s705ms - TotalNetworkReceiveTime: 39s768ms - TotalNetworkSendTime: 1s033ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 573.387ms, non-child: 573.387ms, % non-child: 100.00%) - CodegenTime: 3.095ms - CompileTime: 39.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 350.964ms - PrepareTime: 179.644ms DataStreamSender (dst_id=18):(Total: 5s654ms, non-child: 5s654ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297803429) - NetworkThroughput(*): 62.62 MB/sec - OverallThroughput: 50.23 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s023ms - ThriftTransmitTime(*): 4s535ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 51s401ms, non-child: 3s847ms, % non-child: 7.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 154.496us - GetResultsTime: 132.808ms - HTResizeTime: 124.972ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 512.87 K/sec - StreamingTime: 3s472ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s553ms, non-child: 1s292ms, % non-child: 2.72%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 558.99 K/sec AGGREGATION_NODE (id=17):(Total: 5s639ms, non-child: 2s946ms, % non-child: 52.26%) ExecOption: Codegen Enabled - BuildTime: 2s408ms - GetNewBlockTime: 266.865us - GetResultsTime: 516.017ms - HTResizeTime: 989.877ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 2.36 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1000.000ns EXCHANGE_NODE (id=16):(Total: 2s692ms, non-child: 353.611ms, % non-child: 13.13%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.91 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 32.80 MB, 63.37 MB, 94.07 MB, 125.09 MB, 133.42 MB - BytesReceived: 133.42 MB (139896261) - ConvertRowBatchTime: 305.316ms - DeserializeRowBatchTimer: 256.124ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 4.94 M/sec - SendersBlockedTimer: 10s300ms - SendersBlockedTotalTimer(*): 10s300ms AGGREGATION_NODE (id=13):(Total: 40s622ms, non-child: 2s911ms, % non-child: 7.17%) ExecOption: Codegen Enabled - BuildTime: 2s227ms - GetNewBlockTime: 234.750us - GetResultsTime: 662.837ms - HTResizeTime: 766.274ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 327.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.328us EXCHANGE_NODE (id=12):(Total: 37s710ms, non-child: 343.896ms, % non-child: 0.91%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.69 MB, 25.35 MB, 55.02 MB, 84.41 MB, 112.88 MB - BytesReceived: 133.42 MB (139901333) - ConvertRowBatchTime: 302.227ms - DeserializeRowBatchTimer: 286.753ms - FirstBatchArrivalWaitTime: 35s365ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 352.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704a43b40e790124:4123ec6c75fea5ac (host=vb0206.halxg.cloudera.com:22000):(Total: 56s691ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 96.33 MB, 288.31 MB, 445.16 MB, 624.04 MB, 787.29 MB, 695.60 MB, 525.40 MB, 355.24 MB, 233.67 MB, 92.75 MB, 268.82 MB, 469.40 MB, 656.70 MB, 784.15 MB, 792.14 MB, 792.14 MB, 806.18 MB, 675.84 MB, 531.45 MB, 387.07 MB, 218.63 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 193.354ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 14s276ms - TotalNetworkReceiveTime: 41s897ms - TotalNetworkSendTime: 1s074ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 717.353ms, non-child: 717.353ms, % non-child: 100.00%) - CodegenTime: 3.434ms - CompileTime: 66.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 462.476ms - PrepareTime: 187.025ms DataStreamSender (dst_id=18):(Total: 4s773ms, non-child: 4s773ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297763007) - NetworkThroughput(*): 65.97 MB/sec - OverallThroughput: 59.49 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s577ms - ThriftTransmitTime(*): 4s304ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 51s885ms, non-child: 3s281ms, % non-child: 6.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 215.013us - GetResultsTime: 88.386ms - HTResizeTime: 98.982ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 508.02 K/sec - StreamingTime: 2s956ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 48s604ms, non-child: 1s103ms, % non-child: 2.27%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 546.83 K/sec AGGREGATION_NODE (id=17):(Total: 7s218ms, non-child: 2s612ms, % non-child: 36.19%) ExecOption: Codegen Enabled - BuildTime: 2s117ms - GetNewBlockTime: 314.179us - GetResultsTime: 477.380ms - HTResizeTime: 891.297ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 1.84 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.014us EXCHANGE_NODE (id=16):(Total: 4s605ms, non-child: 298.021ms, % non-child: 6.47%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.91 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.70 MB, 58.15 MB, 92.06 MB, 124.92 MB, 133.39 MB, 133.39 MB, 133.39 MB - BytesReceived: 133.39 MB (139869574) - ConvertRowBatchTime: 236.750ms - DeserializeRowBatchTimer: 384.970ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 2.89 M/sec - SendersBlockedTimer: 8s712ms - SendersBlockedTotalTimer(*): 8s712ms AGGREGATION_NODE (id=13):(Total: 40s282ms, non-child: 2s493ms, % non-child: 6.19%) ExecOption: Codegen Enabled - BuildTime: 1s988ms - GetNewBlockTime: 266.437us - GetResultsTime: 486.263ms - HTResizeTime: 706.241ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 329.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.104us EXCHANGE_NODE (id=12):(Total: 37s788ms, non-child: 284.664ms, % non-child: 0.75%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.23 MB, 28.28 MB, 57.66 MB, 87.14 MB, 117.27 MB - BytesReceived: 133.39 MB (139871995) - ConvertRowBatchTime: 231.916ms - DeserializeRowBatchTimer: 390.900ms - FirstBatchArrivalWaitTime: 35s236ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 351.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance 704a43b40e790124:4123ec6c75fea5be (host=vb0216.halxg.cloudera.com:22000):(Total: 51s713ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.82 MB, 228.20 MB, 356.17 MB, 484.19 MB, 548.20 MB, 692.17 MB, 868.15 MB, 1.07 GB, 1.15 GB, 1.15 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.84 GB, 1.90 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.02 MB, 485.76 MB, 291.53 MB, 121.55 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070227968) - PerHostPeakMemUsage: 3.83 GB (4111212800) - PrepareTime: 180.455ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 36s091ms - TotalNetworkReceiveTime: 11s968ms - TotalNetworkSendTime: 11s642ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 649.204ms, non-child: 649.204ms, % non-child: 100.00%) - CodegenTime: 825.252us - CompileTime: 67.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 404.351ms - PrepareTime: 168.468ms DataStreamSender (dst_id=16):(Total: 15s268ms, non-child: 15s268ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139880967) - NetworkThroughput(*): 9.57 MB/sec - OverallThroughput: 8.74 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 810.596ms - ThriftTransmitTime(*): 13s932ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=8):(Total: 36s427ms, non-child: 9s023ms, % non-child: 24.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 588.269us - GetResultsTime: 459.684ms - HTResizeTime: 1s003ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 364.80 K/sec - StreamingTime: 8s273ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s404ms, non-child: 13s670ms, % non-child: 49.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s251ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s801ms - GetNewBlockTime: 1.234ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s990ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 1.88 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.194us EXCHANGE_NODE (id=15):(Total: 3s961ms, non-child: 598.258ms, % non-child: 15.10%) BytesReceived(1s000ms): 8.00 MB, 67.36 MB, 136.81 MB, 207.99 MB, 270.27 MB, 295.81 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB - BytesReceived: 298.19 MB (312676062) - ConvertRowBatchTime: 270.250ms - DeserializeRowBatchTimer: 1s087ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s772ms, non-child: 3s240ms, % non-child: 33.16%) BytesReceived(1s000ms): 5.07 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.18 MB, 34.32 MB, 76.17 MB, 120.27 MB, 152.34 MB, 188.92 MB, 227.26 MB, 261.80 MB, 305.37 MB, 344.91 MB, 390.63 MB, 441.73 MB, 479.07 MB, 511.99 MB, 543.03 MB, 582.18 MB, 621.93 MB, 662.19 MB, 700.67 MB, 750.98 MB, 798.67 MB, 835.48 MB, 873.01 MB, 915.08 MB, 961.47 MB, 1001.22 MB, 1.02 GB, 1.05 GB - BytesReceived: 1.07 GB (1145690815) - ConvertRowBatchTime: 1s309ms - DeserializeRowBatchTimer: 6s254ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 5.28 M/sec - SendersBlockedTimer: 7s416ms - SendersBlockedTotalTimer(*): 1m43s Instance 704a43b40e790124:4123ec6c75fea5b7 (host=vb0230.halxg.cloudera.com:22000):(Total: 51s388ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.42 MB, 164.19 MB, 292.24 MB, 420.22 MB, 548.23 MB, 676.18 MB, 788.15 MB, 1.00 GB, 1.15 GB, 1.16 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.20 MB, 242.96 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.13 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072429568) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 197.086ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 34s547ms - TotalNetworkReceiveTime: 13s475ms - TotalNetworkSendTime: 11s287ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 694.929ms, non-child: 694.929ms, % non-child: 100.00%) - CodegenTime: 929.806us - CompileTime: 54.017ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 449.282ms - PrepareTime: 182.747ms DataStreamSender (dst_id=16):(Total: 14s976ms, non-child: 14s976ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139941224) - NetworkThroughput(*): 9.70 MB/sec - OverallThroughput: 8.91 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 773.496ms - ThriftTransmitTime(*): 13s757ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=8):(Total: 36s393ms, non-child: 8s962ms, % non-child: 24.63%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.235ms - GetResultsTime: 460.222ms - HTResizeTime: 1s067ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 365.28 K/sec - StreamingTime: 8s208ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s431ms, non-child: 12s249ms, % non-child: 44.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s235ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s766ms - GetNewBlockTime: 1.727ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s638ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 1.88 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.768us EXCHANGE_NODE (id=15):(Total: 3s924ms, non-child: 577.866ms, % non-child: 14.73%) BytesReceived(1s000ms): 19.13 MB, 86.42 MB, 156.46 MB, 227.56 MB, 281.30 MB, 297.74 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB - BytesReceived: 298.28 MB (312773424) - ConvertRowBatchTime: 282.069ms - DeserializeRowBatchTimer: 1s021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 11s257ms, non-child: 2s542ms, % non-child: 22.59%) BytesReceived(1s000ms): 6.71 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.17 MB, 12.13 MB, 46.60 MB, 89.24 MB, 126.91 MB, 160.38 MB, 199.22 MB, 236.65 MB, 274.42 MB, 317.25 MB, 357.24 MB, 406.04 MB, 455.00 MB, 489.89 MB, 519.88 MB, 554.48 MB, 593.65 MB, 634.16 MB, 673.48 MB, 715.48 MB, 765.86 MB, 809.21 MB, 846.08 MB, 883.55 MB, 929.13 MB, 973.18 MB, 1015.03 MB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1146201215) - ConvertRowBatchTime: 1s253ms - DeserializeRowBatchTimer: 5s283ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 4.59 M/sec - SendersBlockedTimer: 7s451ms - SendersBlockedTotalTimer(*): 1m50s Instance 704a43b40e790124:4123ec6c75fea5ba (host=vb0234.halxg.cloudera.com:22000):(Total: 51s245ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 808.00 KB, 164.15 MB, 292.19 MB, 420.19 MB, 548.20 MB, 676.17 MB, 772.13 MB, 1012.13 MB, 1.15 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.73 GB, 1.91 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 534.34 MB, 315.80 MB, 97.25 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072455168) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 179.691ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 35s419ms - TotalNetworkReceiveTime: 12s165ms - TotalNetworkSendTime: 11s555ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 612.081ms, non-child: 612.081ms, % non-child: 100.00%) - CodegenTime: 847.273us - CompileTime: 65.586ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 369.795ms - PrepareTime: 168.595ms DataStreamSender (dst_id=16):(Total: 14s770ms, non-child: 14s770ms, % non-child: 100.00%) - BytesSent: 133.47 MB (139957897) - NetworkThroughput(*): 10.11 MB/sec - OverallThroughput: 9.04 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 724.641ms - ThriftTransmitTime(*): 13s199ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=8):(Total: 36s447ms, non-child: 9s341ms, % non-child: 25.63%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 648.143us - GetResultsTime: 457.301ms - HTResizeTime: 1s075ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 364.81 K/sec - StreamingTime: 8s597ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s106ms, non-child: 13s156ms, % non-child: 48.54%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s294ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s638ms - GetNewBlockTime: 1.281ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s511ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.379us EXCHANGE_NODE (id=15):(Total: 3s939ms, non-child: 577.196ms, % non-child: 14.65%) BytesReceived(1s000ms): 12.01 MB, 75.81 MB, 145.24 MB, 216.69 MB, 275.39 MB, 296.92 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB - BytesReceived: 298.39 MB (312887486) - ConvertRowBatchTime: 268.635ms - DeserializeRowBatchTimer: 1s032ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 3.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s010ms, non-child: 2s764ms, % non-child: 27.61%) BytesReceived(1s000ms): 5.09 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 39.37 MB, 81.69 MB, 122.30 MB, 158.33 MB, 193.54 MB, 231.22 MB, 268.66 MB, 310.26 MB, 349.67 MB, 397.38 MB, 447.05 MB, 483.41 MB, 514.74 MB, 547.68 MB, 586.81 MB, 626.88 MB, 666.88 MB, 706.86 MB, 756.46 MB, 803.49 MB, 840.46 MB, 878.00 MB, 921.59 MB, 967.39 MB, 1007.66 MB, 1.02 GB, 1.06 GB - BytesReceived: 1.07 GB (1146481649) - ConvertRowBatchTime: 1s338ms - DeserializeRowBatchTimer: 5s298ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 5.16 M/sec - SendersBlockedTimer: 7s773ms - SendersBlockedTotalTimer(*): 1m39s Instance 704a43b40e790124:4123ec6c75fea5b9 (host=vb0212.halxg.cloudera.com:22000):(Total: 51s239ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 78.87 MB, 228.21 MB, 352.21 MB, 484.29 MB, 548.21 MB, 676.20 MB, 820.15 MB, 1012.15 MB, 1.13 GB, 1.15 GB, 1.30 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.60 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.90 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.46 MB, 485.77 MB, 291.52 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071021568) - PerHostPeakMemUsage: 3.86 GB (4145505000) - PrepareTime: 202.581ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 38s024ms - TotalNetworkReceiveTime: 10s346ms - TotalNetworkSendTime: 11s352ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 647.759ms, non-child: 647.759ms, % non-child: 100.00%) - CodegenTime: 2.510ms - CompileTime: 52.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 402.390ms - PrepareTime: 178.386ms DataStreamSender (dst_id=16):(Total: 14s704ms, non-child: 14s704ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139813252) - NetworkThroughput(*): 9.87 MB/sec - OverallThroughput: 9.07 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 825.960ms - ThriftTransmitTime(*): 13s511ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=8):(Total: 36s514ms, non-child: 9s291ms, % non-child: 25.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 4.504ms - GetResultsTime: 529.258ms - HTResizeTime: 989.899ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 363.76 K/sec - StreamingTime: 8s439ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s222ms, non-child: 14s920ms, % non-child: 54.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s513ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 2s240ms - GetNewBlockTime: 1.105ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s451ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 1.90 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.002us EXCHANGE_NODE (id=15):(Total: 3s688ms, non-child: 707.742ms, % non-child: 19.19%) BytesReceived(1s000ms): 3.52 MB, 57.56 MB, 126.57 MB, 197.50 MB, 263.18 MB, 294.28 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB - BytesReceived: 298.06 MB (312543510) - ConvertRowBatchTime: 308.987ms - DeserializeRowBatchTimer: 1s208ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 3.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s614ms, non-child: 3s195ms, % non-child: 37.10%) BytesReceived(1s000ms): 3.41 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 28.75 MB, 69.31 MB, 114.46 MB, 145.84 MB, 180.85 MB, 222.17 MB, 255.30 MB, 299.89 MB, 339.48 MB, 383.14 MB, 435.44 MB, 474.26 MB, 507.88 MB, 537.07 MB, 576.23 MB, 615.61 MB, 656.38 MB, 694.91 MB, 744.36 MB, 792.74 MB, 829.71 MB, 866.73 MB, 907.93 MB, 954.54 MB, 993.88 MB, 1.01 GB, 1.05 GB - BytesReceived: 1.07 GB (1145448486) - ConvertRowBatchTime: 1s453ms - DeserializeRowBatchTimer: 6s260ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 5.99 M/sec - SendersBlockedTimer: 7s868ms - SendersBlockedTotalTimer(*): 1m35s Instance 704a43b40e790124:4123ec6c75fea5bc (host=vb0226.halxg.cloudera.com:22000):(Total: 51s181ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 81.77 MB, 228.23 MB, 356.19 MB, 484.20 MB, 548.19 MB, 676.18 MB, 820.15 MB, 1012.15 MB, 1.13 GB, 1.16 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.62 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.81 GB, 1.89 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.46 MB, 437.21 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070970368) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 211.662ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 37s468ms - TotalNetworkReceiveTime: 11s083ms - TotalNetworkSendTime: 11s219ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 697.257ms, non-child: 697.257ms, % non-child: 100.00%) - CodegenTime: 1.399ms - CompileTime: 53.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 449.132ms - PrepareTime: 180.512ms DataStreamSender (dst_id=16):(Total: 14s742ms, non-child: 14s742ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139871182) - NetworkThroughput(*): 9.74 MB/sec - OverallThroughput: 9.05 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 862.704ms - ThriftTransmitTime(*): 13s696ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=8):(Total: 36s422ms, non-child: 9s742ms, % non-child: 26.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.944ms - GetResultsTime: 489.240ms - HTResizeTime: 1s074ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 364.79 K/sec - StreamingTime: 8s927ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s680ms, non-child: 13s740ms, % non-child: 51.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s304ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 2s382ms - GetNewBlockTime: 1.504ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s369ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.046us EXCHANGE_NODE (id=15):(Total: 3s837ms, non-child: 658.813ms, % non-child: 17.17%) BytesReceived(1s000ms): 4.70 MB, 60.52 MB, 129.53 MB, 200.49 MB, 265.42 MB, 294.76 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB - BytesReceived: 298.12 MB (312601103) - ConvertRowBatchTime: 304.893ms - DeserializeRowBatchTimer: 1s148ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 3.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s102ms, non-child: 2s857ms, % non-child: 31.39%) BytesReceived(1s000ms): 4.60 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 30.51 MB, 71.25 MB, 117.02 MB, 147.87 MB, 182.18 MB, 223.44 MB, 256.31 MB, 301.46 MB, 340.85 MB, 385.15 MB, 437.06 MB, 474.92 MB, 509.37 MB, 538.81 MB, 578.03 MB, 617.53 MB, 658.07 MB, 696.53 MB, 746.52 MB, 794.67 MB, 831.34 MB, 868.30 MB, 909.94 MB, 956.11 MB, 996.07 MB, 1.02 GB, 1.05 GB - BytesReceived: 1.07 GB (1145648168) - ConvertRowBatchTime: 1s362ms - DeserializeRowBatchTimer: 5s367ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 5.67 M/sec - SendersBlockedTimer: 8s288ms - SendersBlockedTotalTimer(*): 1m31s Instance 704a43b40e790124:4123ec6c75fea5c3 (host=vb0222.halxg.cloudera.com:22000):(Total: 51s008ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 32.40 MB, 164.16 MB, 292.23 MB, 420.16 MB, 548.17 MB, 676.17 MB, 836.13 MB, 1.05 GB, 1.15 GB, 1.16 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.60 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.58 MB, 582.88 MB, 388.65 MB, 194.38 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070688768) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 184.548ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 36s435ms - TotalNetworkReceiveTime: 11s160ms - TotalNetworkSendTime: 11s241ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 652.132ms, non-child: 652.132ms, % non-child: 100.00%) - CodegenTime: 817.924us - CompileTime: 72.637ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 398.462ms - PrepareTime: 179.400ms DataStreamSender (dst_id=16):(Total: 14s514ms, non-child: 14s514ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139864092) - NetworkThroughput(*): 9.84 MB/sec - OverallThroughput: 9.19 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 905.676ms - ThriftTransmitTime(*): 13s549ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=8):(Total: 36s479ms, non-child: 10s387ms, % non-child: 28.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.017ms - GetResultsTime: 484.405ms - HTResizeTime: 1s044ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 364.29 K/sec - StreamingTime: 9s555ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s091ms, non-child: 12s896ms, % non-child: 49.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s295ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s617ms - GetNewBlockTime: 2.063ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s299ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 1.98 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.150us EXCHANGE_NODE (id=15):(Total: 3s913ms, non-child: 602.553ms, % non-child: 15.40%) BytesReceived(1s000ms): 2.44 MB, 54.63 MB, 123.68 MB, 194.54 MB, 260.90 MB, 293.90 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB - BytesReceived: 298.16 MB (312644567) - ConvertRowBatchTime: 294.687ms - DeserializeRowBatchTimer: 1s052ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s281ms, non-child: 4s001ms, % non-child: 43.12%) BytesReceived(1s000ms): 2.40 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.16 MB, 26.97 MB, 67.35 MB, 112.00 MB, 144.81 MB, 179.55 MB, 220.72 MB, 254.63 MB, 298.21 MB, 338.09 MB, 381.27 MB, 433.68 MB, 473.60 MB, 506.65 MB, 535.79 MB, 575.08 MB, 614.50 MB, 655.29 MB, 693.73 MB, 742.55 MB, 791.42 MB, 828.85 MB, 865.83 MB, 906.55 MB, 953.88 MB, 992.30 MB, 1.01 GB, 1.05 GB - BytesReceived: 1.07 GB (1145947717) - ConvertRowBatchTime: 1s522ms - DeserializeRowBatchTimer: 5s950ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.56 M/sec - SendersBlockedTimer: 14s960ms - SendersBlockedTotalTimer(*): 3m6s Instance 704a43b40e790124:4123ec6c75fea5c0 (host=vb0220.halxg.cloudera.com:22000):(Total: 50s945ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 833.00 KB, 164.29 MB, 292.20 MB, 420.23 MB, 548.25 MB, 676.19 MB, 756.15 MB, 996.15 MB, 1.12 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.34 GB, 1.34 GB, 1.35 GB, 1.38 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.73 GB, 1.90 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068743168) - PerHostPeakMemUsage: 3.83 GB (4109676800) - PrepareTime: 191.343ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 37s552ms - TotalNetworkReceiveTime: 10s609ms - TotalNetworkSendTime: 11s000ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 691.989ms, non-child: 691.989ms, % non-child: 100.00%) - CodegenTime: 896.982us - CompileTime: 54.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 449.569ms - PrepareTime: 180.071ms DataStreamSender (dst_id=16):(Total: 14s515ms, non-child: 14s515ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139863920) - NetworkThroughput(*): 10.48 MB/sec - OverallThroughput: 9.19 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 728.896ms - ThriftTransmitTime(*): 12s724ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=8):(Total: 36s409ms, non-child: 9s522ms, % non-child: 26.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 651.336us - GetResultsTime: 470.005ms - HTResizeTime: 1s026ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 364.97 K/sec - StreamingTime: 8s742ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s886ms, non-child: 14s242ms, % non-child: 52.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s975ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s990ms - GetNewBlockTime: 1.964ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s591ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.076us EXCHANGE_NODE (id=15):(Total: 3s182ms, non-child: 904.208ms, % non-child: 28.42%) BytesReceived(1s000ms): 12.14 MB, 76.06 MB, 145.49 MB, 216.85 MB, 275.32 MB, 296.72 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB - BytesReceived: 298.17 MB (312652823) - ConvertRowBatchTime: 468.530ms - DeserializeRowBatchTimer: 1s243ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 4.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s462ms, non-child: 3s110ms, % non-child: 32.88%) BytesReceived(1s000ms): 5.08 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB, 10.14 MB, 39.62 MB, 81.98 MB, 122.66 MB, 158.75 MB, 193.86 MB, 231.56 MB, 269.04 MB, 310.54 MB, 349.82 MB, 397.60 MB, 447.34 MB, 483.62 MB, 514.87 MB, 547.76 MB, 586.89 MB, 626.89 MB, 666.79 MB, 706.77 MB, 756.20 MB, 803.07 MB, 839.94 MB, 877.29 MB, 920.94 MB, 966.77 MB, 1007.03 MB, 1.02 GB, 1.06 GB - BytesReceived: 1.07 GB (1145683454) - ConvertRowBatchTime: 1s360ms - DeserializeRowBatchTimer: 5s961ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.45 M/sec - SendersBlockedTimer: 8s626ms - SendersBlockedTotalTimer(*): 1m22s Instance 704a43b40e790124:4123ec6c75fea5bf (host=vb0206.halxg.cloudera.com:22000):(Total: 50s858ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.38 MB, 164.20 MB, 296.71 MB, 421.17 MB, 548.23 MB, 676.15 MB, 820.13 MB, 980.13 MB, 1.12 GB, 1.16 GB, 1.30 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 582.88 MB, 388.63 MB, 194.40 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070099968) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 198.782ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 37s263ms - TotalNetworkReceiveTime: 11s104ms - TotalNetworkSendTime: 10s833ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 797.029ms, non-child: 797.029ms, % non-child: 100.00%) - CodegenTime: 926.144us - CompileTime: 75.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 526.684ms - PrepareTime: 187.686ms DataStreamSender (dst_id=16):(Total: 14s543ms, non-child: 14s543ms, % non-child: 100.00%) - BytesSent: 133.43 MB (139907128) - NetworkThroughput(*): 10.08 MB/sec - OverallThroughput: 9.17 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 806.004ms - ThriftTransmitTime(*): 13s233ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=8):(Total: 36s296ms, non-child: 8s824ms, % non-child: 24.31%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 649.186us - GetResultsTime: 458.329ms - HTResizeTime: 1s013ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 366.19 K/sec - StreamingTime: 8s068ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s472ms, non-child: 14s566ms, % non-child: 53.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s034ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 2s101ms - GetNewBlockTime: 2.720ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s732ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.88 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.526us EXCHANGE_NODE (id=15):(Total: 3s011ms, non-child: 1s297ms, % non-child: 43.10%) BytesReceived(1s000ms): 19.11 MB, 86.38 MB, 156.40 MB, 227.47 MB, 281.21 MB, 297.68 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB - BytesReceived: 298.23 MB (312721306) - ConvertRowBatchTime: 444.239ms - DeserializeRowBatchTimer: 1s688ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 4.54 M/sec - SendersBlockedTimer: 2.700ms - SendersBlockedTotalTimer(*): 9.333ms EXCHANGE_NODE (id=14):(Total: 9s894ms, non-child: 2s463ms, % non-child: 24.90%) BytesReceived(1s000ms): 6.69 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.15 MB, 12.12 MB, 46.62 MB, 89.28 MB, 126.87 MB, 160.31 MB, 199.06 MB, 236.64 MB, 274.40 MB, 316.99 MB, 356.92 MB, 405.74 MB, 454.43 MB, 489.32 MB, 519.43 MB, 554.08 MB, 593.21 MB, 633.66 MB, 673.12 MB, 715.19 MB, 765.57 MB, 808.89 MB, 845.80 MB, 883.22 MB, 928.82 MB, 972.95 MB, 1014.84 MB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1146231911) - ConvertRowBatchTime: 1s165ms - DeserializeRowBatchTimer: 5s001ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 7s745ms - SendersBlockedTotalTimer(*): 1m48s Instance 704a43b40e790124:4123ec6c75fea5b8 (host=vb0214.halxg.cloudera.com:22000):(Total: 50s639ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.90 MB, 164.19 MB, 292.21 MB, 420.19 MB, 548.20 MB, 676.18 MB, 788.15 MB, 1012.15 MB, 1.15 GB, 1.15 GB, 1.29 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.34 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.73 GB, 1.90 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.03 MB, 534.34 MB, 340.08 MB, 145.82 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070586368) - PerHostPeakMemUsage: 3.86 GB (4145067752) - PrepareTime: 194.551ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 35s684ms - TotalNetworkReceiveTime: 12s376ms - TotalNetworkSendTime: 10s457ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 625.456ms, non-child: 625.456ms, % non-child: 100.00%) - CodegenTime: 878.007us - CompileTime: 43.310ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 390.905ms - PrepareTime: 183.625ms DataStreamSender (dst_id=16):(Total: 14s165ms, non-child: 14s165ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139896261) - NetworkThroughput(*): 10.50 MB/sec - OverallThroughput: 9.42 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 809.852ms - ThriftTransmitTime(*): 12s702ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=8):(Total: 36s450ms, non-child: 9s176ms, % non-child: 25.18%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 543.804us - GetResultsTime: 457.793ms - HTResizeTime: 1s024ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 364.63 K/sec - StreamingTime: 8s415ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s274ms, non-child: 13s004ms, % non-child: 47.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s287ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s718ms - GetNewBlockTime: 1.208ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s370ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.592us EXCHANGE_NODE (id=15):(Total: 3s933ms, non-child: 705.556ms, % non-child: 17.94%) BytesReceived(1s000ms): 14.24 MB, 79.50 MB, 149.15 MB, 220.52 MB, 277.34 MB, 297.11 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB - BytesReceived: 298.19 MB (312673528) - ConvertRowBatchTime: 300.150ms - DeserializeRowBatchTimer: 1s217ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 3.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s336ms, non-child: 3s128ms, % non-child: 30.27%) BytesReceived(1s000ms): 5.29 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.21 MB, 42.35 MB, 84.60 MB, 124.41 MB, 160.11 MB, 196.90 MB, 233.45 MB, 270.61 MB, 312.93 MB, 352.37 MB, 400.41 MB, 450.20 MB, 485.94 MB, 516.21 MB, 550.21 MB, 589.40 MB, 629.72 MB, 669.40 MB, 709.89 MB, 759.59 MB, 805.43 MB, 842.46 MB, 879.82 MB, 924.19 MB, 969.44 MB, 1010.17 MB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1146236308) - ConvertRowBatchTime: 1s404ms - DeserializeRowBatchTimer: 5s844ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.00 M/sec - SendersBlockedTimer: 7s387ms - SendersBlockedTotalTimer(*): 1m50s Instance 704a43b40e790124:4123ec6c75fea5c4 (host=vb0218.halxg.cloudera.com:22000):(Total: 50s506ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 12.98 MB, 164.20 MB, 292.19 MB, 420.25 MB, 548.17 MB, 676.16 MB, 772.13 MB, 948.13 MB, 1.11 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.78 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.31 MB, 534.32 MB, 340.07 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069024768) - PerHostPeakMemUsage: 3.83 GB (4116367584) - PrepareTime: 199.149ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 37s996ms - TotalNetworkReceiveTime: 10s587ms - TotalNetworkSendTime: 10s551ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 670.273ms, non-child: 670.273ms, % non-child: 100.00%) - CodegenTime: 870.574us - CompileTime: 46.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 428.246ms - PrepareTime: 182.416ms DataStreamSender (dst_id=16):(Total: 14s062ms, non-child: 14s062ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139856260) - NetworkThroughput(*): 10.45 MB/sec - OverallThroughput: 9.48 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 730.561ms - ThriftTransmitTime(*): 12s768ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=8):(Total: 36s427ms, non-child: 9s392ms, % non-child: 25.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 539.285us - GetResultsTime: 456.876ms - HTResizeTime: 929.080ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 364.77 K/sec - StreamingTime: 8s610ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s034ms, non-child: 14s385ms, % non-child: 53.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s786ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 2s404ms - GetNewBlockTime: 1.224ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s501ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.513us EXCHANGE_NODE (id=15):(Total: 3s398ms, non-child: 821.851ms, % non-child: 24.18%) BytesReceived(1s000ms): 19.65 MB, 87.04 MB, 157.08 MB, 228.14 MB, 281.52 MB, 297.66 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB - BytesReceived: 298.16 MB (312647635) - ConvertRowBatchTime: 408.856ms - DeserializeRowBatchTimer: 1s233ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 4.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s250ms, non-child: 3s801ms, % non-child: 41.10%) BytesReceived(1s000ms): 6.91 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 12.39 MB, 47.07 MB, 89.81 MB, 127.38 MB, 160.68 MB, 199.55 MB, 236.79 MB, 274.83 MB, 317.45 MB, 357.50 MB, 406.25 MB, 454.99 MB, 489.71 MB, 519.94 MB, 554.51 MB, 593.59 MB, 634.10 MB, 673.52 MB, 715.75 MB, 766.22 MB, 809.35 MB, 846.28 MB, 883.71 MB, 929.45 MB, 973.21 MB, 1015.09 MB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1145774491) - ConvertRowBatchTime: 1s439ms - DeserializeRowBatchTimer: 6s510ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 5.58 M/sec - SendersBlockedTimer: 13s075ms - SendersBlockedTotalTimer(*): 2m58s Instance 704a43b40e790124:4123ec6c75fea5bd (host=vb0232.halxg.cloudera.com:22000):(Total: 50s154ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.80 MB, 228.19 MB, 356.20 MB, 484.21 MB, 548.21 MB, 692.17 MB, 868.15 MB, 1.05 GB, 1.15 GB, 1.15 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.46 MB, 437.21 MB, 242.94 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072250368) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 199.822ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 35s432ms - TotalNetworkReceiveTime: 12s399ms - TotalNetworkSendTime: 10s363ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 692.310ms, non-child: 692.310ms, % non-child: 100.00%) - CodegenTime: 1.167ms - CompileTime: 57.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 438.674ms - PrepareTime: 184.316ms DataStreamSender (dst_id=16):(Total: 13s737ms, non-child: 13s737ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139945536) - NetworkThroughput(*): 10.79 MB/sec - OverallThroughput: 9.72 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 799.959ms - ThriftTransmitTime(*): 12s368ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=8):(Total: 36s400ms, non-child: 9s071ms, % non-child: 24.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 648.059us - GetResultsTime: 462.530ms - HTResizeTime: 1s056ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 365.23 K/sec - StreamingTime: 8s306ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s329ms, non-child: 13s210ms, % non-child: 48.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s193ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s814ms - GetNewBlockTime: 1.220ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s514ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.323us EXCHANGE_NODE (id=15):(Total: 3s967ms, non-child: 587.374ms, % non-child: 14.81%) BytesReceived(1s000ms): 7.58 MB, 66.48 MB, 135.99 MB, 207.16 MB, 269.79 MB, 295.85 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB, 298.33 MB - BytesReceived: 298.33 MB (312821113) - ConvertRowBatchTime: 268.876ms - DeserializeRowBatchTimer: 1s055ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 3.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s151ms, non-child: 2s694ms, % non-child: 26.55%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.14 MB, 34.19 MB, 75.58 MB, 119.95 MB, 151.90 MB, 188.01 MB, 226.72 MB, 261.07 MB, 304.96 MB, 344.47 MB, 390.05 MB, 441.29 MB, 478.62 MB, 511.70 MB, 542.51 MB, 581.74 MB, 621.57 MB, 661.91 MB, 700.45 MB, 750.79 MB, 798.43 MB, 835.29 MB, 872.85 MB, 914.97 MB, 961.32 MB, 1001.18 MB, 1.02 GB, 1.05 GB - BytesReceived: 1.07 GB (1146505046) - ConvertRowBatchTime: 1s277ms - DeserializeRowBatchTimer: 5s273ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 5.09 M/sec - SendersBlockedTimer: 7s428ms - SendersBlockedTotalTimer(*): 1m14s Instance 704a43b40e790124:4123ec6c75fea5c1 (host=vb0228.halxg.cloudera.com:22000):(Total: 50s000ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 10.83 MB, 164.18 MB, 292.25 MB, 422.46 MB, 548.19 MB, 676.17 MB, 836.13 MB, 1.04 GB, 1.15 GB, 1.16 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.34 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.77 GB, 1.89 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.21 MB, 194.38 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071712768) - PerHostPeakMemUsage: 3.86 GB (4146282224) - PrepareTime: 205.886ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 36s417ms - TotalNetworkReceiveTime: 11s337ms - TotalNetworkSendTime: 10s131ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 595.536ms, non-child: 595.536ms, % non-child: 100.00%) - CodegenTime: 2.001ms - CompileTime: 38.720ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 363.240ms - PrepareTime: 179.339ms DataStreamSender (dst_id=16):(Total: 13s493ms, non-child: 13s493ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139896842) - NetworkThroughput(*): 10.95 MB/sec - OverallThroughput: 9.89 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 782.476ms - ThriftTransmitTime(*): 12s184ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=8):(Total: 36s490ms, non-child: 9s335ms, % non-child: 25.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 6.754ms - GetResultsTime: 457.165ms - HTResizeTime: 1s058ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 364.22 K/sec - StreamingTime: 8s551ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s154ms, non-child: 13s798ms, % non-child: 50.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s877ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s677ms - GetNewBlockTime: 3.374ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s552ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 1.90 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.027us EXCHANGE_NODE (id=15):(Total: 3s359ms, non-child: 1s365ms, % non-child: 40.65%) BytesReceived(1s000ms): 20.19 MB, 87.78 MB, 157.80 MB, 228.76 MB, 281.93 MB, 297.77 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB - BytesReceived: 298.22 MB (312706668) - ConvertRowBatchTime: 414.681ms - DeserializeRowBatchTimer: 1s800ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 4.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s997ms, non-child: 2s840ms, % non-child: 28.41%) BytesReceived(1s000ms): 7.12 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 12.68 MB, 47.29 MB, 90.22 MB, 127.96 MB, 161.01 MB, 199.94 MB, 237.07 MB, 275.40 MB, 318.02 MB, 357.96 MB, 407.04 MB, 455.58 MB, 490.15 MB, 520.59 MB, 555.13 MB, 594.29 MB, 634.68 MB, 674.01 MB, 716.35 MB, 766.93 MB, 809.87 MB, 846.71 MB, 884.21 MB, 930.06 MB, 973.85 MB, 1015.95 MB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1146061679) - ConvertRowBatchTime: 1s398ms - DeserializeRowBatchTimer: 5s417ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 5.16 M/sec - SendersBlockedTimer: 7s296ms - SendersBlockedTotalTimer(*): 1m20s Instance 704a43b40e790124:4123ec6c75fea5b6 (host=vb0208.halxg.cloudera.com:22000):(Total: 49s260ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 78.38 MB, 200.20 MB, 304.20 MB, 484.23 MB, 548.18 MB, 676.18 MB, 836.15 MB, 1.07 GB, 1.15 GB, 1.16 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.30 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 510.04 MB, 291.52 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071226368) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 191.833ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 34s913ms - TotalNetworkReceiveTime: 12s284ms - TotalNetworkSendTime: 9s778ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 654.997ms, non-child: 654.997ms, % non-child: 100.00%) - CodegenTime: 847.196us - CompileTime: 52.146ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 415.051ms - PrepareTime: 179.921ms DataStreamSender (dst_id=16):(Total: 12s827ms, non-child: 12s827ms, % non-child: 100.00%) - BytesSent: 133.37 MB (139849284) - NetworkThroughput(*): 11.35 MB/sec - OverallThroughput: 10.40 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 776.963ms - ThriftTransmitTime(*): 11s754ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=8):(Total: 36s411ms, non-child: 9s603ms, % non-child: 26.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.081ms - GetResultsTime: 454.165ms - HTResizeTime: 1s061ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 364.91 K/sec - StreamingTime: 8s851ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s808ms, non-child: 12s732ms, % non-child: 47.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s219ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s623ms - GetNewBlockTime: 1.450ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s336ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.581us EXCHANGE_NODE (id=15):(Total: 3s971ms, non-child: 593.861ms, % non-child: 14.95%) BytesReceived(1s000ms): 3.28 MB, 56.99 MB, 126.01 MB, 196.94 MB, 262.77 MB, 294.28 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB, 298.15 MB - BytesReceived: 298.15 MB (312629452) - ConvertRowBatchTime: 274.536ms - DeserializeRowBatchTimer: 1s073ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 3.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s104ms, non-child: 2s666ms, % non-child: 26.39%) BytesReceived(1s000ms): 3.22 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.17 MB, 28.47 MB, 68.87 MB, 113.91 MB, 145.44 MB, 180.38 MB, 221.79 MB, 255.29 MB, 299.39 MB, 339.10 MB, 382.59 MB, 434.95 MB, 474.13 MB, 507.75 MB, 536.93 MB, 576.12 MB, 615.38 MB, 656.17 MB, 694.71 MB, 744.05 MB, 792.50 MB, 829.47 MB, 866.44 MB, 907.40 MB, 954.25 MB, 993.31 MB, 1.01 GB, 1.05 GB - BytesReceived: 1.07 GB (1145503045) - ConvertRowBatchTime: 1s343ms - DeserializeRowBatchTimer: 5s341ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.11 M/sec - SendersBlockedTimer: 7s102ms - SendersBlockedTotalTimer(*): 1m32s Instance 704a43b40e790124:4123ec6c75fea5bb (host=vb0204.halxg.cloudera.com:22000):(Total: 48s694ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1020.50 KB, 164.24 MB, 292.17 MB, 420.20 MB, 548.18 MB, 676.15 MB, 772.13 MB, 948.13 MB, 1.08 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.34 GB, 1.34 GB, 1.34 GB, 1.36 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.39 GB, 1.41 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.74 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.58 MB, 582.89 MB, 388.64 MB, 194.40 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071379968) - PerHostPeakMemUsage: 3.86 GB (4144608464) - PrepareTime: 209.142ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 36s889ms - TotalNetworkReceiveTime: 11s484ms - TotalNetworkSendTime: 9s025ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 708.810ms, non-child: 708.810ms, % non-child: 100.00%) - CodegenTime: 837.210us - CompileTime: 42.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 460.426ms - PrepareTime: 196.092ms DataStreamSender (dst_id=16):(Total: 12s249ms, non-child: 12s249ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139869574) - NetworkThroughput(*): 11.76 MB/sec - OverallThroughput: 10.89 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 892.664ms - ThriftTransmitTime(*): 11s339ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=8):(Total: 36s429ms, non-child: 9s092ms, % non-child: 24.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 649.628us - GetResultsTime: 491.043ms - HTResizeTime: 1s038ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 364.80 K/sec - StreamingTime: 8s274ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s336ms, non-child: 14s010ms, % non-child: 51.25%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s234ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 2s468ms - GetNewBlockTime: 1.457ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s602ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.486us EXCHANGE_NODE (id=15):(Total: 3s914ms, non-child: 560.617ms, % non-child: 14.32%) BytesReceived(1s000ms): 12.88 MB, 77.53 MB, 146.91 MB, 218.28 MB, 276.15 MB, 296.89 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB, 298.18 MB - BytesReceived: 298.18 MB (312668344) - ConvertRowBatchTime: 267.052ms - DeserializeRowBatchTimer: 1s051ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 3.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s411ms, non-child: 3s309ms, % non-child: 35.17%) BytesReceived(1s000ms): 5.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.15 MB, 10.16 MB, 40.55 MB, 82.90 MB, 123.38 MB, 159.88 MB, 194.66 MB, 232.20 MB, 269.62 MB, 311.08 MB, 350.44 MB, 398.60 MB, 448.40 MB, 484.53 MB, 515.45 MB, 548.81 MB, 588.11 MB, 628.32 MB, 668.00 MB, 708.15 MB, 757.43 MB, 804.08 MB, 840.94 MB, 878.41 MB, 922.14 MB, 967.67 MB, 1008.04 MB, 1.02 GB, 1.06 GB - BytesReceived: 1.07 GB (1145803055) - ConvertRowBatchTime: 1s377ms - DeserializeRowBatchTimer: 5s687ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 5.48 M/sec - SendersBlockedTimer: 11s940ms - SendersBlockedTotalTimer(*): 2m36s Instance 704a43b40e790124:4123ec6c75fea5c2 (host=vb0224.halxg.cloudera.com:22000):(Total: 48s692ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.39 MB, 164.17 MB, 292.23 MB, 420.15 MB, 548.16 MB, 676.16 MB, 756.13 MB, 900.13 MB, 1.04 GB, 1.17 GB, 1.25 GB, 1.31 GB, 1.35 GB, 1.34 GB, 1.34 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.74 GB, 1.90 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.58 MB, 582.89 MB, 388.65 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068563968) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 197.103ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 37s669ms - TotalNetworkReceiveTime: 11s160ms - TotalNetworkSendTime: 8s774ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 736.114ms, non-child: 736.114ms, % non-child: 100.00%) - CodegenTime: 876.125us - CompileTime: 59.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 482.560ms - PrepareTime: 182.799ms DataStreamSender (dst_id=16):(Total: 12s279ms, non-child: 12s279ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139839696) - NetworkThroughput(*): 11.89 MB/sec - OverallThroughput: 10.86 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 748.122ms - ThriftTransmitTime(*): 11s218ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=8):(Total: 36s385ms, non-child: 9s047ms, % non-child: 24.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 748.634us - GetResultsTime: 493.889ms - HTResizeTime: 1s035ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 365.12 K/sec - StreamingTime: 8s242ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s338ms, non-child: 14s371ms, % non-child: 52.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s295ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 2s651ms - GetNewBlockTime: 1.396ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s703ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.499us EXCHANGE_NODE (id=15):(Total: 3s818ms, non-child: 581.467ms, % non-child: 15.23%) BytesReceived(1s000ms): 13.50 MB, 78.44 MB, 147.93 MB, 219.30 MB, 276.67 MB, 296.95 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB - BytesReceived: 298.12 MB (312604155) - ConvertRowBatchTime: 284.452ms - DeserializeRowBatchTimer: 1s030ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s149ms, non-child: 3s221ms, % non-child: 35.21%) BytesReceived(1s000ms): 5.21 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 41.30 MB, 83.63 MB, 123.87 MB, 159.97 MB, 195.60 MB, 232.74 MB, 270.08 MB, 311.87 MB, 351.20 MB, 399.22 MB, 449.20 MB, 485.25 MB, 515.77 MB, 549.46 MB, 588.72 MB, 628.79 MB, 668.46 MB, 708.88 MB, 758.36 MB, 804.61 MB, 841.48 MB, 878.97 MB, 922.86 MB, 968.41 MB, 1008.93 MB, 1.02 GB, 1.06 GB - BytesReceived: 1.07 GB (1145749345) - ConvertRowBatchTime: 1s333ms - DeserializeRowBatchTimer: 5s994ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 5.64 M/sec - SendersBlockedTimer: 9s998ms - SendersBlockedTotalTimer(*): 2m23s Fragment F05: Instance 704a43b40e790124:4123ec6c75fea5cc (host=vb0228.halxg.cloudera.com:22000):(Total: 5s391ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 0, 83.99 MB, 201.81 MB, 202.01 MB, 201.89 MB, 169.88 MB, 154.37 MB, 154.20 MB, 137.36 MB, 96.93 MB, 97.00 MB, 57.87 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.19 MB (212009776) - PerHostPeakMemUsage: 1.85 GB (1982309224) - PrepareTime: 193.630ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 34s625ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 54.989ms - TotalStorageWaitTime: 128.889ms CodeGen:(Total: 656.231ms, non-child: 656.231ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 454.879ms - PrepareTime: 178.947ms DataStreamSender (dst_id=15):(Total: 5s069ms, non-child: 5s069ms, % non-child: 100.00%) - BytesSent: 329.96 MB (345992803) - NetworkThroughput(*): 51.25 MB/sec - OverallThroughput: 65.09 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s982ms - ThriftTransmitTime(*): 6s437ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=6):(Total: 481.795ms, non-child: 481.795ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:0% 2:0% 3:0% 4:9.091% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 45.34 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 5.64 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 574.379ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.70 MB (211493680) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 31.13 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2092) - ScannerThreadsTotalWallClockTime: 28s922ms - MaterializeTupleTime(*): 28s142ms - ScannerThreadsSysTime: 86.985ms - ScannerThreadsUserTime: 4s933ms - ScannerThreadsVoluntaryContextSwitches: 14.57K (14573) - TotalRawHdfsReadTime(*): 117.719ms - TotalReadThroughput: 31.62 MB/sec Instance 704a43b40e790124:4123ec6c75fea5ca (host=vb0234.halxg.cloudera.com:22000):(Total: 5s288ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 68.00 KB, 210.22 MB, 210.57 MB, 210.21 MB, 186.44 MB, 162.76 MB, 162.70 MB, 162.66 MB, 114.55 MB, 114.71 MB, 67.65 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.64 MB (220873520) - PerHostPeakMemUsage: 1.93 GB (2070093120) - PrepareTime: 188.485ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 35s736ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.627ms - TotalStorageWaitTime: 205.689ms CodeGen:(Total: 567.229ms, non-child: 567.229ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.679ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 371.413ms - PrepareTime: 175.657ms DataStreamSender (dst_id=15):(Total: 4s941ms, non-child: 4s941ms, % non-child: 100.00%) - BytesSent: 354.66 MB (371892595) - NetworkThroughput(*): 58.19 MB/sec - OverallThroughput: 71.77 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s015ms - ThriftTransmitTime(*): 6s094ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=6):(Total: 494.816ms, non-child: 494.816ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 522.682ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220406576) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 32.65 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.17K (2171) - ScannerThreadsTotalWallClockTime: 30s277ms - MaterializeTupleTime(*): 29s425ms - ScannerThreadsSysTime: 111.980ms - ScannerThreadsUserTime: 4s245ms - ScannerThreadsVoluntaryContextSwitches: 15.74K (15740) - TotalRawHdfsReadTime(*): 178.623ms - TotalReadThroughput: 34.03 MB/sec Instance 704a43b40e790124:4123ec6c75fea5c8 (host=vb0232.halxg.cloudera.com:22000):(Total: 5s208ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 212.02 MB, 212.07 MB, 211.85 MB, 211.91 MB, 156.28 MB, 150.18 MB, 136.97 MB, 112.92 MB, 97.08 MB, 57.98 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.25 MB (222562576) - PerHostPeakMemUsage: 1.87 GB (2002711672) - PrepareTime: 183.169ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 35s832ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 46.885ms - TotalStorageWaitTime: 154.118ms CodeGen:(Total: 507.954ms, non-child: 507.954ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 322.022ms - PrepareTime: 180.967ms DataStreamSender (dst_id=15):(Total: 4s892ms, non-child: 4s892ms, % non-child: 100.00%) - BytesSent: 345.59 MB (362378145) - NetworkThroughput(*): 57.35 MB/sec - OverallThroughput: 70.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s931ms - ThriftTransmitTime(*): 6s026ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=6):(Total: 476.533ms, non-child: 476.533ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.10 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 521.782ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.84 MB (222128360) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 33.27 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.08K (2077) - ScannerThreadsTotalWallClockTime: 30s469ms - MaterializeTupleTime(*): 29s729ms - ScannerThreadsSysTime: 48.988ms - ScannerThreadsUserTime: 4s769ms - ScannerThreadsVoluntaryContextSwitches: 15.48K (15481) - TotalRawHdfsReadTime(*): 138.389ms - TotalReadThroughput: 33.45 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d1 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s779ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 68.00 KB, 189.91 MB, 189.70 MB, 189.88 MB, 152.97 MB, 136.94 MB, 137.04 MB, 113.09 MB, 97.06 MB, 57.80 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.26 MB (199500512) - PerHostPeakMemUsage: 1.79 GB (1922662656) - PrepareTime: 191.620ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 29s505ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.906ms - TotalStorageWaitTime: 131.923ms CodeGen:(Total: 618.823ms, non-child: 618.823ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.221ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 423.505ms - PrepareTime: 180.758ms DataStreamSender (dst_id=15):(Total: 4s466ms, non-child: 4s466ms, % non-child: 100.00%) - BytesSent: 306.73 MB (321628073) - NetworkThroughput(*): 57.38 MB/sec - OverallThroughput: 68.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s679ms - ThriftTransmitTime(*): 5s345ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=6):(Total: 481.216ms, non-child: 481.216ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.33 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 461.422ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.80 MB (199017176) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 29.69 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1561) - ScannerThreadsTotalWallClockTime: 24s435ms - MaterializeTupleTime(*): 23s790ms - ScannerThreadsSysTime: 63.988ms - ScannerThreadsUserTime: 3s749ms - ScannerThreadsVoluntaryContextSwitches: 13.91K (13907) - TotalRawHdfsReadTime(*): 122.915ms - TotalReadThroughput: 33.14 MB/sec Instance 704a43b40e790124:4123ec6c75fea5c6 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s652ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.93 MB, 193.95 MB, 193.84 MB, 162.12 MB, 138.03 MB, 137.06 MB, 105.08 MB, 97.08 MB, 57.79 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.19 MB (203621080) - PerHostPeakMemUsage: 1.76 GB (1892996280) - PrepareTime: 185.483ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 29s311ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 44.483ms - TotalStorageWaitTime: 135.003ms CodeGen:(Total: 551.871ms, non-child: 551.871ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 360.801ms - PrepareTime: 176.727ms DataStreamSender (dst_id=15):(Total: 4s337ms, non-child: 4s337ms, % non-child: 100.00%) - BytesSent: 318.34 MB (333798516) - NetworkThroughput(*): 58.85 MB/sec - OverallThroughput: 73.38 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s625ms - ThriftTransmitTime(*): 5s409ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=6):(Total: 476.460ms, non-child: 476.460ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.44 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 484.815ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.76 MB (203170568) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 30.80 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.96K (1960) - ScannerThreadsTotalWallClockTime: 24s446ms - MaterializeTupleTime(*): 23s740ms - ScannerThreadsSysTime: 96.983ms - ScannerThreadsUserTime: 4s382ms - ScannerThreadsVoluntaryContextSwitches: 14.32K (14321) - TotalRawHdfsReadTime(*): 119.190ms - TotalReadThroughput: 34.03 MB/sec Instance 704a43b40e790124:4123ec6c75fea5cb (host=vb0220.halxg.cloudera.com:22000):(Total: 4s576ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 16.76 MB, 176.72 MB, 176.59 MB, 176.62 MB, 137.23 MB, 136.99 MB, 128.97 MB, 96.87 MB, 89.25 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670952) - PerHostPeakMemUsage: 1.74 GB (1866918584) - PrepareTime: 166.571ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 26s178ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 42.238ms - TotalStorageWaitTime: 313.566ms CodeGen:(Total: 492.356ms, non-child: 492.356ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 322.837ms - PrepareTime: 164.653ms DataStreamSender (dst_id=15):(Total: 4s261ms, non-child: 4s261ms, % non-child: 100.00%) - BytesSent: 294.18 MB (308465463) - NetworkThroughput(*): 56.37 MB/sec - OverallThroughput: 69.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s554ms - ThriftTransmitTime(*): 5s218ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=6):(Total: 460.997ms, non-child: 460.997ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 400.00 KB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 683.189ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.68 MB (185261352) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 29.19 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.15K (2153) - ScannerThreadsTotalWallClockTime: 21s603ms - MaterializeTupleTime(*): 20s516ms - ScannerThreadsSysTime: 92.983ms - ScannerThreadsUserTime: 5s703ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13021) - TotalRawHdfsReadTime(*): 110.776ms - TotalReadThroughput: 34.66 MB/sec Instance 704a43b40e790124:4123ec6c75fea5cf (host=vb0230.halxg.cloudera.com:22000):(Total: 4s512ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 0, 176.60 MB, 176.71 MB, 176.80 MB, 136.95 MB, 137.06 MB, 137.02 MB, 105.10 MB, 96.95 MB, 57.83 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185629984) - PerHostPeakMemUsage: 1.65 GB (1767401176) - PrepareTime: 176.525ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 26s120ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.231ms - TotalStorageWaitTime: 149.125ms CodeGen:(Total: 513.664ms, non-child: 513.664ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 334.215ms - PrepareTime: 169.832ms DataStreamSender (dst_id=15):(Total: 4s217ms, non-child: 4s217ms, % non-child: 100.00%) - BytesSent: 293.86 MB (308139694) - NetworkThroughput(*): 59.23 MB/sec - OverallThroughput: 69.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s550ms - ThriftTransmitTime(*): 4s961ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=6):(Total: 449.046ms, non-child: 449.046ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 443.174ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 29.98 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.46K (1460) - ScannerThreadsTotalWallClockTime: 21s436ms - MaterializeTupleTime(*): 20s794ms - ScannerThreadsSysTime: 56.990ms - ScannerThreadsUserTime: 3s695ms - ScannerThreadsVoluntaryContextSwitches: 13.09K (13091) - TotalRawHdfsReadTime(*): 124.268ms - TotalReadThroughput: 34.66 MB/sec Instance 704a43b40e790124:4123ec6c75fea5cd (host=vb0206.halxg.cloudera.com:22000):(Total: 4s492ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 0, 404.00 KB, 176.53 MB, 176.70 MB, 145.06 MB, 137.03 MB, 136.98 MB, 121.03 MB, 96.92 MB, 73.48 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646360) - PerHostPeakMemUsage: 1.78 GB (1908241616) - PrepareTime: 205.778ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 25s959ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.002ms - TotalStorageWaitTime: 132.209ms CodeGen:(Total: 668.686ms, non-child: 668.686ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.627ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 453.891ms - PrepareTime: 204.069ms DataStreamSender (dst_id=15):(Total: 4s186ms, non-child: 4s186ms, % non-child: 100.00%) - BytesSent: 297.05 MB (311475448) - NetworkThroughput(*): 53.93 MB/sec - OverallThroughput: 70.95 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s545ms - ThriftTransmitTime(*): 5s507ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=6):(Total: 491.979ms, non-child: 491.979ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 458.991ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 27.34 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1398) - ScannerThreadsTotalWallClockTime: 21s149ms - MaterializeTupleTime(*): 20s487ms - ScannerThreadsSysTime: 38.991ms - ScannerThreadsUserTime: 3s869ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13055) - TotalRawHdfsReadTime(*): 136.415ms - TotalReadThroughput: 34.66 MB/sec Instance 704a43b40e790124:4123ec6c75fea5c9 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s455ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.73 MB, 176.63 MB, 176.76 MB, 137.02 MB, 136.93 MB, 136.97 MB, 97.03 MB, 97.07 MB, 49.13 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 1.65 GB (1766596464) - PrepareTime: 180.859ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 25s736ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38.964ms - TotalStorageWaitTime: 137.700ms CodeGen:(Total: 504.705ms, non-child: 504.705ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 321.345ms - PrepareTime: 179.226ms DataStreamSender (dst_id=15):(Total: 4s136ms, non-child: 4s136ms, % non-child: 100.00%) - BytesSent: 293.70 MB (307962780) - NetworkThroughput(*): 56.52 MB/sec - OverallThroughput: 71.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s519ms - ThriftTransmitTime(*): 5s196ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=6):(Total: 481.868ms, non-child: 481.868ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 711.403ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 27.93 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.27K (2268) - ScannerThreadsTotalWallClockTime: 21s105ms - MaterializeTupleTime(*): 20s173ms - ScannerThreadsSysTime: 106.981ms - ScannerThreadsUserTime: 6s411ms - ScannerThreadsVoluntaryContextSwitches: 13.07K (13068) - TotalRawHdfsReadTime(*): 101.137ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d0 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s445ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.70 MB, 176.47 MB, 176.84 MB, 136.80 MB, 137.16 MB, 137.02 MB, 97.01 MB, 97.12 MB, 10.77 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.13 MB (185736488) - PerHostPeakMemUsage: 1.63 GB (1754730648) - PrepareTime: 165.927ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 25s832ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 48.777ms - TotalStorageWaitTime: 99.717ms CodeGen:(Total: 476.373ms, non-child: 476.373ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 307.550ms - PrepareTime: 164.132ms DataStreamSender (dst_id=15):(Total: 4s162ms, non-child: 4s162ms, % non-child: 100.00%) - BytesSent: 294.74 MB (309058456) - NetworkThroughput(*): 56.98 MB/sec - OverallThroughput: 70.81 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s526ms - ThriftTransmitTime(*): 5s172ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=6):(Total: 428.402ms, non-child: 428.402ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 441.049ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.68 MB (185261352) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 31.42 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.98K (1978) - ScannerThreadsTotalWallClockTime: 21s198ms - MaterializeTupleTime(*): 20s606ms - ScannerThreadsSysTime: 84.984ms - ScannerThreadsUserTime: 3s927ms - ScannerThreadsVoluntaryContextSwitches: 13.13K (13131) - TotalRawHdfsReadTime(*): 105.014ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5ce (host=vb0204.halxg.cloudera.com:22000):(Total: 4s399ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.71 MB, 176.73 MB, 176.86 MB, 137.10 MB, 136.95 MB, 104.93 MB, 97.08 MB, 57.83 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.06 MB (185662752) - PerHostPeakMemUsage: 1.61 GB (1726526920) - PrepareTime: 189.253ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 25s417ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 47.214ms - TotalStorageWaitTime: 120.421ms CodeGen:(Total: 537.014ms, non-child: 537.014ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.431ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 344.846ms - PrepareTime: 184.802ms DataStreamSender (dst_id=15):(Total: 4s108ms, non-child: 4s108ms, % non-child: 100.00%) - BytesSent: 293.83 MB (308098132) - NetworkThroughput(*): 58.89 MB/sec - OverallThroughput: 71.52 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s456ms - ThriftTransmitTime(*): 4s989ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=6):(Total: 461.525ms, non-child: 461.525ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 440.294ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 29.17 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1488) - ScannerThreadsTotalWallClockTime: 20s814ms - MaterializeTupleTime(*): 20s205ms - ScannerThreadsSysTime: 24.993ms - ScannerThreadsUserTime: 3s771ms - ScannerThreadsVoluntaryContextSwitches: 13.04K (13040) - TotalRawHdfsReadTime(*): 136.304ms - TotalReadThroughput: 34.66 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d2 (host=vb0222.halxg.cloudera.com:22000):(Total: 3s942ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 169.58 MB, 177.94 MB, 177.84 MB, 161.89 MB, 124.47 MB, 111.37 MB, 79.33 MB, 39.03 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 4 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.13 MB (186778368) - PerHostPeakMemUsage: 1.62 GB (1740849216) - PrepareTime: 193.684ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 22s672ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40.387ms - TotalStorageWaitTime: 383.308ms CodeGen:(Total: 544.876ms, non-child: 544.876ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.479ms - PrepareTime: 181.243ms DataStreamSender (dst_id=15):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 285.20 MB (299049115) - NetworkThroughput(*): 58.54 MB/sec - OverallThroughput: 78.32 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s239ms - ThriftTransmitTime(*): 4s871ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=6):(Total: 476.776ms, non-child: 476.776ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:12.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 138.52 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 409.476ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.70 MB (186327856) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 27.43 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1191) - ScannerThreadsTotalWallClockTime: 18s781ms - MaterializeTupleTime(*): 17s745ms - ScannerThreadsSysTime: 21.994ms - ScannerThreadsUserTime: 3s648ms - ScannerThreadsVoluntaryContextSwitches: 12.55K (12554) - TotalRawHdfsReadTime(*): 99.265ms - TotalReadThroughput: 33.72 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d3 (host=vb0214.halxg.cloudera.com:22000):(Total: 3s827ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 114.05 MB, 164.00 MB, 164.28 MB, 124.76 MB, 124.60 MB, 111.35 MB, 79.40 MB, 47.79 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.57 MB (172563792) - PerHostPeakMemUsage: 1.61 GB (1729605392) - PrepareTime: 176.379ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 20s598ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45.723ms - TotalStorageWaitTime: 63.387ms CodeGen:(Total: 549.504ms, non-child: 549.504ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 370.269ms - PrepareTime: 169.603ms DataStreamSender (dst_id=15):(Total: 3s568ms, non-child: 3s568ms, % non-child: 100.00%) - BytesSent: 264.15 MB (276984614) - NetworkThroughput(*): 57.94 MB/sec - OverallThroughput: 74.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s158ms - ThriftTransmitTime(*): 4s559ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=6):(Total: 415.010ms, non-child: 415.010ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:0% 3:0% 4:12.5% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 72.36 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 4.62 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 388.774ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088608) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 29.26 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1113) - ScannerThreadsTotalWallClockTime: 16s486ms - MaterializeTupleTime(*): 15s993ms - ScannerThreadsSysTime: 22.993ms - ScannerThreadsUserTime: 3s184ms - ScannerThreadsVoluntaryContextSwitches: 11.76K (11760) - TotalRawHdfsReadTime(*): 87.844ms - TotalReadThroughput: 35.19 MB/sec Instance 704a43b40e790124:4123ec6c75fea5c7 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s735ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.19 MB, 168.29 MB, 168.25 MB, 128.37 MB, 111.27 MB, 79.34 MB, 79.38 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.51 MB (176700744) - PerHostPeakMemUsage: 1.61 GB (1728664504) - PrepareTime: 184.258ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 20s154ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.132ms - TotalStorageWaitTime: 99.427ms CodeGen:(Total: 527.356ms, non-child: 527.356ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.500ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 340.097ms - PrepareTime: 179.116ms DataStreamSender (dst_id=15):(Total: 3s462ms, non-child: 3s462ms, % non-child: 100.00%) - BytesSent: 266.39 MB (279333507) - NetworkThroughput(*): 57.61 MB/sec - OverallThroughput: 76.93 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s123ms - ThriftTransmitTime(*): 4s624ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=6):(Total: 442.103ms, non-child: 442.103ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 387.671ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217416) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 27.75 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 916 (916) - ScannerThreadsTotalWallClockTime: 16s200ms - MaterializeTupleTime(*): 15s675ms - ScannerThreadsSysTime: 15.995ms - ScannerThreadsUserTime: 3s140ms - ScannerThreadsVoluntaryContextSwitches: 11.87K (11866) - TotalRawHdfsReadTime(*): 97.305ms - TotalReadThroughput: 35.57 MB/sec Instance 704a43b40e790124:4123ec6c75fea5c5 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s691ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.07 MB, 142.96 MB, 143.04 MB, 111.49 MB, 111.41 MB, 79.59 MB, 71.48 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.37 MB (150337424) - PerHostPeakMemUsage: 1.58 GB (1696890344) - PrepareTime: 184.768ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 17s757ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41.650ms - TotalStorageWaitTime: 66.074ms CodeGen:(Total: 508.420ms, non-child: 508.420ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 320.378ms - PrepareTime: 176.577ms DataStreamSender (dst_id=15):(Total: 3s404ms, non-child: 3s404ms, % non-child: 100.00%) - BytesSent: 234.60 MB (245993835) - NetworkThroughput(*): 57.52 MB/sec - OverallThroughput: 68.92 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s073ms - ThriftTransmitTime(*): 4s078ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=6):(Total: 451.489ms, non-child: 451.489ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 360.748ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.91 MB (149854096) - PerReadThreadRawHdfsThroughput: 1.86 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 23.85 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.61K (1606) - ScannerThreadsTotalWallClockTime: 13s828ms - MaterializeTupleTime(*): 13s367ms - ScannerThreadsSysTime: 46.991ms - ScannerThreadsUserTime: 3s044ms - ScannerThreadsVoluntaryContextSwitches: 10.47K (10470) - TotalRawHdfsReadTime(*): 65.604ms - TotalReadThroughput: 31.20 MB/sec Fragment F04: Instance 704a43b40e790124:4123ec6c75fea5d5 (host=vb0230.halxg.cloudera.com:22000):(Total: 35s946ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.95 MB, 192.77 MB, 192.77 MB, 192.77 MB, 192.77 MB, 192.77 MB, 192.77 MB, 192.77 MB, 192.64 MB, 193.47 MB, 193.61 MB, 193.75 MB, 193.82 MB, 193.75 MB, 193.61 MB, 193.62 MB, 193.62 MB, 193.78 MB, 185.70 MB, 74.89 MB, 67.11 MB, 75.37 MB, 185.54 MB, 193.60 MB, 193.69 MB, 193.67 MB, 193.65 MB, 193.60 MB, 193.73 MB, 193.70 MB, 193.79 MB, 161.89 MB, 67.03 MB, 67.24 MB, 55.07 MB, 55.00 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203493184) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 190.001ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s551ms - TotalStorageWaitTime: 471.133ms CodeGen:(Total: 546.470ms, non-child: 546.470ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.023ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.991ms - PrepareTime: 180.316ms DataStreamSender (dst_id=14):(Total: 35s273ms, non-child: 35s273ms, % non-child: 100.00%) - BytesSent: 1.11 GB (1191554703) - NetworkThroughput(*): 7.64 MB/sec - OverallThroughput: 32.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s851ms - ThriftTransmitTime(*): 2m28s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=5):(Total: 783.098ms, non-child: 783.098ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 246.40 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.07 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.58 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s484ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 68.47 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.71K (8711) - ScannerThreadsTotalWallClockTime: 4m32s - MaterializeTupleTime(*): 4m30s - ScannerThreadsSysTime: 284.953ms - ScannerThreadsUserTime: 18s649ms - ScannerThreadsVoluntaryContextSwitches: 51.88K (51875) - TotalRawHdfsReadTime(*): 261.101ms - TotalReadThroughput: 10.27 MB/sec Instance 704a43b40e790124:4123ec6c75fea5dd (host=vb0206.halxg.cloudera.com:22000):(Total: 35s662ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 95.78 MB, 191.87 MB, 191.87 MB, 191.87 MB, 191.87 MB, 191.87 MB, 191.87 MB, 191.87 MB, 191.86 MB, 193.44 MB, 193.67 MB, 193.71 MB, 193.68 MB, 193.83 MB, 193.82 MB, 193.66 MB, 193.70 MB, 193.67 MB, 145.94 MB, 67.12 MB, 67.15 MB, 143.22 MB, 193.61 MB, 193.75 MB, 193.71 MB, 193.57 MB, 193.61 MB, 193.74 MB, 193.68 MB, 193.75 MB, 193.65 MB, 130.23 MB, 67.21 MB, 72.25 MB, 55.08 MB, 51.13 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203521128) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 192.491ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s573ms - TotalStorageWaitTime: 339.394ms CodeGen:(Total: 591.301ms, non-child: 591.301ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.035ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 396.336ms - PrepareTime: 184.650ms DataStreamSender (dst_id=14):(Total: 35s039ms, non-child: 35s039ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1204513389) - NetworkThroughput(*): 8.60 MB/sec - OverallThroughput: 32.78 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s095ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=5):(Total: 747.778ms, non-child: 747.778ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 178.57 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 353.09 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.66 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s313ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.69 MB (203103336) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 71.68 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.44K (7436) - ScannerThreadsTotalWallClockTime: 4m30s - MaterializeTupleTime(*): 4m28s - ScannerThreadsSysTime: 315.949ms - ScannerThreadsUserTime: 16s776ms - ScannerThreadsVoluntaryContextSwitches: 52.23K (52231) - TotalRawHdfsReadTime(*): 302.201ms - TotalReadThroughput: 10.41 MB/sec Instance 704a43b40e790124:4123ec6c75fea5e1 (host=vb0222.halxg.cloudera.com:22000):(Total: 35s555ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 95.95 MB, 192.88 MB, 192.88 MB, 192.88 MB, 192.88 MB, 192.88 MB, 192.88 MB, 192.88 MB, 192.87 MB, 193.79 MB, 193.75 MB, 193.78 MB, 193.70 MB, 193.78 MB, 193.64 MB, 193.69 MB, 193.75 MB, 193.77 MB, 98.46 MB, 67.00 MB, 96.71 MB, 177.37 MB, 188.20 MB, 188.11 MB, 188.18 MB, 188.18 MB, 188.17 MB, 188.14 MB, 188.21 MB, 188.10 MB, 176.17 MB, 118.86 MB, 82.85 MB, 91.35 MB, 55.12 MB, 43.93 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 2 - AverageThreadTokens: 8.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203493136) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 191.401ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s332ms - TotalStorageWaitTime: 399.005ms CodeGen:(Total: 542.493ms, non-child: 542.493ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.212ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.375ms - PrepareTime: 179.304ms DataStreamSender (dst_id=14):(Total: 34s971ms, non-child: 34s971ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1206638269) - NetworkThroughput(*): 8.05 MB/sec - OverallThroughput: 32.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s199ms - ThriftTransmitTime(*): 2m22s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=5):(Total: 708.710ms, non-child: 708.710ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 82.13 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 205.33 MB, 314.75 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 345.55 MB, 345.55 MB, 355.82 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.65 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s416ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 74.85 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.03K (8026) - ScannerThreadsTotalWallClockTime: 4m30s - MaterializeTupleTime(*): 4m27s - ScannerThreadsSysTime: 243.959ms - ScannerThreadsUserTime: 19s552ms - ScannerThreadsVoluntaryContextSwitches: 51.10K (51103) - TotalRawHdfsReadTime(*): 296.377ms - TotalReadThroughput: 10.17 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d8 (host=vb0234.halxg.cloudera.com:22000):(Total: 35s428ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 192.09 MB, 192.09 MB, 192.09 MB, 192.09 MB, 192.09 MB, 192.09 MB, 192.09 MB, 192.09 MB, 192.83 MB, 193.72 MB, 193.75 MB, 193.66 MB, 193.70 MB, 193.76 MB, 193.79 MB, 193.67 MB, 193.76 MB, 189.66 MB, 86.72 MB, 67.27 MB, 96.75 MB, 193.00 MB, 193.59 MB, 193.68 MB, 193.64 MB, 193.65 MB, 193.62 MB, 193.72 MB, 193.64 MB, 193.72 MB, 106.52 MB, 67.03 MB, 67.12 MB, 55.15 MB, 55.14 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203493136) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 180.640ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s420ms - TotalStorageWaitTime: 564.320ms CodeGen:(Total: 561.278ms, non-child: 561.278ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.539ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 380.637ms - PrepareTime: 166.705ms DataStreamSender (dst_id=14):(Total: 34s739ms, non-child: 34s739ms, % non-child: 100.00%) - BytesSent: 1.08 GB (1158680507) - NetworkThroughput(*): 7.10 MB/sec - OverallThroughput: 31.81 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s501ms - ThriftTransmitTime(*): 2m35s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=5):(Total: 772.840ms, non-child: 772.840ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 281.24 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.06 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.56 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s677ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 69.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.27K (9274) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 4m26s - ScannerThreadsSysTime: 351.942ms - ScannerThreadsUserTime: 20s955ms - ScannerThreadsVoluntaryContextSwitches: 51.40K (51401) - TotalRawHdfsReadTime(*): 268.496ms - TotalReadThroughput: 10.27 MB/sec Instance 704a43b40e790124:4123ec6c75fea5e0 (host=vb0224.halxg.cloudera.com:22000):(Total: 35s391ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 34.00 KB, 193.54 MB, 193.54 MB, 193.54 MB, 193.54 MB, 193.54 MB, 193.54 MB, 193.54 MB, 193.51 MB, 193.46 MB, 193.86 MB, 193.78 MB, 193.65 MB, 193.61 MB, 193.72 MB, 193.66 MB, 193.78 MB, 193.76 MB, 157.87 MB, 66.96 MB, 67.15 MB, 128.61 MB, 190.80 MB, 190.65 MB, 190.71 MB, 190.73 MB, 190.62 MB, 190.79 MB, 190.69 MB, 190.70 MB, 190.56 MB, 95.54 MB, 73.41 MB, 82.92 MB, 55.01 MB, 43.23 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509472) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 192.252ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m49s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s398ms - TotalStorageWaitTime: 271.995ms CodeGen:(Total: 540.894ms, non-child: 540.894ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 345.359ms - PrepareTime: 184.184ms DataStreamSender (dst_id=14):(Total: 34s849ms, non-child: 34s849ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1207958688) - NetworkThroughput(*): 9.02 MB/sec - OverallThroughput: 33.06 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s334ms - ThriftTransmitTime(*): 2m7s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=5):(Total: 663.056ms, non-child: 663.056ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 347.01 MB, 357.28 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.66 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s354ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 80.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.71K (6710) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 4m27s - ScannerThreadsSysTime: 156.972ms - ScannerThreadsUserTime: 16s728ms - ScannerThreadsVoluntaryContextSwitches: 51.95K (51954) - TotalRawHdfsReadTime(*): 223.853ms - TotalReadThroughput: 10.35 MB/sec Instance 704a43b40e790124:4123ec6c75fea5db (host=vb0232.halxg.cloudera.com:22000):(Total: 35s297ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.64 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.24 MB, 193.79 MB, 193.73 MB, 193.71 MB, 193.68 MB, 193.86 MB, 193.84 MB, 193.69 MB, 193.67 MB, 193.64 MB, 102.38 MB, 67.15 MB, 67.13 MB, 193.35 MB, 193.55 MB, 193.76 MB, 193.71 MB, 193.61 MB, 193.67 MB, 193.70 MB, 193.68 MB, 193.71 MB, 161.77 MB, 71.05 MB, 67.06 MB, 68.33 MB, 55.12 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 3 - AverageThreadTokens: 8.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.50 MB (203948824) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 193.610ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s465ms - TotalStorageWaitTime: 357.598ms CodeGen:(Total: 557.238ms, non-child: 557.238ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 355.435ms - PrepareTime: 180.879ms DataStreamSender (dst_id=14):(Total: 34s665ms, non-child: 34s665ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1149519189) - NetworkThroughput(*): 9.68 MB/sec - OverallThroughput: 31.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s300ms - ThriftTransmitTime(*): 1m53s - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=5):(Total: 744.632ms, non-child: 744.632ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.61 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s455ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.04 MB (203465544) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 71.94 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.88K (7877) - ScannerThreadsTotalWallClockTime: 4m27s - MaterializeTupleTime(*): 4m25s - ScannerThreadsSysTime: 211.964ms - ScannerThreadsUserTime: 18s243ms - ScannerThreadsVoluntaryContextSwitches: 52.35K (52349) - TotalRawHdfsReadTime(*): 272.676ms - TotalReadThroughput: 10.41 MB/sec Instance 704a43b40e790124:4123ec6c75fea5da (host=vb0226.halxg.cloudera.com:22000):(Total: 35s166ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 96.33 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.91 MB, 193.71 MB, 193.76 MB, 193.63 MB, 193.61 MB, 193.82 MB, 193.55 MB, 193.68 MB, 193.62 MB, 193.66 MB, 98.40 MB, 67.15 MB, 119.08 MB, 193.74 MB, 193.62 MB, 193.68 MB, 193.77 MB, 193.76 MB, 193.72 MB, 193.82 MB, 193.62 MB, 193.73 MB, 126.07 MB, 67.15 MB, 67.18 MB, 67.17 MB, 55.13 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 3 - AverageThreadTokens: 8.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.05 MB (203476744) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 192.914ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s961ms - TotalStorageWaitTime: 491.878ms CodeGen:(Total: 565.394ms, non-child: 565.394ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.893ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.285ms - PrepareTime: 179.423ms DataStreamSender (dst_id=14):(Total: 34s544ms, non-child: 34s544ms, % non-child: 100.00%) - BytesSent: 1.08 GB (1164170299) - NetworkThroughput(*): 8.28 MB/sec - OverallThroughput: 32.14 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s146ms - ThriftTransmitTime(*): 2m14s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=5):(Total: 729.275ms, non-child: 729.275ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 236.13 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.61 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s448ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 73.47 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.57K (7572) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 232.961ms - ScannerThreadsUserTime: 18s189ms - ScannerThreadsVoluntaryContextSwitches: 51.71K (51709) - TotalRawHdfsReadTime(*): 320.084ms - TotalReadThroughput: 10.41 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d4 (host=vb0208.halxg.cloudera.com:22000):(Total: 35s098ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 91.66 MB, 183.93 MB, 183.93 MB, 183.93 MB, 183.93 MB, 183.93 MB, 183.93 MB, 183.93 MB, 183.93 MB, 184.50 MB, 184.78 MB, 184.71 MB, 184.76 MB, 184.78 MB, 184.67 MB, 184.68 MB, 184.65 MB, 184.59 MB, 158.74 MB, 89.26 MB, 98.72 MB, 162.39 MB, 193.72 MB, 193.73 MB, 193.76 MB, 193.52 MB, 193.66 MB, 181.69 MB, 177.81 MB, 166.01 MB, 153.80 MB, 86.83 MB, 98.65 MB, 70.59 MB, 55.05 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 3 - AverageThreadTokens: 8.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.80 MB (205314104) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 167.620ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s941ms - TotalStorageWaitTime: 534.885ms CodeGen:(Total: 489.331ms, non-child: 489.331ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.143ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 316.980ms - PrepareTime: 165.125ms DataStreamSender (dst_id=14):(Total: 34s501ms, non-child: 34s501ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1130484417) - NetworkThroughput(*): 6.92 MB/sec - OverallThroughput: 31.25 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s127ms - ThriftTransmitTime(*): 2m35s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=5):(Total: 696.012ms, non-child: 696.012ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 78.76 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 157.53 MB, 178.07 MB, 188.33 MB, 198.59 MB, 280.73 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 342.33 MB, 342.33 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.63 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s619ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.44 MB (204929080) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 75.55 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.81K (8814) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m24s - ScannerThreadsSysTime: 253.958ms - ScannerThreadsUserTime: 17s872ms - ScannerThreadsVoluntaryContextSwitches: 51.02K (51016) - TotalRawHdfsReadTime(*): 241.382ms - TotalReadThroughput: 10.22 MB/sec Instance 704a43b40e790124:4123ec6c75fea5df (host=vb0228.halxg.cloudera.com:22000):(Total: 35s051ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(1s000ms): 82.32 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.19 MB, 187.64 MB, 187.64 MB, 187.64 MB, 187.57 MB, 187.67 MB, 187.70 MB, 187.69 MB, 187.70 MB, 187.62 MB, 166.51 MB, 82.89 MB, 82.90 MB, 87.58 MB, 177.69 MB, 193.76 MB, 193.68 MB, 193.72 MB, 193.65 MB, 193.73 MB, 189.74 MB, 177.85 MB, 178.01 MB, 161.87 MB, 94.62 MB, 82.79 MB, 51.20 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4 - AverageThreadTokens: 8.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.13 MB (203565096) - PerHostPeakMemUsage: 3.86 GB (4146282224) - PrepareTime: 191.743ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s003ms - TotalStorageWaitTime: 365.793ms CodeGen:(Total: 509.698ms, non-child: 509.698ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.264ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 314.197ms - PrepareTime: 177.476ms DataStreamSender (dst_id=14):(Total: 34s432ms, non-child: 34s432ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1139081420) - NetworkThroughput(*): 8.16 MB/sec - OverallThroughput: 31.55 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s132ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=5):(Total: 733.007ms, non-child: 733.007ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 149.68 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 180.48 MB, 180.48 MB, 180.48 MB, 242.08 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 334.48 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.77 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s331ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.69 MB (203098152) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 68.12 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.09K (8085) - ScannerThreadsTotalWallClockTime: 4m30s - MaterializeTupleTime(*): 4m28s - ScannerThreadsSysTime: 277.954ms - ScannerThreadsUserTime: 16s675ms - ScannerThreadsVoluntaryContextSwitches: 47.65K (47651) - TotalRawHdfsReadTime(*): 197.372ms - TotalReadThroughput: 9.85 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d9 (host=vb0204.halxg.cloudera.com:22000):(Total: 34s878ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 34.00 KB, 170.01 MB, 170.01 MB, 170.01 MB, 170.01 MB, 170.01 MB, 170.01 MB, 170.01 MB, 170.01 MB, 170.29 MB, 170.61 MB, 170.67 MB, 170.60 MB, 170.65 MB, 170.53 MB, 170.55 MB, 170.65 MB, 87.34 MB, 59.92 MB, 115.00 MB, 170.60 MB, 170.52 MB, 170.73 MB, 170.49 MB, 170.56 MB, 170.67 MB, 170.63 MB, 170.56 MB, 103.11 MB, 59.79 MB, 59.94 MB, 77.88 MB, 78.14 MB, 78.21 MB, 54.44 MB ThreadUsage(1s000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4, 4, 4, 4 - AverageThreadTokens: 7.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 170.99 MB (179292424) - PerHostPeakMemUsage: 3.86 GB (4144608464) - PrepareTime: 190.994ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 4m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s948ms - TotalStorageWaitTime: 385.875ms CodeGen:(Total: 536.589ms, non-child: 536.589ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 342.618ms - PrepareTime: 183.538ms DataStreamSender (dst_id=14):(Total: 34s270ms, non-child: 34s270ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1140802893) - NetworkThroughput(*): 7.35 MB/sec - OverallThroughput: 31.75 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s991ms - ThriftTransmitTime(*): 2m28s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=5):(Total: 732.143ms, non-child: 732.143ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 71.86 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 318.27 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.48 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s373ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 170.53 MB (178809088) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 69.13 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.96K (7956) - ScannerThreadsTotalWallClockTime: 3m45s - MaterializeTupleTime(*): 3m43s - ScannerThreadsSysTime: 277.955ms - ScannerThreadsUserTime: 17s141ms - ScannerThreadsVoluntaryContextSwitches: 49.48K (49479) - TotalRawHdfsReadTime(*): 279.191ms - TotalReadThroughput: 9.97 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d6 (host=vb0214.halxg.cloudera.com:22000):(Total: 34s780ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(1s000ms): 95.78 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.67 MB, 193.73 MB, 193.77 MB, 193.81 MB, 193.72 MB, 193.76 MB, 193.64 MB, 193.70 MB, 193.73 MB, 193.63 MB, 110.36 MB, 67.15 MB, 67.14 MB, 168.82 MB, 191.63 MB, 191.57 MB, 191.70 MB, 191.57 MB, 191.65 MB, 191.60 MB, 191.62 MB, 191.66 MB, 191.64 MB, 132.16 MB, 65.12 MB, 82.86 MB, 31.97 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 8.59 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203501288) - PerHostPeakMemUsage: 3.86 GB (4145067752) - PrepareTime: 176.224ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s836ms - TotalStorageWaitTime: 277.066ms CodeGen:(Total: 473.503ms, non-child: 473.503ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 294.069ms - PrepareTime: 170.603ms DataStreamSender (dst_id=14):(Total: 34s183ms, non-child: 34s183ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1124455856) - NetworkThroughput(*): 8.10 MB/sec - OverallThroughput: 31.37 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s993ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=5):(Total: 700.810ms, non-child: 700.810ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 214.82 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 337.24 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.70 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s389ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 71.90 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.64K (7645) - ScannerThreadsTotalWallClockTime: 4m28s - MaterializeTupleTime(*): 4m26s - ScannerThreadsSysTime: 217.963ms - ScannerThreadsUserTime: 17s378ms - ScannerThreadsVoluntaryContextSwitches: 48.33K (48326) - TotalRawHdfsReadTime(*): 228.878ms - TotalReadThroughput: 9.93 MB/sec Instance 704a43b40e790124:4123ec6c75fea5d7 (host=vb0212.halxg.cloudera.com:22000):(Total: 34s747ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 96.08 MB, 192.63 MB, 192.63 MB, 192.63 MB, 192.63 MB, 192.63 MB, 192.63 MB, 192.63 MB, 192.74 MB, 193.61 MB, 193.73 MB, 193.77 MB, 193.70 MB, 193.68 MB, 193.58 MB, 193.66 MB, 193.74 MB, 193.71 MB, 161.75 MB, 67.23 MB, 67.06 MB, 129.98 MB, 193.74 MB, 193.69 MB, 193.71 MB, 193.69 MB, 193.77 MB, 193.77 MB, 193.67 MB, 193.67 MB, 193.67 MB, 98.47 MB, 67.13 MB, 61.70 MB, 31.96 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 2 - AverageThreadTokens: 8.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517624) - PerHostPeakMemUsage: 3.86 GB (4145505000) - PrepareTime: 191.450ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s184ms - TotalStorageWaitTime: 550.309ms CodeGen:(Total: 540.888ms, non-child: 540.888ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.943ms - PrepareTime: 176.582ms DataStreamSender (dst_id=14):(Total: 34s154ms, non-child: 34s154ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1126341895) - NetworkThroughput(*): 7.21 MB/sec - OverallThroughput: 31.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s765ms - ThriftTransmitTime(*): 2m28s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=5):(Total: 711.332ms, non-child: 711.332ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 246.38 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 338.78 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.75 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s327ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075256) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 71.14 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.89K (6895) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m24s - ScannerThreadsSysTime: 206.965ms - ScannerThreadsUserTime: 16s442ms - ScannerThreadsVoluntaryContextSwitches: 48.34K (48343) - TotalRawHdfsReadTime(*): 273.415ms - TotalReadThroughput: 9.97 MB/sec Instance 704a43b40e790124:4123ec6c75fea5e2 (host=vb0218.halxg.cloudera.com:22000):(Total: 34s413ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 95.87 MB, 192.79 MB, 192.79 MB, 192.79 MB, 192.79 MB, 192.79 MB, 192.79 MB, 192.79 MB, 192.79 MB, 193.63 MB, 193.65 MB, 193.73 MB, 193.67 MB, 193.79 MB, 193.72 MB, 193.65 MB, 193.73 MB, 193.68 MB, 102.45 MB, 67.04 MB, 75.52 MB, 192.85 MB, 193.73 MB, 193.74 MB, 193.65 MB, 193.63 MB, 193.66 MB, 193.77 MB, 193.72 MB, 193.60 MB, 161.76 MB, 67.09 MB, 67.18 MB, 54.73 MB, 15.30 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 1 - AverageThreadTokens: 8.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.39 MB (204877272) - PerHostPeakMemUsage: 3.83 GB (4116367584) - PrepareTime: 193.876ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s550ms - TotalStorageWaitTime: 424.232ms CodeGen:(Total: 552.030ms, non-child: 552.030ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 352.479ms - PrepareTime: 178.499ms DataStreamSender (dst_id=14):(Total: 33s873ms, non-child: 33s873ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1140911875) - NetworkThroughput(*): 7.72 MB/sec - OverallThroughput: 32.12 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s499ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=5):(Total: 673.887ms, non-child: 673.887ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 256.67 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 338.80 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.67 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s490ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.93 MB (204402136) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 75.12 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.28K (6276) - ScannerThreadsTotalWallClockTime: 4m22s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 146.975ms - ScannerThreadsUserTime: 15s671ms - ScannerThreadsVoluntaryContextSwitches: 48.36K (48359) - TotalRawHdfsReadTime(*): 272.947ms - TotalReadThroughput: 10.12 MB/sec Instance 704a43b40e790124:4123ec6c75fea5dc (host=vb0216.halxg.cloudera.com:22000):(Total: 33s196ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(1s000ms): 96.63 MB, 193.19 MB, 193.19 MB, 193.19 MB, 193.19 MB, 193.19 MB, 193.19 MB, 193.19 MB, 193.18 MB, 193.51 MB, 193.68 MB, 193.74 MB, 193.67 MB, 193.66 MB, 193.61 MB, 193.77 MB, 193.86 MB, 193.70 MB, 98.43 MB, 67.18 MB, 80.61 MB, 193.32 MB, 193.69 MB, 193.60 MB, 193.65 MB, 193.66 MB, 193.69 MB, 193.82 MB, 193.62 MB, 193.66 MB, 161.87 MB, 75.23 MB, 67.01 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509520) - PerHostPeakMemUsage: 3.69 GB (3962818392) - PrepareTime: 172.049ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s146ms - TotalStorageWaitTime: 290.144ms CodeGen:(Total: 597.910ms, non-child: 597.910ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 420.830ms - PrepareTime: 164.709ms DataStreamSender (dst_id=14):(Total: 32s678ms, non-child: 32s678ms, % non-child: 100.00%) - BytesSent: 1.01 GB (1080325645) - NetworkThroughput(*): 7.35 MB/sec - OverallThroughput: 31.53 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s004ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=5):(Total: 621.740ms, non-child: 621.740ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 178.58 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s236ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 76.64 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.39K (6387) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m21s - ScannerThreadsSysTime: 175.969ms - ScannerThreadsUserTime: 15s422ms - ScannerThreadsVoluntaryContextSwitches: 46.57K (46566) - TotalRawHdfsReadTime(*): 250.124ms - TotalReadThroughput: 9.81 MB/sec Instance 704a43b40e790124:4123ec6c75fea5de (host=vb0220.halxg.cloudera.com:22000):(Total: 32s812ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(1s000ms): 34.00 KB, 193.15 MB, 193.15 MB, 193.15 MB, 193.15 MB, 193.15 MB, 193.15 MB, 193.15 MB, 193.14 MB, 193.33 MB, 193.77 MB, 193.66 MB, 193.79 MB, 193.59 MB, 193.73 MB, 193.71 MB, 193.80 MB, 193.77 MB, 150.02 MB, 67.09 MB, 67.10 MB, 192.62 MB, 193.66 MB, 193.53 MB, 193.72 MB, 193.67 MB, 193.65 MB, 193.70 MB, 193.57 MB, 193.67 MB, 161.73 MB, 67.02 MB, 67.04 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.76 - BloomFilterBytes: 0 - PeakMemoryUsage: 196.21 MB (205745320) - PerHostPeakMemUsage: 3.69 GB (3959855888) - PrepareTime: 184.726ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s351ms - TotalStorageWaitTime: 298.073ms CodeGen:(Total: 573.571ms, non-child: 573.571ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.408ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.967ms - PrepareTime: 176.538ms DataStreamSender (dst_id=14):(Total: 32s251ms, non-child: 32s251ms, % non-child: 100.00%) - BytesSent: 976.11 MB (1023527339) - NetworkThroughput(*): 6.36 MB/sec - OverallThroughput: 30.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s079ms - ThriftTransmitTime(*): 2m33s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=5):(Total: 677.807ms, non-child: 677.807ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 246.42 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s617ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.74 MB (205245616) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 70.27 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 7.11K (7111) - ScannerThreadsTotalWallClockTime: 4m20s - MaterializeTupleTime(*): 4m18s - ScannerThreadsSysTime: 208.964ms - ScannerThreadsUserTime: 16s162ms - ScannerThreadsVoluntaryContextSwitches: 46.64K (46642) - TotalRawHdfsReadTime(*): 257.037ms - TotalReadThroughput: 9.96 MB/sec Fragment F02: Instance 704a43b40e790124:4123ec6c75fea5e5 (host=vb0214.halxg.cloudera.com:22000):(Total: 40s071ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.92 MB, 164.27 MB, 292.23 MB, 420.24 MB, 548.26 MB, 692.23 MB, 868.20 MB, 1.05 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.34 GB, 1.34 GB, 1.40 GB, 1.41 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.69 GB, 1.90 GB, 1.89 GB, 728.59 MB, 582.90 MB, 388.64 MB, 218.67 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2067898368) - PerHostPeakMemUsage: 3.86 GB (4145067752) - PrepareTime: 187.578ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 36s119ms - TotalNetworkReceiveTime: 11s607ms - TotalNetworkSendTime: 174.073ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 612.721ms, non-child: 612.721ms, % non-child: 100.00%) - CodegenTime: 829.892us - CompileTime: 45.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 382.965ms - PrepareTime: 179.491ms DataStreamSender (dst_id=12):(Total: 4s057ms, non-child: 4s057ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139901333) - NetworkThroughput(*): 50.28 MB/sec - OverallThroughput: 32.88 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 806.584ms - ThriftTransmitTime(*): 2s653ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=4):(Total: 35s986ms, non-child: 9s404ms, % non-child: 26.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 909.392us - GetResultsTime: 484.268ms - HTResizeTime: 1s132ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 369.33 K/sec - StreamingTime: 8s614ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s582ms, non-child: 13s060ms, % non-child: 49.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s247ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 2s033ms - GetNewBlockTime: 1.216ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s103ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 1.94 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.406us EXCHANGE_NODE (id=11):(Total: 3s577ms, non-child: 725.679ms, % non-child: 20.29%) BytesReceived(1s000ms): 14.42 MB, 80.90 MB, 152.64 MB, 224.42 MB, 284.29 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB - BytesReceived: 298.31 MB (312798809) - ConvertRowBatchTime: 293.303ms - DeserializeRowBatchTimer: 1s210ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 3.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s944ms, non-child: 3s144ms, % non-child: 31.63%) BytesReceived(1s000ms): 5.42 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 19.78 MB, 57.41 MB, 99.42 MB, 130.42 MB, 171.91 MB, 206.50 MB, 243.51 MB, 285.22 MB, 334.76 MB, 382.72 MB, 426.68 MB, 474.53 MB, 512.81 MB, 561.51 MB, 606.41 MB, 645.61 MB, 684.81 MB, 724.80 MB, 767.18 MB, 816.11 MB, 855.06 MB, 892.03 MB, 929.73 MB, 968.37 MB, 1007.05 MB, 1.01 GB, 1.04 GB - BytesReceived: 1.06 GB (1143177962) - ConvertRowBatchTime: 1s432ms - DeserializeRowBatchTimer: 5s834ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.19 M/sec - SendersBlockedTimer: 8s212ms - SendersBlockedTotalTimer(*): 1m52s Instance 704a43b40e790124:4123ec6c75fea5e8 (host=vb0204.halxg.cloudera.com:22000):(Total: 39s913ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.07 MB, 164.26 MB, 292.26 MB, 420.25 MB, 548.26 MB, 692.22 MB, 820.20 MB, 1012.20 MB, 1.12 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.69 GB, 1.90 GB, 1.89 GB, 728.59 MB, 582.89 MB, 388.63 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068154368) - PerHostPeakMemUsage: 3.86 GB (4144608464) - PrepareTime: 194.433ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 35s396ms - TotalNetworkReceiveTime: 12s641ms - TotalNetworkSendTime: 97.701ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 692.385ms, non-child: 692.385ms, % non-child: 100.00%) - CodegenTime: 794.677us - CompileTime: 48.697ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 452.340ms - PrepareTime: 183.666ms DataStreamSender (dst_id=12):(Total: 3s966ms, non-child: 3s966ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139871995) - NetworkThroughput(*): 54.10 MB/sec - OverallThroughput: 33.63 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 730.031ms - ThriftTransmitTime(*): 2s465ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=4):(Total: 35s930ms, non-child: 8s669ms, % non-child: 24.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 552.242us - GetResultsTime: 489.130ms - HTResizeTime: 1s026ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 369.86 K/sec - StreamingTime: 7s877ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 27s261ms, non-child: 12s897ms, % non-child: 47.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s146ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 2s387ms - GetNewBlockTime: 1.368ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s679ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.423us EXCHANGE_NODE (id=11):(Total: 3s613ms, non-child: 582.840ms, % non-child: 16.13%) BytesReceived(1s000ms): 13.16 MB, 78.79 MB, 150.33 MB, 222.14 MB, 282.89 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB, 298.28 MB - BytesReceived: 298.28 MB (312764581) - ConvertRowBatchTime: 270.531ms - DeserializeRowBatchTimer: 1s043ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 3.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 10s750ms, non-child: 2s984ms, % non-child: 27.76%) BytesReceived(1s000ms): 5.18 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 18.67 MB, 56.22 MB, 98.12 MB, 128.96 MB, 171.63 MB, 204.10 MB, 242.21 MB, 283.21 MB, 332.65 MB, 380.97 MB, 424.94 MB, 472.83 MB, 511.90 MB, 559.62 MB, 605.05 MB, 644.36 MB, 683.49 MB, 723.48 MB, 765.85 MB, 814.76 MB, 853.72 MB, 890.56 MB, 928.14 MB, 966.75 MB, 1005.42 MB, 1.01 GB, 1.04 GB - BytesReceived: 1.06 GB (1142764405) - ConvertRowBatchTime: 1s273ms - DeserializeRowBatchTimer: 5s816ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 4.80 M/sec - SendersBlockedTimer: 7s594ms - SendersBlockedTotalTimer(*): 1m32s Instance 704a43b40e790124:4123ec6c75fea5ea (host=vb0232.halxg.cloudera.com:22000):(Total: 39s776ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.86 MB, 228.26 MB, 356.30 MB, 484.26 MB, 612.24 MB, 724.22 MB, 884.20 MB, 1.10 GB, 1.15 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.78 GB, 1.89 GB, 1.89 GB, 680.02 MB, 485.76 MB, 315.79 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070970368) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 183.246ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 35s900ms - TotalNetworkReceiveTime: 11s690ms - TotalNetworkSendTime: 6.793ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 641.728ms, non-child: 641.728ms, % non-child: 100.00%) - CodegenTime: 776.673us - CompileTime: 69.063ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 392.401ms - PrepareTime: 179.137ms DataStreamSender (dst_id=12):(Total: 3s791ms, non-child: 3s791ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139932620) - NetworkThroughput(*): 70.11 MB/sec - OverallThroughput: 35.20 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 737.616ms - ThriftTransmitTime(*): 1s903ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=4):(Total: 35s970ms, non-child: 9s306ms, % non-child: 25.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 664.093us - GetResultsTime: 488.422ms - HTResizeTime: 1s230ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 369.59 K/sec - StreamingTime: 8s537ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s663ms, non-child: 13s245ms, % non-child: 49.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s284ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 2s015ms - GetNewBlockTime: 2.093ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s294ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 1.94 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.247us EXCHANGE_NODE (id=11):(Total: 3s525ms, non-child: 589.007ms, % non-child: 16.71%) BytesReceived(1s000ms): 7.57 MB, 67.94 MB, 139.01 MB, 211.47 MB, 275.81 MB, 298.18 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB, 298.41 MB - BytesReceived: 298.41 MB (312909172) - ConvertRowBatchTime: 268.891ms - DeserializeRowBatchTimer: 1s053ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 3.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s891ms, non-child: 2s569ms, % non-child: 25.97%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 13.33 MB, 50.33 MB, 91.66 MB, 125.83 MB, 163.81 MB, 198.40 MB, 236.97 MB, 275.48 MB, 324.55 MB, 375.26 MB, 418.95 MB, 465.79 MB, 506.96 MB, 551.65 MB, 599.38 MB, 638.61 MB, 677.71 MB, 717.73 MB, 760.34 MB, 806.38 MB, 848.67 MB, 885.61 MB, 922.94 MB, 961.62 MB, 1000.43 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.07 GB (1143542189) - ConvertRowBatchTime: 1s282ms - DeserializeRowBatchTimer: 5s251ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 7s183ms - SendersBlockedTotalTimer(*): 1m19s Instance 704a43b40e790124:4123ec6c75fea5eb (host=vb0216.halxg.cloudera.com:22000):(Total: 39s754ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.79 MB, 228.23 MB, 356.23 MB, 484.23 MB, 612.22 MB, 724.20 MB, 884.18 MB, 1.02 GB, 1.16 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.41 GB, 1.45 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.89 GB, 680.01 MB, 510.06 MB, 340.08 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068794368) - PerHostPeakMemUsage: 3.83 GB (4111212800) - PrepareTime: 186.398ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 37s775ms - TotalNetworkReceiveTime: 10s176ms - TotalNetworkSendTime: 63.190ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 679.281ms, non-child: 679.281ms, % non-child: 100.00%) - CodegenTime: 861.351us - CompileTime: 78.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 417.666ms - PrepareTime: 176.875ms DataStreamSender (dst_id=12):(Total: 3s785ms, non-child: 3s785ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139870564) - NetworkThroughput(*): 55.32 MB/sec - OverallThroughput: 35.24 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 764.695ms - ThriftTransmitTime(*): 2s411ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=4):(Total: 35s949ms, non-child: 9s360ms, % non-child: 26.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 637.890us - GetResultsTime: 500.210ms - HTResizeTime: 1s140ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 369.66 K/sec - StreamingTime: 8s556ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s588ms, non-child: 14s603ms, % non-child: 54.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s311ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 2s388ms - GetNewBlockTime: 1.266ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s178ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 1.94 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.682us EXCHANGE_NODE (id=11):(Total: 3s461ms, non-child: 598.602ms, % non-child: 17.29%) BytesReceived(1s000ms): 8.01 MB, 68.79 MB, 139.88 MB, 212.35 MB, 276.33 MB, 298.06 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB, 298.27 MB - BytesReceived: 298.27 MB (312758291) - ConvertRowBatchTime: 261.536ms - DeserializeRowBatchTimer: 1s081ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s522ms, non-child: 3s510ms, % non-child: 41.19%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.12 MB, 13.75 MB, 50.65 MB, 92.24 MB, 125.89 MB, 164.03 MB, 198.79 MB, 237.09 MB, 275.88 MB, 324.82 MB, 375.24 MB, 419.11 MB, 465.85 MB, 507.00 MB, 551.75 MB, 599.29 MB, 638.51 MB, 677.61 MB, 717.58 MB, 760.15 MB, 806.57 MB, 848.35 MB, 885.14 MB, 922.55 MB, 961.13 MB, 999.98 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1142596152) - ConvertRowBatchTime: 1s355ms - DeserializeRowBatchTimer: 6s235ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 10s196ms - SendersBlockedTotalTimer(*): 1m53s Instance 704a43b40e790124:4123ec6c75fea5e3 (host=vb0208.halxg.cloudera.com:22000):(Total: 39s643ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 78.23 MB, 228.23 MB, 356.27 MB, 484.26 MB, 548.24 MB, 708.23 MB, 868.20 MB, 1.02 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.43 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.73 GB, 1.89 GB, 1.89 GB, 680.02 MB, 510.04 MB, 340.09 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069485568) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 168.341ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 37s276ms - TotalNetworkReceiveTime: 10s573ms - TotalNetworkSendTime: 57.062ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 593.771ms, non-child: 593.771ms, % non-child: 100.00%) - CodegenTime: 989.365us - CompileTime: 54.013ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 374.602ms - PrepareTime: 163.640ms DataStreamSender (dst_id=12):(Total: 3s615ms, non-child: 3s615ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139861801) - NetworkThroughput(*): 59.83 MB/sec - OverallThroughput: 36.89 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 731.559ms - ThriftTransmitTime(*): 2s229ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=4):(Total: 36s011ms, non-child: 9s247ms, % non-child: 25.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.817ms - GetResultsTime: 498.421ms - HTResizeTime: 1s098ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 368.97 K/sec - StreamingTime: 8s467ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s764ms, non-child: 14s394ms, % non-child: 53.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s207ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 2s422ms - GetNewBlockTime: 1.370ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s080ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.559us EXCHANGE_NODE (id=11):(Total: 3s646ms, non-child: 603.894ms, % non-child: 16.56%) BytesReceived(1s000ms): 3.04 MB, 58.00 MB, 128.76 MB, 201.16 MB, 268.10 MB, 297.64 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB - BytesReceived: 298.24 MB (312725616) - ConvertRowBatchTime: 281.547ms - DeserializeRowBatchTimer: 1s063ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 3.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s723ms, non-child: 2s729ms, % non-child: 31.29%) BytesReceived(1s000ms): 3.14 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.16 MB, 45.65 MB, 84.67 MB, 120.48 MB, 156.84 MB, 191.01 MB, 231.67 MB, 269.14 MB, 317.28 MB, 369.09 MB, 411.81 MB, 458.45 MB, 500.91 MB, 542.91 MB, 593.17 MB, 632.63 MB, 671.78 MB, 711.61 MB, 752.28 MB, 798.68 MB, 842.78 MB, 879.51 MB, 916.17 MB, 955.39 MB, 993.28 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1142442155) - ConvertRowBatchTime: 1s338ms - DeserializeRowBatchTimer: 5s406ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.92 M/sec - SendersBlockedTimer: 7s610ms - SendersBlockedTotalTimer(*): 1m3s Instance 704a43b40e790124:4123ec6c75fea5f0 (host=vb0222.halxg.cloudera.com:22000):(Total: 39s527ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 12.45 MB, 164.24 MB, 356.24 MB, 484.28 MB, 548.25 MB, 708.21 MB, 884.20 MB, 1.05 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.34 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.54 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 680.03 MB, 485.76 MB, 340.07 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069178368) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 194.542ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 35s918ms - TotalNetworkReceiveTime: 11s479ms - TotalNetworkSendTime: 46.109ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 632.266ms, non-child: 632.266ms, % non-child: 100.00%) - CodegenTime: 896.265us - CompileTime: 56.373ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.136ms - PrepareTime: 178.919ms DataStreamSender (dst_id=12):(Total: 3s522ms, non-child: 3s522ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139864786) - NetworkThroughput(*): 73.11 MB/sec - OverallThroughput: 37.87 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 766.952ms - ThriftTransmitTime(*): 1s824ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=4):(Total: 35s986ms, non-child: 9s536ms, % non-child: 26.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.115ms - GetResultsTime: 480.928ms - HTResizeTime: 1s174ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 369.27 K/sec - StreamingTime: 8s747ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s449ms, non-child: 13s128ms, % non-child: 49.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s266ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 2s016ms - GetNewBlockTime: 2.154ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s087ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 1.95 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.216us EXCHANGE_NODE (id=11):(Total: 3s553ms, non-child: 617.004ms, % non-child: 17.36%) BytesReceived(1s000ms): 2.16 MB, 55.61 MB, 126.38 MB, 198.73 MB, 266.20 MB, 297.52 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB, 298.25 MB - BytesReceived: 298.25 MB (312740294) - ConvertRowBatchTime: 295.908ms - DeserializeRowBatchTimer: 1s046ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s767ms, non-child: 3s171ms, % non-child: 32.47%) BytesReceived(1s000ms): 2.42 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.18 MB, 44.43 MB, 83.40 MB, 119.00 MB, 155.70 MB, 190.15 MB, 230.61 MB, 268.12 MB, 315.93 MB, 367.25 MB, 410.49 MB, 456.56 MB, 500.03 MB, 540.85 MB, 591.89 MB, 631.23 MB, 670.40 MB, 710.29 MB, 750.62 MB, 797.68 MB, 841.97 MB, 878.58 MB, 915.34 MB, 954.56 MB, 992.78 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1142851473) - ConvertRowBatchTime: 1s354ms - DeserializeRowBatchTimer: 6s094ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.28 M/sec - SendersBlockedTimer: 8s102ms - SendersBlockedTotalTimer(*): 1m13s Instance 704a43b40e790124:4123ec6c75fea5ef (host=vb0224.halxg.cloudera.com:22000):(Total: 39s510ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.33 MB, 164.20 MB, 292.24 MB, 420.23 MB, 548.21 MB, 692.19 MB, 804.18 MB, 980.18 MB, 1.10 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.34 GB, 1.34 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.69 GB, 1.90 GB, 1.89 GB, 728.58 MB, 534.32 MB, 340.07 MB, 145.84 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.92 GB (2066131968) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 192.427ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 37s384ms - TotalNetworkReceiveTime: 10s531ms - TotalNetworkSendTime: 173.594ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 642.141ms, non-child: 642.141ms, % non-child: 100.00%) - CodegenTime: 924.471us - CompileTime: 60.562ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 392.675ms - PrepareTime: 177.759ms DataStreamSender (dst_id=12):(Total: 3s527ms, non-child: 3s527ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139837437) - NetworkThroughput(*): 50.07 MB/sec - OverallThroughput: 37.80 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 811.948ms - ThriftTransmitTime(*): 2s663ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=4):(Total: 35s957ms, non-child: 9s152ms, % non-child: 25.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 560.159us - GetResultsTime: 476.869ms - HTResizeTime: 1s073ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 369.47 K/sec - StreamingTime: 8s356ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s804ms, non-child: 14s393ms, % non-child: 53.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s276ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 2s749ms - GetNewBlockTime: 1.198ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s647ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.383us EXCHANGE_NODE (id=11):(Total: 3s521ms, non-child: 585.127ms, % non-child: 16.62%) BytesReceived(1s000ms): 13.71 MB, 79.65 MB, 151.37 MB, 223.13 MB, 283.39 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB - BytesReceived: 298.17 MB (312649552) - ConvertRowBatchTime: 277.780ms - DeserializeRowBatchTimer: 1s017ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s889ms, non-child: 3s232ms, % non-child: 36.37%) BytesReceived(1s000ms): 5.25 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 19.13 MB, 56.67 MB, 98.64 MB, 129.63 MB, 171.56 MB, 205.06 MB, 242.72 MB, 284.09 MB, 333.50 MB, 381.67 MB, 425.82 MB, 473.65 MB, 512.42 MB, 560.66 MB, 605.72 MB, 644.98 MB, 684.17 MB, 724.17 MB, 766.46 MB, 815.31 MB, 854.23 MB, 891.10 MB, 928.69 MB, 967.29 MB, 1005.91 MB, 1.01 GB, 1.04 GB - BytesReceived: 1.06 GB (1142716655) - ConvertRowBatchTime: 1s410ms - DeserializeRowBatchTimer: 5s934ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 5.81 M/sec - SendersBlockedTimer: 8s049ms - SendersBlockedTotalTimer(*): 1m53s Instance 704a43b40e790124:4123ec6c75fea5e9 (host=vb0226.halxg.cloudera.com:22000):(Total: 39s469ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 22.47 MB, 228.22 MB, 356.23 MB, 484.22 MB, 612.22 MB, 708.19 MB, 932.18 MB, 1.12 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.42 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.74 GB, 1.89 GB, 1.89 GB, 680.02 MB, 485.77 MB, 291.51 MB, 97.28 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068768768) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 190.564ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 34s638ms - TotalNetworkReceiveTime: 12s157ms - TotalNetworkSendTime: 61.811ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 722.402ms, non-child: 722.402ms, % non-child: 100.00%) - CodegenTime: 812.451us - CompileTime: 72.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 462.880ms - PrepareTime: 175.768ms DataStreamSender (dst_id=12):(Total: 3s569ms, non-child: 3s569ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139868405) - NetworkThroughput(*): 62.87 MB/sec - OverallThroughput: 37.37 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 766.627ms - ThriftTransmitTime(*): 2s121ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=4):(Total: 35s866ms, non-child: 9s181ms, % non-child: 25.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 719.571us - GetResultsTime: 478.610ms - HTResizeTime: 1s091ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 370.44 K/sec - StreamingTime: 8s405ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s684ms, non-child: 12s756ms, % non-child: 47.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s149ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s688ms - GetNewBlockTime: 1.664ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s347ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.654us EXCHANGE_NODE (id=11):(Total: 3s560ms, non-child: 676.835ms, % non-child: 19.01%) BytesReceived(1s000ms): 4.56 MB, 61.50 MB, 132.36 MB, 204.77 MB, 270.80 MB, 297.76 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB - BytesReceived: 298.23 MB (312720059) - ConvertRowBatchTime: 295.944ms - DeserializeRowBatchTimer: 1s159ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 10s367ms, non-child: 2s715ms, % non-child: 26.19%) BytesReceived(1s000ms): 4.38 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.46 MB, 47.17 MB, 87.16 MB, 123.06 MB, 159.75 MB, 192.83 MB, 233.32 MB, 269.97 MB, 319.34 MB, 371.25 MB, 414.24 MB, 460.74 MB, 501.74 MB, 545.63 MB, 595.02 MB, 634.30 MB, 673.64 MB, 713.60 MB, 754.92 MB, 800.82 MB, 844.68 MB, 881.52 MB, 918.15 MB, 957.52 MB, 995.23 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1142755891) - ConvertRowBatchTime: 1s296ms - DeserializeRowBatchTimer: 5s340ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 4.98 M/sec - SendersBlockedTimer: 6s774ms - SendersBlockedTotalTimer(*): 1m7s Instance 704a43b40e790124:4123ec6c75fea5e6 (host=vb0212.halxg.cloudera.com:22000):(Total: 39s320ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 78.81 MB, 228.27 MB, 356.23 MB, 484.26 MB, 552.26 MB, 708.22 MB, 884.20 MB, 1.05 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.34 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.73 GB, 1.89 GB, 1.89 GB, 680.01 MB, 485.77 MB, 291.52 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068615168) - PerHostPeakMemUsage: 3.86 GB (4145505000) - PrepareTime: 186.824ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 36s160ms - TotalNetworkReceiveTime: 10s995ms - TotalNetworkSendTime: 40.000ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 657.874ms, non-child: 657.874ms, % non-child: 100.00%) - CodegenTime: 779.862us - CompileTime: 86.341ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 387.774ms - PrepareTime: 174.692ms DataStreamSender (dst_id=12):(Total: 3s381ms, non-child: 3s381ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139814875) - NetworkThroughput(*): 67.49 MB/sec - OverallThroughput: 39.44 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 758.592ms - ThriftTransmitTime(*): 1s975ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=4):(Total: 35s926ms, non-child: 9s254ms, % non-child: 25.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 582.886us - GetResultsTime: 458.680ms - HTResizeTime: 1s077ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 369.72 K/sec - StreamingTime: 8s500ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s671ms, non-child: 13s896ms, % non-child: 52.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s428ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 2s113ms - GetNewBlockTime: 1.149ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s737ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 905.000ns EXCHANGE_NODE (id=11):(Total: 3s366ms, non-child: 666.321ms, % non-child: 19.79%) BytesReceived(1s000ms): 3.26 MB, 58.55 MB, 129.33 MB, 201.72 MB, 268.46 MB, 297.58 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB, 298.16 MB - BytesReceived: 298.16 MB (312647238) - ConvertRowBatchTime: 295.625ms - DeserializeRowBatchTimer: 1s187ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 4.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s408ms, non-child: 2s951ms, % non-child: 31.37%) BytesReceived(1s000ms): 3.35 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.17 MB, 45.90 MB, 85.13 MB, 120.96 MB, 157.31 MB, 191.48 MB, 232.05 MB, 269.38 MB, 317.83 MB, 369.86 MB, 412.36 MB, 459.05 MB, 501.14 MB, 543.55 MB, 593.73 MB, 632.95 MB, 672.20 MB, 711.99 MB, 752.64 MB, 798.94 MB, 843.07 MB, 879.83 MB, 916.56 MB, 955.85 MB, 993.49 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1142569947) - ConvertRowBatchTime: 1s308ms - DeserializeRowBatchTimer: 6s195ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 5.48 M/sec - SendersBlockedTimer: 7s243ms - SendersBlockedTotalTimer(*): 1m5s Instance 704a43b40e790124:4123ec6c75fea5ee (host=vb0228.halxg.cloudera.com:22000):(Total: 39s274ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 10.65 MB, 175.56 MB, 292.46 MB, 485.96 MB, 548.30 MB, 708.22 MB, 852.20 MB, 1.02 GB, 1.15 GB, 1.18 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 704.29 MB, 485.76 MB, 291.51 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069152768) - PerHostPeakMemUsage: 3.86 GB (4146282224) - PrepareTime: 189.715ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 37s505ms - TotalNetworkReceiveTime: 9s748ms - TotalNetworkSendTime: 63.755ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 744.297ms, non-child: 744.297ms, % non-child: 100.00%) - CodegenTime: 818.520us - CompileTime: 62.243ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 495.676ms - PrepareTime: 175.388ms DataStreamSender (dst_id=12):(Total: 3s385ms, non-child: 3s385ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139888820) - NetworkThroughput(*): 60.07 MB/sec - OverallThroughput: 39.41 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 734.294ms - ThriftTransmitTime(*): 2s220ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=4):(Total: 35s863ms, non-child: 9s125ms, % non-child: 25.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 738.424us - GetResultsTime: 488.718ms - HTResizeTime: 1s054ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 370.58 K/sec - StreamingTime: 8s333ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s737ms, non-child: 14s954ms, % non-child: 55.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s172ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 2s185ms - GetNewBlockTime: 2.506ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s846ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.561us EXCHANGE_NODE (id=11):(Total: 2s504ms, non-child: 1s484ms, % non-child: 59.25%) BytesReceived(1s000ms): 1.85 MB, 54.47 MB, 125.22 MB, 197.54 MB, 265.29 MB, 297.50 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB - BytesReceived: 298.31 MB (312802517) - ConvertRowBatchTime: 490.691ms - DeserializeRowBatchTimer: 1s801ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 5.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s278ms, non-child: 2s931ms, % non-child: 31.60%) BytesReceived(1s000ms): 2.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.16 MB, 43.86 MB, 82.58 MB, 118.12 MB, 155.05 MB, 190.00 MB, 229.87 MB, 267.42 MB, 315.14 MB, 365.96 MB, 409.57 MB, 455.52 MB, 499.70 MB, 539.65 MB, 590.81 MB, 630.32 MB, 669.49 MB, 709.31 MB, 749.42 MB, 796.66 MB, 840.84 MB, 877.59 MB, 914.39 MB, 953.74 MB, 992.01 MB, 1.01 GB, 1.03 GB, 1.06 GB - BytesReceived: 1.06 GB (1143074302) - ConvertRowBatchTime: 1s335ms - DeserializeRowBatchTimer: 5s370ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 5.56 M/sec - SendersBlockedTimer: 9s524ms - SendersBlockedTotalTimer(*): 1m33s Instance 704a43b40e790124:4123ec6c75fea5ec (host=vb0206.halxg.cloudera.com:22000):(Total: 39s251ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.09 MB, 164.34 MB, 292.92 MB, 468.22 MB, 548.23 MB, 708.19 MB, 916.18 MB, 1.10 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 728.59 MB, 510.05 MB, 291.51 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068128768) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 197.533ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 34s480ms - TotalNetworkReceiveTime: 12s407ms - TotalNetworkSendTime: 64.450ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 749.939ms, non-child: 749.939ms, % non-child: 100.00%) - CodegenTime: 934.238us - CompileTime: 68.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 487.987ms - PrepareTime: 186.818ms DataStreamSender (dst_id=12):(Total: 3s377ms, non-child: 3s377ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139902454) - NetworkThroughput(*): 64.80 MB/sec - OverallThroughput: 39.50 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 774.165ms - ThriftTransmitTime(*): 2s058ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=4):(Total: 35s859ms, non-child: 8s774ms, % non-child: 24.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.609ms - GetResultsTime: 457.762ms - HTResizeTime: 1s224ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 370.65 K/sec - StreamingTime: 8s006ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 27s085ms, non-child: 12s951ms, % non-child: 47.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s737ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 1s952ms - GetNewBlockTime: 1.850ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s642ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.599us EXCHANGE_NODE (id=11):(Total: 2s954ms, non-child: 1s213ms, % non-child: 41.08%) BytesReceived(1s000ms): 19.27 MB, 87.99 MB, 160.07 MB, 231.48 MB, 287.99 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB, 298.32 MB - BytesReceived: 298.32 MB (312815925) - ConvertRowBatchTime: 360.877ms - DeserializeRowBatchTimer: 1s687ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 4.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 11s179ms, non-child: 2s546ms, % non-child: 22.78%) BytesReceived(1s000ms): 6.81 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.18 MB, 22.56 MB, 60.53 MB, 103.07 MB, 134.42 MB, 172.17 MB, 208.89 MB, 246.71 MB, 290.99 MB, 340.36 MB, 387.03 MB, 431.06 MB, 479.43 MB, 516.81 MB, 566.71 MB, 610.52 MB, 649.78 MB, 689.19 MB, 729.15 MB, 771.61 MB, 820.28 MB, 859.20 MB, 895.92 MB, 933.68 MB, 972.29 MB, 1010.82 MB, 1.02 GB, 1.05 GB - BytesReceived: 1.06 GB (1143230046) - ConvertRowBatchTime: 1s182ms - DeserializeRowBatchTimer: 5s035ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 4.62 M/sec - SendersBlockedTimer: 7s080ms - SendersBlockedTotalTimer(*): 1m46s Instance 704a43b40e790124:4123ec6c75fea5ed (host=vb0220.halxg.cloudera.com:22000):(Total: 39s233ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 772.50 KB, 164.29 MB, 292.32 MB, 420.29 MB, 548.25 MB, 692.23 MB, 852.20 MB, 1.05 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.35 GB, 1.38 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.67 GB, 1.91 GB, 1.89 GB, 728.58 MB, 534.33 MB, 340.08 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.92 GB (2066951168) - PerHostPeakMemUsage: 3.83 GB (4109676800) - PrepareTime: 186.729ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 36s298ms - TotalNetworkReceiveTime: 10s611ms - TotalNetworkSendTime: 46.408ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 658.662ms, non-child: 658.662ms, % non-child: 100.00%) - CodegenTime: 846.577us - CompileTime: 50.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 425.030ms - PrepareTime: 175.657ms DataStreamSender (dst_id=12):(Total: 3s234ms, non-child: 3s234ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139866337) - NetworkThroughput(*): 57.72 MB/sec - OverallThroughput: 41.24 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 723.573ms - ThriftTransmitTime(*): 2s310ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=4):(Total: 35s982ms, non-child: 9s305ms, % non-child: 25.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 666.578us - GetResultsTime: 489.241ms - HTResizeTime: 1s054ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 369.29 K/sec - StreamingTime: 8s485ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s677ms, non-child: 14s097ms, % non-child: 52.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s965ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s976ms - GetNewBlockTime: 1.833ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s534ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.231us EXCHANGE_NODE (id=11):(Total: 2s816ms, non-child: 862.387ms, % non-child: 30.62%) BytesReceived(1s000ms): 12.37 MB, 77.33 MB, 148.82 MB, 220.76 MB, 282.02 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB - BytesReceived: 298.29 MB (312777699) - ConvertRowBatchTime: 425.209ms - DeserializeRowBatchTimer: 1s219ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 4.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s763ms, non-child: 3s168ms, % non-child: 32.45%) BytesReceived(1s000ms): 5.10 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.18 MB, 17.99 MB, 55.40 MB, 97.49 MB, 128.40 MB, 170.59 MB, 203.38 MB, 241.48 MB, 282.26 MB, 331.65 MB, 380.09 MB, 424.06 MB, 472.05 MB, 511.56 MB, 558.61 MB, 604.12 MB, 643.31 MB, 682.58 MB, 722.66 MB, 764.98 MB, 813.70 MB, 853.02 MB, 889.80 MB, 927.40 MB, 965.97 MB, 1004.67 MB, 1.01 GB, 1.04 GB - BytesReceived: 1.06 GB (1142699685) - ConvertRowBatchTime: 1s340ms - DeserializeRowBatchTimer: 5s882ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.29 M/sec - SendersBlockedTimer: 8s117ms - SendersBlockedTotalTimer(*): 1m51s Instance 704a43b40e790124:4123ec6c75fea5e7 (host=vb0234.halxg.cloudera.com:22000):(Total: 39s126ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 770.50 KB, 164.25 MB, 292.25 MB, 420.25 MB, 548.26 MB, 692.22 MB, 852.20 MB, 1.02 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.38 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.69 GB, 1.90 GB, 1.89 GB, 728.57 MB, 534.34 MB, 340.08 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069357568) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 203.967ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 35s802ms - TotalNetworkReceiveTime: 11s006ms - TotalNetworkSendTime: 85.894ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 763.588ms, non-child: 763.588ms, % non-child: 100.00%) - CodegenTime: 2.969ms - CompileTime: 56.154ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 522.513ms - PrepareTime: 174.052ms DataStreamSender (dst_id=12):(Total: 3s304ms, non-child: 3s304ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139943493) - NetworkThroughput(*): 64.50 MB/sec - OverallThroughput: 40.39 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 761.068ms - ThriftTransmitTime(*): 2s069ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=4):(Total: 35s808ms, non-child: 9s102ms, % non-child: 25.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.655ms - GetResultsTime: 448.512ms - HTResizeTime: 1s108ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 371.32 K/sec - StreamingTime: 8s344ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s705ms, non-child: 13s976ms, % non-child: 52.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s515ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s924ms - GetNewBlockTime: 1.429ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s812ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.682us EXCHANGE_NODE (id=11):(Total: 3s150ms, non-child: 549.641ms, % non-child: 17.44%) BytesReceived(1s000ms): 12.25 MB, 77.09 MB, 148.55 MB, 220.57 MB, 282.02 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB, 298.48 MB - BytesReceived: 298.48 MB (312974476) - ConvertRowBatchTime: 259.989ms - DeserializeRowBatchTimer: 1s034ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 4.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s577ms, non-child: 2s799ms, % non-child: 29.22%) BytesReceived(1s000ms): 5.09 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 17.85 MB, 55.31 MB, 97.25 MB, 128.11 MB, 170.22 MB, 203.22 MB, 241.43 MB, 282.16 MB, 331.80 MB, 380.43 MB, 424.31 MB, 472.32 MB, 511.83 MB, 558.85 MB, 604.43 MB, 643.61 MB, 682.83 MB, 722.88 MB, 765.29 MB, 814.00 MB, 853.42 MB, 890.26 MB, 927.82 MB, 966.32 MB, 1005.04 MB, 1.01 GB, 1.04 GB - BytesReceived: 1.06 GB (1143412280) - ConvertRowBatchTime: 1s292ms - DeserializeRowBatchTimer: 5s390ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 5.39 M/sec - SendersBlockedTimer: 7s155ms - SendersBlockedTotalTimer(*): 1m33s Instance 704a43b40e790124:4123ec6c75fea5f1 (host=vb0218.halxg.cloudera.com:22000):(Total: 38s995ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 9.05 MB, 164.23 MB, 292.31 MB, 484.27 MB, 548.24 MB, 708.22 MB, 852.20 MB, 1.00 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.40 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.41 GB, 1.53 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.60 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.89 GB, 1.89 GB, 680.02 MB, 485.76 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072608768) - PerHostPeakMemUsage: 3.83 GB (4116367584) - PrepareTime: 193.465ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 38s808ms - TotalNetworkReceiveTime: 8s127ms - TotalNetworkSendTime: 59.075ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 686.539ms, non-child: 686.539ms, % non-child: 100.00%) - CodegenTime: 814.762us - CompileTime: 42.820ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 453.784ms - PrepareTime: 176.939ms DataStreamSender (dst_id=12):(Total: 3s053ms, non-child: 3s053ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139855385) - NetworkThroughput(*): 68.55 MB/sec - OverallThroughput: 43.68 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 756.865ms - ThriftTransmitTime(*): 1s945ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=4):(Total: 35s927ms, non-child: 10s316ms, % non-child: 28.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 761.253us - GetResultsTime: 481.064ms - HTResizeTime: 1s038ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 369.84 K/sec - StreamingTime: 9s491ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s611ms, non-child: 15s111ms, % non-child: 59.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s925ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 2s183ms - GetNewBlockTime: 1.620ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s267ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.413us EXCHANGE_NODE (id=11):(Total: 2s830ms, non-child: 881.411ms, % non-child: 31.14%) BytesReceived(1s000ms): 19.85 MB, 88.66 MB, 160.78 MB, 232.11 MB, 288.22 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB, 298.24 MB - BytesReceived: 298.24 MB (312725072) - ConvertRowBatchTime: 451.191ms - DeserializeRowBatchTimer: 1s215ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 4.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s669ms, non-child: 4s540ms, % non-child: 59.21%) BytesReceived(1s000ms): 6.99 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.15 MB, 22.67 MB, 60.78 MB, 103.35 MB, 135.09 MB, 172.53 MB, 209.27 MB, 246.93 MB, 291.52 MB, 340.87 MB, 387.19 MB, 431.24 MB, 479.63 MB, 516.68 MB, 566.95 MB, 610.53 MB, 649.67 MB, 689.10 MB, 728.96 MB, 771.48 MB, 820.17 MB, 859.17 MB, 895.87 MB, 933.67 MB, 972.19 MB, 1010.68 MB, 1.01 GB, 1.05 GB - BytesReceived: 1.06 GB (1142839064) - ConvertRowBatchTime: 1s683ms - DeserializeRowBatchTimer: 6s363ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.73 M/sec - SendersBlockedTimer: 19s483ms - SendersBlockedTotalTimer(*): 4m Instance 704a43b40e790124:4123ec6c75fea5e4 (host=vb0230.halxg.cloudera.com:22000):(Total: 38s955ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.08 MB, 164.26 MB, 292.26 MB, 480.24 MB, 548.23 MB, 692.23 MB, 884.20 MB, 1.08 GB, 1.15 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 704.30 MB, 485.78 MB, 267.24 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069024768) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 193.096ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 34s055ms - TotalNetworkReceiveTime: 12s643ms - TotalNetworkSendTime: 43.640ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 681.927ms, non-child: 681.927ms, % non-child: 100.00%) - CodegenTime: 898.707us - CompileTime: 52.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 441.231ms - PrepareTime: 179.494ms DataStreamSender (dst_id=12):(Total: 3s007ms, non-child: 3s007ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139930495) - NetworkThroughput(*): 79.21 MB/sec - OverallThroughput: 44.38 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 724.510ms - ThriftTransmitTime(*): 1s684ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=4):(Total: 35s925ms, non-child: 8s835ms, % non-child: 24.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.080ms - GetResultsTime: 481.698ms - HTResizeTime: 1s063ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 370.03 K/sec - StreamingTime: 8s057ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 27s090ms, non-child: 12s671ms, % non-child: 46.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s311ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 2s023ms - GetNewBlockTime: 1.472ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s710ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.544us EXCHANGE_NODE (id=11):(Total: 3s451ms, non-child: 569.402ms, % non-child: 16.50%) BytesReceived(1s000ms): 19.30 MB, 88.04 MB, 160.15 MB, 231.59 MB, 288.08 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB, 298.39 MB - BytesReceived: 298.39 MB (312883926) - ConvertRowBatchTime: 280.233ms - DeserializeRowBatchTimer: 1s011ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 10s967ms, non-child: 2s732ms, % non-child: 24.92%) BytesReceived(1s000ms): 6.76 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.10 MB, 22.45 MB, 60.36 MB, 103.00 MB, 134.49 MB, 172.14 MB, 208.88 MB, 246.63 MB, 290.89 MB, 340.41 MB, 386.96 MB, 431.01 MB, 479.41 MB, 516.73 MB, 566.63 MB, 610.38 MB, 649.58 MB, 688.93 MB, 728.88 MB, 771.34 MB, 819.99 MB, 858.92 MB, 895.68 MB, 933.40 MB, 972.17 MB, 1010.75 MB, 1.02 GB, 1.05 GB - BytesReceived: 1.06 GB (1143214023) - ConvertRowBatchTime: 1s313ms - DeserializeRowBatchTimer: 5s425ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 4.71 M/sec - SendersBlockedTimer: 7s161ms - SendersBlockedTotalTimer(*): 50s212ms Fragment F01: Instance 704a43b40e790124:4123ec6c75fea5f7 (host=vb0234.halxg.cloudera.com:22000):(Total: 5s087ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 68.00 KB, 210.20 MB, 210.19 MB, 210.40 MB, 162.59 MB, 162.69 MB, 162.86 MB, 162.76 MB, 114.76 MB, 114.75 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.72 MB (220955400) - PerHostPeakMemUsage: 1.93 GB (2070093120) - PrepareTime: 174.154ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 34s549ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21.885ms - TotalStorageWaitTime: 97.980ms CodeGen:(Total: 537.822ms, non-child: 537.822ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 359.346ms - PrepareTime: 164.554ms DataStreamSender (dst_id=11):(Total: 4s812ms, non-child: 4s812ms, % non-child: 100.00%) - BytesSent: 354.57 MB (371798456) - NetworkThroughput(*): 57.45 MB/sec - OverallThroughput: 73.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s831ms - ThriftTransmitTime(*): 6s172ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=2):(Total: 426.829ms, non-child: 426.829ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 505.496ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.32 MB (220537520) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 37.85 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1539) - ScannerThreadsTotalWallClockTime: 29s192ms - MaterializeTupleTime(*): 28s534ms - ScannerThreadsSysTime: 28.992ms - ScannerThreadsUserTime: 4s522ms - ScannerThreadsVoluntaryContextSwitches: 15.70K (15701) - TotalRawHdfsReadTime(*): 138.878ms - TotalReadThroughput: 37.44 MB/sec Instance 704a43b40e790124:4123ec6c75fea5fa (host=vb0206.halxg.cloudera.com:22000):(Total: 4s800ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 0, 176.56 MB, 176.83 MB, 176.78 MB, 160.78 MB, 137.10 MB, 136.98 MB, 136.90 MB, 97.16 MB, 97.18 MB, 22.39 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 2 - AverageThreadTokens: 5.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185654560) - PerHostPeakMemUsage: 1.78 GB (1908241616) - PrepareTime: 186.386ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 27s914ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20.493ms - TotalStorageWaitTime: 144.944ms CodeGen:(Total: 587.092ms, non-child: 587.092ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 396.991ms - PrepareTime: 181.835ms DataStreamSender (dst_id=11):(Total: 4s499ms, non-child: 4s499ms, % non-child: 100.00%) - BytesSent: 299.31 MB (313851530) - NetworkThroughput(*): 53.33 MB/sec - OverallThroughput: 66.51 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s720ms - ThriftTransmitTime(*): 5s612ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=2):(Total: 464.608ms, non-child: 464.608ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 149.36 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 4.60 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 504.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1013.66 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 28.96 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1641) - ScannerThreadsTotalWallClockTime: 22s851ms - MaterializeTupleTime(*): 22s145ms - ScannerThreadsSysTime: 52.990ms - ScannerThreadsUserTime: 4s250ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13027) - TotalRawHdfsReadTime(*): 153.879ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f5 (host=vb0232.halxg.cloudera.com:22000):(Total: 4s776ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 211.87 MB, 211.85 MB, 211.93 MB, 211.98 MB, 150.06 MB, 138.12 MB, 136.98 MB, 96.82 MB, 81.42 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.29 MB (222603448) - PerHostPeakMemUsage: 1.87 GB (2002711672) - PrepareTime: 191.027ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 32s563ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24.011ms - TotalStorageWaitTime: 228.695ms CodeGen:(Total: 559.379ms, non-child: 559.379ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.355ms - PrepareTime: 179.992ms DataStreamSender (dst_id=11):(Total: 4s459ms, non-child: 4s459ms, % non-child: 100.00%) - BytesSent: 345.39 MB (362172248) - NetworkThroughput(*): 59.16 MB/sec - OverallThroughput: 77.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s752ms - ThriftTransmitTime(*): 5s838ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=2):(Total: 484.048ms, non-child: 484.048ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 493.533ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.90 MB (222193808) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 32.76 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1381) - ScannerThreadsTotalWallClockTime: 27s641ms - MaterializeTupleTime(*): 26s749ms - ScannerThreadsSysTime: 18.993ms - ScannerThreadsUserTime: 4s707ms - ScannerThreadsVoluntaryContextSwitches: 15.37K (15367) - TotalRawHdfsReadTime(*): 150.076ms - TotalReadThroughput: 36.79 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f8 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s755ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 42.67 MB, 176.61 MB, 176.73 MB, 160.89 MB, 136.94 MB, 137.01 MB, 137.12 MB, 96.98 MB, 97.21 MB, 39.10 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 5.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185654560) - PerHostPeakMemUsage: 1.76 GB (1892297640) - PrepareTime: 166.110ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 27s484ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 29.592ms - TotalStorageWaitTime: 222.169ms CodeGen:(Total: 489.521ms, non-child: 489.521ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 320.354ms - PrepareTime: 164.677ms DataStreamSender (dst_id=11):(Total: 4s454ms, non-child: 4s454ms, % non-child: 100.00%) - BytesSent: 294.50 MB (308801280) - NetworkThroughput(*): 56.04 MB/sec - OverallThroughput: 66.11 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s653ms - ThriftTransmitTime(*): 5s255ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=2):(Total: 444.453ms, non-child: 444.453ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 32.49 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 4.80 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 728.117ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 30.28 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2286) - ScannerThreadsTotalWallClockTime: 22s625ms - MaterializeTupleTime(*): 21s605ms - ScannerThreadsSysTime: 76.987ms - ScannerThreadsUserTime: 6s686ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13020) - TotalRawHdfsReadTime(*): 112.252ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f9 (host=vb0228.halxg.cloudera.com:22000):(Total: 4s665ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 0, 201.53 MB, 201.84 MB, 201.88 MB, 201.77 MB, 154.12 MB, 154.35 MB, 137.16 MB, 96.90 MB, 97.05 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.20 MB (212024232) - PerHostPeakMemUsage: 1.85 GB (1982309224) - PrepareTime: 190.734ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 29s879ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26.431ms - TotalStorageWaitTime: 110.104ms CodeGen:(Total: 610.038ms, non-child: 610.038ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 417.147ms - PrepareTime: 175.492ms DataStreamSender (dst_id=11):(Total: 4s371ms, non-child: 4s371ms, % non-child: 100.00%) - BytesSent: 329.30 MB (345296842) - NetworkThroughput(*): 51.47 MB/sec - OverallThroughput: 75.33 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s688ms - ThriftTransmitTime(*): 6s397ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=2):(Total: 454.497ms, non-child: 454.497ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.67 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 486.080ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.77 MB (211573672) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 33.00 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1483) - ScannerThreadsTotalWallClockTime: 24s902ms - MaterializeTupleTime(*): 24s252ms - ScannerThreadsSysTime: 21.995ms - ScannerThreadsUserTime: 4s012ms - ScannerThreadsVoluntaryContextSwitches: 14.52K (14520) - TotalRawHdfsReadTime(*): 110.395ms - TotalReadThroughput: 38.65 MB/sec Instance 704a43b40e790124:4123ec6c75fea5fb (host=vb0204.halxg.cloudera.com:22000):(Total: 4s616ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.64 MB, 176.69 MB, 176.80 MB, 137.07 MB, 137.02 MB, 137.11 MB, 96.99 MB, 97.13 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646408) - PerHostPeakMemUsage: 1.69 GB (1816443688) - PrepareTime: 196.585ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 26s598ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.913ms - TotalStorageWaitTime: 216.634ms CodeGen:(Total: 557.282ms, non-child: 557.282ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 355.963ms - PrepareTime: 184.851ms DataStreamSender (dst_id=11):(Total: 4s276ms, non-child: 4s276ms, % non-child: 100.00%) - BytesSent: 293.47 MB (307728115) - NetworkThroughput(*): 59.63 MB/sec - OverallThroughput: 68.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s562ms - ThriftTransmitTime(*): 4s921ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=2):(Total: 513.835ms, non-child: 513.835ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 448.545ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 26.20 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1693) - ScannerThreadsTotalWallClockTime: 21s828ms - MaterializeTupleTime(*): 21s063ms - ScannerThreadsSysTime: 61.988ms - ScannerThreadsUserTime: 3s661ms - ScannerThreadsVoluntaryContextSwitches: 12.99K (12987) - TotalRawHdfsReadTime(*): 137.844ms - TotalReadThroughput: 34.66 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f3 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s533ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.74 MB, 193.70 MB, 193.89 MB, 146.04 MB, 137.06 MB, 136.89 MB, 96.96 MB, 97.06 MB, 116.00 KB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.17 MB (203604736) - PerHostPeakMemUsage: 1.71 GB (1835947352) - PrepareTime: 175.577ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 28s609ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30.330ms - TotalStorageWaitTime: 123.122ms CodeGen:(Total: 514.269ms, non-child: 514.269ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 333.601ms - PrepareTime: 165.089ms DataStreamSender (dst_id=11):(Total: 4s261ms, non-child: 4s261ms, % non-child: 100.00%) - BytesSent: 318.23 MB (333689004) - NetworkThroughput(*): 58.34 MB/sec - OverallThroughput: 74.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s589ms - ThriftTransmitTime(*): 5s455ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=2):(Total: 428.231ms, non-child: 428.231ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 465.279ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.76 MB (203170568) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 34.27 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1402) - ScannerThreadsTotalWallClockTime: 23s867ms - MaterializeTupleTime(*): 23s215ms - ScannerThreadsSysTime: 18.995ms - ScannerThreadsUserTime: 4s158ms - ScannerThreadsVoluntaryContextSwitches: 14.24K (14236) - TotalRawHdfsReadTime(*): 131.728ms - TotalReadThroughput: 37.81 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f6 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s529ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 0, 176.67 MB, 176.69 MB, 176.78 MB, 136.89 MB, 137.10 MB, 137.12 MB, 105.00 MB, 97.00 MB, 57.64 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.00 MB (185597208) - PerHostPeakMemUsage: 1.65 GB (1766596464) - PrepareTime: 177.090ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 26s315ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24.369ms - TotalStorageWaitTime: 78.719ms CodeGen:(Total: 497.551ms, non-child: 497.551ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 317.271ms - PrepareTime: 175.502ms DataStreamSender (dst_id=11):(Total: 4s220ms, non-child: 4s220ms, % non-child: 100.00%) - BytesSent: 293.63 MB (307889306) - NetworkThroughput(*): 56.63 MB/sec - OverallThroughput: 69.57 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s557ms - ThriftTransmitTime(*): 5s184ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=2):(Total: 464.636ms, non-child: 464.636ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 715.504ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 28.97 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.37K (2367) - ScannerThreadsTotalWallClockTime: 21s539ms - MaterializeTupleTime(*): 20s682ms - ScannerThreadsSysTime: 110.981ms - ScannerThreadsUserTime: 5s966ms - ScannerThreadsVoluntaryContextSwitches: 13.08K (13082) - TotalRawHdfsReadTime(*): 90.487ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5ff (host=vb0222.halxg.cloudera.com:22000):(Total: 4s506ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 177.28 MB, 177.84 MB, 177.74 MB, 177.92 MB, 124.54 MB, 111.32 MB, 111.37 MB, 79.35 MB, 47.95 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.18 MB (186835768) - PerHostPeakMemUsage: 1.62 GB (1740849216) - PrepareTime: 184.509ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 26s323ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23.888ms - TotalStorageWaitTime: 318.308ms CodeGen:(Total: 527.931ms, non-child: 527.931ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 340.863ms - PrepareTime: 175.928ms DataStreamSender (dst_id=11):(Total: 4s191ms, non-child: 4s191ms, % non-child: 100.00%) - BytesSent: 284.98 MB (298826982) - NetworkThroughput(*): 58.53 MB/sec - OverallThroughput: 68.00 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s492ms - ThriftTransmitTime(*): 4s869ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=2):(Total: 477.668ms, non-child: 477.668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 467.303ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.76 MB (186393400) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 27.38 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1668) - ScannerThreadsTotalWallClockTime: 21s785ms - MaterializeTupleTime(*): 20s920ms - ScannerThreadsSysTime: 38.990ms - ScannerThreadsUserTime: 4s200ms - ScannerThreadsVoluntaryContextSwitches: 12.64K (12642) - TotalRawHdfsReadTime(*): 129.429ms - TotalReadThroughput: 30.35 MB/sec Instance 704a43b40e790124:4123ec6c75fea5fd (host=vb0208.halxg.cloudera.com:22000):(Total: 4s341ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.48 MB, 176.74 MB, 176.70 MB, 137.19 MB, 137.09 MB, 137.03 MB, 97.05 MB, 97.02 MB, 8.53 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646416) - PerHostPeakMemUsage: 1.63 GB (1754730648) - PrepareTime: 184.181ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 25s199ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26.905ms - TotalStorageWaitTime: 91.878ms CodeGen:(Total: 578.472ms, non-child: 578.472ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.454ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 391.298ms - PrepareTime: 176.915ms DataStreamSender (dst_id=11):(Total: 4s063ms, non-child: 4s063ms, % non-child: 100.00%) - BytesSent: 294.32 MB (308619125) - NetworkThroughput(*): 57.55 MB/sec - OverallThroughput: 72.44 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s454ms - ThriftTransmitTime(*): 5s113ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=2):(Total: 437.008ms, non-child: 437.008ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 428.561ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 30.80 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.36K (1362) - ScannerThreadsTotalWallClockTime: 20s551ms - MaterializeTupleTime(*): 19s985ms - ScannerThreadsSysTime: 19.995ms - ScannerThreadsUserTime: 3s558ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13032) - TotalRawHdfsReadTime(*): 105.196ms - TotalReadThroughput: 31.20 MB/sec Instance 704a43b40e790124:4123ec6c75fea5fe (host=vb0224.halxg.cloudera.com:22000):(Total: 4s194ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 68.00 KB, 189.81 MB, 189.76 MB, 177.60 MB, 137.12 MB, 137.09 MB, 113.09 MB, 97.01 MB, 40.23 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.09 MB (199320368) - PerHostPeakMemUsage: 1.68 GB (1806360048) - PrepareTime: 190.064ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 25s528ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24.973ms - TotalStorageWaitTime: 214.561ms CodeGen:(Total: 618.838ms, non-child: 618.838ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 425.359ms - PrepareTime: 179.413ms DataStreamSender (dst_id=11):(Total: 3s895ms, non-child: 3s895ms, % non-child: 100.00%) - BytesSent: 306.76 MB (321658669) - NetworkThroughput(*): 58.73 MB/sec - OverallThroughput: 78.74 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s420ms - ThriftTransmitTime(*): 5s223ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=2):(Total: 464.838ms, non-child: 464.838ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 442.081ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.63 MB (198845272) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 30.74 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1353) - ScannerThreadsTotalWallClockTime: 21s121ms - MaterializeTupleTime(*): 20s314ms - ScannerThreadsSysTime: 21.995ms - ScannerThreadsUserTime: 3s920ms - ScannerThreadsVoluntaryContextSwitches: 13.83K (13829) - TotalRawHdfsReadTime(*): 118.115ms - TotalReadThroughput: 36.82 MB/sec Instance 704a43b40e790124:4123ec6c75fea5fc (host=vb0230.halxg.cloudera.com:22000):(Total: 4s182ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 0, 176.40 MB, 176.69 MB, 176.72 MB, 137.12 MB, 137.01 MB, 136.85 MB, 96.80 MB, 96.78 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621792) - PerHostPeakMemUsage: 1.65 GB (1767401176) - PrepareTime: 186.866ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 24s222ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26.054ms - TotalStorageWaitTime: 119.052ms CodeGen:(Total: 574.782ms, non-child: 574.782ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 381.362ms - PrepareTime: 179.639ms DataStreamSender (dst_id=11):(Total: 3s906ms, non-child: 3s906ms, % non-child: 100.00%) - BytesSent: 294.26 MB (308550833) - NetworkThroughput(*): 59.48 MB/sec - OverallThroughput: 75.33 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s378ms - ThriftTransmitTime(*): 4s946ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=2):(Total: 443.092ms, non-child: 443.092ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 425.615ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 30.38 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.29K (1295) - ScannerThreadsTotalWallClockTime: 19s775ms - MaterializeTupleTime(*): 19s169ms - ScannerThreadsSysTime: 29.993ms - ScannerThreadsUserTime: 3s514ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13011) - TotalRawHdfsReadTime(*): 101.928ms - TotalReadThroughput: 39.00 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f4 (host=vb0226.halxg.cloudera.com:22000):(Total: 4s130ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.15 MB, 168.32 MB, 168.22 MB, 128.33 MB, 128.61 MB, 111.25 MB, 79.45 MB, 55.87 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.53 MB (176717088) - PerHostPeakMemUsage: 1.61 GB (1728664504) - PrepareTime: 189.070ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 22s145ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24.532ms - TotalStorageWaitTime: 247.787ms CodeGen:(Total: 526.059ms, non-child: 526.059ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.269ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 333.195ms - PrepareTime: 175.297ms DataStreamSender (dst_id=11):(Total: 3s807ms, non-child: 3s807ms, % non-child: 100.00%) - BytesSent: 266.16 MB (279092830) - NetworkThroughput(*): 57.84 MB/sec - OverallThroughput: 69.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s283ms - ThriftTransmitTime(*): 4s601ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=2):(Total: 477.598ms, non-child: 477.598ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.62 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 439.359ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.12 MB (176282912) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 25.69 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2012) - ScannerThreadsTotalWallClockTime: 17s918ms - MaterializeTupleTime(*): 17s116ms - ScannerThreadsSysTime: 88.984ms - ScannerThreadsUserTime: 3s936ms - ScannerThreadsVoluntaryContextSwitches: 11.75K (11750) - TotalRawHdfsReadTime(*): 118.932ms - TotalReadThroughput: 31.62 MB/sec Instance 704a43b40e790124:4123ec6c75fea600 (host=vb0214.halxg.cloudera.com:22000):(Total: 3s701ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 68.00 KB, 164.25 MB, 164.23 MB, 164.05 MB, 124.60 MB, 111.42 MB, 79.31 MB, 47.85 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 4.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.54 MB (172531024) - PerHostPeakMemUsage: 1.61 GB (1729605392) - PrepareTime: 185.585ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 19s944ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18.053ms - TotalStorageWaitTime: 87.464ms CodeGen:(Total: 606.316ms, non-child: 606.316ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.457ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 416.756ms - PrepareTime: 178.132ms DataStreamSender (dst_id=11):(Total: 3s399ms, non-child: 3s399ms, % non-child: 100.00%) - BytesSent: 263.90 MB (276722687) - NetworkThroughput(*): 60.28 MB/sec - OverallThroughput: 77.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s073ms - ThriftTransmitTime(*): 4s378ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=2):(Total: 458.548ms, non-child: 458.548ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 391.275ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.06 MB (172031256) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 26.48 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1438) - ScannerThreadsTotalWallClockTime: 15s901ms - MaterializeTupleTime(*): 15s377ms - ScannerThreadsSysTime: 74.985ms - ScannerThreadsUserTime: 3s211ms - ScannerThreadsVoluntaryContextSwitches: 11.78K (11782) - TotalRawHdfsReadTime(*): 128.855ms - TotalReadThroughput: 35.19 MB/sec Instance 704a43b40e790124:4123ec6c75fea5f2 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s528ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.07 MB, 143.12 MB, 143.14 MB, 111.32 MB, 111.35 MB, 79.32 MB, 47.97 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.32 MB (150280080) - PerHostPeakMemUsage: 1.58 GB (1696890344) - PrepareTime: 188.841ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 16s855ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.708ms - TotalStorageWaitTime: 134.831ms CodeGen:(Total: 535.095ms, non-child: 535.095ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.586ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 341.117ms - PrepareTime: 175.203ms DataStreamSender (dst_id=11):(Total: 3s243ms, non-child: 3s243ms, % non-child: 100.00%) - BytesSent: 235.55 MB (246995320) - NetworkThroughput(*): 57.05 MB/sec - OverallThroughput: 72.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 1s972ms - ThriftTransmitTime(*): 4s129ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=2):(Total: 446.881ms, non-child: 446.881ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 349.898ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.91 MB (149854096) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 24.09 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.15K (1146) - ScannerThreadsTotalWallClockTime: 13s125ms - MaterializeTupleTime(*): 12s585ms - ScannerThreadsSysTime: 37.992ms - ScannerThreadsUserTime: 2s887ms - ScannerThreadsVoluntaryContextSwitches: 10.33K (10328) - TotalRawHdfsReadTime(*): 103.735ms - TotalReadThroughput: 31.20 MB/sec Fragment F00: Instance 704a43b40e790124:4123ec6c75fea60a (host=vb0206.halxg.cloudera.com:22000):(Total: 35s395ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 90.82 MB, 191.60 MB, 191.60 MB, 191.60 MB, 191.60 MB, 191.60 MB, 191.60 MB, 191.60 MB, 191.63 MB, 193.65 MB, 193.58 MB, 193.63 MB, 193.53 MB, 193.61 MB, 193.77 MB, 193.76 MB, 193.54 MB, 193.66 MB, 98.50 MB, 67.11 MB, 109.13 MB, 193.50 MB, 193.65 MB, 193.72 MB, 193.62 MB, 193.64 MB, 193.62 MB, 193.71 MB, 193.65 MB, 193.63 MB, 126.08 MB, 67.02 MB, 67.11 MB, 60.98 MB, 55.07 MB, 39.28 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.18 MB (203607744) - PerHostPeakMemUsage: 3.94 GB (4226541712) - PrepareTime: 189.111ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s633ms - TotalStorageWaitTime: 361.899ms CodeGen:(Total: 621.624ms, non-child: 621.624ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 424.433ms - PrepareTime: 187.448ms DataStreamSender (dst_id=10):(Total: 34s636ms, non-child: 34s636ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1201270062) - NetworkThroughput(*): 8.75 MB/sec - OverallThroughput: 33.08 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s928ms - ThriftTransmitTime(*): 2m10s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=1):(Total: 877.058ms, non-child: 877.058ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 161.08 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 297.71 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 369.58 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.58 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s295ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.76 MB (203173360) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 61.11 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.50K (8503) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m24s - ScannerThreadsSysTime: 269.955ms - ScannerThreadsUserTime: 18s485ms - ScannerThreadsVoluntaryContextSwitches: 52.27K (52272) - TotalRawHdfsReadTime(*): 317.555ms - TotalReadThroughput: 10.41 MB/sec Instance 704a43b40e790124:4123ec6c75fea60d (host=vb0224.halxg.cloudera.com:22000):(Total: 35s247ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 94.42 MB, 190.08 MB, 190.08 MB, 190.08 MB, 190.08 MB, 190.08 MB, 190.08 MB, 190.08 MB, 190.05 MB, 190.71 MB, 190.69 MB, 190.63 MB, 190.69 MB, 190.66 MB, 190.68 MB, 190.78 MB, 190.78 MB, 162.67 MB, 67.94 MB, 73.47 MB, 134.68 MB, 193.71 MB, 193.71 MB, 193.70 MB, 193.63 MB, 193.64 MB, 193.73 MB, 193.73 MB, 189.56 MB, 181.75 MB, 106.25 MB, 67.12 MB, 82.75 MB, 70.99 MB, 55.07 MB, 36.13 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 3, 2 - AverageThreadTokens: 8.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509480) - PerHostPeakMemUsage: 3.93 GB (4225075352) - PrepareTime: 187.312ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s823ms - TotalStorageWaitTime: 282.829ms CodeGen:(Total: 500.028ms, non-child: 500.028ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 309.729ms - PrepareTime: 175.888ms DataStreamSender (dst_id=10):(Total: 34s664ms, non-child: 34s664ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1203853841) - NetworkThroughput(*): 9.87 MB/sec - OverallThroughput: 33.12 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s298ms - ThriftTransmitTime(*): 1m56s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=1):(Total: 700.519ms, non-child: 700.519ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 182.73 MB, 320.26 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 336.74 MB, 357.28 MB, 367.54 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.54 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s398ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 76.06 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.70K (7696) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 218.962ms - ScannerThreadsUserTime: 17s547ms - ScannerThreadsVoluntaryContextSwitches: 51.93K (51929) - TotalRawHdfsReadTime(*): 242.632ms - TotalReadThroughput: 10.35 MB/sec Instance 704a43b40e790124:4123ec6c75fea60e (host=vb0222.halxg.cloudera.com:22000):(Total: 35s142ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 85.46 MB, 171.76 MB, 171.76 MB, 171.76 MB, 171.76 MB, 171.76 MB, 171.76 MB, 171.76 MB, 171.91 MB, 188.13 MB, 188.14 MB, 188.05 MB, 188.24 MB, 188.19 MB, 188.25 MB, 188.28 MB, 188.26 MB, 160.28 MB, 76.11 MB, 82.91 MB, 145.42 MB, 193.76 MB, 193.83 MB, 193.68 MB, 193.71 MB, 193.63 MB, 193.69 MB, 189.68 MB, 177.86 MB, 166.03 MB, 82.80 MB, 82.95 MB, 82.85 MB, 55.08 MB, 55.12 MB, 22.29 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 2 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 197.04 MB (206616400) - PerHostPeakMemUsage: 3.94 GB (4227165376) - PrepareTime: 183.839ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s694ms - TotalStorageWaitTime: 384.227ms CodeGen:(Total: 524.953ms, non-child: 524.953ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 338.356ms - PrepareTime: 174.429ms DataStreamSender (dst_id=10):(Total: 34s540ms, non-child: 34s540ms, % non-child: 100.00%) - BytesSent: 1.12 GB (1206037583) - NetworkThroughput(*): 8.76 MB/sec - OverallThroughput: 33.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s449ms - ThriftTransmitTime(*): 2m11s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=1):(Total: 719.321ms, non-child: 719.321ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 72.26 MB, 144.53 MB, 144.53 MB, 144.53 MB, 144.53 MB, 144.53 MB, 144.53 MB, 144.53 MB, 144.53 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 171.02 MB, 181.28 MB, 263.42 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 345.55 MB, 345.55 MB, 366.08 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.46 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s436ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 196.58 MB (206133072) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 73.74 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.38K (7380) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 244.958ms - ScannerThreadsUserTime: 17s767ms - ScannerThreadsVoluntaryContextSwitches: 51.32K (51323) - TotalRawHdfsReadTime(*): 269.036ms - TotalReadThroughput: 10.17 MB/sec Instance 704a43b40e790124:4123ec6c75fea607 (host=vb0226.halxg.cloudera.com:22000):(Total: 34s984ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 95.90 MB, 192.00 MB, 192.00 MB, 192.00 MB, 192.00 MB, 192.00 MB, 192.00 MB, 192.00 MB, 192.40 MB, 193.57 MB, 193.59 MB, 193.66 MB, 193.75 MB, 193.80 MB, 193.68 MB, 193.87 MB, 193.62 MB, 161.82 MB, 67.13 MB, 67.17 MB, 166.97 MB, 193.68 MB, 193.62 MB, 193.73 MB, 193.73 MB, 193.61 MB, 193.67 MB, 193.64 MB, 193.70 MB, 157.83 MB, 67.09 MB, 67.08 MB, 61.10 MB, 55.08 MB, 55.06 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.19 MB (203622080) - PerHostPeakMemUsage: 3.94 GB (4227606688) - PrepareTime: 188.157ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s490ms - TotalStorageWaitTime: 391.490ms CodeGen:(Total: 537.141ms, non-child: 537.141ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.244ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 345.231ms - PrepareTime: 175.773ms DataStreamSender (dst_id=10):(Total: 34s337ms, non-child: 34s337ms, % non-child: 100.00%) - BytesSent: 1.08 GB (1161440869) - NetworkThroughput(*): 7.67 MB/sec - OverallThroughput: 32.26 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s245ms - ThriftTransmitTime(*): 2m24s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=1):(Total: 746.218ms, non-child: 746.218ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 297.72 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.05 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s552ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.79 MB (203204296) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 71.81 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.53K (9530) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 4m19s - ScannerThreadsSysTime: 375.938ms - ScannerThreadsUserTime: 18s711ms - ScannerThreadsVoluntaryContextSwitches: 52.09K (52092) - TotalRawHdfsReadTime(*): 335.900ms - TotalReadThroughput: 10.41 MB/sec Instance 704a43b40e790124:4123ec6c75fea602 (host=vb0230.halxg.cloudera.com:22000):(Total: 34s938ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.80 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.67 MB, 193.79 MB, 193.71 MB, 193.73 MB, 193.62 MB, 193.71 MB, 193.61 MB, 193.77 MB, 169.71 MB, 75.07 MB, 67.13 MB, 138.26 MB, 193.75 MB, 193.59 MB, 193.64 MB, 193.72 MB, 193.58 MB, 193.75 MB, 193.57 MB, 193.68 MB, 149.89 MB, 67.16 MB, 67.18 MB, 61.92 MB, 55.04 MB, 55.06 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.19 MB (203621416) - PerHostPeakMemUsage: 3.94 GB (4229098608) - PrepareTime: 172.153ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s250ms - TotalStorageWaitTime: 349.362ms CodeGen:(Total: 513.122ms, non-child: 513.122ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.472ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 337.975ms - PrepareTime: 167.719ms DataStreamSender (dst_id=10):(Total: 34s359ms, non-child: 34s359ms, % non-child: 100.00%) - BytesSent: 1.10 GB (1185645968) - NetworkThroughput(*): 9.11 MB/sec - OverallThroughput: 32.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s552ms - ThriftTransmitTime(*): 2m4s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=1):(Total: 675.686ms, non-child: 675.686ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 174.53 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s395ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.81 MB (203228200) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 79.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.77K (6767) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 4m19s - ScannerThreadsSysTime: 176.970ms - ScannerThreadsUserTime: 17s430ms - ScannerThreadsVoluntaryContextSwitches: 52.26K (52255) - TotalRawHdfsReadTime(*): 273.907ms - TotalReadThroughput: 10.56 MB/sec Instance 704a43b40e790124:4123ec6c75fea605 (host=vb0234.halxg.cloudera.com:22000):(Total: 34s781ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.85 MB, 193.69 MB, 193.73 MB, 193.72 MB, 193.73 MB, 193.76 MB, 193.67 MB, 193.83 MB, 193.68 MB, 161.74 MB, 67.10 MB, 67.10 MB, 193.27 MB, 193.66 MB, 193.73 MB, 193.68 MB, 193.81 MB, 193.51 MB, 193.66 MB, 193.80 MB, 193.62 MB, 98.40 MB, 67.17 MB, 67.11 MB, 56.43 MB, 55.13 MB, 55.04 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203542208) - PerHostPeakMemUsage: 3.91 GB (4195967984) - PrepareTime: 184.188ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s382ms - TotalStorageWaitTime: 381.911ms CodeGen:(Total: 554.686ms, non-child: 554.686ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 362.763ms - PrepareTime: 172.836ms DataStreamSender (dst_id=10):(Total: 34s180ms, non-child: 34s180ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1152704696) - NetworkThroughput(*): 7.98 MB/sec - OverallThroughput: 32.16 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s143ms - ThriftTransmitTime(*): 2m17s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=1):(Total: 704.699ms, non-child: 704.699ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 246.39 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.06 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.39 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s900ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 76.05 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.38K (7375) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m14s - ScannerThreadsSysTime: 248.958ms - ScannerThreadsUserTime: 18s171ms - ScannerThreadsVoluntaryContextSwitches: 51.99K (51993) - TotalRawHdfsReadTime(*): 298.222ms - TotalReadThroughput: 10.56 MB/sec Instance 704a43b40e790124:4123ec6c75fea608 (host=vb0232.halxg.cloudera.com:22000):(Total: 34s767ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.61 MB, 193.16 MB, 193.16 MB, 193.16 MB, 193.16 MB, 193.16 MB, 193.16 MB, 193.16 MB, 193.39 MB, 193.66 MB, 193.76 MB, 193.73 MB, 193.77 MB, 193.74 MB, 193.84 MB, 193.75 MB, 193.71 MB, 169.69 MB, 74.95 MB, 67.09 MB, 161.50 MB, 193.71 MB, 193.74 MB, 193.75 MB, 193.67 MB, 193.69 MB, 193.63 MB, 193.64 MB, 193.70 MB, 118.17 MB, 67.16 MB, 67.14 MB, 55.70 MB, 55.12 MB, 39.24 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.36 MB (204853344) - PerHostPeakMemUsage: 3.93 GB (4219350528) - PrepareTime: 185.976ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s316ms - TotalStorageWaitTime: 684.321ms CodeGen:(Total: 517.370ms, non-child: 517.370ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.348ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 327.638ms - PrepareTime: 177.445ms DataStreamSender (dst_id=10):(Total: 34s163ms, non-child: 34s163ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1148067834) - NetworkThroughput(*): 18.30 MB/sec - OverallThroughput: 32.05 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s274ms - ThriftTransmitTime(*): 59s837ms - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=1):(Total: 718.000ms, non-child: 718.000ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 287.47 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.48 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s547ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.86 MB (204329048) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 74.61 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.82K (7820) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m17s - ScannerThreadsSysTime: 211.964ms - ScannerThreadsUserTime: 17s854ms - ScannerThreadsVoluntaryContextSwitches: 52.33K (52326) - TotalRawHdfsReadTime(*): 277.037ms - TotalReadThroughput: 10.56 MB/sec Instance 704a43b40e790124:4123ec6c75fea60c (host=vb0228.halxg.cloudera.com:22000):(Total: 34s350ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(1s000ms): 92.86 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.30 MB, 187.45 MB, 187.69 MB, 187.77 MB, 187.72 MB, 187.66 MB, 187.75 MB, 187.68 MB, 187.66 MB, 187.64 MB, 187.60 MB, 110.18 MB, 82.92 MB, 99.72 MB, 193.27 MB, 193.70 MB, 193.62 MB, 193.71 MB, 193.63 MB, 193.69 MB, 181.80 MB, 177.88 MB, 177.74 MB, 122.66 MB, 82.80 MB, 83.04 MB, 47.53 MB, 24.08 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 2 - AverageThreadTokens: 8.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203493144) - PerHostPeakMemUsage: 3.85 GB (4136372704) - PrepareTime: 187.804ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s800ms - TotalStorageWaitTime: 308.763ms CodeGen:(Total: 500.287ms, non-child: 500.287ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.508ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 309.536ms - PrepareTime: 174.612ms DataStreamSender (dst_id=10):(Total: 33s792ms, non-child: 33s792ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1136264384) - NetworkThroughput(*): 8.80 MB/sec - OverallThroughput: 32.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s915ms - ThriftTransmitTime(*): 2m3s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=1):(Total: 670.185ms, non-child: 670.185ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 79.97 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 180.48 MB, 180.48 MB, 201.01 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.65 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s319ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 74.51 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.10K (7099) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m21s - ScannerThreadsSysTime: 201.965ms - ScannerThreadsUserTime: 16s438ms - ScannerThreadsVoluntaryContextSwitches: 47.49K (47487) - TotalRawHdfsReadTime(*): 219.002ms - TotalReadThroughput: 9.85 MB/sec Instance 704a43b40e790124:4123ec6c75fea601 (host=vb0208.halxg.cloudera.com:22000):(Total: 34s346ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 94.65 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.36 MB, 190.66 MB, 190.78 MB, 190.60 MB, 190.78 MB, 190.87 MB, 190.65 MB, 190.62 MB, 190.60 MB, 107.31 MB, 64.13 MB, 104.21 MB, 187.56 MB, 187.71 MB, 187.71 MB, 187.68 MB, 187.65 MB, 187.71 MB, 187.65 MB, 183.59 MB, 158.72 MB, 94.77 MB, 79.92 MB, 92.41 MB, 55.01 MB, 47.18 MB, 22.15 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 3, 3, 2 - AverageThreadTokens: 8.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 191.09 MB (200371944) - PerHostPeakMemUsage: 3.88 GB (4170859160) - PrepareTime: 165.121ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s269ms - TotalStorageWaitTime: 367.993ms CodeGen:(Total: 484.427ms, non-child: 484.427ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.765ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 314.948ms - PrepareTime: 162.109ms DataStreamSender (dst_id=10):(Total: 33s798ms, non-child: 33s798ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1128943662) - NetworkThroughput(*): 7.09 MB/sec - OverallThroughput: 31.85 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s923ms - ThriftTransmitTime(*): 2m31s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=1):(Total: 642.936ms, non-child: 642.936ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 81.42 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 162.84 MB, 207.95 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 332.06 MB, 342.32 MB, 342.32 MB, 362.86 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.42 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s536ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 190.61 MB (199864080) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 81.79 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.11K (8114) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 4m14s - ScannerThreadsSysTime: 210.965ms - ScannerThreadsUserTime: 17s859ms - ScannerThreadsVoluntaryContextSwitches: 50.93K (50932) - TotalRawHdfsReadTime(*): 263.845ms - TotalReadThroughput: 10.37 MB/sec Instance 704a43b40e790124:4123ec6c75fea604 (host=vb0212.halxg.cloudera.com:22000):(Total: 34s156ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 96.14 MB, 193.55 MB, 193.55 MB, 193.55 MB, 193.55 MB, 193.55 MB, 193.55 MB, 193.55 MB, 193.57 MB, 193.73 MB, 193.61 MB, 193.80 MB, 193.63 MB, 193.73 MB, 193.78 MB, 193.69 MB, 193.70 MB, 161.79 MB, 67.04 MB, 67.25 MB, 169.07 MB, 193.75 MB, 193.71 MB, 193.68 MB, 193.73 MB, 193.63 MB, 193.76 MB, 193.64 MB, 193.78 MB, 161.74 MB, 67.22 MB, 67.15 MB, 51.02 MB, 31.94 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.33 MB (203771848) - PerHostPeakMemUsage: 3.77 GB (4048195608) - PrepareTime: 187.269ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s481ms - TotalStorageWaitTime: 316.420ms CodeGen:(Total: 530.793ms, non-child: 530.793ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 340.576ms - PrepareTime: 174.194ms DataStreamSender (dst_id=10):(Total: 33s596ms, non-child: 33s596ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1122959177) - NetworkThroughput(*): 8.24 MB/sec - OverallThroughput: 31.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s857ms - ThriftTransmitTime(*): 2m9s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=1):(Total: 672.358ms, non-child: 672.358ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.53% 1:1.471% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 295.50 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 338.78 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.59 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s837ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.91 MB (203329480) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 75.26 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.60K (7602) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 245.959ms - ScannerThreadsUserTime: 16s716ms - ScannerThreadsVoluntaryContextSwitches: 48.29K (48290) - TotalRawHdfsReadTime(*): 277.851ms - TotalReadThroughput: 10.12 MB/sec Instance 704a43b40e790124:4123ec6c75fea606 (host=vb0204.halxg.cloudera.com:22000):(Total: 34s108ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 34.00 KB, 169.51 MB, 169.51 MB, 169.51 MB, 169.51 MB, 169.51 MB, 169.51 MB, 169.51 MB, 169.55 MB, 170.61 MB, 170.60 MB, 170.72 MB, 170.59 MB, 170.58 MB, 170.48 MB, 170.60 MB, 154.65 MB, 63.80 MB, 56.86 MB, 170.16 MB, 170.64 MB, 170.53 MB, 170.56 MB, 170.57 MB, 170.65 MB, 170.60 MB, 158.70 MB, 63.84 MB, 59.92 MB, 92.37 MB, 78.20 MB, 78.13 MB, 78.08 MB, 42.47 MB, 20.87 MB ThreadUsage(1s000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 4, 4, 4, 4, 2 - AverageThreadTokens: 7.13 - BloomFilterBytes: 0 - PeakMemoryUsage: 171.05 MB (179357864) - PerHostPeakMemUsage: 3.79 GB (4069165384) - PrepareTime: 198.141ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 3m55s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s808ms - TotalStorageWaitTime: 440.288ms CodeGen:(Total: 572.892ms, non-child: 572.892ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 366.592ms - PrepareTime: 185.077ms DataStreamSender (dst_id=10):(Total: 33s550ms, non-child: 33s550ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1139122972) - NetworkThroughput(*): 7.51 MB/sec - OverallThroughput: 32.38 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s708ms - ThriftTransmitTime(*): 2m24s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=1):(Total: 693.998ms, non-child: 693.998ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 71.86 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 215.59 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 318.26 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.31 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s348ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 170.59 MB (178874584) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 72.93 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.32K (7316) - ScannerThreadsTotalWallClockTime: 3m36s - MaterializeTupleTime(*): 3m34s - ScannerThreadsSysTime: 221.963ms - ScannerThreadsUserTime: 16s937ms - ScannerThreadsVoluntaryContextSwitches: 49.42K (49421) - TotalRawHdfsReadTime(*): 273.319ms - TotalReadThroughput: 10.12 MB/sec Instance 704a43b40e790124:4123ec6c75fea60f (host=vb0218.halxg.cloudera.com:22000):(Total: 34s074ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 95.82 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.67 MB, 193.64 MB, 193.73 MB, 193.68 MB, 193.71 MB, 193.78 MB, 193.71 MB, 193.76 MB, 193.61 MB, 161.73 MB, 67.17 MB, 67.07 MB, 187.04 MB, 193.68 MB, 193.55 MB, 193.68 MB, 193.69 MB, 193.78 MB, 193.73 MB, 193.70 MB, 193.65 MB, 145.81 MB, 67.14 MB, 67.22 MB, 58.14 MB, 31.97 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 2 - AverageThreadTokens: 8.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.27 MB (203704624) - PerHostPeakMemUsage: 3.80 GB (4078798736) - PrepareTime: 188.466ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s486ms - TotalStorageWaitTime: 497.906ms CodeGen:(Total: 547.313ms, non-child: 547.313ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.456ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 350.995ms - PrepareTime: 175.193ms DataStreamSender (dst_id=10):(Total: 33s491ms, non-child: 33s491ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1135490978) - NetworkThroughput(*): 8.74 MB/sec - OverallThroughput: 32.33 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s878ms - ThriftTransmitTime(*): 2m3s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=1):(Total: 710.312ms, non-child: 710.312ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:98.53% 1:1.471% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 236.19 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.62 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s312ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.88 MB (203295024) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 71.26 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.23K (7230) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 212.963ms - ScannerThreadsUserTime: 16s415ms - ScannerThreadsVoluntaryContextSwitches: 48.37K (48371) - TotalRawHdfsReadTime(*): 268.454ms - TotalReadThroughput: 10.27 MB/sec Instance 704a43b40e790124:4123ec6c75fea603 (host=vb0214.halxg.cloudera.com:22000):(Total: 34s014ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(1s000ms): 34.00 KB, 192.15 MB, 192.15 MB, 192.15 MB, 192.15 MB, 192.15 MB, 192.15 MB, 192.15 MB, 192.17 MB, 193.60 MB, 193.66 MB, 193.75 MB, 193.59 MB, 193.68 MB, 193.65 MB, 193.65 MB, 193.75 MB, 165.85 MB, 74.98 MB, 67.10 MB, 136.52 MB, 191.71 MB, 191.68 MB, 191.81 MB, 191.75 MB, 191.65 MB, 191.76 MB, 191.72 MB, 191.82 MB, 171.79 MB, 80.77 MB, 65.21 MB, 69.63 MB, 31.98 MB, 12.74 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 2, 1 - AverageThreadTokens: 8.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203501240) - PerHostPeakMemUsage: 3.79 GB (4064657240) - PrepareTime: 185.093ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s739ms - TotalStorageWaitTime: 430.604ms CodeGen:(Total: 617.303ms, non-child: 617.303ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.953ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.728ms - PrepareTime: 177.082ms DataStreamSender (dst_id=10):(Total: 33s455ms, non-child: 33s455ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1123859703) - NetworkThroughput(*): 8.23 MB/sec - OverallThroughput: 32.04 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s772ms - ThriftTransmitTime(*): 2m10s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=1):(Total: 664.000ms, non-child: 664.000ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 174.53 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 337.24 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.51 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s360ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 75.88 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.61K (7614) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m15s - ScannerThreadsSysTime: 227.962ms - ScannerThreadsUserTime: 16s896ms - ScannerThreadsVoluntaryContextSwitches: 48.02K (48018) - TotalRawHdfsReadTime(*): 282.204ms - TotalReadThroughput: 10.07 MB/sec Instance 704a43b40e790124:4123ec6c75fea609 (host=vb0216.halxg.cloudera.com:22000):(Total: 32s673ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(1s000ms): 96.81 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.58 MB, 193.62 MB, 193.64 MB, 193.67 MB, 193.69 MB, 193.73 MB, 193.77 MB, 193.75 MB, 193.55 MB, 193.64 MB, 161.76 MB, 67.16 MB, 67.08 MB, 168.31 MB, 193.71 MB, 193.60 MB, 193.74 MB, 193.71 MB, 193.63 MB, 193.70 MB, 193.75 MB, 193.68 MB, 165.79 MB, 78.86 MB, 67.19 MB, 63.40 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8 - AverageThreadTokens: 8.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203542248) - PerHostPeakMemUsage: 3.69 GB (3962818392) - PrepareTime: 173.055ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s162ms - TotalStorageWaitTime: 270.814ms CodeGen:(Total: 493.676ms, non-child: 493.676ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 317.523ms - PrepareTime: 163.428ms DataStreamSender (dst_id=10):(Total: 32s135ms, non-child: 32s135ms, % non-child: 100.00%) - BytesSent: 1.00 GB (1074356832) - NetworkThroughput(*): 9.62 MB/sec - OverallThroughput: 31.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s261ms - ThriftTransmitTime(*): 1m46s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=1):(Total: 644.361ms, non-child: 644.361ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.13 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 291.52 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.98 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s370ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 73.95 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 7.46K (7458) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m17s - ScannerThreadsSysTime: 214.963ms - ScannerThreadsUserTime: 17s538ms - ScannerThreadsVoluntaryContextSwitches: 46.60K (46601) - TotalRawHdfsReadTime(*): 205.504ms - TotalReadThroughput: 9.96 MB/sec Instance 704a43b40e790124:4123ec6c75fea60b (host=vb0220.halxg.cloudera.com:22000):(Total: 32s097ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(1s000ms): 65.06 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.88 MB, 193.75 MB, 193.58 MB, 193.72 MB, 193.69 MB, 193.72 MB, 193.69 MB, 193.74 MB, 193.67 MB, 161.74 MB, 67.11 MB, 67.02 MB, 178.29 MB, 193.68 MB, 193.75 MB, 193.80 MB, 193.68 MB, 193.71 MB, 193.78 MB, 193.68 MB, 193.65 MB, 161.80 MB, 67.07 MB, 67.14 MB, 33.70 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5 - AverageThreadTokens: 8.76 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203535520) - PerHostPeakMemUsage: 3.69 GB (3959855888) - PrepareTime: 163.252ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s209ms - TotalStorageWaitTime: 291.253ms CodeGen:(Total: 487.916ms, non-child: 487.916ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 321.908ms - PrepareTime: 161.709ms DataStreamSender (dst_id=10):(Total: 31s529ms, non-child: 31s529ms, % non-child: 100.00%) - BytesSent: 976.44 MB (1023867668) - NetworkThroughput(*): 8.20 MB/sec - OverallThroughput: 30.97 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s954ms - ThriftTransmitTime(*): 1m59s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=1):(Total: 661.805ms, non-child: 661.805ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:0% 2:0% 3:0% 4:1.562% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 128.22 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 164.29 MB, 225.89 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s524ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203076768) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 71.97 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 7.34K (7340) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 221.962ms - ScannerThreadsUserTime: 15s996ms - ScannerThreadsVoluntaryContextSwitches: 46.67K (46670) - TotalRawHdfsReadTime(*): 213.306ms - TotalReadThroughput: 10.27 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 20:EXCHANGE | 1 | 10.63us | 0ns | 10.63us | 0 | 36.00M | | 19:AGGREGATE | 15 | 5.36s | 0ns | 6.67s | 0 | 36.00M | | 18:EXCHANGE | 15 | 1.03s | 0ns | 1.24s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 4.40s | 0ns | 5.24s | 395.39M | 36.00M | | 00:UNION | 15 | 1.48s | 0ns | 1.66s | 398.68M | 36.00M | | |--17:AGGREGATE | 15 | 2.94s | 0ns | 3.54s | 199.34M | 18.00M | | | 16:EXCHANGE | 15 | 356.47ms | 0ns | 447.25ms | 199.34M | 18.00M | | | 08:AGGREGATE | 15 | 9.11s | 0ns | 9.91s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.47s | 0ns | 15.27s | 774.31M | 18.00M | | | |--15:EXCHANGE | 15 | 793.38ms | 0ns | 1.33s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 488.24ms | 0ns | 553.23ms | 204.99M | 45.00M | | | 14:EXCHANGE | 15 | 2.97s | 0ns | 3.70s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 715.71ms | 0ns | 759.21ms | 774.31M | 180.00M | | 13:AGGREGATE | 15 | 3.02s | 0ns | 3.49s | 199.34M | 18.00M | | 12:EXCHANGE | 15 | 383.41ms | 0ns | 491.92ms | 199.34M | 18.00M | | 04:AGGREGATE | 15 | 9.30s | 0ns | 10.07s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.31s | 0ns | 14.44s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 801.65ms | 0ns | 1.41s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 482.21ms | 0ns | 525.44ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 3.03s | 0ns | 4.03s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 711.11ms | 0ns | 742.69ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=ad4f3ef268d8fe31:65d07fc04e2146bf): Summary: Session ID: f84cc7e76c23dfc9:af9f6c36c736cc84 Session Type: BEESWAX Start Time: 2016-03-23 01:06:10.265279000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 45089593363bb86c9944d70021d78b0963ed3d0f) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:40017 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=3 20:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 19:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 18:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--17:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 16:EXCHANGE [HASH(l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 08:AGGREGATE [STREAMING] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--15:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 14:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 13:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 12:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=8B cardinality=17999891 | 04:AGGREGATE [STREAMING] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 3 Request Pool: default-pool Planner Timeline: 24.542ms - Analysis finished: 9.349ms (9.349ms) - Equivalence classes computed: 9.659ms (309.598us) - Single node plan created: 15.777ms (6.118ms) - Runtime filters computed: 16.032ms (254.125us) - Distributed plan created: 19.583ms (3.551ms) - Lineage info computed: 20.436ms (853.331us) - Planning finished: 24.542ms (4.106ms) Query Timeline: 1m - Start execution: 66.982us (66.982us) - Planning finished: 29.545ms (29.478ms) - Ready to start 120 remote fragments: 32.341ms (2.795ms) - All 120 remote fragments started: 45.312ms (12.971ms) - Rows available: 1m (1m) - First row fetched: 1m (45.105ms) ImpalaServer: - ClientFetchWaitTimer: 45.114ms - RowMaterializationTimer: 0.000ns Execution Profile ad4f3ef268d8fe31:65d07fc04e2146bf:(Total: 1m, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 120, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 2ms, 99.9th %-ile: 3ms Per Node Peak Memory Usage: vb0208.halxg.cloudera.com:22000(3.90 GB) vb0230.halxg.cloudera.com:22000(3.94 GB) vb0214.halxg.cloudera.com:22000(3.86 GB) vb0212.halxg.cloudera.com:22000(3.86 GB) vb0234.halxg.cloudera.com:22000(3.92 GB) vb0226.halxg.cloudera.com:22000(3.90 GB) vb0232.halxg.cloudera.com:22000(3.88 GB) vb0216.halxg.cloudera.com:22000(3.83 GB) vb0206.halxg.cloudera.com:22000(3.90 GB) vb0220.halxg.cloudera.com:22000(3.83 GB) vb0228.halxg.cloudera.com:22000(3.90 GB) vb0224.halxg.cloudera.com:22000(3.90 GB) vb0222.halxg.cloudera.com:22000(3.91 GB) vb0218.halxg.cloudera.com:22000(3.83 GB) vb0204.halxg.cloudera.com:22000(3.86 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F10:(Total: 1m, non-child: 451.528us, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 33.980us - RowsProduced: 0 (0) - TotalCpuTime: 60.140ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m, non-child: 10.629us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 3.178us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1m - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F09:(Total: 59s807ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m max:1m mean: 1m stddev:10.917ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.02 MB (969953750) - PerHostPeakMemUsage: 3.88 GB (4167876605) - PrepareTime: 197.340ms - RowsProduced: 0 (0) - TotalCpuTime: 6s645ms - TotalNetworkReceiveTime: 53s565ms - TotalNetworkSendTime: 175.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 597.812ms, non-child: 597.812ms, % non-child: 100.00%) - CodegenTime: 1.597ms - CompileTime: 27.185ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 376.162ms - PrepareTime: 186.363ms DataStreamSender (dst_id=20):(Total: 14.749us, non-child: 14.749us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s805ms, non-child: 5s357ms, % non-child: 8.96%) - BuildTime: 4s401ms - GetNewBlockTime: 756.561us - GetResultsTime: 693.575ms - HTResizeTime: 1s062ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.333us EXCHANGE_NODE (id=18):(Total: 54s447ms, non-child: 54s447ms, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759591) - ConvertRowBatchTime: 820.378ms - DeserializeRowBatchTimer: 750.755ms - FirstBatchArrivalWaitTime: 38s799ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 484.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F08:(Total: 57s463ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:56s166ms max:59s518ms mean: 57s975ms stddev:1s062ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902171499) - PerHostPeakMemUsage: 3.88 GB (4167876605) - PrepareTime: 198.515ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 18s345ms - TotalNetworkReceiveTime: 38s456ms - TotalNetworkSendTime: 1s171ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 661.438ms, non-child: 661.438ms, % non-child: 100.00%) - CodegenTime: 4.518ms - CompileTime: 57.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 412.807ms - PrepareTime: 183.705ms DataStreamSender (dst_id=18):(Total: 6s476ms, non-child: 6s476ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759591) - NetworkThroughput(*): 57.81 MB/sec - OverallThroughput: 44.31 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s346ms - ThriftTransmitTime(*): 5s000ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 50s949ms, non-child: 4s398ms, % non-child: 8.63%) - GetNewBlockTime: 270.054us - GetResultsTime: 127.789ms - HTResizeTime: 108.686ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 517.41 K/sec - StreamingTime: 4s014ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s550ms, non-child: 1s476ms, % non-child: 3.17%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 571.01 K/sec AGGREGATION_NODE (id=17):(Total: 5s690ms, non-child: 2s943ms, % non-child: 51.73%) - BuildTime: 2s278ms - GetNewBlockTime: 1.542ms - GetResultsTime: 641.590ms - HTResizeTime: 851.443ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 2.35 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.195us EXCHANGE_NODE (id=16):(Total: 2s747ms, non-child: 2s747ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139883047) - ConvertRowBatchTime: 300.158ms - DeserializeRowBatchTimer: 324.453ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 5.08 M/sec - SendersBlockedTimer: 10s042ms - SendersBlockedTotalTimer(*): 10s042ms AGGREGATION_NODE (id=13):(Total: 39s383ms, non-child: 3s018ms, % non-child: 7.66%) - BuildTime: 2s305ms - GetNewBlockTime: 296.904us - GetResultsTime: 681.442ms - HTResizeTime: 806.782ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 337.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.259us EXCHANGE_NODE (id=12):(Total: 36s364ms, non-child: 36s364ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139880972) - ConvertRowBatchTime: 325.648ms - DeserializeRowBatchTimer: 290.137ms - FirstBatchArrivalWaitTime: 34s235ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 365.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 49s481ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:49s349ms max:51s237ms mean: 49s994ms stddev:462.500ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069113514) - PerHostPeakMemUsage: 3.88 GB (4167876605) - PrepareTime: 197.751ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 36s092ms - TotalNetworkReceiveTime: 11s401ms - TotalNetworkSendTime: 10s159ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 692.187ms, non-child: 692.187ms, % non-child: 100.00%) - CodegenTime: 1.213ms - CompileTime: 66.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 433.015ms - PrepareTime: 182.745ms DataStreamSender (dst_id=16):(Total: 13s640ms, non-child: 13s640ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139883047) - NetworkThroughput(*): 10.80 MB/sec - OverallThroughput: 9.79 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 777.134ms - ThriftTransmitTime(*): 12s371ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=8):(Total: 35s819ms, non-child: 9s109ms, % non-child: 25.43%) - GetNewBlockTime: 836.287us - GetResultsTime: 467.725ms - HTResizeTime: 1s071ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 371.01 K/sec - StreamingTime: 8s320ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s709ms, non-child: 13s473ms, % non-child: 50.44%) - BuildPartitionTime: 1s482ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s843ms - GetNewBlockTime: 1.603ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s419ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.321us EXCHANGE_NODE (id=15):(Total: 3s744ms, non-child: 3s744ms, % non-child: 100.00%) - BytesReceived: 297.65 MB (312105230) - ConvertRowBatchTime: 330.116ms - DeserializeRowBatchTimer: 1s274ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s492ms, non-child: 9s492ms, % non-child: 100.00%) - BytesReceived: 1.03 GB (1109271338) - ConvertRowBatchTime: 1s316ms - DeserializeRowBatchTimer: 5s573ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 5.48 M/sec - SendersBlockedTimer: 8s938ms - SendersBlockedTotalTimer(*): 1m52s Averaged Fragment F05:(Total: 4s736ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:4s228ms max:5s958ms mean: 5s122ms stddev:478.733ms execution rates: min:230.46 MB/sec max:280.51 MB/sec mean:251.07 MB/sec stddev:14.21 MB/sec num instances: 15 - AverageThreadTokens: 5.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190586764) - PerHostPeakMemUsage: 1.73 GB (1854149270) - PrepareTime: 193.655ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 27s991ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.818ms - TotalStorageWaitTime: 147.464ms CodeGen:(Total: 550.693ms, non-child: 550.693ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 352.970ms - PrepareTime: 182.486ms DataStreamSender (dst_id=15):(Total: 4s416ms, non-child: 4s416ms, % non-child: 100.00%) - BytesSent: 297.65 MB (312105230) - NetworkThroughput(*): 52.55 MB/sec - OverallThroughput: 67.54 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s544ms - ThriftTransmitTime(*): 5s675ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=6):(Total: 488.243ms, non-child: 488.243ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 5.03 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 510.739ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.30 MB (190103446) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 27.96 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1809) - ScannerThreadsTotalWallClockTime: 23s178ms - MaterializeTupleTime(*): 22s441ms - ScannerThreadsSysTime: 59.921ms - ScannerThreadsUserTime: 4s356ms - ScannerThreadsVoluntaryContextSwitches: 13.25K (13251) - TotalRawHdfsReadTime(*): 122.844ms - TotalReadThroughput: 31.52 MB/sec Averaged Fragment F04:(Total: 34s032ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:32s238ms max:35s842ms mean: 34s550ms stddev:1s022ms execution rates: min:121.83 MB/sec max:130.97 MB/sec mean:127.15 MB/sec stddev:2.88 MB/sec num instances: 15 - AverageThreadTokens: 8.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 192.94 MB (202312795) - PerHostPeakMemUsage: 3.85 GB (4137258498) - PrepareTime: 193.564ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s236ms - TotalStorageWaitTime: 367.680ms CodeGen:(Total: 568.319ms, non-child: 568.319ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 369.702ms - PrepareTime: 181.525ms DataStreamSender (dst_id=14):(Total: 33s434ms, non-child: 33s434ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1109271338) - NetworkThroughput(*): 7.73 MB/sec - OverallThroughput: 31.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s712ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=5):(Total: 715.706ms, non-child: 715.706ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.56 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s445ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.50 MB (201851328) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 72.21 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.63K (7632) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 4m14s - ScannerThreadsSysTime: 249.291ms - ScannerThreadsUserTime: 17s420ms - ScannerThreadsVoluntaryContextSwitches: 49.99K (49990) - TotalRawHdfsReadTime(*): 258.084ms - TotalReadThroughput: 10.35 MB/sec Averaged Fragment F02:(Total: 38s313ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:38s413ms max:39s357ms mean: 38s836ms stddev:274.921ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071311701) - PerHostPeakMemUsage: 3.88 GB (4167876605) - PrepareTime: 200.368ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 36s154ms - TotalNetworkReceiveTime: 10s388ms - TotalNetworkSendTime: 79.262ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 703.465ms, non-child: 703.465ms, % non-child: 100.00%) - CodegenTime: 1.403ms - CompileTime: 59.243ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 449.811ms - PrepareTime: 182.492ms DataStreamSender (dst_id=12):(Total: 3s429ms, non-child: 3s429ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139880972) - NetworkThroughput(*): 63.52 MB/sec - OverallThroughput: 39.15 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 755.375ms - ThriftTransmitTime(*): 2s127ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=4):(Total: 34s861ms, non-child: 9s295ms, % non-child: 26.66%) - GetNewBlockTime: 1.551ms - GetResultsTime: 470.858ms - HTResizeTime: 1s088ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 381.21 K/sec - StreamingTime: 8s506ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s566ms, non-child: 13s312ms, % non-child: 52.07%) - BuildPartitionTime: 1s540ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s768ms - GetNewBlockTime: 1.540ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s271ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.533us EXCHANGE_NODE (id=11):(Total: 3s883ms, non-child: 3s883ms, % non-child: 100.00%) - BytesReceived: 297.69 MB (312154033) - ConvertRowBatchTime: 335.588ms - DeserializeRowBatchTimer: 1s272ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s370ms, non-child: 8s370ms, % non-child: 100.00%) - BytesReceived: 1.03 GB (1108451913) - ConvertRowBatchTime: 1s339ms - DeserializeRowBatchTimer: 5s588ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.19 M/sec - SendersBlockedTimer: 8s870ms - SendersBlockedTotalTimer(*): 1m47s Averaged Fragment F01:(Total: 4s712ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:4s158ms max:6s192ms mean: 5s116ms stddev:538.183ms execution rates: min:237.38 MB/sec max:274.44 MB/sec mean:251.56 MB/sec stddev:12.60 MB/sec num instances: 15 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.75 MB (190575840) - PerHostPeakMemUsage: 1.73 GB (1858779724) - PrepareTime: 191.375ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 27s870ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 153.477ms - TotalStorageWaitTime: 175.350ms CodeGen:(Total: 563.535ms, non-child: 563.535ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 367.186ms - PrepareTime: 179.643ms DataStreamSender (dst_id=11):(Total: 4s391ms, non-child: 4s391ms, % non-child: 100.00%) - BytesSent: 297.69 MB (312154033) - NetworkThroughput(*): 52.90 MB/sec - OverallThroughput: 67.98 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s558ms - ThriftTransmitTime(*): 5s641ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=2):(Total: 482.209ms, non-child: 482.209ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 509.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.31 MB (190112459) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 28.37 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1758) - ScannerThreadsTotalWallClockTime: 23s082ms - MaterializeTupleTime(*): 22s310ms - ScannerThreadsSysTime: 63.987ms - ScannerThreadsUserTime: 4s408ms - ScannerThreadsVoluntaryContextSwitches: 13.27K (13271) - TotalRawHdfsReadTime(*): 123.236ms - TotalReadThroughput: 31.79 MB/sec Averaged Fragment F00:(Total: 32s932ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:30s892ms max:34s903ms mean: 33s423ms stddev:1s021ms execution rates: min:127.33 MB/sec max:137.04 MB/sec mean:131.43 MB/sec stddev:2.77 MB/sec num instances: 15 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 193.07 MB (202448579) - PerHostPeakMemUsage: 3.81 GB (4094860699) - PrepareTime: 189.422ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s349ms - TotalStorageWaitTime: 383.699ms CodeGen:(Total: 553.315ms, non-child: 553.315ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 359.772ms - PrepareTime: 178.327ms DataStreamSender (dst_id=10):(Total: 32s332ms, non-child: 32s332ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1108451913) - NetworkThroughput(*): 8.07 MB/sec - OverallThroughput: 32.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s593ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=1):(Total: 711.106ms, non-child: 711.106ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s421ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.63 MB (201988702) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 72.63 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.93K (7934) - ScannerThreadsTotalWallClockTime: 4m6s - MaterializeTupleTime(*): 4m4s - ScannerThreadsSysTime: 249.024ms - ScannerThreadsUserTime: 17s669ms - ScannerThreadsVoluntaryContextSwitches: 49.98K (49983) - TotalRawHdfsReadTime(*): 269.922ms - TotalReadThroughput: 10.68 MB/sec Fragment F09: Instance ad4f3ef268d8fe31:65d07fc04e2146ca (host=vb0204.halxg.cloudera.com:22000):(Total: 59s871ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 95.71 MB, 208.67 MB, 352.41 MB, 473.02 MB, 596.37 MB, 734.11 MB, 862.06 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.07 MB, 906.05 MB, 906.04 MB, 877.71 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.53 MB (970486256) - PerHostPeakMemUsage: 3.86 GB (4146528336) - PrepareTime: 204.071ms - RowsProduced: 0 (0) - TotalCpuTime: 6s207ms - TotalNetworkReceiveTime: 54s003ms - TotalNetworkSendTime: 134.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 540.627ms, non-child: 540.627ms, % non-child: 100.00%) - CodegenTime: 1.361ms - CompileTime: 17.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 321.066ms - PrepareTime: 195.379ms DataStreamSender (dst_id=20):(Total: 13.043us, non-child: 13.043us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s870ms, non-child: 5s028ms, % non-child: 8.40%) ExecOption: Codegen Enabled - BuildTime: 4s070ms - GetNewBlockTime: 387.786us - GetResultsTime: 692.509ms - HTResizeTime: 992.153ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.283us EXCHANGE_NODE (id=18):(Total: 54s842ms, non-child: 980.861ms, % non-child: 1.79%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.49 MB, 26.62 MB, 46.01 MB, 66.15 MB, 85.33 MB, 106.34 MB, 129.71 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 144.97 MB, 163.61 MB, 186.67 MB, 209.10 MB, 234.14 MB, 260.97 MB, 284.01 MB, 284.01 MB - BytesReceived: 284.01 MB (297805098) - ConvertRowBatchTime: 773.097ms - DeserializeRowBatchTimer: 824.582ms - FirstBatchArrivalWaitTime: 38s856ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 480.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146ce (host=vb0230.halxg.cloudera.com:22000):(Total: 59s861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.65 MB, 145.25 MB, 265.18 MB, 378.22 MB, 515.25 MB, 709.04 MB, 829.83 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.04 MB, 882.07 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 792.78 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.88 MB (968762160) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 191.716ms - RowsProduced: 0 (0) - TotalCpuTime: 6s266ms - TotalNetworkReceiveTime: 53s964ms - TotalNetworkSendTime: 157.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 558.577ms, non-child: 558.577ms, % non-child: 100.00%) - CodegenTime: 1.352ms - CompileTime: 18.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 350.707ms - PrepareTime: 185.682ms DataStreamSender (dst_id=20):(Total: 12.612us, non-child: 12.612us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s860ms, non-child: 5s064ms, % non-child: 8.46%) ExecOption: Codegen Enabled - BuildTime: 4s101ms - GetNewBlockTime: 345.348us - GetResultsTime: 712.375ms - HTResizeTime: 1s013ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.000us EXCHANGE_NODE (id=18):(Total: 54s795ms, non-child: 947.101ms, % non-child: 1.73%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.67 MB, 22.82 MB, 42.94 MB, 61.08 MB, 83.76 MB, 113.27 MB, 133.74 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 141.56 MB, 155.07 MB, 171.54 MB, 187.86 MB, 204.88 MB, 222.20 MB, 239.17 MB, 257.01 MB - BytesReceived: 283.95 MB (297740443) - ConvertRowBatchTime: 779.745ms - DeserializeRowBatchTimer: 668.728ms - FirstBatchArrivalWaitTime: 38s838ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 481.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c9 (host=vb0226.halxg.cloudera.com:22000):(Total: 59s844ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 24.88 MB, 136.20 MB, 253.14 MB, 382.24 MB, 475.01 MB, 595.96 MB, 720.89 MB, 862.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.07 MB, 882.05 MB, 915.11 MB, 707.84 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.45 MB (969356864) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 186.359ms - RowsProduced: 0 (0) - TotalCpuTime: 6s422ms - TotalNetworkReceiveTime: 53s803ms - TotalNetworkSendTime: 147.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 565.129ms, non-child: 565.129ms, % non-child: 100.00%) - CodegenTime: 1.289ms - CompileTime: 28.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 351.751ms - PrepareTime: 182.696ms DataStreamSender (dst_id=20):(Total: 13.282us, non-child: 13.282us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s843ms, non-child: 5s208ms, % non-child: 8.70%) ExecOption: Codegen Enabled - BuildTime: 4s256ms - GetNewBlockTime: 323.465us - GetResultsTime: 707.782ms - HTResizeTime: 1s060ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.048us EXCHANGE_NODE (id=18):(Total: 54s634ms, non-child: 984.866ms, % non-child: 1.80%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.30 MB, 23.29 MB, 41.87 MB, 60.43 MB, 77.65 MB, 96.02 MB, 117.03 MB, 137.84 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 142.39 MB, 156.29 MB, 172.51 MB, 191.33 MB, 209.99 MB, 228.93 MB, 248.11 MB, 270.24 MB - BytesReceived: 283.96 MB (297750100) - ConvertRowBatchTime: 770.485ms - DeserializeRowBatchTimer: 820.098ms - FirstBatchArrivalWaitTime: 38s832ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 482.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146cd (host=vb0214.halxg.cloudera.com:22000):(Total: 59s842ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 22.84 MB, 95.74 MB, 208.67 MB, 354.49 MB, 442.54 MB, 567.71 MB, 704.88 MB, 821.83 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.04 MB, 882.06 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.05 MB, 898.05 MB, 849.41 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.82 MB (969744240) - PerHostPeakMemUsage: 3.86 GB (4142989040) - PrepareTime: 187.720ms - RowsProduced: 0 (0) - TotalCpuTime: 6s472ms - TotalNetworkReceiveTime: 53s725ms - TotalNetworkSendTime: 348.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 539.232ms, non-child: 539.232ms, % non-child: 100.00%) - CodegenTime: 1.407ms - CompileTime: 17.902ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 335.835ms - PrepareTime: 181.986ms DataStreamSender (dst_id=20):(Total: 13.788us, non-child: 13.788us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s841ms, non-child: 5s223ms, % non-child: 8.73%) ExecOption: Codegen Enabled - BuildTime: 4s286ms - GetNewBlockTime: 434.191us - GetResultsTime: 679.102ms - HTResizeTime: 988.774ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.130us EXCHANGE_NODE (id=18):(Total: 54s618ms, non-child: 1s049ms, % non-child: 1.92%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.65 MB, 27.38 MB, 46.09 MB, 64.65 MB, 81.53 MB, 103.98 MB, 122.18 MB, 139.98 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 144.67 MB, 160.88 MB, 177.15 MB, 193.36 MB, 209.53 MB, 229.58 MB, 255.91 MB, 281.57 MB - BytesReceived: 283.87 MB (297664197) - ConvertRowBatchTime: 830.421ms - DeserializeRowBatchTimer: 791.225ms - FirstBatchArrivalWaitTime: 38s858ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 482.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146cb (host=vb0234.halxg.cloudera.com:22000):(Total: 59s832ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.65 MB, 91.72 MB, 195.26 MB, 313.60 MB, 434.53 MB, 547.48 MB, 660.43 MB, 819.82 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.06 MB, 894.06 MB, 906.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.28 MB (970224368) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 192.210ms - RowsProduced: 0 (0) - TotalCpuTime: 6s796ms - TotalNetworkReceiveTime: 53s410ms - TotalNetworkSendTime: 151.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 563.905ms, non-child: 563.905ms, % non-child: 100.00%) - CodegenTime: 1.335ms - CompileTime: 27.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 346.084ms - PrepareTime: 185.381ms DataStreamSender (dst_id=20):(Total: 12.947us, non-child: 12.947us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s832ms, non-child: 5s499ms, % non-child: 9.19%) ExecOption: Codegen Enabled - BuildTime: 4s546ms - GetNewBlockTime: 423.048us - GetResultsTime: 688.919ms - HTResizeTime: 1s162ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.452us EXCHANGE_NODE (id=18):(Total: 54s332ms, non-child: 1s073ms, % non-child: 1.98%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.06 MB, 24.48 MB, 40.65 MB, 60.82 MB, 80.23 MB, 97.55 MB, 117.38 MB, 139.59 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 144.27 MB, 160.52 MB, 177.57 MB, 195.89 MB, 215.03 MB, 235.66 MB, 255.30 MB, 279.71 MB - BytesReceived: 283.95 MB (297741695) - ConvertRowBatchTime: 857.254ms - DeserializeRowBatchTimer: 838.609ms - FirstBatchArrivalWaitTime: 38s836ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 485.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146cc (host=vb0212.halxg.cloudera.com:22000):(Total: 59s830ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 23.87 MB, 132.19 MB, 247.14 MB, 362.08 MB, 483.00 MB, 591.96 MB, 721.17 MB, 862.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.04 MB, 882.06 MB, 882.06 MB, 886.07 MB, 906.04 MB, 736.15 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.16 MB (970098880) - PerHostPeakMemUsage: 3.86 GB (4145828608) - PrepareTime: 190.360ms - RowsProduced: 0 (0) - TotalCpuTime: 6s533ms - TotalNetworkReceiveTime: 53s661ms - TotalNetworkSendTime: 304.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 552.345ms, non-child: 552.345ms, % non-child: 100.00%) - CodegenTime: 1.331ms - CompileTime: 14.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.229ms - PrepareTime: 179.766ms DataStreamSender (dst_id=20):(Total: 14.497us, non-child: 14.497us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s829ms, non-child: 5s238ms, % non-child: 8.76%) ExecOption: Codegen Enabled - BuildTime: 4s288ms - GetNewBlockTime: 383.825us - GetResultsTime: 675.732ms - HTResizeTime: 1s082ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 957.000ns EXCHANGE_NODE (id=18):(Total: 54s590ms, non-child: 1s098ms, % non-child: 2.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.81 MB, 21.81 MB, 40.64 MB, 59.03 MB, 77.77 MB, 95.22 MB, 114.59 MB, 137.55 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 142.28 MB, 157.16 MB, 176.47 MB, 196.90 MB, 216.46 MB, 237.53 MB, 257.67 MB, 280.48 MB - BytesReceived: 283.98 MB (297774270) - ConvertRowBatchTime: 864.644ms - DeserializeRowBatchTimer: 887.075ms - FirstBatchArrivalWaitTime: 38s847ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 482.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c7 (host=vb0216.halxg.cloudera.com:22000):(Total: 59s829ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 40.26 MB, 190.66 MB, 325.61 MB, 455.41 MB, 607.98 MB, 739.13 MB, 862.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.04 MB, 882.05 MB, 906.06 MB, 906.04 MB, 906.04 MB, 651.22 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.95 MB (970928192) - PerHostPeakMemUsage: 3.83 GB (4109472000) - PrepareTime: 190.691ms - RowsProduced: 0 (0) - TotalCpuTime: 6s794ms - TotalNetworkReceiveTime: 53s409ms - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 561.515ms, non-child: 561.515ms, % non-child: 100.00%) - CodegenTime: 1.406ms - CompileTime: 21.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 351.202ms - PrepareTime: 183.272ms DataStreamSender (dst_id=20):(Total: 15.337us, non-child: 15.337us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s828ms, non-child: 5s481ms, % non-child: 9.16%) ExecOption: Codegen Enabled - BuildTime: 4s536ms - GetNewBlockTime: 354.123us - GetResultsTime: 685.726ms - HTResizeTime: 1s096ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.367us EXCHANGE_NODE (id=18):(Total: 54s346ms, non-child: 1s079ms, % non-child: 1.99%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.65 MB, 31.62 MB, 53.38 MB, 72.57 MB, 97.27 MB, 118.93 MB, 137.65 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 144.19 MB, 166.00 MB, 196.08 MB, 221.56 MB, 245.03 MB, 277.78 MB, 283.89 MB, 283.89 MB - BytesReceived: 283.89 MB (297681835) - ConvertRowBatchTime: 874.020ms - DeserializeRowBatchTimer: 761.008ms - FirstBatchArrivalWaitTime: 38s838ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 484.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c5 (host=vb0220.halxg.cloudera.com:22000):(Total: 59s821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.65 MB, 112.97 MB, 246.28 MB, 378.06 MB, 529.48 MB, 656.59 MB, 822.13 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.04 MB, 882.05 MB, 906.04 MB, 906.03 MB, 906.03 MB, 906.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.07 MB (970006128) - PerHostPeakMemUsage: 3.83 GB (4107731200) - PrepareTime: 188.304ms - RowsProduced: 0 (0) - TotalCpuTime: 6s013ms - TotalNetworkReceiveTime: 54s204ms - TotalNetworkSendTime: 147.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 580.865ms, non-child: 580.865ms, % non-child: 100.00%) - CodegenTime: 1.353ms - CompileTime: 19.519ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 375.015ms - PrepareTime: 184.637ms DataStreamSender (dst_id=20):(Total: 13.056us, non-child: 13.056us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s820ms, non-child: 4s870ms, % non-child: 8.14%) ExecOption: Codegen Enabled - BuildTime: 3s924ms - GetNewBlockTime: 381.591us - GetResultsTime: 699.822ms - HTResizeTime: 1s017ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.247us EXCHANGE_NODE (id=18):(Total: 54s950ms, non-child: 863.982ms, % non-child: 1.57%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.68 MB, 30.07 MB, 51.91 MB, 73.72 MB, 95.57 MB, 117.78 MB, 139.52 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 146.25 MB, 174.44 MB, 206.03 MB, 236.76 MB, 271.20 MB, 284.11 MB, 284.11 MB, 284.11 MB - BytesReceived: 284.11 MB (297915950) - ConvertRowBatchTime: 691.692ms - DeserializeRowBatchTimer: 551.937ms - FirstBatchArrivalWaitTime: 38s818ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 479.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c3 (host=vb0224.halxg.cloudera.com:22000):(Total: 59s791ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 10.64 MB, 115.91 MB, 212.67 MB, 355.58 MB, 467.57 MB, 593.95 MB, 753.36 MB, 870.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.08 MB, 882.06 MB, 882.04 MB, 882.04 MB, 882.07 MB, 894.06 MB, 906.04 MB, 877.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.86 MB (969787888) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 210.269ms - RowsProduced: 0 (0) - TotalCpuTime: 6s780ms - TotalNetworkReceiveTime: 53s438ms - TotalNetworkSendTime: 137.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 623.388ms, non-child: 623.388ms, % non-child: 100.00%) - CodegenTime: 2.689ms - CompileTime: 27.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 397.586ms - PrepareTime: 182.882ms DataStreamSender (dst_id=20):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s787ms, non-child: 5s452ms, % non-child: 9.12%) ExecOption: Codegen Enabled - BuildTime: 4s476ms - GetNewBlockTime: 5.679ms - GetResultsTime: 701.861ms - HTResizeTime: 1s106ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.211us EXCHANGE_NODE (id=18):(Total: 54s335ms, non-child: 1s034ms, % non-child: 1.90%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.84 MB, 27.84 MB, 47.03 MB, 64.97 MB, 83.72 MB, 108.52 MB, 131.35 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 146.66 MB, 167.88 MB, 186.01 MB, 209.36 MB, 233.32 MB, 250.19 MB, 277.93 MB, 284.01 MB - BytesReceived: 284.01 MB (297803645) - ConvertRowBatchTime: 830.213ms - DeserializeRowBatchTimer: 797.004ms - FirstBatchArrivalWaitTime: 38s759ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 485.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c6 (host=vb0206.halxg.cloudera.com:22000):(Total: 59s789ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 23.38 MB, 119.80 MB, 247.14 MB, 362.08 MB, 487.21 MB, 650.50 MB, 819.86 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.07 MB, 882.05 MB, 906.05 MB, 906.03 MB, 906.03 MB, 792.77 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.24 MB (970180720) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 184.638ms - RowsProduced: 0 (0) - TotalCpuTime: 6s847ms - TotalNetworkReceiveTime: 53s361ms - TotalNetworkSendTime: 235.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 601.364ms, non-child: 601.364ms, % non-child: 100.00%) - CodegenTime: 1.342ms - CompileTime: 37.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 381.138ms - PrepareTime: 180.926ms DataStreamSender (dst_id=20):(Total: 12.627us, non-child: 12.627us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s788ms, non-child: 5s499ms, % non-child: 9.20%) ExecOption: Codegen Enabled - BuildTime: 4s566ms - GetNewBlockTime: 385.129us - GetResultsTime: 691.899ms - HTResizeTime: 1s127ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.309us EXCHANGE_NODE (id=18):(Total: 54s289ms, non-child: 1s069ms, % non-child: 1.97%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.61 MB, 19.53 MB, 40.62 MB, 58.88 MB, 77.37 MB, 103.83 MB, 131.42 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 141.46 MB, 162.96 MB, 189.81 MB, 221.59 MB, 252.99 MB, 280.14 MB, 283.97 MB, 283.97 MB - BytesReceived: 283.97 MB (297763117) - ConvertRowBatchTime: 865.195ms - DeserializeRowBatchTimer: 703.108ms - FirstBatchArrivalWaitTime: 38s795ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 485.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c1 (host=vb0218.halxg.cloudera.com:22000):(Total: 59s772ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.64 MB, 100.05 MB, 241.21 MB, 398.30 MB, 531.48 MB, 673.08 MB, 850.01 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 906.05 MB, 906.06 MB, 906.06 MB, 792.78 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.07 MB (971053680) - PerHostPeakMemUsage: 3.83 GB (4111110400) - PrepareTime: 201.280ms - RowsProduced: 0 (0) - TotalCpuTime: 6s607ms - TotalNetworkReceiveTime: 53s604ms - TotalNetworkSendTime: 153.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 635.745ms, non-child: 635.745ms, % non-child: 100.00%) - CodegenTime: 2.525ms - CompileTime: 35.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 402.266ms - PrepareTime: 186.099ms DataStreamSender (dst_id=20):(Total: 23.702us, non-child: 23.702us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s768ms, non-child: 5s240ms, % non-child: 8.77%) ExecOption: Codegen Enabled - BuildTime: 4s280ms - GetNewBlockTime: 387.133us - GetResultsTime: 695.239ms - HTResizeTime: 1s005ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.303us EXCHANGE_NODE (id=18):(Total: 54s528ms, non-child: 1s068ms, % non-child: 1.96%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.14 MB, 16.92 MB, 39.68 MB, 65.33 MB, 86.15 MB, 106.30 MB, 134.18 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 141.60 MB, 164.54 MB, 195.76 MB, 220.92 MB, 243.86 MB, 277.47 MB, 283.91 MB, 283.91 MB - BytesReceived: 283.91 MB (297701377) - ConvertRowBatchTime: 864.509ms - DeserializeRowBatchTimer: 662.734ms - FirstBatchArrivalWaitTime: 38s768ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 483.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146cf (host=vb0208.halxg.cloudera.com:22000):(Total: 59s767ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.65 MB, 149.23 MB, 265.14 MB, 378.07 MB, 491.01 MB, 603.94 MB, 741.12 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 906.05 MB, 764.46 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.36 MB (970311664) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 206.554ms - RowsProduced: 0 (0) - TotalCpuTime: 6s887ms - TotalNetworkReceiveTime: 53s333ms - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 655.852ms, non-child: 655.852ms, % non-child: 100.00%) - CodegenTime: 1.968ms - CompileTime: 40.555ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 411.932ms - PrepareTime: 191.023ms DataStreamSender (dst_id=20):(Total: 12.045us, non-child: 12.045us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s766ms, non-child: 5s492ms, % non-child: 9.19%) ExecOption: Codegen Enabled - BuildTime: 4s515ms - GetNewBlockTime: 612.988us - GetResultsTime: 702.388ms - HTResizeTime: 1s039ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.395us EXCHANGE_NODE (id=18):(Total: 54s273ms, non-child: 1s238ms, % non-child: 2.28%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.41 MB, 22.58 MB, 43.22 MB, 62.37 MB, 79.54 MB, 98.51 MB, 119.35 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 142.15 MB, 158.48 MB, 174.64 MB, 190.70 MB, 206.83 MB, 224.90 MB, 248.29 MB, 277.72 MB - BytesReceived: 283.93 MB (297721334) - ConvertRowBatchTime: 867.550ms - DeserializeRowBatchTimer: 702.318ms - FirstBatchArrivalWaitTime: 38s740ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 485.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c2 (host=vb0222.halxg.cloudera.com:22000):(Total: 59s758ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 24.89 MB, 136.19 MB, 249.13 MB, 366.07 MB, 479.00 MB, 599.93 MB, 783.59 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.04 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.04 MB, 894.06 MB, 906.04 MB, 764.47 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.36 MB (969264112) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 204.020ms - RowsProduced: 0 (0) - TotalCpuTime: 6s079ms - TotalNetworkReceiveTime: 54s115ms - TotalNetworkSendTime: 145.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 637.540ms, non-child: 637.540ms, % non-child: 100.00%) - CodegenTime: 1.496ms - CompileTime: 30.263ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 405.470ms - PrepareTime: 188.237ms DataStreamSender (dst_id=20):(Total: 12.388us, non-child: 12.388us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s757ms, non-child: 4s855ms, % non-child: 8.13%) ExecOption: Codegen Enabled - BuildTime: 3s910ms - GetNewBlockTime: 455.970us - GetResultsTime: 678.324ms - HTResizeTime: 932.920ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.093us EXCHANGE_NODE (id=18):(Total: 54s901ms, non-child: 899.302ms, % non-child: 1.64%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.26 MB, 23.54 MB, 42.02 MB, 60.02 MB, 77.79 MB, 97.17 MB, 125.35 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 142.29 MB, 160.76 MB, 180.18 MB, 200.98 MB, 225.10 MB, 243.72 MB, 263.70 MB, 284.05 MB - BytesReceived: 284.05 MB (297847639) - ConvertRowBatchTime: 733.306ms - DeserializeRowBatchTimer: 612.662ms - FirstBatchArrivalWaitTime: 38s760ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 480.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c4 (host=vb0228.halxg.cloudera.com:22000):(Total: 59s749ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.64 MB, 95.73 MB, 208.66 MB, 321.59 MB, 439.21 MB, 528.55 MB, 634.23 MB, 755.66 MB, 870.05 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.06 MB, 882.05 MB, 882.07 MB, 906.05 MB, 906.04 MB, 792.78 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.53 MB (969444160) - PerHostPeakMemUsage: 3.90 GB (4182707160) - PrepareTime: 198.167ms - RowsProduced: 0 (0) - TotalCpuTime: 8s082ms - TotalNetworkReceiveTime: 52s140ms - TotalNetworkSendTime: 149.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 668.870ms, non-child: 668.870ms, % non-child: 100.00%) - CodegenTime: 1.381ms - CompileTime: 34.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 438.268ms - PrepareTime: 183.338ms DataStreamSender (dst_id=20):(Total: 14.449us, non-child: 14.449us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s748ms, non-child: 6s669ms, % non-child: 11.16%) ExecOption: Codegen Enabled - BuildTime: 5s690ms - GetNewBlockTime: 448.528us - GetResultsTime: 705.694ms - HTResizeTime: 1s173ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.113us EXCHANGE_NODE (id=18):(Total: 53s078ms, non-child: 1s098ms, % non-child: 2.07%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.31 MB, 17.95 MB, 36.17 MB, 52.20 MB, 69.66 MB, 84.25 MB, 101.58 MB, 120.23 MB, 139.64 MB, 140.70 MB, 140.70 MB, 140.70 MB, 141.02 MB, 158.83 MB, 184.17 MB, 211.03 MB, 236.96 MB, 257.18 MB, 280.09 MB, 283.82 MB - BytesReceived: 283.82 MB (297606963) - ConvertRowBatchTime: 875.455ms - DeserializeRowBatchTimer: 826.544ms - FirstBatchArrivalWaitTime: 38s728ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 496.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146c8 (host=vb0232.halxg.cloudera.com:22000):(Total: 59s740ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 40.82 MB, 189.56 MB, 309.60 MB, 434.54 MB, 547.47 MB, 698.89 MB, 841.82 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.07 MB, 882.04 MB, 906.05 MB, 651.21 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.74 MB (969656944) - PerHostPeakMemUsage: 3.88 GB (4169855184) - PrepareTime: 223.742ms - RowsProduced: 0 (0) - TotalCpuTime: 6s894ms - TotalNetworkReceiveTime: 53s310ms - TotalNetworkSendTime: 134.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 682.232ms, non-child: 682.232ms, % non-child: 100.00%) - CodegenTime: 1.725ms - CompileTime: 36.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 424.885ms - PrepareTime: 204.137ms DataStreamSender (dst_id=20):(Total: 12.374us, non-child: 12.374us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 59s739ms, non-child: 5s538ms, % non-child: 9.27%) ExecOption: Codegen Enabled - BuildTime: 4s565ms - GetNewBlockTime: 345.367us - GetResultsTime: 686.250ms - HTResizeTime: 1s142ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.099us EXCHANGE_NODE (id=18):(Total: 54s200ms, non-child: 1s024ms, % non-child: 1.89%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.81 MB, 29.43 MB, 50.76 MB, 70.03 MB, 89.42 MB, 112.18 MB, 135.16 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 143.75 MB, 158.97 MB, 175.83 MB, 193.44 MB, 210.01 MB, 230.58 MB, 250.16 MB, 273.98 MB - BytesReceived: 284.08 MB (297876215) - ConvertRowBatchTime: 828.089ms - DeserializeRowBatchTimer: 813.689ms - FirstBatchArrivalWaitTime: 38s711ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 486.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F08: Instance ad4f3ef268d8fe31:65d07fc04e2146dd (host=vb0230.halxg.cloudera.com:22000):(Total: 59s066ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 83.06 MB, 295.73 MB, 493.59 MB, 691.47 MB, 810.77 MB, 695.58 MB, 598.33 MB, 501.09 MB, 379.51 MB, 209.32 MB, 112.07 MB, 194.81 MB, 388.39 MB, 570.27 MB, 751.90 MB, 792.13 MB, 806.17 MB, 748.03 MB, 651.78 MB, 555.51 MB, 459.27 MB, 362.99 MB, 290.83 MB, 194.58 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 187.083ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 19s131ms - TotalNetworkReceiveTime: 39s259ms - TotalNetworkSendTime: 1s125ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 594.119ms, non-child: 594.119ms, % non-child: 100.00%) - CodegenTime: 3.471ms - CompileTime: 49.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.774ms - PrepareTime: 180.986ms DataStreamSender (dst_id=18):(Total: 7s000ms, non-child: 7s000ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297740443) - NetworkThroughput(*): 53.47 MB/sec - OverallThroughput: 40.56 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s576ms - ThriftTransmitTime(*): 5s310ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 52s028ms, non-child: 4s768ms, % non-child: 9.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 277.235us - GetResultsTime: 148.435ms - HTResizeTime: 95.546ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 506.61 K/sec - StreamingTime: 4s369ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 47s260ms, non-child: 1s578ms, % non-child: 3.34%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 562.37 K/sec AGGREGATION_NODE (id=17):(Total: 6s192ms, non-child: 3s143ms, % non-child: 50.77%) ExecOption: Codegen Enabled - BuildTime: 2s324ms - GetNewBlockTime: 265.304us - GetResultsTime: 796.939ms - HTResizeTime: 862.915ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 993.000ns EXCHANGE_NODE (id=16):(Total: 3s048ms, non-child: 381.310ms, % non-child: 12.51%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 31.87 MB, 64.72 MB, 96.10 MB, 126.94 MB, 133.38 MB - BytesReceived: 133.38 MB (139862643) - ConvertRowBatchTime: 333.681ms - DeserializeRowBatchTimer: 294.678ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 4.36 M/sec - SendersBlockedTimer: 9s705ms - SendersBlockedTotalTimer(*): 9s705ms AGGREGATION_NODE (id=13):(Total: 39s489ms, non-child: 2s690ms, % non-child: 6.81%) ExecOption: Codegen Enabled - BuildTime: 1s950ms - GetNewBlockTime: 265.199us - GetResultsTime: 664.721ms - HTResizeTime: 729.749ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 336.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.084us EXCHANGE_NODE (id=12):(Total: 36s798ms, non-child: 274.331ms, % non-child: 0.75%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.58 MB, 46.21 MB, 80.91 MB, 114.56 MB - BytesReceived: 133.38 MB (139864254) - ConvertRowBatchTime: 226.314ms - DeserializeRowBatchTimer: 399.151ms - FirstBatchArrivalWaitTime: 34s353ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 361.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d8 (host=vb0226.halxg.cloudera.com:22000):(Total: 58s592ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 131.70 MB, 348.23 MB, 559.49 MB, 762.20 MB, 786.50 MB, 695.60 MB, 598.37 MB, 501.12 MB, 403.85 MB, 306.60 MB, 209.35 MB, 110.91 MB, 259.61 MB, 432.89 MB, 612.72 MB, 776.00 MB, 816.40 MB, 748.02 MB, 651.77 MB, 555.51 MB, 459.29 MB, 363.00 MB, 242.71 MB, 117.64 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 208.782ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 19s692ms - TotalNetworkReceiveTime: 38s058ms - TotalNetworkSendTime: 1s379ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 694.162ms, non-child: 694.162ms, % non-child: 100.00%) - CodegenTime: 6.104ms - CompileTime: 44.707ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 453.763ms - PrepareTime: 182.264ms DataStreamSender (dst_id=18):(Total: 7s339ms, non-child: 7s339ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297750100) - NetworkThroughput(*): 48.12 MB/sec - OverallThroughput: 38.69 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s619ms - ThriftTransmitTime(*): 5s901ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 51s215ms, non-child: 4s735ms, % non-child: 9.25%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 924.237us - GetResultsTime: 155.969ms - HTResizeTime: 123.760ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 514.65 K/sec - StreamingTime: 4s314ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s479ms, non-child: 1s624ms, % non-child: 3.50%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 571.82 K/sec AGGREGATION_NODE (id=17):(Total: 5s419ms, non-child: 2s895ms, % non-child: 53.43%) ExecOption: Codegen Enabled - BuildTime: 2s131ms - GetNewBlockTime: 2.344ms - GetResultsTime: 739.370ms - HTResizeTime: 880.036ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 2.45 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.399us EXCHANGE_NODE (id=16):(Total: 2s524ms, non-child: 315.029ms, % non-child: 12.48%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 14.09 MB, 41.06 MB, 71.42 MB, 102.04 MB, 129.05 MB - BytesReceived: 133.40 MB (139877570) - ConvertRowBatchTime: 257.942ms - DeserializeRowBatchTimer: 394.023ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 5.26 M/sec - SendersBlockedTimer: 10s471ms - SendersBlockedTotalTimer(*): 10s471ms AGGREGATION_NODE (id=13):(Total: 39s435ms, non-child: 3s254ms, % non-child: 8.25%) ExecOption: Codegen Enabled - BuildTime: 2s454ms - GetNewBlockTime: 280.954us - GetResultsTime: 726.204ms - HTResizeTime: 860.446ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 336.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.280us EXCHANGE_NODE (id=12):(Total: 36s181ms, non-child: 422.088ms, % non-child: 1.17%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21.16 MB, 55.71 MB, 91.75 MB, 126.01 MB - BytesReceived: 133.39 MB (139869402) - ConvertRowBatchTime: 360.507ms - DeserializeRowBatchTimer: 239.069ms - FirstBatchArrivalWaitTime: 34s197ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 367.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d7 (host=vb0232.halxg.cloudera.com:22000):(Total: 58s465ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 6.47 MB, 165.29 MB, 380.69 MB, 578.57 MB, 764.21 MB, 792.87 MB, 671.30 MB, 549.72 MB, 452.49 MB, 355.24 MB, 209.35 MB, 96.92 MB, 221.49 MB, 404.41 MB, 582.29 MB, 755.92 MB, 792.16 MB, 786.23 MB, 723.97 MB, 651.78 MB, 555.53 MB, 459.27 MB, 338.96 MB, 218.64 MB, 89.34 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.88 GB (4169855184) - PrepareTime: 208.104ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 17s881ms - TotalNetworkReceiveTime: 39s800ms - TotalNetworkSendTime: 1s347ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 727.152ms, non-child: 727.152ms, % non-child: 100.00%) - CodegenTime: 5.748ms - CompileTime: 67.582ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 459.225ms - PrepareTime: 183.166ms DataStreamSender (dst_id=18):(Total: 6s953ms, non-child: 6s953ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297876215) - NetworkThroughput(*): 51.65 MB/sec - OverallThroughput: 40.85 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s534ms - ThriftTransmitTime(*): 5s500ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 51s476ms, non-child: 4s567ms, % non-child: 8.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 171.637us - GetResultsTime: 135.679ms - HTResizeTime: 91.243ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270593) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 512.25 K/sec - StreamingTime: 4s161ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s909ms, non-child: 1s551ms, % non-child: 3.31%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 566.81 K/sec AGGREGATION_NODE (id=17):(Total: 6s092ms, non-child: 2s619ms, % non-child: 42.99%) ExecOption: Codegen Enabled - BuildTime: 1s860ms - GetNewBlockTime: 297.522us - GetResultsTime: 739.410ms - HTResizeTime: 667.274ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 2.18 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.393us EXCHANGE_NODE (id=16):(Total: 3s473ms, non-child: 276.257ms, % non-child: 7.95%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.44 MB, 34.34 MB, 66.23 MB, 98.08 MB, 127.55 MB, 133.46 MB - BytesReceived: 133.46 MB (139948135) - ConvertRowBatchTime: 228.443ms - DeserializeRowBatchTimer: 351.106ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 3.83 M/sec - SendersBlockedTimer: 9s625ms - SendersBlockedTotalTimer(*): 9s625ms AGGREGATION_NODE (id=13):(Total: 39s264ms, non-child: 2s453ms, % non-child: 6.25%) ExecOption: Codegen Enabled - BuildTime: 1s800ms - GetNewBlockTime: 411.741us - GetResultsTime: 632.442ms - HTResizeTime: 612.205ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 338.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.853us EXCHANGE_NODE (id=12):(Total: 36s811ms, non-child: 278.401ms, % non-child: 0.76%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 121.12 KB, 25.47 MB, 60.03 MB, 94.61 MB, 126.52 MB - BytesReceived: 133.45 MB (139933558) - ConvertRowBatchTime: 230.869ms - DeserializeRowBatchTimer: 373.893ms - FirstBatchArrivalWaitTime: 34s168ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 361.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146da (host=vb0234.halxg.cloudera.com:22000):(Total: 58s268ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 79.16 MB, 279.55 MB, 465.68 MB, 639.02 MB, 798.78 MB, 744.20 MB, 646.95 MB, 549.71 MB, 452.45 MB, 355.22 MB, 257.95 MB, 112.08 MB, 225.37 MB, 424.88 MB, 630.75 MB, 784.16 MB, 806.26 MB, 748.02 MB, 651.76 MB, 555.52 MB, 459.28 MB, 363.01 MB, 266.77 MB, 141.98 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 214.602ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 19s895ms - TotalNetworkReceiveTime: 37s606ms - TotalNetworkSendTime: 1s344ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 730.444ms, non-child: 730.444ms, % non-child: 100.00%) - CodegenTime: 6.007ms - CompileTime: 48.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 482.129ms - PrepareTime: 186.640ms DataStreamSender (dst_id=18):(Total: 7s248ms, non-child: 7s248ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741695) - NetworkThroughput(*): 51.32 MB/sec - OverallThroughput: 39.17 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s640ms - ThriftTransmitTime(*): 5s532ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 50s982ms, non-child: 4s694ms, % non-child: 9.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 157.028us - GetResultsTime: 142.676ms - HTResizeTime: 123.321ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 516.98 K/sec - StreamingTime: 4s280ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s287ms, non-child: 1s612ms, % non-child: 3.48%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 574.16 K/sec AGGREGATION_NODE (id=17):(Total: 5s324ms, non-child: 3s168ms, % non-child: 59.50%) ExecOption: Codegen Enabled - BuildTime: 2s426ms - GetNewBlockTime: 3.750ms - GetResultsTime: 713.469ms - HTResizeTime: 869.965ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 2.50 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.483us EXCHANGE_NODE (id=16):(Total: 2s156ms, non-child: 425.796ms, % non-child: 19.75%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.60 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 17.55 MB, 52.50 MB, 89.11 MB, 123.18 MB, 133.38 MB - BytesReceived: 133.38 MB (139864089) - ConvertRowBatchTime: 366.777ms - DeserializeRowBatchTimer: 262.478ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 6.16 M/sec - SendersBlockedTimer: 10s509ms - SendersBlockedTotalTimer(*): 10s509ms AGGREGATION_NODE (id=13):(Total: 39s350ms, non-child: 3s138ms, % non-child: 7.98%) ExecOption: Codegen Enabled - BuildTime: 2s380ms - GetNewBlockTime: 470.363us - GetResultsTime: 725.710ms - HTResizeTime: 789.864ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 337.69 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.220us EXCHANGE_NODE (id=12):(Total: 36s211ms, non-child: 418.372ms, % non-child: 1.16%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.02 MB, 27.28 MB, 58.84 MB, 90.34 MB, 121.99 MB - BytesReceived: 133.39 MB (139866954) - ConvertRowBatchTime: 363.484ms - DeserializeRowBatchTimer: 288.664ms - FirstBatchArrivalWaitTime: 34s155ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 366.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146dc (host=vb0214.halxg.cloudera.com:22000):(Total: 58s267ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 83.08 MB, 298.07 MB, 497.60 MB, 691.48 MB, 810.78 MB, 744.21 MB, 646.95 MB, 525.41 MB, 452.46 MB, 330.90 MB, 209.33 MB, 112.08 MB, 208.95 MB, 421.04 MB, 627.14 MB, 784.14 MB, 799.16 MB, 748.01 MB, 651.75 MB, 579.59 MB, 507.40 MB, 411.15 MB, 266.77 MB, 89.35 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.86 GB (4142989040) - PrepareTime: 187.793ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 20s439ms - TotalNetworkReceiveTime: 37s064ms - TotalNetworkSendTime: 1s257ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 640.548ms, non-child: 640.548ms, % non-child: 100.00%) - CodegenTime: 3.183ms - CompileTime: 68.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 388.861ms - PrepareTime: 180.847ms DataStreamSender (dst_id=18):(Total: 6s973ms, non-child: 6s973ms, % non-child: 100.00%) - BytesSent: 283.87 MB (297664197) - NetworkThroughput(*): 50.52 MB/sec - OverallThroughput: 40.71 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s517ms - ThriftTransmitTime(*): 5s619ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 51s257ms, non-child: 4s835ms, % non-child: 9.43%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 273.247us - GetResultsTime: 129.474ms - HTResizeTime: 107.528ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255945) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 514.08 K/sec - StreamingTime: 4s457ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s421ms, non-child: 1s661ms, % non-child: 3.58%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 572.37 K/sec AGGREGATION_NODE (id=17):(Total: 5s305ms, non-child: 3s536ms, % non-child: 66.65%) ExecOption: Codegen Enabled - BuildTime: 2s780ms - GetNewBlockTime: 333.251us - GetResultsTime: 736.540ms - HTResizeTime: 776.454ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 2.50 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.200us EXCHANGE_NODE (id=16):(Total: 1s769ms, non-child: 398.863ms, % non-child: 22.54%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.27 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 17.80 MB, 52.00 MB, 87.18 MB, 122.59 MB, 133.36 MB - BytesReceived: 133.36 MB (139839049) - ConvertRowBatchTime: 336.554ms - DeserializeRowBatchTimer: 235.645ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 7.51 M/sec - SendersBlockedTimer: 10s522ms - SendersBlockedTotalTimer(*): 10s522ms AGGREGATION_NODE (id=13):(Total: 39s454ms, non-child: 3s393ms, % non-child: 8.60%) ExecOption: Codegen Enabled - BuildTime: 2s637ms - GetNewBlockTime: 301.942us - GetResultsTime: 732.847ms - HTResizeTime: 892.822ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 336.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.230us EXCHANGE_NODE (id=12):(Total: 36s060ms, non-child: 455.380ms, % non-child: 1.26%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.09 MB, 30.41 MB, 64.25 MB, 98.23 MB, 128.24 MB - BytesReceived: 133.36 MB (139837214) - ConvertRowBatchTime: 394.821ms - DeserializeRowBatchTimer: 257.865ms - FirstBatchArrivalWaitTime: 34s261ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 368.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146de (host=vb0208.halxg.cloudera.com:22000):(Total: 58s183ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 123.54 MB, 361.21 MB, 582.57 MB, 772.20 MB, 810.80 MB, 695.60 MB, 598.35 MB, 501.09 MB, 403.87 MB, 306.60 MB, 185.05 MB, 127.43 MB, 364.96 MB, 578.28 MB, 776.73 MB, 792.14 MB, 808.37 MB, 723.95 MB, 651.77 MB, 555.53 MB, 459.26 MB, 363.02 MB, 242.71 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 193.205ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 18s293ms - TotalNetworkReceiveTime: 39s158ms - TotalNetworkSendTime: 1s247ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 664.134ms, non-child: 664.134ms, % non-child: 100.00%) - CodegenTime: 3.490ms - CompileTime: 74.841ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 400.537ms - PrepareTime: 186.198ms DataStreamSender (dst_id=18):(Total: 6s810ms, non-child: 6s810ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297721334) - NetworkThroughput(*): 53.03 MB/sec - OverallThroughput: 41.69 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s461ms - ThriftTransmitTime(*): 5s353ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 51s338ms, non-child: 4s641ms, % non-child: 9.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 149.333us - GetResultsTime: 139.083ms - HTResizeTime: 125.299ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 513.37 K/sec - StreamingTime: 4s247ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s697ms, non-child: 1s546ms, % non-child: 3.31%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 569.10 K/sec AGGREGATION_NODE (id=17):(Total: 5s764ms, non-child: 2s830ms, % non-child: 49.09%) ExecOption: Codegen Enabled - BuildTime: 2s080ms - GetNewBlockTime: 220.807us - GetResultsTime: 731.479ms - HTResizeTime: 892.858ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 2.30 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.014us EXCHANGE_NODE (id=16):(Total: 2s934ms, non-child: 262.940ms, % non-child: 8.96%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.18 MB, 60.06 MB, 97.44 MB, 129.36 MB, 133.38 MB - BytesReceived: 133.38 MB (139857934) - ConvertRowBatchTime: 229.716ms - DeserializeRowBatchTimer: 188.386ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 4.53 M/sec - SendersBlockedTimer: 10s069ms - SendersBlockedTotalTimer(*): 10s069ms AGGREGATION_NODE (id=13):(Total: 39s385ms, non-child: 2s673ms, % non-child: 6.79%) ExecOption: Codegen Enabled - BuildTime: 1s963ms - GetNewBlockTime: 376.016us - GetResultsTime: 689.536ms - HTResizeTime: 719.945ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 337.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.058us EXCHANGE_NODE (id=12):(Total: 36s712ms, non-child: 270.709ms, % non-child: 0.74%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21.38 MB, 57.95 MB, 95.84 MB, 128.83 MB - BytesReceived: 133.38 MB (139857251) - ConvertRowBatchTime: 237.785ms - DeserializeRowBatchTimer: 194.126ms - FirstBatchArrivalWaitTime: 34s259ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 361.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146db (host=vb0212.halxg.cloudera.com:22000):(Total: 58s091ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 132.12 MB, 368.55 MB, 575.76 MB, 762.18 MB, 786.46 MB, 695.57 MB, 598.34 MB, 501.09 MB, 403.85 MB, 306.57 MB, 209.34 MB, 103.75 MB, 277.71 MB, 465.32 MB, 659.20 MB, 792.13 MB, 808.39 MB, 748.01 MB, 627.69 MB, 507.39 MB, 411.16 MB, 314.89 MB, 170.26 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.86 GB (4145828608) - PrepareTime: 188.718ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 18s905ms - TotalNetworkReceiveTime: 38s298ms - TotalNetworkSendTime: 1s331ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 593.359ms, non-child: 593.359ms, % non-child: 100.00%) - CodegenTime: 3.103ms - CompileTime: 49.366ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 359.095ms - PrepareTime: 177.401ms DataStreamSender (dst_id=18):(Total: 6s987ms, non-child: 6s987ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297774270) - NetworkThroughput(*): 51.57 MB/sec - OverallThroughput: 40.64 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s524ms - ThriftTransmitTime(*): 5s506ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 51s065ms, non-child: 4s603ms, % non-child: 9.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 146.513us - GetResultsTime: 143.720ms - HTResizeTime: 95.002ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 516.23 K/sec - StreamingTime: 4s211ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s461ms, non-child: 1s584ms, % non-child: 3.41%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 572.11 K/sec AGGREGATION_NODE (id=17):(Total: 5s405ms, non-child: 2s625ms, % non-child: 48.58%) ExecOption: Codegen Enabled - BuildTime: 1s929ms - GetNewBlockTime: 267.593us - GetResultsTime: 678.181ms - HTResizeTime: 726.306ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 2.46 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 971.000ns EXCHANGE_NODE (id=16):(Total: 2s779ms, non-child: 307.195ms, % non-child: 11.05%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 14.51 MB, 43.85 MB, 76.77 MB, 109.88 MB, 133.41 MB - BytesReceived: 133.41 MB (139894978) - ConvertRowBatchTime: 245.728ms - DeserializeRowBatchTimer: 377.109ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 4.78 M/sec - SendersBlockedTimer: 10s350ms - SendersBlockedTotalTimer(*): 10s350ms AGGREGATION_NODE (id=13):(Total: 39s472ms, non-child: 3s285ms, % non-child: 8.32%) ExecOption: Codegen Enabled - BuildTime: 2s558ms - GetNewBlockTime: 233.211us - GetResultsTime: 703.836ms - HTResizeTime: 878.120ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 336.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.135us EXCHANGE_NODE (id=12):(Total: 36s186ms, non-child: 446.952ms, % non-child: 1.24%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21.67 MB, 57.68 MB, 92.84 MB, 125.76 MB - BytesReceived: 133.41 MB (139890940) - ConvertRowBatchTime: 387.620ms - DeserializeRowBatchTimer: 248.206ms - FirstBatchArrivalWaitTime: 34s309ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 367.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d1 (host=vb0222.halxg.cloudera.com:22000):(Total: 57s726ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 95.97 MB, 300.22 MB, 483.86 MB, 672.48 MB, 778.48 MB, 695.57 MB, 598.34 MB, 501.09 MB, 403.84 MB, 306.59 MB, 136.38 MB, 165.29 MB, 374.54 MB, 560.97 MB, 741.99 MB, 792.14 MB, 808.38 MB, 699.89 MB, 603.65 MB, 507.41 MB, 363.00 MB, 266.76 MB, 141.98 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 191.183ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 18s896ms - TotalNetworkReceiveTime: 38s215ms - TotalNetworkSendTime: 1s086ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 620.917ms, non-child: 620.917ms, % non-child: 100.00%) - CodegenTime: 3.210ms - CompileTime: 62.982ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 370.825ms - PrepareTime: 185.481ms DataStreamSender (dst_id=18):(Total: 6s464ms, non-child: 6s464ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297847639) - NetworkThroughput(*): 56.63 MB/sec - OverallThroughput: 43.94 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s347ms - ThriftTransmitTime(*): 5s016ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 51s227ms, non-child: 4s380ms, % non-child: 8.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.407us - GetResultsTime: 119.177ms - HTResizeTime: 101.584ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 514.72 K/sec - StreamingTime: 4s008ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s847ms, non-child: 1s499ms, % non-child: 3.20%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 567.53 K/sec AGGREGATION_NODE (id=17):(Total: 5s903ms, non-child: 3s341ms, % non-child: 56.61%) ExecOption: Codegen Enabled - BuildTime: 2s648ms - GetNewBlockTime: 435.113us - GetResultsTime: 664.632ms - HTResizeTime: 973.410ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.022us EXCHANGE_NODE (id=16):(Total: 2s561ms, non-child: 441.460ms, % non-child: 17.24%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 27.28 MB, 60.78 MB, 92.75 MB, 124.56 MB, 133.46 MB - BytesReceived: 133.46 MB (139940805) - ConvertRowBatchTime: 365.493ms - DeserializeRowBatchTimer: 435.737ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 5.19 M/sec - SendersBlockedTimer: 9s847ms - SendersBlockedTotalTimer(*): 9s847ms AGGREGATION_NODE (id=13):(Total: 39s444ms, non-child: 3s069ms, % non-child: 7.78%) ExecOption: Codegen Enabled - BuildTime: 2s341ms - GetNewBlockTime: 225.367us - GetResultsTime: 703.936ms - HTResizeTime: 843.866ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 337.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.653us EXCHANGE_NODE (id=12):(Total: 36s375ms, non-child: 368.297ms, % non-child: 1.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.31 MB, 46.62 MB, 77.77 MB, 108.77 MB - BytesReceived: 133.45 MB (139929373) - ConvertRowBatchTime: 321.187ms - DeserializeRowBatchTimer: 223.559ms - FirstBatchArrivalWaitTime: 34s277ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 365.46 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d2 (host=vb0224.halxg.cloudera.com:22000):(Total: 57s470ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 87.08 MB, 337.29 MB, 534.39 MB, 735.95 MB, 810.77 MB, 744.20 MB, 646.95 MB, 501.09 MB, 428.13 MB, 306.58 MB, 160.71 MB, 134.20 MB, 307.65 MB, 477.52 MB, 647.52 MB, 780.14 MB, 793.94 MB, 748.03 MB, 627.72 MB, 507.38 MB, 387.09 MB, 266.76 MB, 141.97 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 209.132ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 19s219ms - TotalNetworkReceiveTime: 37s577ms - TotalNetworkSendTime: 1s211ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 692.719ms, non-child: 692.719ms, % non-child: 100.00%) - CodegenTime: 8.353ms - CompileTime: 60.038ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 436.139ms - PrepareTime: 182.054ms DataStreamSender (dst_id=18):(Total: 6s558ms, non-child: 6s558ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297803645) - NetworkThroughput(*): 55.91 MB/sec - OverallThroughput: 43.30 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s356ms - ThriftTransmitTime(*): 5s080ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 50s865ms, non-child: 4s288ms, % non-child: 8.43%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 695.933us - GetResultsTime: 118.920ms - HTResizeTime: 109.939ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 518.28 K/sec - StreamingTime: 3s902ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s576ms, non-child: 1s498ms, % non-child: 3.22%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 570.71 K/sec AGGREGATION_NODE (id=17):(Total: 5s723ms, non-child: 3s367ms, % non-child: 58.83%) ExecOption: Codegen Enabled - BuildTime: 2s660ms - GetNewBlockTime: 1.083ms - GetResultsTime: 670.187ms - HTResizeTime: 969.234ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 2.32 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.916us EXCHANGE_NODE (id=16):(Total: 2s356ms, non-child: 438.081ms, % non-child: 18.59%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.37 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 33.58 MB, 63.45 MB, 92.99 MB, 122.60 MB, 133.41 MB - BytesReceived: 133.41 MB (139893296) - ConvertRowBatchTime: 367.896ms - DeserializeRowBatchTimer: 328.094ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 5.64 M/sec - SendersBlockedTimer: 10s071ms - SendersBlockedTotalTimer(*): 10s071ms AGGREGATION_NODE (id=13):(Total: 39s354ms, non-child: 3s338ms, % non-child: 8.48%) ExecOption: Codegen Enabled - BuildTime: 2s602ms - GetNewBlockTime: 287.857us - GetResultsTime: 706.623ms - HTResizeTime: 885.918ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 337.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.224us EXCHANGE_NODE (id=12):(Total: 36s016ms, non-child: 491.917ms, % non-child: 1.37%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.23 MB, 33.06 MB, 69.37 MB, 105.14 MB, 132.80 MB - BytesReceived: 133.42 MB (139898379) - ConvertRowBatchTime: 391.488ms - DeserializeRowBatchTimer: 350.364ms - FirstBatchArrivalWaitTime: 34s185ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 369.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d9 (host=vb0204.halxg.cloudera.com:22000):(Total: 57s013ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 79.07 MB, 286.03 MB, 481.61 MB, 687.55 MB, 810.78 MB, 744.20 MB, 646.94 MB, 501.08 MB, 403.84 MB, 306.58 MB, 185.02 MB, 117.65 MB, 291.46 MB, 516.68 MB, 719.75 MB, 792.14 MB, 810.27 MB, 748.02 MB, 651.76 MB, 507.38 MB, 387.08 MB, 242.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.86 GB (4146528336) - PrepareTime: 226.089ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 18s296ms - TotalNetworkReceiveTime: 37s922ms - TotalNetworkSendTime: 1s313ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 683.058ms, non-child: 683.058ms, % non-child: 100.00%) - CodegenTime: 5.792ms - CompileTime: 39.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 436.948ms - PrepareTime: 193.546ms DataStreamSender (dst_id=18):(Total: 6s413ms, non-child: 6s413ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297805098) - NetworkThroughput(*): 54.23 MB/sec - OverallThroughput: 44.28 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s266ms - ThriftTransmitTime(*): 5s237ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 50s547ms, non-child: 4s246ms, % non-child: 8.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 309.953us - GetResultsTime: 115.231ms - HTResizeTime: 129.884ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 521.55 K/sec - StreamingTime: 3s864ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s300ms, non-child: 1s388ms, % non-child: 3.00%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 574.13 K/sec AGGREGATION_NODE (id=17):(Total: 5s607ms, non-child: 3s061ms, % non-child: 54.59%) ExecOption: Codegen Enabled - BuildTime: 2s420ms - GetNewBlockTime: 11.796ms - GetResultsTime: 606.830ms - HTResizeTime: 910.414ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 2.37 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.222us EXCHANGE_NODE (id=16):(Total: 2s546ms, non-child: 403.374ms, % non-child: 15.84%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.25 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 30.37 MB, 66.41 MB, 102.34 MB, 131.27 MB, 133.43 MB - BytesReceived: 133.43 MB (139908479) - ConvertRowBatchTime: 347.566ms - DeserializeRowBatchTimer: 228.735ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 10s139ms - SendersBlockedTotalTimer(*): 10s139ms AGGREGATION_NODE (id=13):(Total: 39s304ms, non-child: 3s187ms, % non-child: 8.11%) ExecOption: Codegen Enabled - BuildTime: 2s496ms - GetNewBlockTime: 265.411us - GetResultsTime: 666.378ms - HTResizeTime: 853.329ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 338.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.162us EXCHANGE_NODE (id=12):(Total: 36s117ms, non-child: 428.108ms, % non-child: 1.19%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.70 MB, 28.92 MB, 61.96 MB, 95.53 MB, 127.79 MB - BytesReceived: 133.43 MB (139908579) - ConvertRowBatchTime: 361.704ms - DeserializeRowBatchTimer: 310.193ms - FirstBatchArrivalWaitTime: 34s179ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 368.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d3 (host=vb0228.halxg.cloudera.com:22000):(Total: 57s012ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 127.79 MB, 365.49 MB, 583.14 MB, 768.21 MB, 810.80 MB, 744.24 MB, 646.96 MB, 549.74 MB, 452.49 MB, 355.23 MB, 257.96 MB, 160.74 MB, 116.93 MB, 283.54 MB, 469.33 MB, 662.14 MB, 814.67 MB, 723.95 MB, 579.59 MB, 435.20 MB, 314.89 MB, 170.26 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.90 GB (4182707160) - PrepareTime: 187.579ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 18s738ms - TotalNetworkReceiveTime: 37s599ms - TotalNetworkSendTime: 1s148ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 615.382ms, non-child: 615.382ms, % non-child: 100.00%) - CodegenTime: 3.189ms - CompileTime: 66.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 365.036ms - PrepareTime: 182.048ms DataStreamSender (dst_id=18):(Total: 6s309ms, non-child: 6s309ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297606963) - NetworkThroughput(*): 60.08 MB/sec - OverallThroughput: 44.98 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s252ms - ThriftTransmitTime(*): 4s724ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 50s666ms, non-child: 5s242ms, % non-child: 10.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 169.329us - GetResultsTime: 148.209ms - HTResizeTime: 117.922ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 519.98 K/sec - StreamingTime: 4s832ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s424ms, non-child: 1s419ms, % non-child: 3.13%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 584.82 K/sec AGGREGATION_NODE (id=17):(Total: 4s517ms, non-child: 2s805ms, % non-child: 62.11%) ExecOption: Codegen Enabled - BuildTime: 2s234ms - GetNewBlockTime: 259.338us - GetResultsTime: 549.995ms - HTResizeTime: 939.195ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 2.94 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 930.000ns EXCHANGE_NODE (id=16):(Total: 1s711ms, non-child: 315.428ms, % non-child: 18.43%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 16.67 MB, 46.73 MB, 78.02 MB, 109.45 MB - BytesReceived: 133.34 MB (139812943) - ConvertRowBatchTime: 274.684ms - DeserializeRowBatchTimer: 239.761ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 7.76 M/sec - SendersBlockedTimer: 11s153ms - SendersBlockedTotalTimer(*): 11s153ms AGGREGATION_NODE (id=13):(Total: 39s487ms, non-child: 3s008ms, % non-child: 7.62%) ExecOption: Codegen Enabled - BuildTime: 2s241ms - GetNewBlockTime: 290.885us - GetResultsTime: 741.177ms - HTResizeTime: 844.260ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 336.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.287us EXCHANGE_NODE (id=12):(Total: 36s478ms, non-child: 344.510ms, % non-child: 0.94%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20.04 MB, 57.78 MB, 95.50 MB, 127.67 MB - BytesReceived: 133.34 MB (139816503) - ConvertRowBatchTime: 289.471ms - DeserializeRowBatchTimer: 256.992ms - FirstBatchArrivalWaitTime: 34s282ms - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 364.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d6 (host=vb0216.halxg.cloudera.com:22000):(Total: 56s215ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 11.23 MB, 169.45 MB, 396.67 MB, 617.72 MB, 788.41 MB, 792.82 MB, 646.96 MB, 549.72 MB, 428.12 MB, 306.57 MB, 185.02 MB, 94.18 MB, 223.97 MB, 388.39 MB, 574.67 MB, 740.91 MB, 792.13 MB, 786.24 MB, 675.84 MB, 531.47 MB, 387.07 MB, 266.75 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4109472000) - PrepareTime: 206.182ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 16s534ms - TotalNetworkReceiveTime: 39s094ms - TotalNetworkSendTime: 1s124ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 697.889ms, non-child: 697.889ms, % non-child: 100.00%) - CodegenTime: 5.764ms - CompileTime: 51.086ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 451.114ms - PrepareTime: 183.070ms DataStreamSender (dst_id=18):(Total: 5s737ms, non-child: 5s737ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297681835) - NetworkThroughput(*): 65.71 MB/sec - OverallThroughput: 49.48 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s112ms - ThriftTransmitTime(*): 4s320ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 50s435ms, non-child: 3s809ms, % non-child: 7.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 176.168us - GetResultsTime: 95.705ms - HTResizeTime: 102.999ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 522.51 K/sec - StreamingTime: 3s461ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s625ms, non-child: 1s301ms, % non-child: 2.79%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 569.92 K/sec AGGREGATION_NODE (id=17):(Total: 6s070ms, non-child: 2s693ms, % non-child: 44.38%) ExecOption: Codegen Enabled - BuildTime: 2s141ms - GetNewBlockTime: 1.186ms - GetResultsTime: 530.606ms - HTResizeTime: 847.110ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.243us EXCHANGE_NODE (id=16):(Total: 3s376ms, non-child: 326.070ms, % non-child: 9.66%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.51 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.86 MB, 35.51 MB, 65.17 MB, 95.06 MB, 124.80 MB, 133.39 MB - BytesReceived: 133.39 MB (139869423) - ConvertRowBatchTime: 270.192ms - DeserializeRowBatchTimer: 407.719ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 3.94 M/sec - SendersBlockedTimer: 9s565ms - SendersBlockedTotalTimer(*): 9s565ms AGGREGATION_NODE (id=13):(Total: 39s254ms, non-child: 2s914ms, % non-child: 7.43%) ExecOption: Codegen Enabled - BuildTime: 2s283ms - GetNewBlockTime: 250.712us - GetResultsTime: 607.969ms - HTResizeTime: 819.180ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 338.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.072us EXCHANGE_NODE (id=12):(Total: 36s339ms, non-child: 376.549ms, % non-child: 1.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 369.15 KB, 27.75 MB, 64.77 MB, 101.23 MB, 131.12 MB - BytesReceived: 133.39 MB (139867259) - ConvertRowBatchTime: 323.731ms - DeserializeRowBatchTimer: 217.500ms - FirstBatchArrivalWaitTime: 34s185ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 365.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d0 (host=vb0218.halxg.cloudera.com:22000):(Total: 55s958ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 103.43 MB, 291.73 MB, 458.19 MB, 631.02 MB, 794.78 MB, 744.21 MB, 622.64 MB, 476.77 MB, 355.21 MB, 233.65 MB, 112.08 MB, 211.25 MB, 376.38 MB, 547.03 MB, 715.67 MB, 792.14 MB, 806.17 MB, 699.90 MB, 531.46 MB, 411.13 MB, 266.76 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4111110400) - PrepareTime: 185.398ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 17s520ms - TotalNetworkReceiveTime: 38s032ms - TotalNetworkSendTime: 892.814ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 631.173ms, non-child: 631.173ms, % non-child: 100.00%) - CodegenTime: 3.244ms - CompileTime: 61.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 388.745ms - PrepareTime: 179.830ms DataStreamSender (dst_id=18):(Total: 5s434ms, non-child: 5s434ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297701377) - NetworkThroughput(*): 72.29 MB/sec - OverallThroughput: 52.24 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s016ms - ThriftTransmitTime(*): 3s927ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 50s491ms, non-child: 3s735ms, % non-child: 7.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 143.677us - GetResultsTime: 75.805ms - HTResizeTime: 108.927ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 521.96 K/sec - StreamingTime: 3s421ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s755ms, non-child: 1s324ms, % non-child: 2.83%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 568.37 K/sec AGGREGATION_NODE (id=17):(Total: 6s023ms, non-child: 3s075ms, % non-child: 51.06%) ExecOption: Codegen Enabled - BuildTime: 2s533ms - GetNewBlockTime: 284.390us - GetResultsTime: 514.369ms - HTResizeTime: 907.159ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 2.21 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 995.000ns EXCHANGE_NODE (id=16):(Total: 2s947ms, non-child: 447.252ms, % non-child: 15.17%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 32.54 MB, 62.06 MB, 91.53 MB, 120.42 MB, 133.37 MB - BytesReceived: 133.37 MB (139850009) - ConvertRowBatchTime: 384.910ms - DeserializeRowBatchTimer: 347.816ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 4.51 M/sec - SendersBlockedTimer: 9s536ms - SendersBlockedTotalTimer(*): 9s536ms AGGREGATION_NODE (id=13):(Total: 39s407ms, non-child: 3s485ms, % non-child: 8.84%) ExecOption: Codegen Enabled - BuildTime: 2s790ms - GetNewBlockTime: 249.745us - GetResultsTime: 663.552ms - HTResizeTime: 965.060ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 337.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.336us EXCHANGE_NODE (id=12):(Total: 35s922ms, non-child: 485.216ms, % non-child: 1.35%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 15.85 MB, 45.34 MB, 74.73 MB, 104.60 MB - BytesReceived: 133.38 MB (139859486) - ConvertRowBatchTime: 416.343ms - DeserializeRowBatchTimer: 365.648ms - FirstBatchArrivalWaitTime: 34s263ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 369.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d5 (host=vb0206.halxg.cloudera.com:22000):(Total: 55s935ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 127.73 MB, 365.38 MB, 586.57 MB, 788.94 MB, 786.48 MB, 744.23 MB, 598.36 MB, 501.10 MB, 403.84 MB, 257.97 MB, 112.09 MB, 194.51 MB, 388.40 MB, 582.25 MB, 759.91 MB, 792.14 MB, 806.18 MB, 699.90 MB, 555.53 MB, 387.09 MB, 218.63 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 193.578ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 16s397ms - TotalNetworkReceiveTime: 39s157ms - TotalNetworkSendTime: 924.650ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 699.397ms, non-child: 699.397ms, % non-child: 100.00%) - CodegenTime: 3.925ms - CompileTime: 60.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 450.284ms - PrepareTime: 187.116ms DataStreamSender (dst_id=18):(Total: 5s648ms, non-child: 5s648ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297763117) - NetworkThroughput(*): 69.44 MB/sec - OverallThroughput: 50.28 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s015ms - ThriftTransmitTime(*): 4s089ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 50s256ms, non-child: 3s756ms, % non-child: 7.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 143.757us - GetResultsTime: 137.456ms - HTResizeTime: 100.372ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 524.49 K/sec - StreamingTime: 3s373ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s500ms, non-child: 1s265ms, % non-child: 2.72%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 571.58 K/sec AGGREGATION_NODE (id=17):(Total: 5s942ms, non-child: 2s501ms, % non-child: 42.10%) ExecOption: Codegen Enabled - BuildTime: 2s008ms - GetNewBlockTime: 326.564us - GetResultsTime: 477.819ms - HTResizeTime: 790.289ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 2.24 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 985.000ns EXCHANGE_NODE (id=16):(Total: 3s440ms, non-child: 287.651ms, % non-child: 8.36%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 31.24 MB, 64.41 MB, 97.50 MB, 127.89 MB, 133.39 MB - BytesReceived: 133.39 MB (139871505) - ConvertRowBatchTime: 234.898ms - DeserializeRowBatchTimer: 377.243ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 3.86 M/sec - SendersBlockedTimer: 9s609ms - SendersBlockedTotalTimer(*): 9s609ms AGGREGATION_NODE (id=13):(Total: 39s291ms, non-child: 2s960ms, % non-child: 7.53%) ExecOption: Codegen Enabled - BuildTime: 2s307ms - GetNewBlockTime: 283.047us - GetResultsTime: 631.130ms - HTResizeTime: 795.586ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 338.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.178us EXCHANGE_NODE (id=12):(Total: 36s331ms, non-child: 415.026ms, % non-child: 1.14%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 19.84 MB, 58.20 MB, 96.29 MB, 129.32 MB - BytesReceived: 133.39 MB (139871704) - ConvertRowBatchTime: 351.945ms - DeserializeRowBatchTimer: 236.312ms - FirstBatchArrivalWaitTime: 34s197ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 365.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ad4f3ef268d8fe31:65d07fc04e2146d4 (host=vb0220.halxg.cloudera.com:22000):(Total: 55s682ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 75.07 MB, 281.20 MB, 481.63 MB, 679.48 MB, 810.78 MB, 719.90 MB, 598.32 MB, 501.08 MB, 355.20 MB, 257.95 MB, 112.07 MB, 194.54 MB, 388.40 MB, 582.28 MB, 759.93 MB, 792.16 MB, 826.27 MB, 723.95 MB, 555.53 MB, 387.09 MB, 218.64 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4107731200) - PrepareTime: 190.290ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 15s337ms - TotalNetworkReceiveTime: 39s996ms - TotalNetworkSendTime: 831.155ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 637.118ms, non-child: 637.118ms, % non-child: 100.00%) - CodegenTime: 3.188ms - CompileTime: 63.260ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 387.634ms - PrepareTime: 184.931ms DataStreamSender (dst_id=18):(Total: 5s270ms, non-child: 5s270ms, % non-child: 100.00%) - BytesSent: 284.11 MB (297915950) - NetworkThroughput(*): 73.19 MB/sec - OverallThroughput: 53.90 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s957ms - ThriftTransmitTime(*): 3s881ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 50s380ms, non-child: 3s670ms, % non-child: 7.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 135.367us - GetResultsTime: 111.303ms - HTResizeTime: 96.960ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278191) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 523.48 K/sec - StreamingTime: 3s317ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s710ms, non-child: 1s289ms, % non-child: 2.76%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 569.31 K/sec AGGREGATION_NODE (id=17):(Total: 6s072ms, non-child: 2s489ms, % non-child: 41.00%) ExecOption: Codegen Enabled - BuildTime: 1s999ms - GetNewBlockTime: 280.730us - GetResultsTime: 474.027ms - HTResizeTime: 759.030ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us EXCHANGE_NODE (id=16):(Total: 3s582ms, non-child: 320.301ms, % non-child: 8.94%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.94 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 16.97 MB, 49.37 MB, 82.62 MB, 115.52 MB, 133.47 MB, 133.47 MB - BytesReceived: 133.47 MB (139954847) - ConvertRowBatchTime: 257.898ms - DeserializeRowBatchTimer: 398.261ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 9s456ms - SendersBlockedTotalTimer(*): 9s456ms AGGREGATION_NODE (id=13):(Total: 39s348ms, non-child: 2s418ms, % non-child: 6.15%) ExecOption: Codegen Enabled - BuildTime: 1s776ms - GetNewBlockTime: 261.122us - GetResultsTime: 625.565ms - HTResizeTime: 611.379ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 337.92 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.114us EXCHANGE_NODE (id=12):(Total: 36s929ms, non-child: 275.330ms, % non-child: 0.75%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.23 MB, 27.88 MB, 60.35 MB, 95.03 MB, 127.60 MB - BytesReceived: 133.46 MB (139943736) - ConvertRowBatchTime: 227.459ms - DeserializeRowBatchTimer: 390.507ms - FirstBatchArrivalWaitTime: 34s261ms - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 360.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance ad4f3ef268d8fe31:65d07fc04e2146e2 (host=vb0212.halxg.cloudera.com:22000):(Total: 50s740ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 78.05 MB, 224.38 MB, 292.40 MB, 420.35 MB, 548.33 MB, 676.32 MB, 804.30 MB, 996.30 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.32 GB, 1.34 GB, 1.35 GB, 1.38 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.40 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.03 MB, 534.32 MB, 340.07 MB, 145.84 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068410368) - PerHostPeakMemUsage: 3.86 GB (4145828608) - PrepareTime: 197.237ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 36s979ms - TotalNetworkReceiveTime: 10s880ms - TotalNetworkSendTime: 11s230ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 673.342ms, non-child: 673.342ms, % non-child: 100.00%) - CodegenTime: 893.275us - CompileTime: 55.264ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 427.097ms - PrepareTime: 178.803ms DataStreamSender (dst_id=16):(Total: 14s917ms, non-child: 14s917ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139812943) - NetworkThroughput(*): 9.99 MB/sec - OverallThroughput: 8.94 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 772.987ms - ThriftTransmitTime(*): 13s350ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=8):(Total: 35s786ms, non-child: 8s951ms, % non-child: 25.01%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.487ms - GetResultsTime: 451.564ms - HTResizeTime: 1s047ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 371.17 K/sec - StreamingTime: 8s197ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s834ms, non-child: 13s943ms, % non-child: 51.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s638ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s979ms - GetNewBlockTime: 1.404ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s532ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.170us EXCHANGE_NODE (id=15):(Total: 3s584ms, non-child: 871.855ms, % non-child: 24.32%) BytesReceived(1s000ms): 3.42 MB, 57.16 MB, 125.91 MB, 186.38 MB, 252.74 MB, 292.22 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB, 297.52 MB - BytesReceived: 297.52 MB (311974739) - ConvertRowBatchTime: 407.126ms - DeserializeRowBatchTimer: 1s328ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 3.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s305ms, non-child: 3s700ms, % non-child: 39.77%) BytesReceived(1s000ms): 3.06 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 13.68 MB, 51.70 MB, 84.63 MB, 129.84 MB, 172.88 MB, 216.66 MB, 249.09 MB, 286.52 MB, 326.44 MB, 372.50 MB, 417.30 MB, 459.71 MB, 498.82 MB, 525.32 MB, 561.04 MB, 593.83 MB, 627.14 MB, 661.93 MB, 707.28 MB, 752.78 MB, 799.15 MB, 844.10 MB, 891.84 MB, 927.71 MB, 972.87 MB, 1007.28 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108833050) - ConvertRowBatchTime: 1s391ms - DeserializeRowBatchTimer: 6s186ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 5.54 M/sec - SendersBlockedTimer: 12s232ms - SendersBlockedTotalTimer(*): 2m34s Instance ad4f3ef268d8fe31:65d07fc04e2146e7 (host=vb0216.halxg.cloudera.com:22000):(Total: 50s129ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.85 MB, 228.34 MB, 356.35 MB, 428.39 MB, 548.34 MB, 676.34 MB, 836.30 MB, 1.04 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.86 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 534.34 MB, 364.36 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068487168) - PerHostPeakMemUsage: 3.83 GB (4109472000) - PrepareTime: 199.468ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 35s588ms - TotalNetworkReceiveTime: 11s831ms - TotalNetworkSendTime: 10s819ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 666.911ms, non-child: 666.911ms, % non-child: 100.00%) - CodegenTime: 933.066us - CompileTime: 66.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 406.008ms - PrepareTime: 180.979ms DataStreamSender (dst_id=16):(Total: 14s267ms, non-child: 14s267ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139877570) - NetworkThroughput(*): 10.02 MB/sec - OverallThroughput: 9.35 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 914.572ms - ThriftTransmitTime(*): 13s306ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=8):(Total: 35s830ms, non-child: 8s942ms, % non-child: 24.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 883.217us - GetResultsTime: 470.691ms - HTResizeTime: 1s054ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 370.88 K/sec - StreamingTime: 8s158ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s888ms, non-child: 13s284ms, % non-child: 49.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s287ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s760ms - GetNewBlockTime: 1.285ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s491ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.788us EXCHANGE_NODE (id=15):(Total: 3s961ms, non-child: 557.084ms, % non-child: 14.06%) BytesReceived(1s000ms): 7.83 MB, 66.99 MB, 135.91 MB, 196.13 MB, 260.80 MB, 294.46 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB - BytesReceived: 297.62 MB (312076162) - ConvertRowBatchTime: 269.580ms - DeserializeRowBatchTimer: 1s012ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s641ms, non-child: 3s062ms, % non-child: 31.77%) BytesReceived(1s000ms): 5.05 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 18.45 MB, 56.67 MB, 91.74 MB, 134.69 MB, 180.69 MB, 221.79 MB, 254.36 MB, 291.73 MB, 332.06 MB, 378.52 MB, 422.11 MB, 467.03 MB, 501.10 MB, 530.48 MB, 565.51 MB, 598.27 MB, 631.60 MB, 667.57 MB, 713.38 MB, 759.00 MB, 804.87 MB, 851.11 MB, 896.48 MB, 932.90 MB, 979.36 MB, 1008.94 MB, 1.01 GB - BytesReceived: 1.03 GB (1108860436) - ConvertRowBatchTime: 1s322ms - DeserializeRowBatchTimer: 5s958ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 5.35 M/sec - SendersBlockedTimer: 7s468ms - SendersBlockedTotalTimer(*): 1m14s Instance ad4f3ef268d8fe31:65d07fc04e2146ea (host=vb0228.halxg.cloudera.com:22000):(Total: 49s745ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 11.91 MB, 164.45 MB, 292.53 MB, 420.40 MB, 548.55 MB, 676.34 MB, 788.30 MB, 996.30 MB, 1.15 GB, 1.23 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.31 MB, 534.31 MB, 388.64 MB, 194.38 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069024768) - PerHostPeakMemUsage: 3.90 GB (4182707160) - PrepareTime: 195.831ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 36s790ms - TotalNetworkReceiveTime: 10s620ms - TotalNetworkSendTime: 10s399ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 688.845ms, non-child: 688.845ms, % non-child: 100.00%) - CodegenTime: 922.210us - CompileTime: 60.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 436.038ms - PrepareTime: 181.308ms DataStreamSender (dst_id=16):(Total: 13s890ms, non-child: 13s890ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139894978) - NetworkThroughput(*): 10.54 MB/sec - OverallThroughput: 9.60 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 747.017ms - ThriftTransmitTime(*): 12s658ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=8):(Total: 35s836ms, non-child: 8s573ms, % non-child: 23.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 449.953us - GetResultsTime: 487.242ms - HTResizeTime: 1s014ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 370.86 K/sec - StreamingTime: 7s793ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s263ms, non-child: 14s817ms, % non-child: 54.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s929ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s793ms - GetNewBlockTime: 1.537ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s440ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 1.89 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.109us EXCHANGE_NODE (id=15):(Total: 3s298ms, non-child: 1s298ms, % non-child: 39.37%) BytesReceived(1s000ms): 1.95 MB, 53.08 MB, 121.94 MB, 182.86 MB, 249.25 MB, 291.26 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB, 297.67 MB - BytesReceived: 297.67 MB (312133662) - ConvertRowBatchTime: 416.814ms - DeserializeRowBatchTimer: 1s804ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 4.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s148ms, non-child: 2s509ms, % non-child: 27.43%) BytesReceived(1s000ms): 1.55 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 11.80 MB, 49.79 MB, 83.66 MB, 126.23 MB, 171.44 MB, 214.65 MB, 247.29 MB, 284.36 MB, 323.84 MB, 370.46 MB, 415.31 MB, 456.63 MB, 497.54 MB, 523.25 MB, 559.23 MB, 592.11 MB, 625.19 MB, 659.86 MB, 704.28 MB, 750.10 MB, 796.59 MB, 841.01 MB, 889.17 MB, 925.50 MB, 969.88 MB, 1006.35 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109258793) - ConvertRowBatchTime: 1s218ms - DeserializeRowBatchTimer: 5s144ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 5.64 M/sec - SendersBlockedTimer: 7s409ms - SendersBlockedTotalTimer(*): 1m51s Instance ad4f3ef268d8fe31:65d07fc04e2146e1 (host=vb0214.halxg.cloudera.com:22000):(Total: 49s735ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.99 MB, 164.63 MB, 292.42 MB, 420.35 MB, 548.35 MB, 648.33 MB, 772.30 MB, 980.30 MB, 1.14 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.03 MB, 510.05 MB, 340.08 MB, 170.11 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068359168) - PerHostPeakMemUsage: 3.86 GB (4142989040) - PrepareTime: 193.847ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 35s495ms - TotalNetworkReceiveTime: 12s228ms - TotalNetworkSendTime: 10s141ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 648.723ms, non-child: 648.723ms, % non-child: 100.00%) - CodegenTime: 834.454us - CompileTime: 70.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 387.638ms - PrepareTime: 181.311ms DataStreamSender (dst_id=16):(Total: 13s874ms, non-child: 13s874ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139893296) - NetworkThroughput(*): 10.82 MB/sec - OverallThroughput: 9.62 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 737.646ms - ThriftTransmitTime(*): 12s329ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=8):(Total: 35s845ms, non-child: 8s814ms, % non-child: 24.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 543.092us - GetResultsTime: 461.032ms - HTResizeTime: 1s034ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 370.78 K/sec - StreamingTime: 8s055ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s030ms, non-child: 12s982ms, % non-child: 48.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s563ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s810ms - GetNewBlockTime: 1.431ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s906ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.197us EXCHANGE_NODE (id=15):(Total: 3s715ms, non-child: 1s331ms, % non-child: 35.84%) BytesReceived(1s000ms): 14.27 MB, 79.25 MB, 148.05 MB, 208.25 MB, 270.27 MB, 295.88 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB - BytesReceived: 297.64 MB (312102204) - ConvertRowBatchTime: 337.415ms - DeserializeRowBatchTimer: 1s910ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 3.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s332ms, non-child: 2s497ms, % non-child: 24.17%) BytesReceived(1s000ms): 5.27 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 23.74 MB, 62.98 MB, 102.60 MB, 142.53 MB, 188.19 MB, 226.40 MB, 262.61 MB, 298.60 MB, 340.66 MB, 389.56 MB, 430.05 MB, 472.82 MB, 505.48 MB, 537.39 MB, 571.63 MB, 604.29 MB, 637.90 MB, 675.50 MB, 722.42 MB, 767.98 MB, 813.47 MB, 860.70 MB, 903.63 MB, 940.80 MB, 988.19 MB, 1012.28 MB, 1.02 GB - BytesReceived: 1.03 GB (1109554669) - ConvertRowBatchTime: 1s291ms - DeserializeRowBatchTimer: 4s884ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.00 M/sec - SendersBlockedTimer: 7s472ms - SendersBlockedTotalTimer(*): 1m52s Instance ad4f3ef268d8fe31:65d07fc04e2146e9 (host=vb0220.halxg.cloudera.com:22000):(Total: 49s593ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 720.50 KB, 164.34 MB, 292.35 MB, 420.33 MB, 548.36 MB, 612.33 MB, 772.30 MB, 980.30 MB, 1.14 GB, 1.18 GB, 1.32 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.40 GB, 1.39 GB, 1.43 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.89 GB, 752.86 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 582.89 MB, 388.64 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.92 GB (2066746368) - PerHostPeakMemUsage: 3.83 GB (4107731200) - PrepareTime: 198.146ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 35s076ms - TotalNetworkReceiveTime: 11s992ms - TotalNetworkSendTime: 10s631ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 715.798ms, non-child: 715.798ms, % non-child: 100.00%) - CodegenTime: 799.822us - CompileTime: 60.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 460.343ms - PrepareTime: 184.331ms DataStreamSender (dst_id=16):(Total: 13s800ms, non-child: 13s800ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139864089) - NetworkThroughput(*): 10.49 MB/sec - OverallThroughput: 9.67 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 794.869ms - ThriftTransmitTime(*): 12s718ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=8):(Total: 35s764ms, non-child: 8s896ms, % non-child: 24.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 698.901us - GetResultsTime: 456.939ms - HTResizeTime: 1s020ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 371.55 K/sec - StreamingTime: 8s131ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s867ms, non-child: 13s108ms, % non-child: 48.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s124ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s783ms - GetNewBlockTime: 1.874ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s478ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.395us EXCHANGE_NODE (id=15):(Total: 4s078ms, non-child: 569.410ms, % non-child: 13.96%) BytesReceived(1s000ms): 12.06 MB, 75.62 MB, 144.38 MB, 204.63 MB, 267.49 MB, 295.54 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB, 297.64 MB - BytesReceived: 297.64 MB (312100901) - ConvertRowBatchTime: 265.721ms - DeserializeRowBatchTimer: 1s064ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 3.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s681ms, non-child: 3s166ms, % non-child: 32.70%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 22.12 MB, 60.37 MB, 99.32 MB, 138.84 MB, 186.08 MB, 224.85 MB, 260.07 MB, 296.29 MB, 337.80 MB, 385.97 MB, 427.33 MB, 470.55 MB, 503.61 MB, 534.96 MB, 569.70 MB, 602.30 MB, 635.70 MB, 672.74 MB, 719.35 MB, 764.98 MB, 810.61 MB, 857.56 MB, 901.02 MB, 937.74 MB, 985.15 MB, 1010.49 MB, 1.02 GB - BytesReceived: 1.03 GB (1109106842) - ConvertRowBatchTime: 1s317ms - DeserializeRowBatchTimer: 5s916ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 8s562ms - SendersBlockedTotalTimer(*): 1m43s Instance ad4f3ef268d8fe31:65d07fc04e2146eb (host=vb0224.halxg.cloudera.com:22000):(Total: 49s584ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.45 MB, 164.35 MB, 292.37 MB, 420.34 MB, 548.37 MB, 612.34 MB, 756.30 MB, 948.30 MB, 1.12 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.78 GB, 1.89 GB, 1.89 GB, 752.86 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 582.90 MB, 388.64 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.92 GB (2066285568) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 208.398ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 34s730ms - TotalNetworkReceiveTime: 12s456ms - TotalNetworkSendTime: 10s605ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 765.136ms, non-child: 765.136ms, % non-child: 100.00%) - CodegenTime: 2.509ms - CompileTime: 57.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 511.800ms - PrepareTime: 180.105ms DataStreamSender (dst_id=16):(Total: 13s842ms, non-child: 13s842ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139839049) - NetworkThroughput(*): 10.57 MB/sec - OverallThroughput: 9.63 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 760.320ms - ThriftTransmitTime(*): 12s617ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=8):(Total: 35s716ms, non-child: 8s819ms, % non-child: 24.69%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 821.343us - GetResultsTime: 454.061ms - HTResizeTime: 1s080ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 371.95 K/sec - StreamingTime: 8s063ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s896ms, non-child: 12s779ms, % non-child: 47.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s210ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s865ms - GetNewBlockTime: 1.065ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s959ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.267us EXCHANGE_NODE (id=15):(Total: 3s934ms, non-child: 541.459ms, % non-child: 13.76%) BytesReceived(1s000ms): 13.47 MB, 77.93 MB, 146.78 MB, 206.98 MB, 269.23 MB, 295.69 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB, 297.54 MB - BytesReceived: 297.54 MB (311992332) - ConvertRowBatchTime: 265.569ms - DeserializeRowBatchTimer: 1s018ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s182ms, non-child: 2s825ms, % non-child: 27.75%) BytesReceived(1s000ms): 5.16 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 23.25 MB, 61.87 MB, 101.55 MB, 140.90 MB, 187.05 MB, 225.23 MB, 261.57 MB, 297.36 MB, 339.26 MB, 387.90 MB, 428.72 MB, 471.45 MB, 504.54 MB, 536.34 MB, 570.67 MB, 603.31 MB, 636.80 MB, 674.24 MB, 720.99 MB, 766.46 MB, 812.00 MB, 859.08 MB, 902.30 MB, 939.30 MB, 986.79 MB, 1011.28 MB, 1.02 GB - BytesReceived: 1.03 GB (1109098578) - ConvertRowBatchTime: 1s227ms - DeserializeRowBatchTimer: 5s656ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 7s574ms - SendersBlockedTotalTimer(*): 1m16s Instance ad4f3ef268d8fe31:65d07fc04e2146e5 (host=vb0226.halxg.cloudera.com:22000):(Total: 49s488ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 80.89 MB, 228.33 MB, 356.32 MB, 420.35 MB, 548.32 MB, 676.30 MB, 820.28 MB, 1012.28 MB, 1.14 GB, 1.26 GB, 1.30 GB, 1.33 GB, 1.34 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 607.16 MB, 437.20 MB, 267.24 MB, 97.28 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069280768) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 202.350ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 36s451ms - TotalNetworkReceiveTime: 11s578ms - TotalNetworkSendTime: 9s803ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 673.952ms, non-child: 673.952ms, % non-child: 100.00%) - CodegenTime: 2.532ms - CompileTime: 55.140ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 422.852ms - PrepareTime: 182.466ms DataStreamSender (dst_id=16):(Total: 13s634ms, non-child: 13s634ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139869423) - NetworkThroughput(*): 10.60 MB/sec - OverallThroughput: 9.78 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 822.783ms - ThriftTransmitTime(*): 12s584ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=8):(Total: 35s836ms, non-child: 9s084ms, % non-child: 25.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.071ms - GetResultsTime: 472.922ms - HTResizeTime: 1s070ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 370.75 K/sec - StreamingTime: 8s305ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s752ms, non-child: 13s382ms, % non-child: 50.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s274ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s997ms - GetNewBlockTime: 1.510ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s371ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.280us EXCHANGE_NODE (id=15):(Total: 3s978ms, non-child: 651.544ms, % non-child: 16.38%) BytesReceived(1s000ms): 4.61 MB, 59.85 MB, 128.89 MB, 189.28 MB, 255.09 MB, 292.90 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB, 297.58 MB - BytesReceived: 297.58 MB (312038503) - ConvertRowBatchTime: 301.727ms - DeserializeRowBatchTimer: 1s138ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 3.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s391ms, non-child: 3s247ms, % non-child: 34.58%) BytesReceived(1s000ms): 4.21 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 15.13 MB, 53.09 MB, 85.96 MB, 132.31 MB, 175.41 MB, 218.04 MB, 250.46 MB, 287.88 MB, 327.88 MB, 373.97 MB, 418.83 MB, 462.17 MB, 499.63 MB, 526.96 MB, 562.60 MB, 595.44 MB, 628.72 MB, 663.41 MB, 709.26 MB, 754.89 MB, 800.86 MB, 846.12 MB, 893.43 MB, 929.44 MB, 975.23 MB, 1008.24 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109129749) - ConvertRowBatchTime: 1s302ms - DeserializeRowBatchTimer: 6s442ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 5.50 M/sec - SendersBlockedTimer: 7s697ms - SendersBlockedTotalTimer(*): 1m32s Instance ad4f3ef268d8fe31:65d07fc04e2146df (host=vb0208.halxg.cloudera.com:22000):(Total: 49s373ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 77.43 MB, 164.41 MB, 292.36 MB, 420.34 MB, 548.33 MB, 676.33 MB, 820.30 MB, 1.02 GB, 1.15 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 607.16 MB, 437.20 MB, 242.95 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069383168) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 199.751ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 35s336ms - TotalNetworkReceiveTime: 12s461ms - TotalNetworkSendTime: 9s579ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 705.759ms, non-child: 705.759ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 70.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 439.981ms - PrepareTime: 187.651ms DataStreamSender (dst_id=16):(Total: 13s542ms, non-child: 13s542ms, % non-child: 100.00%) - BytesSent: 133.37 MB (139850009) - NetworkThroughput(*): 11.28 MB/sec - OverallThroughput: 9.85 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 734.543ms - ThriftTransmitTime(*): 11s823ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=8):(Total: 35s813ms, non-child: 9s006ms, % non-child: 25.15%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 548.636us - GetResultsTime: 482.797ms - HTResizeTime: 1s022ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 371.00 K/sec - StreamingTime: 8s216ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s807ms, non-child: 12s570ms, % non-child: 46.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s156ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s678ms - GetNewBlockTime: 1.124ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s016ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 1.92 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.269us EXCHANGE_NODE (id=15):(Total: 4s068ms, non-child: 564.793ms, % non-child: 13.88%) BytesReceived(1s000ms): 3.20 MB, 56.58 MB, 125.33 MB, 185.83 MB, 252.32 MB, 292.15 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB, 297.60 MB - BytesReceived: 297.60 MB (312059979) - ConvertRowBatchTime: 263.999ms - DeserializeRowBatchTimer: 1s052ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 3.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s168ms, non-child: 2s755ms, % non-child: 27.10%) BytesReceived(1s000ms): 2.82 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 13.41 MB, 51.37 MB, 84.18 MB, 129.14 MB, 172.36 MB, 216.07 MB, 248.50 MB, 285.77 MB, 325.65 MB, 371.70 MB, 416.41 MB, 458.76 MB, 498.13 MB, 524.42 MB, 560.20 MB, 593.07 MB, 626.42 MB, 661.15 MB, 706.41 MB, 752.05 MB, 798.34 MB, 843.22 MB, 890.90 MB, 926.97 MB, 972.20 MB, 1007.14 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108941921) - ConvertRowBatchTime: 1s329ms - DeserializeRowBatchTimer: 5s355ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 7s351ms - SendersBlockedTotalTimer(*): 1m28s Instance ad4f3ef268d8fe31:65d07fc04e2146e0 (host=vb0230.halxg.cloudera.com:22000):(Total: 49s343ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 9.17 MB, 164.43 MB, 292.31 MB, 420.32 MB, 548.33 MB, 676.31 MB, 788.28 MB, 980.28 MB, 1.14 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.34 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.42 GB, 1.40 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.81 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.19 MB, 267.25 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069485568) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 187.761ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 36s030ms - TotalNetworkReceiveTime: 11s356ms - TotalNetworkSendTime: 10s161ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 658.147ms, non-child: 658.147ms, % non-child: 100.00%) - CodegenTime: 956.300us - CompileTime: 76.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 397.197ms - PrepareTime: 182.813ms DataStreamSender (dst_id=16):(Total: 13s488ms, non-child: 13s488ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139940805) - NetworkThroughput(*): 10.77 MB/sec - OverallThroughput: 9.89 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 823.693ms - ThriftTransmitTime(*): 12s387ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=8):(Total: 35s839ms, non-child: 9s478ms, % non-child: 26.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 588.883us - GetResultsTime: 471.450ms - HTResizeTime: 1s092ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 370.92 K/sec - StreamingTime: 8s719ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s361ms, non-child: 13s129ms, % non-child: 49.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s721ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s844ms - GetNewBlockTime: 1.732ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s825ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 1.96 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.113us EXCHANGE_NODE (id=15):(Total: 3s542ms, non-child: 1s318ms, % non-child: 37.22%) BytesReceived(1s000ms): 1.51 MB, 51.79 MB, 120.66 MB, 182.28 MB, 248.09 MB, 290.96 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB, 297.73 MB - BytesReceived: 297.73 MB (312188920) - ConvertRowBatchTime: 375.054ms - DeserializeRowBatchTimer: 1s872ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s689ms, non-child: 3s141ms, % non-child: 32.43%) BytesReceived(1s000ms): 1.10 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 11.09 MB, 49.01 MB, 83.35 MB, 125.41 MB, 170.66 MB, 213.72 MB, 246.49 MB, 283.53 MB, 322.82 MB, 369.68 MB, 414.53 MB, 455.46 MB, 496.71 MB, 522.45 MB, 558.31 MB, 591.30 MB, 624.47 MB, 659.24 MB, 703.53 MB, 749.17 MB, 795.60 MB, 840.16 MB, 888.51 MB, 924.96 MB, 969.01 MB, 1006.25 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109558490) - ConvertRowBatchTime: 1s301ms - DeserializeRowBatchTimer: 5s833ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 8s776ms - SendersBlockedTotalTimer(*): 1m22s Instance ad4f3ef268d8fe31:65d07fc04e2146e6 (host=vb0232.halxg.cloudera.com:22000):(Total: 49s241ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.87 MB, 228.37 MB, 356.37 MB, 420.34 MB, 548.34 MB, 676.32 MB, 836.30 MB, 1.04 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.86 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.58 MB, 582.88 MB, 437.21 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071072768) - PerHostPeakMemUsage: 3.88 GB (4169855184) - PrepareTime: 198.939ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 35s861ms - TotalNetworkReceiveTime: 11s890ms - TotalNetworkSendTime: 9s636ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 736.004ms, non-child: 736.004ms, % non-child: 100.00%) - CodegenTime: 900.446us - CompileTime: 69.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 471.269ms - PrepareTime: 181.055ms DataStreamSender (dst_id=16):(Total: 13s395ms, non-child: 13s395ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139948135) - NetworkThroughput(*): 11.36 MB/sec - OverallThroughput: 9.96 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 747.596ms - ThriftTransmitTime(*): 11s752ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=8):(Total: 35s830ms, non-child: 8s803ms, % non-child: 24.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 632.571us - GetResultsTime: 448.626ms - HTResizeTime: 1s082ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 371.03 K/sec - StreamingTime: 7s971ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s026ms, non-child: 13s371ms, % non-child: 49.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s838ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s747ms - GetNewBlockTime: 1.554ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s995ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.417us EXCHANGE_NODE (id=15):(Total: 3s342ms, non-child: 790.723ms, % non-child: 23.66%) BytesReceived(1s000ms): 7.40 MB, 66.16 MB, 135.12 MB, 195.34 MB, 260.24 MB, 294.47 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB, 297.80 MB - BytesReceived: 297.80 MB (312267670) - ConvertRowBatchTime: 373.973ms - DeserializeRowBatchTimer: 1s318ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 4.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s312ms, non-child: 2s509ms, % non-child: 24.33%) BytesReceived(1s000ms): 5.07 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 18.06 MB, 56.36 MB, 91.13 MB, 135.01 MB, 180.53 MB, 221.54 MB, 254.17 MB, 291.49 MB, 331.81 MB, 378.13 MB, 422.03 MB, 467.03 MB, 501.30 MB, 530.23 MB, 565.54 MB, 598.32 MB, 631.57 MB, 667.42 MB, 713.20 MB, 759.00 MB, 804.93 MB, 851.10 MB, 896.85 MB, 933.22 MB, 979.59 MB, 1009.80 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109775956) - ConvertRowBatchTime: 1s215ms - DeserializeRowBatchTimer: 4s959ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 5.01 M/sec - SendersBlockedTimer: 7s496ms - SendersBlockedTotalTimer(*): 1m45s Instance ad4f3ef268d8fe31:65d07fc04e2146ec (host=vb0222.halxg.cloudera.com:22000):(Total: 49s183ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 12.89 MB, 164.34 MB, 292.34 MB, 420.38 MB, 548.35 MB, 676.34 MB, 788.30 MB, 980.30 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.83 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 607.17 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2067975168) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 201.691ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 37s111ms - TotalNetworkReceiveTime: 10s519ms - TotalNetworkSendTime: 9s899ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 703.182ms, non-child: 703.182ms, % non-child: 100.00%) - CodegenTime: 899.214us - CompileTime: 55.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 450.055ms - PrepareTime: 185.257ms DataStreamSender (dst_id=16):(Total: 13s220ms, non-child: 13s220ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139862643) - NetworkThroughput(*): 11.06 MB/sec - OverallThroughput: 10.09 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 813.347ms - ThriftTransmitTime(*): 12s056ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=8):(Total: 35s948ms, non-child: 9s612ms, % non-child: 26.74%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.140ms - GetResultsTime: 483.262ms - HTResizeTime: 1s079ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 369.66 K/sec - StreamingTime: 8s680ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s336ms, non-child: 13s858ms, % non-child: 52.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s709ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 2s007ms - GetNewBlockTime: 3.322ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s398ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 1.96 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.026us EXCHANGE_NODE (id=15):(Total: 3s514ms, non-child: 766.668ms, % non-child: 21.81%) BytesReceived(1s000ms): 2.33 MB, 54.24 MB, 123.07 MB, 183.63 MB, 250.31 MB, 291.54 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB - BytesReceived: 297.63 MB (312091560) - ConvertRowBatchTime: 398.533ms - DeserializeRowBatchTimer: 1s154ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s963ms, non-child: 2s927ms, % non-child: 32.66%) BytesReceived(1s000ms): 1.92 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 12.28 MB, 50.27 MB, 83.76 MB, 127.47 MB, 172.19 MB, 215.40 MB, 247.95 MB, 285.20 MB, 324.83 MB, 371.17 MB, 415.92 MB, 457.51 MB, 497.78 MB, 523.82 MB, 559.74 MB, 592.61 MB, 625.76 MB, 660.37 MB, 705.11 MB, 750.82 MB, 797.28 MB, 842.08 MB, 889.95 MB, 926.09 MB, 970.74 MB, 1006.75 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109356444) - ConvertRowBatchTime: 1s365ms - DeserializeRowBatchTimer: 5s544ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.76 M/sec - SendersBlockedTimer: 7s696ms - SendersBlockedTotalTimer(*): 1m32s Instance ad4f3ef268d8fe31:65d07fc04e2146e8 (host=vb0206.halxg.cloudera.com:22000):(Total: 49s161ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 7.33 MB, 164.36 MB, 292.37 MB, 420.35 MB, 548.35 MB, 676.33 MB, 772.30 MB, 932.30 MB, 1.11 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.53 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.02 MB, 485.77 MB, 291.52 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2067847168) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 184.366ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 36s204ms - TotalNetworkReceiveTime: 11s249ms - TotalNetworkSendTime: 10s193ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 708.681ms, non-child: 708.681ms, % non-child: 100.00%) - CodegenTime: 804.705us - CompileTime: 99.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 428.262ms - PrepareTime: 179.759ms DataStreamSender (dst_id=16):(Total: 13s381ms, non-child: 13s381ms, % non-child: 100.00%) - BytesSent: 133.43 MB (139908479) - NetworkThroughput(*): 10.96 MB/sec - OverallThroughput: 9.97 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 754.372ms - ThriftTransmitTime(*): 12s177ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=8):(Total: 35s766ms, non-child: 9s056ms, % non-child: 25.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 578.089us - GetResultsTime: 449.506ms - HTResizeTime: 1s065ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 371.62 K/sec - StreamingTime: 8s320ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s709ms, non-child: 13s692ms, % non-child: 51.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s265ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 2s164ms - GetNewBlockTime: 1.433ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s559ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.93 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=15):(Total: 3s960ms, non-child: 594.328ms, % non-child: 15.01%) BytesReceived(1s000ms): 1.46 MB, 51.76 MB, 120.57 MB, 182.21 MB, 247.96 MB, 290.89 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB - BytesReceived: 297.68 MB (312140537) - ConvertRowBatchTime: 274.799ms - DeserializeRowBatchTimer: 1s082ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 3.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s056ms, non-child: 2s638ms, % non-child: 29.13%) BytesReceived(1s000ms): 1.08 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 11.15 MB, 49.04 MB, 83.44 MB, 125.47 MB, 170.75 MB, 213.90 MB, 246.56 MB, 283.51 MB, 322.72 MB, 369.54 MB, 414.47 MB, 455.45 MB, 496.80 MB, 522.56 MB, 558.47 MB, 591.45 MB, 624.58 MB, 659.46 MB, 703.75 MB, 749.46 MB, 795.93 MB, 840.39 MB, 888.58 MB, 925.09 MB, 968.96 MB, 1006.19 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109448264) - ConvertRowBatchTime: 1s312ms - DeserializeRowBatchTimer: 5s144ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 7s820ms - SendersBlockedTotalTimer(*): 1m49s Instance ad4f3ef268d8fe31:65d07fc04e2146e4 (host=vb0204.halxg.cloudera.com:22000):(Total: 49s050ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.08 MB, 164.29 MB, 292.35 MB, 420.33 MB, 548.33 MB, 612.29 MB, 772.28 MB, 1.00 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.34 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.40 GB, 1.40 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.66 GB, 1.67 GB, 1.67 GB, 1.71 GB, 1.92 GB, 1.89 GB, 752.86 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2073223168) - PerHostPeakMemUsage: 3.86 GB (4146528336) - PrepareTime: 217.213ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 37s048ms - TotalNetworkReceiveTime: 10s261ms - TotalNetworkSendTime: 9s652ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 687.642ms, non-child: 687.642ms, % non-child: 100.00%) - CodegenTime: 2.306ms - CompileTime: 64.447ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 417.783ms - PrepareTime: 192.401ms DataStreamSender (dst_id=16):(Total: 13s204ms, non-child: 13s204ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139871505) - NetworkThroughput(*): 11.15 MB/sec - OverallThroughput: 10.10 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 729.636ms - ThriftTransmitTime(*): 11s968ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=8):(Total: 35s800ms, non-child: 9s907ms, % non-child: 27.67%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 702.728us - GetResultsTime: 469.754ms - HTResizeTime: 1s048ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 371.20 K/sec - StreamingTime: 9s090ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s893ms, non-child: 13s730ms, % non-child: 53.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s245ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s676ms - GetNewBlockTime: 1.588ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s113ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.99 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.458us EXCHANGE_NODE (id=15):(Total: 3s956ms, non-child: 573.005ms, % non-child: 14.48%) BytesReceived(1s000ms): 12.87 MB, 77.05 MB, 145.81 MB, 205.98 MB, 268.56 MB, 295.67 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB, 297.63 MB - BytesReceived: 297.63 MB (312085229) - ConvertRowBatchTime: 276.546ms - DeserializeRowBatchTimer: 1s041ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 3.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s206ms, non-child: 3s455ms, % non-child: 42.10%) BytesReceived(1s000ms): 5.12 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 22.84 MB, 61.45 MB, 100.82 MB, 140.27 MB, 187.18 MB, 225.35 MB, 261.29 MB, 297.19 MB, 339.01 MB, 387.50 MB, 428.60 MB, 471.23 MB, 504.55 MB, 536.07 MB, 570.58 MB, 603.27 MB, 636.78 MB, 673.96 MB, 720.58 MB, 766.08 MB, 811.70 MB, 858.81 MB, 902.00 MB, 938.77 MB, 986.11 MB, 1011.08 MB, 1.02 GB - BytesReceived: 1.03 GB (1109108496) - ConvertRowBatchTime: 1s429ms - DeserializeRowBatchTimer: 6s021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 6.29 M/sec - SendersBlockedTimer: 11s625ms - SendersBlockedTotalTimer(*): 2m26s Instance ad4f3ef268d8fe31:65d07fc04e2146ed (host=vb0218.halxg.cloudera.com:22000):(Total: 49s010ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 9.76 MB, 164.37 MB, 292.40 MB, 420.32 MB, 548.34 MB, 676.34 MB, 804.30 MB, 1.02 GB, 1.15 GB, 1.22 GB, 1.30 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.56 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.02 MB, 461.48 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070125568) - PerHostPeakMemUsage: 3.83 GB (4111110400) - PrepareTime: 184.341ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 33s755ms - TotalNetworkReceiveTime: 13s131ms - TotalNetworkSendTime: 10s132ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 656.987ms, non-child: 656.987ms, % non-child: 100.00%) - CodegenTime: 985.132us - CompileTime: 72.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 403.428ms - PrepareTime: 179.792ms DataStreamSender (dst_id=16):(Total: 13s154ms, non-child: 13s154ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139857934) - NetworkThroughput(*): 11.11 MB/sec - OverallThroughput: 10.14 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 766.383ms - ThriftTransmitTime(*): 12s004ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=8):(Total: 35s839ms, non-child: 8s788ms, % non-child: 24.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 488.117us - GetResultsTime: 471.255ms - HTResizeTime: 1s089ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 370.76 K/sec - StreamingTime: 8s026ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 27s050ms, non-child: 12s173ms, % non-child: 45.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s209ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s726ms - GetNewBlockTime: 1.275ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s584ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 1.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.001us EXCHANGE_NODE (id=15):(Total: 4s064ms, non-child: 615.703ms, % non-child: 15.15%) BytesReceived(1s000ms): 1.72 MB, 52.45 MB, 121.27 MB, 182.54 MB, 248.60 MB, 291.01 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB, 297.59 MB - BytesReceived: 297.59 MB (312046886) - ConvertRowBatchTime: 280.806ms - DeserializeRowBatchTimer: 1s128ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 3.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 10s812ms, non-child: 2s591ms, % non-child: 23.97%) BytesReceived(1s000ms): 1.34 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 11.51 MB, 49.57 MB, 83.85 MB, 125.88 MB, 171.29 MB, 214.37 MB, 247.09 MB, 284.04 MB, 323.46 MB, 370.20 MB, 415.03 MB, 456.11 MB, 497.09 MB, 522.68 MB, 558.51 MB, 591.47 MB, 624.62 MB, 659.50 MB, 703.87 MB, 749.62 MB, 796.17 MB, 840.56 MB, 888.76 MB, 925.17 MB, 969.35 MB, 1006.23 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1109227355) - ConvertRowBatchTime: 1s287ms - DeserializeRowBatchTimer: 5s202ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 4.77 M/sec - SendersBlockedTimer: 7s343ms - SendersBlockedTotalTimer(*): 1m50s Instance ad4f3ef268d8fe31:65d07fc04e2146e3 (host=vb0234.halxg.cloudera.com:22000):(Total: 48s834ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 708.00 KB, 164.32 MB, 292.31 MB, 420.35 MB, 548.34 MB, 612.32 MB, 756.28 MB, 980.28 MB, 1.12 GB, 1.22 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.40 GB, 1.39 GB, 1.42 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.66 GB, 1.64 GB, 1.65 GB, 1.75 GB, 1.89 GB, 1.89 GB, 752.87 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.44 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070995968) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 196.930ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 38s928ms - TotalNetworkReceiveTime: 8s563ms - TotalNetworkSendTime: 9s511ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 693.696ms, non-child: 693.696ms, % non-child: 100.00%) - CodegenTime: 775.458us - CompileTime: 64.358ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 435.474ms - PrepareTime: 183.141ms DataStreamSender (dst_id=16):(Total: 12s984ms, non-child: 12s984ms, % non-child: 100.00%) - BytesSent: 133.47 MB (139954847) - NetworkThroughput(*): 11.27 MB/sec - OverallThroughput: 10.28 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 737.240ms - ThriftTransmitTime(*): 11s842ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=8):(Total: 35s831ms, non-child: 9s902ms, % non-child: 27.64%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 909.590us - GetResultsTime: 484.779ms - HTResizeTime: 1s265ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 371.09 K/sec - StreamingTime: 9s079ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s928ms, non-child: 15s269ms, % non-child: 58.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s058ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s807ms - GetNewBlockTime: 1.912ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s621ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.99 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=15):(Total: 3s168ms, non-child: 855.514ms, % non-child: 27.00%) BytesReceived(1s000ms): 11.94 MB, 75.40 MB, 144.17 MB, 204.46 MB, 267.47 MB, 295.69 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB, 297.81 MB - BytesReceived: 297.81 MB (312279172) - ConvertRowBatchTime: 444.078ms - DeserializeRowBatchTimer: 1s195ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 4.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 7s490ms, non-child: 3s573ms, % non-child: 47.70%) BytesReceived(1s000ms): 5.08 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 22.07 MB, 60.44 MB, 99.28 MB, 138.71 MB, 186.09 MB, 224.92 MB, 260.08 MB, 296.54 MB, 338.16 MB, 386.35 MB, 427.85 MB, 470.97 MB, 504.00 MB, 535.37 MB, 570.02 MB, 602.52 MB, 635.98 MB, 673.10 MB, 719.72 MB, 765.36 MB, 811.11 MB, 858.15 MB, 901.61 MB, 938.32 MB, 985.61 MB, 1011.08 MB, 1.02 GB - BytesReceived: 1.03 GB (1109811036) - ConvertRowBatchTime: 1s435ms - DeserializeRowBatchTimer: 5s348ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.89 M/sec - SendersBlockedTimer: 17s546ms - SendersBlockedTotalTimer(*): 3m49s Fragment F05: Instance ad4f3ef268d8fe31:65d07fc04e2146f3 (host=vb0234.halxg.cloudera.com:22000):(Total: 5s579ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 49.05 MB, 210.47 MB, 210.38 MB, 210.15 MB, 170.51 MB, 162.81 MB, 162.76 MB, 162.76 MB, 130.72 MB, 114.68 MB, 106.92 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.77 MB (221004464) - PerHostPeakMemUsage: 1.93 GB (2072869088) - PrepareTime: 192.729ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 37s568ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 156.825ms - TotalStorageWaitTime: 110.758ms CodeGen:(Total: 527.775ms, non-child: 527.775ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 331.876ms - PrepareTime: 181.437ms DataStreamSender (dst_id=15):(Total: 5s194ms, non-child: 5s194ms, % non-child: 100.00%) - BytesSent: 352.61 MB (369736219) - NetworkThroughput(*): 52.50 MB/sec - OverallThroughput: 67.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s049ms - ThriftTransmitTime(*): 6s715ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=6):(Total: 553.229ms, non-child: 553.229ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:0% 2:0% 3:0% 4:0% 5:0% 6:9.091% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 600.00 KB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.55 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 821.223ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.36 MB (220578480) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 29.20 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.42K (2419) - ScannerThreadsTotalWallClockTime: 31s887ms - MaterializeTupleTime(*): 30s878ms - ScannerThreadsSysTime: 107.980ms - ScannerThreadsUserTime: 6s794ms - ScannerThreadsVoluntaryContextSwitches: 15.79K (15794) - TotalRawHdfsReadTime(*): 121.343ms - TotalReadThroughput: 34.03 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f1 (host=vb0232.halxg.cloudera.com:22000):(Total: 5s554ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 212.03 MB, 211.80 MB, 211.94 MB, 211.83 MB, 204.04 MB, 150.20 MB, 138.12 MB, 137.15 MB, 97.07 MB, 97.11 MB, 20.33 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 7, 6, 6, 6, 6, 2 - AverageThreadTokens: 6.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.29 MB (222603496) - PerHostPeakMemUsage: 1.89 GB (2034635112) - PrepareTime: 196.560ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 37s864ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 186.846ms - TotalStorageWaitTime: 145.852ms CodeGen:(Total: 571.622ms, non-child: 571.622ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 372.115ms - PrepareTime: 179.418ms DataStreamSender (dst_id=15):(Total: 5s208ms, non-child: 5s208ms, % non-child: 100.00%) - BytesSent: 345.64 MB (362427354) - NetworkThroughput(*): 51.94 MB/sec - OverallThroughput: 66.36 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s961ms - ThriftTransmitTime(*): 6s654ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=6):(Total: 520.424ms, non-child: 520.424ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.64 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 818.176ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.78 MB (222062912) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 30.47 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.43K (2434) - ScannerThreadsTotalWallClockTime: 32s239ms - MaterializeTupleTime(*): 31s191ms - ScannerThreadsSysTime: 79.985ms - ScannerThreadsUserTime: 7s012ms - ScannerThreadsVoluntaryContextSwitches: 15.40K (15396) - TotalRawHdfsReadTime(*): 130.454ms - TotalReadThroughput: 30.66 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146ef (host=vb0216.halxg.cloudera.com:22000):(Total: 5s200ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.93 MB, 193.79 MB, 193.90 MB, 193.88 MB, 146.08 MB, 136.81 MB, 137.04 MB, 96.94 MB, 96.98 MB, 57.96 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.16 MB (203596552) - PerHostPeakMemUsage: 1.82 GB (1956263696) - PrepareTime: 194.381ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 32s580ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 165.050ms - TotalStorageWaitTime: 188.502ms CodeGen:(Total: 541.930ms, non-child: 541.930ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 344.087ms - PrepareTime: 182.287ms DataStreamSender (dst_id=15):(Total: 4s858ms, non-child: 4s858ms, % non-child: 100.00%) - BytesSent: 318.16 MB (333612663) - NetworkThroughput(*): 54.08 MB/sec - OverallThroughput: 65.48 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s820ms - ThriftTransmitTime(*): 5s882ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=6):(Total: 505.990ms, non-child: 505.990ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 478.675ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.76 MB (203170568) - PerReadThreadRawHdfsThroughput: 962.05 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 29.00 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1758) - ScannerThreadsTotalWallClockTime: 27s348ms - MaterializeTupleTime(*): 26s618ms - ScannerThreadsSysTime: 50.989ms - ScannerThreadsUserTime: 3s973ms - ScannerThreadsVoluntaryContextSwitches: 14.35K (14350) - TotalRawHdfsReadTime(*): 176.851ms - TotalReadThroughput: 30.93 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f6 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s976ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 68.00 KB, 143.64 MB, 176.84 MB, 176.66 MB, 176.57 MB, 137.09 MB, 137.07 MB, 137.07 MB, 96.91 MB, 96.82 MB, 57.80 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 176.98 MB (185580872) - PerHostPeakMemUsage: 1.83 GB (1960762192) - PrepareTime: 192.332ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 28s714ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 201.886ms - TotalStorageWaitTime: 249.423ms CodeGen:(Total: 580.781ms, non-child: 580.781ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 384.835ms - PrepareTime: 186.657ms DataStreamSender (dst_id=15):(Total: 4s649ms, non-child: 4s649ms, % non-child: 100.00%) - BytesSent: 294.02 MB (308307328) - NetworkThroughput(*): 53.83 MB/sec - OverallThroughput: 63.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s650ms - ThriftTransmitTime(*): 5s462ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=6):(Total: 496.756ms, non-child: 496.756ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 125.78 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 459.310ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 27.08 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1987) - ScannerThreadsTotalWallClockTime: 23s754ms - MaterializeTupleTime(*): 22s887ms - ScannerThreadsSysTime: 104.982ms - ScannerThreadsUserTime: 4s269ms - ScannerThreadsVoluntaryContextSwitches: 12.97K (12972) - TotalRawHdfsReadTime(*): 143.842ms - TotalReadThroughput: 28.36 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146fa (host=vb0224.halxg.cloudera.com:22000):(Total: 4s911ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 144.92 MB, 189.81 MB, 189.68 MB, 189.81 MB, 137.02 MB, 137.01 MB, 137.16 MB, 97.02 MB, 96.98 MB, 57.93 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.16 MB (199402240) - PerHostPeakMemUsage: 1.82 GB (1950232000) - PrepareTime: 194.011ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 30s090ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 166.069ms - TotalStorageWaitTime: 139.761ms CodeGen:(Total: 530.314ms, non-child: 530.314ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 332.956ms - PrepareTime: 179.593ms DataStreamSender (dst_id=15):(Total: 4s588ms, non-child: 4s588ms, % non-child: 100.00%) - BytesSent: 310.50 MB (325581629) - NetworkThroughput(*): 54.48 MB/sec - OverallThroughput: 67.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s670ms - ThriftTransmitTime(*): 5s699ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=6):(Total: 489.196ms, non-child: 489.196ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:90% 1:0% 2:10% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 112.41 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 5.40 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 467.396ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.70 MB (198910720) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 29.21 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.21K (2211) - ScannerThreadsTotalWallClockTime: 25s117ms - MaterializeTupleTime(*): 24s458ms - ScannerThreadsSysTime: 48.990ms - ScannerThreadsUserTime: 3s922ms - ScannerThreadsVoluntaryContextSwitches: 13.85K (13847) - TotalRawHdfsReadTime(*): 125.359ms - TotalReadThroughput: 33.14 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f7 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s871ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.64 MB, 176.85 MB, 176.76 MB, 137.05 MB, 137.11 MB, 137.10 MB, 96.95 MB, 96.97 MB, 57.69 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646408) - PerHostPeakMemUsage: 1.77 GB (1904304880) - PrepareTime: 205.640ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 27s884ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 147.114ms - TotalStorageWaitTime: 141.447ms CodeGen:(Total: 562.552ms, non-child: 562.552ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.662ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.740ms - PrepareTime: 191.607ms DataStreamSender (dst_id=15):(Total: 4s528ms, non-child: 4s528ms, % non-child: 100.00%) - BytesSent: 291.84 MB (306013386) - NetworkThroughput(*): 54.14 MB/sec - OverallThroughput: 64.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s607ms - ThriftTransmitTime(*): 5s390ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=6):(Total: 498.423ms, non-child: 498.423ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 448.081ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 27.01 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.94K (1936) - ScannerThreadsTotalWallClockTime: 22s912ms - MaterializeTupleTime(*): 22s202ms - ScannerThreadsSysTime: 48.990ms - ScannerThreadsUserTime: 3s873ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13023) - TotalRawHdfsReadTime(*): 145.674ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146fb (host=vb0222.halxg.cloudera.com:22000):(Total: 4s821ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 177.78 MB, 177.84 MB, 177.78 MB, 177.81 MB, 124.56 MB, 111.38 MB, 111.41 MB, 79.33 MB, 79.31 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.15 MB (186803000) - PerHostPeakMemUsage: 1.69 GB (1815630280) - PrepareTime: 184.373ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 27s641ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 148.300ms - TotalStorageWaitTime: 121.835ms CodeGen:(Total: 520.563ms, non-child: 520.563ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.942ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 332.734ms - PrepareTime: 182.624ms DataStreamSender (dst_id=15):(Total: 4s518ms, non-child: 4s518ms, % non-child: 100.00%) - BytesSent: 283.12 MB (296869096) - NetworkThroughput(*): 53.01 MB/sec - OverallThroughput: 62.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s392ms - ThriftTransmitTime(*): 5s340ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=6):(Total: 467.422ms, non-child: 467.422ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 583.282ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.70 MB (186327856) - PerReadThreadRawHdfsThroughput: 1.70 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 27.98 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.27K (2269) - ScannerThreadsTotalWallClockTime: 22s728ms - MaterializeTupleTime(*): 21s960ms - ScannerThreadsSysTime: 60.988ms - ScannerThreadsUserTime: 4s905ms - ScannerThreadsVoluntaryContextSwitches: 12.71K (12705) - TotalRawHdfsReadTime(*): 87.162ms - TotalReadThroughput: 30.35 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f9 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s725ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.66 MB, 176.88 MB, 176.77 MB, 136.87 MB, 136.97 MB, 137.05 MB, 137.17 MB, 97.14 MB, 96.90 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.06 MB (185662792) - PerHostPeakMemUsage: 1.76 GB (1885365168) - PrepareTime: 194.724ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 27s380ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.382ms - TotalStorageWaitTime: 88.277ms CodeGen:(Total: 583.826ms, non-child: 583.826ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.384ms - PrepareTime: 185.863ms DataStreamSender (dst_id=15):(Total: 4s429ms, non-child: 4s429ms, % non-child: 100.00%) - BytesSent: 294.03 MB (308318013) - NetworkThroughput(*): 54.47 MB/sec - OverallThroughput: 66.38 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s566ms - ThriftTransmitTime(*): 5s397ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=6):(Total: 471.080ms, non-child: 471.080ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 449.292ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 28.57 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1820) - ScannerThreadsTotalWallClockTime: 22s479ms - MaterializeTupleTime(*): 21s893ms - ScannerThreadsSysTime: 40.991ms - ScannerThreadsUserTime: 4s201ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13034) - TotalRawHdfsReadTime(*): 103.798ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f4 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s717ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.64 MB, 176.46 MB, 176.78 MB, 136.97 MB, 137.18 MB, 137.11 MB, 97.01 MB, 97.12 MB, 30.25 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 4.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638216) - PerHostPeakMemUsage: 1.65 GB (1766830720) - PrepareTime: 191.023ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 27s232ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 148.355ms - TotalStorageWaitTime: 117.135ms CodeGen:(Total: 542.919ms, non-child: 542.919ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.401ms - PrepareTime: 182.949ms DataStreamSender (dst_id=15):(Total: 4s396ms, non-child: 4s396ms, % non-child: 100.00%) - BytesSent: 294.15 MB (308443626) - NetworkThroughput(*): 55.09 MB/sec - OverallThroughput: 66.90 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s556ms - ThriftTransmitTime(*): 5s339ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=6):(Total: 488.318ms, non-child: 488.318ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 454.536ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 27.56 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.19K (2194) - ScannerThreadsTotalWallClockTime: 22s398ms - MaterializeTupleTime(*): 21s778ms - ScannerThreadsSysTime: 118.979ms - ScannerThreadsUserTime: 3s626ms - ScannerThreadsVoluntaryContextSwitches: 13.08K (13082) - TotalRawHdfsReadTime(*): 104.480ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f5 (host=vb0228.halxg.cloudera.com:22000):(Total: 4s665ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 201.73 MB, 201.63 MB, 201.75 MB, 162.02 MB, 154.24 MB, 154.26 MB, 137.06 MB, 96.98 MB, 81.32 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.30 MB (212124344) - PerHostPeakMemUsage: 1.65 GB (1773010136) - PrepareTime: 191.851ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 29s696ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 175.159ms - TotalStorageWaitTime: 112.792ms CodeGen:(Total: 530.003ms, non-child: 530.003ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 334.848ms - PrepareTime: 180.433ms DataStreamSender (dst_id=15):(Total: 4s377ms, non-child: 4s377ms, % non-child: 100.00%) - BytesSent: 332.31 MB (348451750) - NetworkThroughput(*): 48.91 MB/sec - OverallThroughput: 75.92 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s607ms - ThriftTransmitTime(*): 6s793ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=6):(Total: 461.596ms, non-child: 461.596ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.67 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 485.373ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.82 MB (211624624) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 32.49 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1399) - ScannerThreadsTotalWallClockTime: 24s957ms - MaterializeTupleTime(*): 24s308ms - ScannerThreadsSysTime: 25.994ms - ScannerThreadsUserTime: 4s025ms - ScannerThreadsVoluntaryContextSwitches: 14.58K (14577) - TotalRawHdfsReadTime(*): 122.239ms - TotalReadThroughput: 34.78 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146fc (host=vb0214.halxg.cloudera.com:22000):(Total: 4s437ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 163.95 MB, 164.33 MB, 164.13 MB, 164.30 MB, 124.57 MB, 111.48 MB, 111.36 MB, 79.40 MB, 48.05 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.56 MB (172555600) - PerHostPeakMemUsage: 1.59 GB (1703082960) - PrepareTime: 194.385ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 23s613ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 166.120ms - TotalStorageWaitTime: 76.625ms CodeGen:(Total: 523.221ms, non-child: 523.221ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.314ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 326.000ms - PrepareTime: 179.552ms DataStreamSender (dst_id=15):(Total: 4s146ms, non-child: 4s146ms, % non-child: 100.00%) - BytesSent: 264.47 MB (277318529) - NetworkThroughput(*): 47.39 MB/sec - OverallThroughput: 63.79 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s372ms - ThriftTransmitTime(*): 5s580ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=6):(Total: 464.271ms, non-child: 464.271ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.56 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 463.857ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088656) - PerReadThreadRawHdfsThroughput: 1.72 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 26.15 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1504) - ScannerThreadsTotalWallClockTime: 19s066ms - MaterializeTupleTime(*): 18s480ms - ScannerThreadsSysTime: 76.986ms - ScannerThreadsUserTime: 3s966ms - ScannerThreadsVoluntaryContextSwitches: 11.69K (11690) - TotalRawHdfsReadTime(*): 80.087ms - TotalReadThroughput: 31.28 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f8 (host=vb0230.halxg.cloudera.com:22000):(Total: 4s365ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 68.00 KB, 176.68 MB, 176.73 MB, 176.80 MB, 137.11 MB, 137.17 MB, 137.18 MB, 97.00 MB, 97.05 MB, 30.24 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621832) - PerHostPeakMemUsage: 1.65 GB (1768338184) - PrepareTime: 191.494ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 25s014ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 166.733ms - TotalStorageWaitTime: 179.802ms CodeGen:(Total: 559.243ms, non-child: 559.243ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 362.094ms - PrepareTime: 182.398ms DataStreamSender (dst_id=15):(Total: 4s063ms, non-child: 4s063ms, % non-child: 100.00%) - BytesSent: 293.49 MB (307746414) - NetworkThroughput(*): 47.73 MB/sec - OverallThroughput: 72.23 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s404ms - ThriftTransmitTime(*): 6s149ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=6):(Total: 473.205ms, non-child: 473.205ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 436.563ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 28.45 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.23K (1233) - ScannerThreadsTotalWallClockTime: 20s605ms - MaterializeTupleTime(*): 19s888ms - ScannerThreadsSysTime: 20.995ms - ScannerThreadsUserTime: 3s582ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13017) - TotalRawHdfsReadTime(*): 149.274ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f2 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s355ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.27 MB, 176.53 MB, 176.72 MB, 137.13 MB, 137.05 MB, 137.06 MB, 97.20 MB, 97.07 MB, 48.92 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 176.98 MB (185580872) - PerHostPeakMemUsage: 1.65 GB (1767820720) - PrepareTime: 196.084ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 24s979ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 146.656ms - TotalStorageWaitTime: 188.143ms CodeGen:(Total: 588.870ms, non-child: 588.870ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 384.974ms - PrepareTime: 183.334ms DataStreamSender (dst_id=15):(Total: 4s035ms, non-child: 4s035ms, % non-child: 100.00%) - BytesSent: 290.65 MB (304766627) - NetworkThroughput(*): 54.74 MB/sec - OverallThroughput: 72.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s289ms - ThriftTransmitTime(*): 5s309ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=6):(Total: 489.361ms, non-child: 489.361ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 418.918ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 27.51 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.27K (1266) - ScannerThreadsTotalWallClockTime: 20s540ms - MaterializeTupleTime(*): 19s815ms - ScannerThreadsSysTime: 21.995ms - ScannerThreadsUserTime: 3s695ms - ScannerThreadsVoluntaryContextSwitches: 13.04K (13040) - TotalRawHdfsReadTime(*): 118.686ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146ee (host=vb0212.halxg.cloudera.com:22000):(Total: 4s013ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.02 MB, 143.19 MB, 143.07 MB, 111.34 MB, 111.48 MB, 103.38 MB, 79.36 MB, 38.16 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 4.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.39 MB (150353768) - PerHostPeakMemUsage: 1.60 GB (1722474248) - PrepareTime: 191.230ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 19s097ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 141.912ms - TotalStorageWaitTime: 119.342ms CodeGen:(Total: 541.661ms, non-child: 541.661ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 347.496ms - PrepareTime: 178.453ms DataStreamSender (dst_id=15):(Total: 3s698ms, non-child: 3s698ms, % non-child: 100.00%) - BytesSent: 234.52 MB (245907836) - NetworkThroughput(*): 51.74 MB/sec - OverallThroughput: 63.40 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s116ms - ThriftTransmitTime(*): 4s532ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=6):(Total: 467.236ms, non-child: 467.236ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.88 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 494.572ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.91 MB (149854096) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 23.04 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1622) - ScannerThreadsTotalWallClockTime: 14s966ms - MaterializeTupleTime(*): 14s305ms - ScannerThreadsSysTime: 74.988ms - ScannerThreadsUserTime: 4s110ms - ScannerThreadsVoluntaryContextSwitches: 10.40K (10402) - TotalRawHdfsReadTime(*): 116.299ms - TotalReadThroughput: 27.73 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146f0 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s847ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.24 MB, 168.21 MB, 168.22 MB, 128.55 MB, 112.27 MB, 87.32 MB, 79.36 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.44 MB (176627016) - PerHostPeakMemUsage: 1.61 GB (1730619680) - PrepareTime: 194.007ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 20s515ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 158.856ms - TotalStorageWaitTime: 232.273ms CodeGen:(Total: 555.108ms, non-child: 555.108ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 358.005ms - PrepareTime: 180.692ms DataStreamSender (dst_id=15):(Total: 3s547ms, non-child: 3s547ms, % non-child: 100.00%) - BytesSent: 265.20 MB (278077986) - NetworkThroughput(*): 54.26 MB/sec - OverallThroughput: 74.75 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s106ms - ThriftTransmitTime(*): 4s887ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=6):(Total: 477.131ms, non-child: 477.131ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 381.827ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 167.99 MB (176151920) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 25.72 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1092) - ScannerThreadsTotalWallClockTime: 16s679ms - MaterializeTupleTime(*): 15s956ms - ScannerThreadsSysTime: 14.995ms - ScannerThreadsUserTime: 3s385ms - ScannerThreadsVoluntaryContextSwitches: 11.85K (11847) - TotalRawHdfsReadTime(*): 117.111ms - TotalReadThroughput: 35.57 MB/sec Fragment F04: Instance ad4f3ef268d8fe31:65d07fc04e2146fe (host=vb0230.halxg.cloudera.com:22000):(Total: 35s335ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.98 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 193.10 MB, 193.73 MB, 193.61 MB, 193.66 MB, 193.72 MB, 193.80 MB, 193.67 MB, 193.80 MB, 193.66 MB, 161.79 MB, 67.17 MB, 67.03 MB, 186.03 MB, 193.77 MB, 193.61 MB, 193.72 MB, 193.65 MB, 193.60 MB, 193.72 MB, 193.64 MB, 193.72 MB, 193.56 MB, 161.87 MB, 67.04 MB, 67.16 MB, 60.22 MB, 55.07 MB, 39.27 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.10 MB (203525864) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 193.408ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m46s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s823ms - TotalStorageWaitTime: 446.958ms CodeGen:(Total: 584.914ms, non-child: 584.914ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.293ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.691ms - PrepareTime: 182.439ms DataStreamSender (dst_id=14):(Total: 34s734ms, non-child: 34s734ms, % non-child: 100.00%) - BytesSent: 1.11 GB (1195649237) - NetworkThroughput(*): 8.99 MB/sec - OverallThroughput: 32.83 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s447ms - ThriftTransmitTime(*): 2m6s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=5):(Total: 721.652ms, non-child: 721.652ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 318.27 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.51 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 74.30 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.74K (7740) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 4m23s - ScannerThreadsSysTime: 218.963ms - ScannerThreadsUserTime: 19s127ms - ScannerThreadsVoluntaryContextSwitches: 52.17K (52169) - TotalRawHdfsReadTime(*): 271.613ms - TotalReadThroughput: 10.27 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214706 (host=vb0206.halxg.cloudera.com:22000):(Total: 35s066ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 95.80 MB, 192.69 MB, 192.69 MB, 192.69 MB, 192.69 MB, 192.69 MB, 192.69 MB, 192.69 MB, 193.09 MB, 193.73 MB, 193.74 MB, 193.72 MB, 193.64 MB, 193.67 MB, 193.70 MB, 193.75 MB, 193.64 MB, 185.70 MB, 74.88 MB, 67.09 MB, 116.74 MB, 192.84 MB, 193.67 MB, 193.58 MB, 193.75 MB, 193.64 MB, 193.72 MB, 193.70 MB, 193.68 MB, 193.67 MB, 102.34 MB, 67.05 MB, 67.03 MB, 55.07 MB, 55.12 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203501328) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 180.683ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m44s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s078ms - TotalStorageWaitTime: 293.022ms CodeGen:(Total: 539.784ms, non-child: 539.784ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.053ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 355.575ms - PrepareTime: 178.991ms DataStreamSender (dst_id=14):(Total: 34s423ms, non-child: 34s423ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1128028349) - NetworkThroughput(*): 7.29 MB/sec - OverallThroughput: 31.25 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s165ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=5):(Total: 745.381ms, non-child: 745.381ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 225.85 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 369.58 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s483ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.61 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 71.91 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.47K (10467) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m21s - ScannerThreadsSysTime: 337.944ms - ScannerThreadsUserTime: 20s414ms - ScannerThreadsVoluntaryContextSwitches: 52.40K (52398) - TotalRawHdfsReadTime(*): 224.565ms - TotalReadThroughput: 10.41 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214703 (host=vb0226.halxg.cloudera.com:22000):(Total: 35s065ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 96.76 MB, 193.47 MB, 193.47 MB, 193.47 MB, 193.47 MB, 193.47 MB, 193.47 MB, 193.47 MB, 193.54 MB, 193.73 MB, 193.61 MB, 193.66 MB, 193.73 MB, 193.68 MB, 193.68 MB, 193.80 MB, 193.55 MB, 126.47 MB, 67.08 MB, 67.17 MB, 192.73 MB, 193.73 MB, 193.59 MB, 193.72 MB, 193.64 MB, 193.66 MB, 193.61 MB, 193.67 MB, 193.76 MB, 189.75 MB, 74.98 MB, 67.04 MB, 61.09 MB, 55.05 MB, 55.00 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 197.48 MB (207072248) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 186.452ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s643ms - TotalStorageWaitTime: 315.410ms CodeGen:(Total: 517.932ms, non-child: 517.932ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.401ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 327.567ms - PrepareTime: 178.078ms DataStreamSender (dst_id=14):(Total: 34s490ms, non-child: 34s490ms, % non-child: 100.00%) - BytesSent: 1.09 GB (1170019264) - NetworkThroughput(*): 7.12 MB/sec - OverallThroughput: 32.35 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s129ms - ThriftTransmitTime(*): 2m36s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=5):(Total: 696.344ms, non-child: 696.344ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 349.05 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s366ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 197.04 MB (206613496) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 76.95 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.00K (6997) - ScannerThreadsTotalWallClockTime: 4m22s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 290.951ms - ScannerThreadsUserTime: 17s237ms - ScannerThreadsVoluntaryContextSwitches: 52.36K (52361) - TotalRawHdfsReadTime(*): 244.978ms - TotalReadThroughput: 10.41 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214700 (host=vb0212.halxg.cloudera.com:22000):(Total: 34s578ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 95.95 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.22 MB, 193.52 MB, 193.85 MB, 193.75 MB, 193.64 MB, 193.68 MB, 193.78 MB, 193.75 MB, 193.73 MB, 193.62 MB, 149.99 MB, 67.01 MB, 67.05 MB, 143.40 MB, 193.63 MB, 193.56 MB, 193.62 MB, 193.62 MB, 193.55 MB, 193.54 MB, 193.73 MB, 193.76 MB, 193.76 MB, 161.74 MB, 67.19 MB, 67.19 MB, 50.92 MB, 27.99 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 2 - AverageThreadTokens: 8.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.46 MB (203906368) - PerHostPeakMemUsage: 3.86 GB (4145828608) - PrepareTime: 189.192ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s086ms - TotalStorageWaitTime: 431.434ms CodeGen:(Total: 566.284ms, non-child: 566.284ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.785ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 367.828ms - PrepareTime: 176.305ms DataStreamSender (dst_id=14):(Total: 33s965ms, non-child: 33s965ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1145322605) - NetworkThroughput(*): 9.88 MB/sec - OverallThroughput: 32.16 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s747ms - ThriftTransmitTime(*): 1m50s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=5):(Total: 713.946ms, non-child: 713.946ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.55% 1:1.449% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 260.70 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.05 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.67 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s556ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.02 MB (203447616) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 70.88 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.68K (7676) - ScannerThreadsTotalWallClockTime: 4m23s - MaterializeTupleTime(*): 4m21s - ScannerThreadsSysTime: 284.952ms - ScannerThreadsUserTime: 16s805ms - ScannerThreadsVoluntaryContextSwitches: 47.55K (47545) - TotalRawHdfsReadTime(*): 318.762ms - TotalReadThroughput: 9.97 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146fd (host=vb0208.halxg.cloudera.com:22000):(Total: 34s468ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 94.29 MB, 190.07 MB, 190.07 MB, 190.07 MB, 190.07 MB, 190.07 MB, 190.07 MB, 190.07 MB, 190.41 MB, 190.73 MB, 190.71 MB, 190.67 MB, 190.58 MB, 190.80 MB, 190.78 MB, 190.57 MB, 190.77 MB, 115.33 MB, 73.47 MB, 82.99 MB, 187.39 MB, 187.75 MB, 187.70 MB, 187.62 MB, 187.53 MB, 187.78 MB, 187.66 MB, 187.68 MB, 175.75 MB, 143.98 MB, 83.04 MB, 98.71 MB, 76.90 MB, 54.99 MB, 39.30 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 191.04 MB (200322784) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 199.485ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s475ms - TotalStorageWaitTime: 373.871ms CodeGen:(Total: 603.613ms, non-child: 603.613ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.210ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 398.499ms - PrepareTime: 186.668ms DataStreamSender (dst_id=14):(Total: 33s895ms, non-child: 33s895ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1124174775) - NetworkThroughput(*): 9.09 MB/sec - OverallThroughput: 31.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s966ms - ThriftTransmitTime(*): 1m57s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=5):(Total: 706.680ms, non-child: 706.680ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 81.02 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 162.04 MB, 172.31 MB, 182.58 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 321.01 MB, 342.33 MB, 362.86 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s732ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 190.61 MB (199864080) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 74.41 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.50K (7505) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 248.957ms - ScannerThreadsUserTime: 17s092ms - ScannerThreadsVoluntaryContextSwitches: 51.34K (51335) - TotalRawHdfsReadTime(*): 271.044ms - TotalReadThroughput: 10.37 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214701 (host=vb0234.halxg.cloudera.com:22000):(Total: 34s459ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 192.91 MB, 192.91 MB, 192.91 MB, 192.91 MB, 192.91 MB, 192.91 MB, 192.91 MB, 192.91 MB, 193.71 MB, 193.77 MB, 193.72 MB, 193.70 MB, 193.63 MB, 193.72 MB, 193.76 MB, 193.63 MB, 161.84 MB, 67.07 MB, 67.18 MB, 192.81 MB, 193.73 MB, 193.77 MB, 193.76 MB, 193.71 MB, 193.59 MB, 193.57 MB, 193.62 MB, 193.71 MB, 161.63 MB, 67.10 MB, 67.14 MB, 63.96 MB, 55.05 MB, 47.11 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.14 MB (203566824) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 197.311ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s576ms - TotalStorageWaitTime: 363.919ms CodeGen:(Total: 544.832ms, non-child: 544.832ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 344.156ms - PrepareTime: 184.542ms DataStreamSender (dst_id=14):(Total: 33s854ms, non-child: 33s854ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1146765292) - NetworkThroughput(*): 7.35 MB/sec - OverallThroughput: 32.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s954ms - ThriftTransmitTime(*): 2m28s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=5):(Total: 724.122ms, non-child: 724.122ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.53% 1:1.471% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 246.39 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 332.62 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.56 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s361ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075352) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 74.01 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.91K (7913) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 274.954ms - ScannerThreadsUserTime: 18s730ms - ScannerThreadsVoluntaryContextSwitches: 52.29K (52288) - TotalRawHdfsReadTime(*): 272.141ms - TotalReadThroughput: 10.71 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214708 (host=vb0228.halxg.cloudera.com:22000):(Total: 34s369ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(1s000ms): 82.16 MB, 165.04 MB, 165.04 MB, 165.04 MB, 165.04 MB, 165.04 MB, 165.04 MB, 165.04 MB, 176.54 MB, 187.73 MB, 187.67 MB, 187.75 MB, 187.66 MB, 187.70 MB, 187.62 MB, 187.73 MB, 187.66 MB, 187.70 MB, 118.14 MB, 82.84 MB, 82.85 MB, 129.79 MB, 193.59 MB, 193.69 MB, 193.75 MB, 193.71 MB, 193.70 MB, 193.67 MB, 181.80 MB, 177.94 MB, 173.80 MB, 106.37 MB, 82.90 MB, 73.02 MB, 24.07 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 2 - AverageThreadTokens: 8.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.44 MB (203880600) - PerHostPeakMemUsage: 3.90 GB (4182707160) - PrepareTime: 193.631ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m47s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s823ms - TotalStorageWaitTime: 383.833ms CodeGen:(Total: 599.864ms, non-child: 599.864ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 400.169ms - PrepareTime: 180.310ms DataStreamSender (dst_id=14):(Total: 33s732ms, non-child: 33s732ms, % non-child: 100.00%) - BytesSent: 1.00 GB (1074026651) - NetworkThroughput(*): 7.02 MB/sec - OverallThroughput: 30.36 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s406ms - ThriftTransmitTime(*): 2m25s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=5):(Total: 757.916ms, non-child: 757.916ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 69.70 MB, 139.41 MB, 139.41 MB, 139.41 MB, 139.41 MB, 139.41 MB, 139.41 MB, 139.41 MB, 149.68 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 180.48 MB, 180.48 MB, 180.48 MB, 242.08 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.77 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s364ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.98 MB (203405512) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 65.89 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.29K (8290) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 4m24s - ScannerThreadsSysTime: 323.947ms - ScannerThreadsUserTime: 16s784ms - ScannerThreadsVoluntaryContextSwitches: 48.22K (48220) - TotalRawHdfsReadTime(*): 258.458ms - TotalReadThroughput: 9.85 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21470a (host=vb0222.halxg.cloudera.com:22000):(Total: 34s339ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 85.35 MB, 193.13 MB, 193.13 MB, 193.13 MB, 193.13 MB, 193.13 MB, 193.13 MB, 193.13 MB, 193.22 MB, 193.70 MB, 193.73 MB, 193.72 MB, 193.66 MB, 193.81 MB, 193.71 MB, 193.69 MB, 193.78 MB, 98.66 MB, 67.12 MB, 100.78 MB, 188.17 MB, 188.12 MB, 188.31 MB, 188.09 MB, 188.25 MB, 188.29 MB, 188.27 MB, 188.20 MB, 188.29 MB, 131.12 MB, 82.91 MB, 82.93 MB, 55.11 MB, 51.05 MB, 27.74 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 2 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.06 MB (203484896) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 196.098ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s601ms - TotalStorageWaitTime: 325.585ms CodeGen:(Total: 568.284ms, non-child: 568.284ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 367.440ms - PrepareTime: 184.696ms DataStreamSender (dst_id=14):(Total: 33s788ms, non-child: 33s788ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1147663352) - NetworkThroughput(*): 8.24 MB/sec - OverallThroughput: 32.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s862ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=5):(Total: 684.246ms, non-child: 684.246ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:98.55% 1:1.449% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 72.26 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 210.17 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 335.29 MB, 345.55 MB, 345.55 MB, 366.08 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.46 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s360ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 77.52 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.00K (6995) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m15s - ScannerThreadsSysTime: 207.965ms - ScannerThreadsUserTime: 16s938ms - ScannerThreadsVoluntaryContextSwitches: 51.56K (51563) - TotalRawHdfsReadTime(*): 267.012ms - TotalReadThroughput: 10.46 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214709 (host=vb0224.halxg.cloudera.com:22000):(Total: 34s216ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 34.00 KB, 190.16 MB, 190.16 MB, 190.16 MB, 190.16 MB, 190.16 MB, 190.16 MB, 190.16 MB, 190.20 MB, 190.77 MB, 190.70 MB, 190.72 MB, 190.77 MB, 190.72 MB, 190.70 MB, 190.65 MB, 190.61 MB, 154.76 MB, 64.15 MB, 82.86 MB, 192.97 MB, 193.65 MB, 193.72 MB, 193.78 MB, 193.70 MB, 193.70 MB, 193.68 MB, 193.64 MB, 189.72 MB, 138.11 MB, 67.08 MB, 82.97 MB, 55.02 MB, 55.10 MB, 35.30 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.06 MB (203484856) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 194.703ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s110ms - TotalStorageWaitTime: 316.156ms CodeGen:(Total: 592.508ms, non-child: 592.508ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 393.514ms - PrepareTime: 180.050ms DataStreamSender (dst_id=14):(Total: 33s636ms, non-child: 33s636ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1111576102) - NetworkThroughput(*): 7.17 MB/sec - OverallThroughput: 31.52 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s942ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=5):(Total: 691.000ms, non-child: 691.000ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 81.10 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 162.20 MB, 172.47 MB, 254.60 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 326.47 MB, 336.74 MB, 357.28 MB, 367.54 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.47 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s591ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 77.10 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.19K (7190) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 180.969ms - ScannerThreadsUserTime: 17s343ms - ScannerThreadsVoluntaryContextSwitches: 51.95K (51947) - TotalRawHdfsReadTime(*): 237.767ms - TotalReadThroughput: 10.65 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214704 (host=vb0232.halxg.cloudera.com:22000):(Total: 34s130ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.10 MB, 192.13 MB, 192.13 MB, 192.13 MB, 192.13 MB, 192.13 MB, 192.13 MB, 192.13 MB, 192.90 MB, 193.78 MB, 193.62 MB, 193.62 MB, 193.73 MB, 193.65 MB, 193.70 MB, 193.70 MB, 193.70 MB, 98.53 MB, 67.04 MB, 127.01 MB, 193.68 MB, 193.77 MB, 193.72 MB, 193.67 MB, 193.60 MB, 193.71 MB, 193.64 MB, 193.76 MB, 193.76 MB, 94.47 MB, 67.10 MB, 65.51 MB, 55.05 MB, 55.12 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.13 MB (203558632) - PerHostPeakMemUsage: 3.88 GB (4169855184) - PrepareTime: 193.384ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s620ms - TotalStorageWaitTime: 447.188ms CodeGen:(Total: 660.106ms, non-child: 660.106ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.086ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 458.184ms - PrepareTime: 178.447ms DataStreamSender (dst_id=14):(Total: 33s502ms, non-child: 33s502ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1102803495) - NetworkThroughput(*): 7.97 MB/sec - OverallThroughput: 31.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s056ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=5):(Total: 749.225ms, non-child: 749.225ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:98.53% 1:1.471% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 240.18 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.06 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s584ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 71.50 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.90K (7901) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 256.956ms - ScannerThreadsUserTime: 18s845ms - ScannerThreadsVoluntaryContextSwitches: 51.79K (51786) - TotalRawHdfsReadTime(*): 293.697ms - TotalReadThroughput: 10.71 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214702 (host=vb0204.halxg.cloudera.com:22000):(Total: 34s101ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 34.00 KB, 170.37 MB, 170.37 MB, 170.37 MB, 170.37 MB, 170.37 MB, 170.37 MB, 170.37 MB, 170.34 MB, 170.38 MB, 170.65 MB, 170.61 MB, 170.55 MB, 170.60 MB, 170.67 MB, 170.55 MB, 127.04 MB, 59.80 MB, 113.42 MB, 170.65 MB, 170.58 MB, 170.74 MB, 170.49 MB, 170.75 MB, 170.67 MB, 170.48 MB, 170.60 MB, 142.61 MB, 59.70 MB, 81.68 MB, 78.25 MB, 78.19 MB, 78.21 MB, 30.71 MB ThreadUsage(1s000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4, 4, 4, 4 - AverageThreadTokens: 7.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 173.59 MB (182025728) - PerHostPeakMemUsage: 3.86 GB (4146528336) - PrepareTime: 203.850ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 3m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s049ms - TotalStorageWaitTime: 351.833ms CodeGen:(Total: 529.452ms, non-child: 529.452ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.346ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 322.814ms - PrepareTime: 192.001ms DataStreamSender (dst_id=14):(Total: 33s502ms, non-child: 33s502ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1119792497) - NetworkThroughput(*): 7.58 MB/sec - OverallThroughput: 31.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s475ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=5):(Total: 707.701ms, non-child: 707.701ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:97.01% 1:2.985% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 71.86 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 281.25 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 342.85 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 6.46 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s478ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 173.15 MB (181558784) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 71.51 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.13K (7128) - ScannerThreadsTotalWallClockTime: 3m37s - MaterializeTupleTime(*): 3m35s - ScannerThreadsSysTime: 253.957ms - ScannerThreadsUserTime: 16s458ms - ScannerThreadsVoluntaryContextSwitches: 49.47K (49469) - TotalRawHdfsReadTime(*): 256.151ms - TotalReadThroughput: 10.27 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e2146ff (host=vb0214.halxg.cloudera.com:22000):(Total: 34s025ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(1s000ms): 24.81 MB, 190.68 MB, 190.68 MB, 190.68 MB, 190.68 MB, 190.68 MB, 190.68 MB, 190.68 MB, 190.69 MB, 191.75 MB, 191.81 MB, 191.74 MB, 191.56 MB, 191.62 MB, 191.65 MB, 191.82 MB, 191.71 MB, 159.75 MB, 65.01 MB, 74.02 MB, 153.99 MB, 193.71 MB, 193.62 MB, 193.59 MB, 193.70 MB, 193.57 MB, 193.73 MB, 193.68 MB, 193.72 MB, 181.72 MB, 94.58 MB, 67.15 MB, 79.39 MB, 31.94 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 2 - AverageThreadTokens: 8.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.98 MB (204453064) - PerHostPeakMemUsage: 3.86 GB (4142989040) - PrepareTime: 195.406ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s062ms - TotalStorageWaitTime: 464.777ms CodeGen:(Total: 551.278ms, non-child: 551.278ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 350.563ms - PrepareTime: 180.578ms DataStreamSender (dst_id=14):(Total: 33s377ms, non-child: 33s377ms, % non-child: 100.00%) - BytesSent: 1019.22 MB (1068731295) - NetworkThroughput(*): 7.36 MB/sec - OverallThroughput: 30.54 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s849ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=5):(Total: 759.205ms, non-child: 759.205ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:98.53% 1:0% 2:0% 3:0% 4:0% 5:1.471% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 85.70 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 162.72 MB, 203.78 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 326.96 MB, 337.23 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 7.68 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s410ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.55 MB (204002504) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 66.37 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.05K (8048) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 4m16s - ScannerThreadsSysTime: 266.955ms - ScannerThreadsUserTime: 17s708ms - ScannerThreadsVoluntaryContextSwitches: 47.56K (47565) - TotalRawHdfsReadTime(*): 268.189ms - TotalReadThroughput: 10.22 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21470b (host=vb0218.halxg.cloudera.com:22000):(Total: 32s631ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 95.84 MB, 193.33 MB, 193.33 MB, 193.33 MB, 193.33 MB, 193.33 MB, 193.33 MB, 193.33 MB, 193.57 MB, 193.71 MB, 193.76 MB, 193.76 MB, 193.79 MB, 193.69 MB, 193.71 MB, 193.75 MB, 193.88 MB, 122.49 MB, 67.19 MB, 74.90 MB, 193.61 MB, 193.64 MB, 193.52 MB, 193.61 MB, 193.67 MB, 193.64 MB, 193.78 MB, 193.66 MB, 193.70 MB, 114.39 MB, 67.06 MB, 67.07 MB, 31.93 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 8.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.41 MB (203849544) - PerHostPeakMemUsage: 3.69 GB (3964974904) - PrepareTime: 193.101ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s505ms - TotalStorageWaitTime: 275.436ms CodeGen:(Total: 561.352ms, non-child: 561.352ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.788ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 365.004ms - PrepareTime: 180.450ms DataStreamSender (dst_id=14):(Total: 32s037ms, non-child: 32s037ms, % non-child: 100.00%) - BytesSent: 1000.36 MB (1048954933) - NetworkThroughput(*): 7.69 MB/sec - OverallThroughput: 31.22 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s291ms - ThriftTransmitTime(*): 2m10s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=5):(Total: 712.648ms, non-child: 712.648ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 174.52 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.78 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s371ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.98 MB (203407176) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 71.03 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.21K (7215) - ScannerThreadsTotalWallClockTime: 4m11s - MaterializeTupleTime(*): 4m10s - ScannerThreadsSysTime: 220.962ms - ScannerThreadsUserTime: 16s692ms - ScannerThreadsVoluntaryContextSwitches: 48.09K (48087) - TotalRawHdfsReadTime(*): 217.827ms - TotalReadThroughput: 10.58 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214707 (host=vb0220.halxg.cloudera.com:22000):(Total: 32s002ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(1s000ms): 34.00 KB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.80 MB, 193.70 MB, 193.64 MB, 193.68 MB, 193.70 MB, 193.60 MB, 193.77 MB, 193.73 MB, 193.79 MB, 130.14 MB, 67.21 MB, 67.18 MB, 193.41 MB, 193.58 MB, 193.70 MB, 193.67 MB, 193.61 MB, 193.70 MB, 193.68 MB, 193.69 MB, 193.63 MB, 185.74 MB, 86.68 MB, 67.14 MB, 38.17 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5 - AverageThreadTokens: 8.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.10 MB (203525904) - PerHostPeakMemUsage: 3.67 GB (3944902432) - PrepareTime: 196.307ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s316ms - TotalStorageWaitTime: 418.992ms CodeGen:(Total: 580.569ms, non-child: 580.569ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.456ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.888ms - PrepareTime: 181.794ms DataStreamSender (dst_id=14):(Total: 31s403ms, non-child: 31s403ms, % non-child: 100.00%) - BytesSent: 979.80 MB (1027398577) - NetworkThroughput(*): 6.79 MB/sec - OverallThroughput: 31.20 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s652ms - ThriftTransmitTime(*): 2m24s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=5):(Total: 709.558ms, non-child: 709.558ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 246.42 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.88 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s237ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 67.13 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 7.11K (7110) - ScannerThreadsTotalWallClockTime: 4m14s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 192.967ms - ScannerThreadsUserTime: 15s428ms - ScannerThreadsVoluntaryContextSwitches: 46.58K (46576) - TotalRawHdfsReadTime(*): 230.287ms - TotalReadThroughput: 10.11 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214705 (host=vb0216.halxg.cloudera.com:22000):(Total: 31s702ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(1s000ms): 96.87 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.68 MB, 193.71 MB, 193.64 MB, 193.68 MB, 193.66 MB, 193.77 MB, 193.73 MB, 193.62 MB, 193.73 MB, 193.78 MB, 102.50 MB, 67.16 MB, 124.35 MB, 193.74 MB, 193.62 MB, 193.68 MB, 193.75 MB, 193.77 MB, 193.80 MB, 193.76 MB, 193.71 MB, 193.70 MB, 110.42 MB, 67.08 MB, 67.18 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.06 MB (204533288) - PerHostPeakMemUsage: 3.69 GB (3959164656) - PrepareTime: 190.450ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s774ms - TotalStorageWaitTime: 306.788ms CodeGen:(Total: 524.021ms, non-child: 524.021ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.441ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 330.646ms - PrepareTime: 177.528ms DataStreamSender (dst_id=14):(Total: 31s176ms, non-child: 31s176ms, % non-child: 100.00%) - BytesSent: 980.53 MB (1028163655) - NetworkThroughput(*): 6.45 MB/sec - OverallThroughput: 31.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s742ms - ThriftTransmitTime(*): 2m32s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=5):(Total: 655.973ms, non-child: 655.973ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:98.41% 1:1.587% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 236.18 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s231ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.68 MB (204140072) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 72.64 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.32K (6318) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 4m11s - ScannerThreadsSysTime: 177.970ms - ScannerThreadsUserTime: 15s704ms - ScannerThreadsVoluntaryContextSwitches: 46.55K (46554) - TotalRawHdfsReadTime(*): 238.774ms - TotalReadThroughput: 10.27 MB/sec Fragment F02: Instance ad4f3ef268d8fe31:65d07fc04e21470c (host=vb0208.halxg.cloudera.com:22000):(Total: 38s818ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 74.25 MB, 164.29 MB, 292.29 MB, 420.30 MB, 548.33 MB, 676.29 MB, 772.25 MB, 996.25 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 680.03 MB, 534.33 MB, 340.07 MB, 194.40 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071943168) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 201.052ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 35s943ms - TotalNetworkReceiveTime: 10s985ms - TotalNetworkSendTime: 101.991ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 713.645ms, non-child: 713.645ms, % non-child: 100.00%) - CodegenTime: 1.541ms - CompileTime: 60.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 456.610ms - PrepareTime: 184.441ms DataStreamSender (dst_id=12):(Total: 3s951ms, non-child: 3s951ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139859486) - NetworkThroughput(*): 53.24 MB/sec - OverallThroughput: 33.76 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 746.157ms - ThriftTransmitTime(*): 2s505ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=4):(Total: 34s846ms, non-child: 9s549ms, % non-child: 27.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 893.807us - GetResultsTime: 468.121ms - HTResizeTime: 1s093ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 381.30 K/sec - StreamingTime: 8s759ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s297ms, non-child: 12s508ms, % non-child: 49.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s143ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s650ms - GetNewBlockTime: 1.273ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s968ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.04 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.729us EXCHANGE_NODE (id=11):(Total: 4s278ms, non-child: 557.740ms, % non-child: 13.04%) BytesReceived(1s000ms): 2.92 MB, 56.00 MB, 124.12 MB, 185.54 MB, 252.19 MB, 291.25 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB - BytesReceived: 297.65 MB (312107042) - ConvertRowBatchTime: 264.887ms - DeserializeRowBatchTimer: 1s043ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 3.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s511ms, non-child: 2s780ms, % non-child: 32.67%) BytesReceived(1s000ms): 2.73 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 49.69 MB, 98.38 MB, 144.18 MB, 188.51 MB, 233.09 MB, 273.37 MB, 322.64 MB, 366.44 MB, 417.74 MB, 465.56 MB, 499.77 MB, 535.00 MB, 579.38 MB, 621.28 MB, 654.87 MB, 688.69 MB, 730.24 MB, 780.89 MB, 828.10 MB, 872.12 MB, 908.91 MB, 943.50 MB, 979.09 MB, 1007.64 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1107989582) - ConvertRowBatchTime: 1s360ms - DeserializeRowBatchTimer: 5s344ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 7s558ms - SendersBlockedTotalTimer(*): 1m45s Instance ad4f3ef268d8fe31:65d07fc04e21470d (host=vb0230.halxg.cloudera.com:22000):(Total: 38s750ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 6.98 MB, 164.36 MB, 292.47 MB, 420.38 MB, 548.31 MB, 676.29 MB, 756.25 MB, 996.25 MB, 1.14 GB, 1.23 GB, 1.31 GB, 1.34 GB, 1.34 GB, 1.35 GB, 1.41 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.89 GB, 728.58 MB, 534.32 MB, 340.07 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070944768) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 196.678ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 37s073ms - TotalNetworkReceiveTime: 9s815ms - TotalNetworkSendTime: 90.153ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 724.664ms, non-child: 724.664ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 59.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 473.443ms - PrepareTime: 181.299ms DataStreamSender (dst_id=12):(Total: 3s891ms, non-child: 3s891ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139929373) - NetworkThroughput(*): 60.92 MB/sec - OverallThroughput: 34.29 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 762.576ms - ThriftTransmitTime(*): 2s190ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=4):(Total: 34s842ms, non-child: 9s669ms, % non-child: 27.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 784.670us - GetResultsTime: 475.507ms - HTResizeTime: 1s059ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 381.53 K/sec - StreamingTime: 8s883ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s172ms, non-child: 13s288ms, % non-child: 52.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s850ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s695ms - GetNewBlockTime: 2.028ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s999ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.05 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.627us EXCHANGE_NODE (id=11):(Total: 3s552ms, non-child: 1s412ms, % non-child: 39.76%) BytesReceived(1s000ms): 1.19 MB, 51.25 MB, 119.38 MB, 182.00 MB, 248.13 MB, 290.01 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB, 297.78 MB - BytesReceived: 297.78 MB (312248357) - ConvertRowBatchTime: 427.639ms - DeserializeRowBatchTimer: 1s881ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 3.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s332ms, non-child: 3s323ms, % non-child: 39.89%) BytesReceived(1s000ms): 1.21 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.14 MB, 45.27 MB, 97.43 MB, 140.27 MB, 186.10 MB, 230.15 MB, 269.59 MB, 319.27 MB, 363.76 MB, 413.64 MB, 462.79 MB, 498.48 MB, 532.46 MB, 576.03 MB, 619.37 MB, 653.16 MB, 686.69 MB, 727.39 MB, 777.92 MB, 826.02 MB, 870.13 MB, 906.88 MB, 941.92 MB, 977.58 MB, 1006.84 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108775994) - ConvertRowBatchTime: 1s427ms - DeserializeRowBatchTimer: 5s814ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 6.20 M/sec - SendersBlockedTimer: 8s927ms - SendersBlockedTotalTimer(*): 1m46s Instance ad4f3ef268d8fe31:65d07fc04e214716 (host=vb0220.halxg.cloudera.com:22000):(Total: 38s616ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 720.50 KB, 164.29 MB, 292.29 MB, 420.28 MB, 548.32 MB, 612.34 MB, 724.27 MB, 948.25 MB, 1.11 GB, 1.23 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.41 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.89 GB, 728.58 MB, 534.32 MB, 364.35 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069715968) - PerHostPeakMemUsage: 3.83 GB (4107731200) - PrepareTime: 200.773ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 36s804ms - TotalNetworkReceiveTime: 10s000ms - TotalNetworkSendTime: 60.611ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 707.554ms, non-child: 707.554ms, % non-child: 100.00%) - CodegenTime: 3.315ms - CompileTime: 60.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 454.008ms - PrepareTime: 179.149ms DataStreamSender (dst_id=12):(Total: 3s768ms, non-child: 3s768ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139866954) - NetworkThroughput(*): 57.96 MB/sec - OverallThroughput: 35.39 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 763.925ms - ThriftTransmitTime(*): 2s301ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=4):(Total: 34s821ms, non-child: 10s065ms, % non-child: 28.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.277ms - GetResultsTime: 448.537ms - HTResizeTime: 1s038ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 381.61 K/sec - StreamingTime: 9s298ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s756ms, non-child: 12s893ms, % non-child: 52.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s206ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s730ms - GetNewBlockTime: 1.817ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s235ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.827us EXCHANGE_NODE (id=11):(Total: 4s207ms, non-child: 584.148ms, % non-child: 13.88%) BytesReceived(1s000ms): 11.80 MB, 74.46 MB, 143.28 MB, 204.60 MB, 266.93 MB, 294.47 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB, 297.69 MB - BytesReceived: 297.69 MB (312153074) - ConvertRowBatchTime: 282.109ms - DeserializeRowBatchTimer: 1s063ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 3.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s655ms, non-child: 3s322ms, % non-child: 43.39%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 15.05 MB, 66.12 MB, 113.85 MB, 154.62 MB, 201.00 MB, 242.96 MB, 286.41 MB, 336.23 MB, 379.97 MB, 432.16 MB, 475.82 MB, 507.32 MB, 546.05 MB, 593.12 MB, 630.87 MB, 664.33 MB, 698.31 MB, 743.20 MB, 795.11 MB, 840.99 MB, 883.19 MB, 918.46 MB, 953.62 MB, 988.89 MB, 1013.17 MB, 1.02 GB - BytesReceived: 1.03 GB (1108141611) - ConvertRowBatchTime: 1s385ms - DeserializeRowBatchTimer: 5s988ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 6.74 M/sec - SendersBlockedTimer: 8s770ms - SendersBlockedTotalTimer(*): 1m36s Instance ad4f3ef268d8fe31:65d07fc04e214719 (host=vb0222.halxg.cloudera.com:22000):(Total: 38s519ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 11.39 MB, 164.30 MB, 292.30 MB, 420.31 MB, 548.35 MB, 676.31 MB, 772.25 MB, 1012.25 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 728.57 MB, 534.33 MB, 340.09 MB, 145.82 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071149568) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 197.280ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 36s260ms - TotalNetworkReceiveTime: 10s423ms - TotalNetworkSendTime: 35.753ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 688.689ms, non-child: 688.689ms, % non-child: 100.00%) - CodegenTime: 893.242us - CompileTime: 55.586ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 439.150ms - PrepareTime: 182.373ms DataStreamSender (dst_id=12):(Total: 3s580ms, non-child: 3s580ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139864254) - NetworkThroughput(*): 56.70 MB/sec - OverallThroughput: 37.25 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 721.546ms - ThriftTransmitTime(*): 2s352ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=4):(Total: 34s923ms, non-child: 9s379ms, % non-child: 26.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 929.755us - GetResultsTime: 467.061ms - HTResizeTime: 1s226ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 380.52 K/sec - StreamingTime: 8s559ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s544ms, non-child: 13s242ms, % non-child: 51.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s765ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s742ms - GetNewBlockTime: 2.375ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s100ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.665us EXCHANGE_NODE (id=11):(Total: 3s687ms, non-child: 718.359ms, % non-child: 19.48%) BytesReceived(1s000ms): 2.03 MB, 53.71 MB, 121.85 MB, 183.32 MB, 250.28 MB, 290.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB - BytesReceived: 297.70 MB (312156267) - ConvertRowBatchTime: 357.911ms - DeserializeRowBatchTimer: 1s156ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s613ms, non-child: 2s730ms, % non-child: 31.70%) BytesReceived(1s000ms): 2.00 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.12 MB, 47.60 MB, 97.89 MB, 142.09 MB, 187.52 MB, 231.84 MB, 271.70 MB, 321.08 MB, 365.26 MB, 415.79 MB, 464.26 MB, 499.09 MB, 533.76 MB, 577.83 MB, 620.31 MB, 653.94 MB, 687.58 MB, 728.69 MB, 779.33 MB, 827.04 MB, 871.24 MB, 908.11 MB, 942.68 MB, 978.45 MB, 1007.24 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108377815) - ConvertRowBatchTime: 1s333ms - DeserializeRowBatchTimer: 5s418ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.99 M/sec - SendersBlockedTimer: 7s614ms - SendersBlockedTotalTimer(*): 1m8s Instance ad4f3ef268d8fe31:65d07fc04e214718 (host=vb0224.halxg.cloudera.com:22000):(Total: 38s393ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.07 MB, 164.34 MB, 292.34 MB, 420.35 MB, 548.34 MB, 612.30 MB, 724.28 MB, 900.28 MB, 1.10 GB, 1.22 GB, 1.30 GB, 1.34 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.80 GB, 1.89 GB, 1.89 GB, 728.58 MB, 534.32 MB, 340.08 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068563968) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 203.502ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 36s052ms - TotalNetworkReceiveTime: 10s715ms - TotalNetworkSendTime: 88.473ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 716.631ms, non-child: 716.631ms, % non-child: 100.00%) - CodegenTime: 2.289ms - CompileTime: 70.338ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 455.152ms - PrepareTime: 178.107ms DataStreamSender (dst_id=12):(Total: 3s538ms, non-child: 3s538ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139837214) - NetworkThroughput(*): 61.97 MB/sec - OverallThroughput: 37.69 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 769.795ms - ThriftTransmitTime(*): 2s152ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=4):(Total: 34s828ms, non-child: 8s945ms, % non-child: 25.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.369ms - GetResultsTime: 458.744ms - HTResizeTime: 1s086ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 381.44 K/sec - StreamingTime: 8s169ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s882ms, non-child: 13s383ms, % non-child: 51.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s198ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s899ms - GetNewBlockTime: 983.918us - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s516ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 1.99 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.409us EXCHANGE_NODE (id=11):(Total: 4s210ms, non-child: 550.079ms, % non-child: 13.06%) BytesReceived(1s000ms): 13.06 MB, 76.82 MB, 145.68 MB, 206.97 MB, 268.62 MB, 294.67 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB - BytesReceived: 297.56 MB (312010150) - ConvertRowBatchTime: 265.349ms - DeserializeRowBatchTimer: 1s011ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s288ms, non-child: 2s908ms, % non-child: 35.10%) BytesReceived(1s000ms): 5.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 16.17 MB, 68.34 MB, 116.05 MB, 156.86 MB, 202.62 MB, 243.81 MB, 288.15 MB, 337.53 MB, 381.98 MB, 433.74 MB, 477.14 MB, 508.91 MB, 547.55 MB, 594.43 MB, 632.14 MB, 665.38 MB, 699.70 MB, 745.05 MB, 797.14 MB, 842.62 MB, 884.41 MB, 919.66 MB, 954.90 MB, 990.15 MB, 1014.16 MB, 1.02 GB - BytesReceived: 1.03 GB (1108219119) - ConvertRowBatchTime: 1s339ms - DeserializeRowBatchTimer: 5s539ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 6.23 M/sec - SendersBlockedTimer: 7s830ms - SendersBlockedTotalTimer(*): 1m49s Instance ad4f3ef268d8fe31:65d07fc04e214715 (host=vb0206.halxg.cloudera.com:22000):(Total: 38s355ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 6.96 MB, 164.32 MB, 292.29 MB, 420.27 MB, 548.32 MB, 676.28 MB, 740.25 MB, 916.25 MB, 1.08 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 680.02 MB, 534.32 MB, 340.08 MB, 97.28 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071200768) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 190.939ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 36s639ms - TotalNetworkReceiveTime: 10s332ms - TotalNetworkSendTime: 71.903ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 700.895ms, non-child: 700.895ms, % non-child: 100.00%) - CodegenTime: 878.980us - CompileTime: 55.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 458.218ms - PrepareTime: 182.844ms DataStreamSender (dst_id=12):(Total: 3s441ms, non-child: 3s441ms, % non-child: 100.00%) - BytesSent: 133.43 MB (139908579) - NetworkThroughput(*): 60.98 MB/sec - OverallThroughput: 38.77 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 747.740ms - ThriftTransmitTime(*): 2s188ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=4):(Total: 34s892ms, non-child: 9s183ms, % non-child: 26.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 674.524us - GetResultsTime: 500.293ms - HTResizeTime: 1s076ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 380.93 K/sec - StreamingTime: 8s378ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s708ms, non-child: 13s536ms, % non-child: 52.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s383ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 2s154ms - GetNewBlockTime: 1.666ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s298ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.01 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.015us EXCHANGE_NODE (id=11):(Total: 4s053ms, non-child: 604.534ms, % non-child: 14.91%) BytesReceived(1s000ms): 1.17 MB, 51.20 MB, 119.29 MB, 181.90 MB, 247.97 MB, 289.90 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB - BytesReceived: 297.72 MB (312186971) - ConvertRowBatchTime: 282.257ms - DeserializeRowBatchTimer: 1s078ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 3.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s118ms, non-child: 2s779ms, % non-child: 34.24%) BytesReceived(1s000ms): 1.19 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 45.48 MB, 97.75 MB, 140.66 MB, 186.72 MB, 230.70 MB, 270.15 MB, 319.61 MB, 363.99 MB, 413.84 MB, 463.01 MB, 498.72 MB, 532.64 MB, 576.02 MB, 619.19 MB, 652.90 MB, 686.49 MB, 727.12 MB, 777.69 MB, 825.79 MB, 869.95 MB, 906.73 MB, 941.78 MB, 977.48 MB, 1006.81 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108661603) - ConvertRowBatchTime: 1s358ms - DeserializeRowBatchTimer: 5s145ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 6.36 M/sec - SendersBlockedTimer: 8s025ms - SendersBlockedTotalTimer(*): 2m Instance ad4f3ef268d8fe31:65d07fc04e214710 (host=vb0234.halxg.cloudera.com:22000):(Total: 38s315ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 708.00 KB, 164.33 MB, 292.29 MB, 420.31 MB, 548.36 MB, 612.28 MB, 724.26 MB, 916.25 MB, 1.11 GB, 1.22 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.52 GB, 1.52 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.60 GB, 1.66 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.89 GB, 728.58 MB, 534.33 MB, 340.09 MB, 145.81 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072839168) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 194.244ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 36s745ms - TotalNetworkReceiveTime: 9s767ms - TotalNetworkSendTime: 112.878ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 760.604ms, non-child: 760.604ms, % non-child: 100.00%) - CodegenTime: 832.778us - CompileTime: 46.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 523.020ms - PrepareTime: 179.773ms DataStreamSender (dst_id=12):(Total: 3s492ms, non-child: 3s492ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139943736) - NetworkThroughput(*): 53.93 MB/sec - OverallThroughput: 38.21 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 763.160ms - ThriftTransmitTime(*): 2s474ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=4):(Total: 34s801ms, non-child: 8s630ms, % non-child: 24.80%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.355ms - GetResultsTime: 478.238ms - HTResizeTime: 1s084ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 382.06 K/sec - StreamingTime: 7s841ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s171ms, non-child: 14s440ms, % non-child: 55.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s075ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s730ms - GetNewBlockTime: 1.795ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s868ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 1.97 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.582us EXCHANGE_NODE (id=11):(Total: 3s287ms, non-child: 868.445ms, % non-child: 26.42%) BytesReceived(1s000ms): 11.69 MB, 74.25 MB, 143.07 MB, 204.47 MB, 266.93 MB, 294.61 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312347076) - ConvertRowBatchTime: 450.807ms - DeserializeRowBatchTimer: 1s193ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 4.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s443ms, non-child: 3s185ms, % non-child: 37.73%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 14.94 MB, 65.89 MB, 113.58 MB, 154.40 MB, 200.87 MB, 242.96 MB, 286.48 MB, 336.47 MB, 380.28 MB, 432.47 MB, 476.26 MB, 507.71 MB, 546.37 MB, 593.34 MB, 631.19 MB, 664.62 MB, 698.68 MB, 743.56 MB, 795.51 MB, 841.53 MB, 883.79 MB, 918.94 MB, 954.10 MB, 989.46 MB, 1013.83 MB, 1.02 GB - BytesReceived: 1.03 GB (1108950813) - ConvertRowBatchTime: 1s311ms - DeserializeRowBatchTimer: 5s399ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 6.12 M/sec - SendersBlockedTimer: 11s844ms - SendersBlockedTotalTimer(*): 2m20s Instance ad4f3ef268d8fe31:65d07fc04e214714 (host=vb0216.halxg.cloudera.com:22000):(Total: 38s278ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.85 MB, 228.30 MB, 356.32 MB, 468.29 MB, 548.31 MB, 676.28 MB, 788.25 MB, 1012.25 MB, 1.15 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.40 GB, 1.41 GB, 1.42 GB, 1.40 GB, 1.39 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.87 GB, 1.89 GB, 1.33 GB, 655.73 MB, 437.20 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070970368) - PerHostPeakMemUsage: 3.83 GB (4109472000) - PrepareTime: 195.424ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 35s748ms - TotalNetworkReceiveTime: 10s771ms - TotalNetworkSendTime: 35.541ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 650.244ms, non-child: 650.244ms, % non-child: 100.00%) - CodegenTime: 895.383us - CompileTime: 55.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 404.278ms - PrepareTime: 178.191ms DataStreamSender (dst_id=12):(Total: 3s362ms, non-child: 3s362ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139869402) - NetworkThroughput(*): 77.32 MB/sec - OverallThroughput: 39.67 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 729.476ms - ThriftTransmitTime(*): 1s725ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=4):(Total: 34s887ms, non-child: 9s117ms, % non-child: 26.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.221ms - GetResultsTime: 458.609ms - HTResizeTime: 1s080ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 380.91 K/sec - StreamingTime: 8s348ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s769ms, non-child: 13s219ms, % non-child: 51.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s294ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s706ms - GetNewBlockTime: 1.080ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s460ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.052us EXCHANGE_NODE (id=11):(Total: 4s182ms, non-child: 549.923ms, % non-child: 13.15%) BytesReceived(1s000ms): 7.60 MB, 66.05 MB, 134.88 MB, 196.03 MB, 260.46 MB, 293.23 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB, 297.66 MB - BytesReceived: 297.66 MB (312123650) - ConvertRowBatchTime: 269.501ms - DeserializeRowBatchTimer: 1s021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s368ms, non-child: 3s213ms, % non-child: 38.40%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 11.47 MB, 59.09 MB, 106.19 MB, 149.95 MB, 195.54 MB, 239.33 MB, 280.44 MB, 330.89 MB, 373.14 MB, 426.40 MB, 471.72 MB, 504.36 MB, 541.17 MB, 587.39 MB, 626.92 MB, 660.43 MB, 694.16 MB, 737.62 MB, 788.68 MB, 835.63 MB, 878.42 MB, 914.54 MB, 949.62 MB, 984.74 MB, 1010.24 MB, 1.02 GB - BytesReceived: 1.03 GB (1108201588) - ConvertRowBatchTime: 1s330ms - DeserializeRowBatchTimer: 5s934ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 6.17 M/sec - SendersBlockedTimer: 9s158ms - SendersBlockedTotalTimer(*): 1m32s Instance ad4f3ef268d8fe31:65d07fc04e214713 (host=vb0232.halxg.cloudera.com:22000):(Total: 38s251ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 86.95 MB, 228.32 MB, 356.35 MB, 420.32 MB, 548.34 MB, 676.31 MB, 788.28 MB, 996.28 MB, 1.15 GB, 1.24 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.87 GB, 1.89 GB, 1.33 GB, 631.45 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2073453568) - PerHostPeakMemUsage: 3.88 GB (4169855184) - PrepareTime: 219.153ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 36s313ms - TotalNetworkReceiveTime: 10s190ms - TotalNetworkSendTime: 49.317ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 804.402ms, non-child: 804.402ms, % non-child: 100.00%) - CodegenTime: 830.260us - CompileTime: 50.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 538.423ms - PrepareTime: 199.891ms DataStreamSender (dst_id=12):(Total: 3s471ms, non-child: 3s471ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139933558) - NetworkThroughput(*): 62.47 MB/sec - OverallThroughput: 38.44 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 767.903ms - ThriftTransmitTime(*): 2s136ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=4):(Total: 34s764ms, non-child: 8s854ms, % non-child: 25.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 522.706us - GetResultsTime: 449.756ms - HTResizeTime: 1s105ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 382.42 K/sec - StreamingTime: 8s088ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s909ms, non-child: 13s915ms, % non-child: 53.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s060ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s693ms - GetNewBlockTime: 1.718ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s359ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 1.99 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.560us EXCHANGE_NODE (id=11):(Total: 3s271ms, non-child: 814.978ms, % non-child: 24.91%) BytesReceived(1s000ms): 7.16 MB, 65.20 MB, 134.05 MB, 195.21 MB, 259.86 MB, 293.27 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB, 297.83 MB - BytesReceived: 297.83 MB (312292813) - ConvertRowBatchTime: 397.743ms - DeserializeRowBatchTimer: 1s316ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 4.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s722ms, non-child: 2s540ms, % non-child: 29.13%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 11.11 MB, 58.54 MB, 105.37 MB, 150.07 MB, 195.36 MB, 238.81 MB, 279.93 MB, 330.34 MB, 372.70 MB, 426.05 MB, 471.36 MB, 503.96 MB, 540.96 MB, 587.07 MB, 626.83 MB, 660.33 MB, 694.10 MB, 737.59 MB, 788.49 MB, 835.52 MB, 878.39 MB, 914.59 MB, 949.75 MB, 984.84 MB, 1010.75 MB, 1.02 GB - BytesReceived: 1.03 GB (1108903202) - ConvertRowBatchTime: 1s219ms - DeserializeRowBatchTimer: 5s199ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 5.92 M/sec - SendersBlockedTimer: 7s685ms - SendersBlockedTotalTimer(*): 1m24s Instance ad4f3ef268d8fe31:65d07fc04e214717 (host=vb0228.halxg.cloudera.com:22000):(Total: 38s219ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 9.04 MB, 164.63 MB, 293.50 MB, 420.36 MB, 548.35 MB, 676.31 MB, 756.28 MB, 948.28 MB, 1.13 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 680.02 MB, 485.78 MB, 291.52 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070842368) - PerHostPeakMemUsage: 3.90 GB (4182707160) - PrepareTime: 195.451ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 37s136ms - TotalNetworkReceiveTime: 9s513ms - TotalNetworkSendTime: 57.702ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 705.820ms, non-child: 705.820ms, % non-child: 100.00%) - CodegenTime: 902.431us - CompileTime: 68.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 444.873ms - PrepareTime: 180.602ms DataStreamSender (dst_id=12):(Total: 3s348ms, non-child: 3s348ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139890940) - NetworkThroughput(*): 71.49 MB/sec - OverallThroughput: 39.84 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 745.404ms - ThriftTransmitTime(*): 1s866ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=4):(Total: 34s855ms, non-child: 9s261ms, % non-child: 26.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 538.578us - GetResultsTime: 468.399ms - HTResizeTime: 1s124ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 381.30 K/sec - StreamingTime: 8s483ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s593ms, non-child: 14s158ms, % non-child: 55.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s890ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s934ms - GetNewBlockTime: 1.579ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s600ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.090us EXCHANGE_NODE (id=11):(Total: 3s529ms, non-child: 1s335ms, % non-child: 37.84%) BytesReceived(1s000ms): 1.63 MB, 52.53 MB, 120.67 MB, 182.57 MB, 249.20 MB, 290.35 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB, 297.72 MB - BytesReceived: 297.72 MB (312185818) - ConvertRowBatchTime: 423.295ms - DeserializeRowBatchTimer: 1s806ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 3.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s905ms, non-child: 2s601ms, % non-child: 32.91%) BytesReceived(1s000ms): 1.62 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.17 MB, 46.63 MB, 97.93 MB, 141.16 MB, 186.99 MB, 231.24 MB, 270.96 MB, 320.39 MB, 364.71 MB, 414.84 MB, 463.68 MB, 498.90 MB, 533.23 MB, 576.99 MB, 619.76 MB, 653.43 MB, 687.09 MB, 727.96 MB, 778.43 MB, 826.32 MB, 870.65 MB, 907.59 MB, 942.19 MB, 978.02 MB, 1006.98 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108505996) - ConvertRowBatchTime: 1s305ms - DeserializeRowBatchTimer: 5s084ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 6.53 M/sec - SendersBlockedTimer: 7s833ms - SendersBlockedTotalTimer(*): 1m49s Instance ad4f3ef268d8fe31:65d07fc04e21470e (host=vb0214.halxg.cloudera.com:22000):(Total: 38s149ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.56 MB, 164.35 MB, 292.30 MB, 421.33 MB, 548.70 MB, 612.29 MB, 740.26 MB, 948.25 MB, 1.12 GB, 1.22 GB, 1.30 GB, 1.34 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.80 GB, 1.89 GB, 1.89 GB, 728.56 MB, 485.77 MB, 291.50 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071175168) - PerHostPeakMemUsage: 3.86 GB (4142989040) - PrepareTime: 197.079ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 34s942ms - TotalNetworkReceiveTime: 11s259ms - TotalNetworkSendTime: 173.138ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 656.490ms, non-child: 656.490ms, % non-child: 100.00%) - CodegenTime: 857.796us - CompileTime: 59.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 403.162ms - PrepareTime: 178.134ms DataStreamSender (dst_id=12):(Total: 3s209ms, non-child: 3s209ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139898379) - NetworkThroughput(*): 56.69 MB/sec - OverallThroughput: 41.57 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 768.742ms - ThriftTransmitTime(*): 2s353ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=4):(Total: 34s913ms, non-child: 8s800ms, % non-child: 25.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 631.825us - GetResultsTime: 486.920ms - HTResizeTime: 1s098ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 380.69 K/sec - StreamingTime: 8s014ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s113ms, non-child: 12s966ms, % non-child: 49.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s751ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s736ms - GetNewBlockTime: 1.637ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s800ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 1.98 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.879us EXCHANGE_NODE (id=11):(Total: 3s710ms, non-child: 1s413ms, % non-child: 38.09%) BytesReceived(1s000ms): 13.79 MB, 78.15 MB, 146.97 MB, 208.29 MB, 269.71 MB, 294.96 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB, 297.70 MB - BytesReceived: 297.70 MB (312161528) - ConvertRowBatchTime: 413.412ms - DeserializeRowBatchTimer: 1s902ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 3.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s435ms, non-child: 2s496ms, % non-child: 26.45%) BytesReceived(1s000ms): 5.26 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 16.72 MB, 69.56 MB, 116.85 MB, 158.18 MB, 203.45 MB, 244.83 MB, 289.17 MB, 338.32 MB, 383.24 MB, 434.59 MB, 478.03 MB, 510.26 MB, 548.66 MB, 595.67 MB, 633.29 MB, 666.58 MB, 701.08 MB, 746.70 MB, 798.95 MB, 844.24 MB, 885.87 MB, 921.12 MB, 956.30 MB, 991.49 MB, 1015.25 MB, 1.02 GB - BytesReceived: 1.03 GB (1108795310) - ConvertRowBatchTime: 1s283ms - DeserializeRowBatchTimer: 4s873ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.47 M/sec - SendersBlockedTimer: 7s581ms - SendersBlockedTotalTimer(*): 1m38s Instance ad4f3ef268d8fe31:65d07fc04e214712 (host=vb0226.halxg.cloudera.com:22000):(Total: 38s070ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 80.60 MB, 228.27 MB, 356.29 MB, 420.27 MB, 548.34 MB, 676.29 MB, 804.25 MB, 1.04 GB, 1.15 GB, 1.24 GB, 1.30 GB, 1.34 GB, 1.34 GB, 1.34 GB, 1.40 GB, 1.40 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.65 GB, 1.66 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.81 GB, 1.90 GB, 1.89 GB, 680.02 MB, 437.20 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2073453568) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 199.069ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 36s134ms - TotalNetworkReceiveTime: 9s884ms - TotalNetworkSendTime: 35.512ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 659.288ms, non-child: 659.288ms, % non-child: 100.00%) - CodegenTime: 2.528ms - CompileTime: 62.990ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 403.515ms - PrepareTime: 179.871ms DataStreamSender (dst_id=12):(Total: 3s144ms, non-child: 3s144ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139867259) - NetworkThroughput(*): 77.30 MB/sec - OverallThroughput: 42.42 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 738.468ms - ThriftTransmitTime(*): 1s725ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=4):(Total: 34s907ms, non-child: 9s850ms, % non-child: 28.22%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.601ms - GetResultsTime: 471.694ms - HTResizeTime: 1s003ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 380.62 K/sec - StreamingTime: 9s052ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s057ms, non-child: 13s206ms, % non-child: 52.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s332ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s497ms - GetNewBlockTime: 1.301ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s692ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.06 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.060us EXCHANGE_NODE (id=11):(Total: 4s144ms, non-child: 623.595ms, % non-child: 15.05%) BytesReceived(1s000ms): 4.33 MB, 59.07 MB, 127.71 MB, 189.04 MB, 254.92 MB, 292.01 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB, 297.62 MB - BytesReceived: 297.62 MB (312072910) - ConvertRowBatchTime: 291.947ms - DeserializeRowBatchTimer: 1s133ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 3.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s706ms, non-child: 4s029ms, % non-child: 52.29%) BytesReceived(1s000ms): 4.09 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.13 MB, 52.93 MB, 100.28 MB, 147.50 MB, 191.36 MB, 235.11 MB, 276.01 MB, 325.41 MB, 368.73 MB, 421.11 MB, 467.95 MB, 501.08 MB, 537.25 MB, 582.30 MB, 623.37 MB, 656.93 MB, 690.68 MB, 732.94 MB, 783.80 MB, 830.73 MB, 874.48 MB, 911.00 MB, 945.66 MB, 981.18 MB, 1008.81 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108310635) - ConvertRowBatchTime: 1s463ms - DeserializeRowBatchTimer: 6s415ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 6.70 M/sec - SendersBlockedTimer: 13s809ms - SendersBlockedTotalTimer(*): 2m25s Instance ad4f3ef268d8fe31:65d07fc04e21470f (host=vb0212.halxg.cloudera.com:22000):(Total: 38s039ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 77.81 MB, 172.33 MB, 292.73 MB, 420.28 MB, 548.34 MB, 676.29 MB, 772.25 MB, 1.00 GB, 1.15 GB, 1.23 GB, 1.30 GB, 1.34 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.41 GB, 1.47 GB, 1.54 GB, 1.54 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.83 GB, 1.89 GB, 1.89 GB, 680.03 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070765568) - PerHostPeakMemUsage: 3.86 GB (4145828608) - PrepareTime: 192.333ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 35s585ms - TotalNetworkReceiveTime: 10s434ms - TotalNetworkSendTime: 97.214ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 684.405ms, non-child: 684.405ms, % non-child: 100.00%) - CodegenTime: 884.971us - CompileTime: 73.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 421.791ms - PrepareTime: 177.780ms DataStreamSender (dst_id=12):(Total: 3s129ms, non-child: 3s129ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139816503) - NetworkThroughput(*): 67.61 MB/sec - OverallThroughput: 42.61 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 761.901ms - ThriftTransmitTime(*): 1s972ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=4):(Total: 34s875ms, non-child: 9s411ms, % non-child: 26.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 501.494us - GetResultsTime: 491.498ms - HTResizeTime: 1s127ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 380.86 K/sec - StreamingTime: 8s615ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s463ms, non-child: 13s100ms, % non-child: 51.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s468ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s544ms - GetNewBlockTime: 1.187ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s362ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.688us EXCHANGE_NODE (id=11):(Total: 3s966ms, non-child: 808.184ms, % non-child: 20.37%) BytesReceived(1s000ms): 3.12 MB, 56.59 MB, 124.71 MB, 186.12 MB, 252.61 MB, 291.34 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB, 297.56 MB - BytesReceived: 297.56 MB (312019131) - ConvertRowBatchTime: 351.030ms - DeserializeRowBatchTimer: 1s329ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 3.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s396ms, non-child: 3s657ms, % non-child: 43.56%) BytesReceived(1s000ms): 2.98 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.17 MB, 50.35 MB, 98.87 MB, 144.84 MB, 188.89 MB, 233.50 MB, 273.98 MB, 323.40 MB, 367.08 MB, 418.56 MB, 466.03 MB, 500.02 MB, 535.40 MB, 579.83 MB, 621.68 MB, 655.31 MB, 689.10 MB, 730.74 MB, 781.46 MB, 828.67 MB, 872.66 MB, 909.46 MB, 944.11 MB, 979.67 MB, 1008.02 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108104548) - ConvertRowBatchTime: 1s377ms - DeserializeRowBatchTimer: 6s313ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.15 M/sec - SendersBlockedTimer: 10s749ms - SendersBlockedTotalTimer(*): 2m21s Instance ad4f3ef268d8fe31:65d07fc04e21471a (host=vb0218.halxg.cloudera.com:22000):(Total: 37s989ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.08 MB, 164.35 MB, 292.33 MB, 420.30 MB, 548.31 MB, 676.28 MB, 756.25 MB, 948.25 MB, 1.11 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.40 GB, 1.46 GB, 1.52 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.89 GB, 680.01 MB, 485.77 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070765568) - PerHostPeakMemUsage: 3.83 GB (4111110400) - PrepareTime: 201.763ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 36s320ms - TotalNetworkReceiveTime: 10s073ms - TotalNetworkSendTime: 80.713ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 706.870ms, non-child: 706.870ms, % non-child: 100.00%) - CodegenTime: 1.249ms - CompileTime: 64.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 447.043ms - PrepareTime: 185.022ms DataStreamSender (dst_id=12):(Total: 3s102ms, non-child: 3s102ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139857251) - NetworkThroughput(*): 66.46 MB/sec - OverallThroughput: 42.99 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 772.832ms - ThriftTransmitTime(*): 2s006ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=4):(Total: 34s872ms, non-child: 9s918ms, % non-child: 28.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 550.398us - GetResultsTime: 457.572ms - HTResizeTime: 1s040ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 381.03 K/sec - StreamingTime: 9s126ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s954ms, non-child: 13s129ms, % non-child: 52.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s399ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s908ms - GetNewBlockTime: 1.156ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s061ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.07 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.323us EXCHANGE_NODE (id=11):(Total: 4s034ms, non-child: 611.179ms, % non-child: 15.15%) BytesReceived(1s000ms): 1.42 MB, 51.91 MB, 120.01 MB, 182.25 MB, 248.61 MB, 290.08 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB, 297.65 MB - BytesReceived: 297.65 MB (312104870) - ConvertRowBatchTime: 280.532ms - DeserializeRowBatchTimer: 1s115ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 3.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s790ms, non-child: 2s674ms, % non-child: 34.32%) BytesReceived(1s000ms): 1.43 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.15 MB, 46.08 MB, 98.00 MB, 140.93 MB, 187.08 MB, 231.11 MB, 270.57 MB, 320.10 MB, 364.48 MB, 414.38 MB, 463.24 MB, 498.75 MB, 532.98 MB, 576.51 MB, 619.41 MB, 653.11 MB, 686.75 MB, 727.57 MB, 778.11 MB, 826.13 MB, 870.32 MB, 907.19 MB, 941.94 MB, 977.59 MB, 1006.79 MB, 1.01 GB, 1.03 GB - BytesReceived: 1.03 GB (1108476662) - ConvertRowBatchTime: 1s299ms - DeserializeRowBatchTimer: 5s268ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 6.63 M/sec - SendersBlockedTimer: 7s837ms - SendersBlockedTotalTimer(*): 1m26s Instance ad4f3ef268d8fe31:65d07fc04e214711 (host=vb0204.halxg.cloudera.com:22000):(Total: 37s927ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 833.00 KB, 164.32 MB, 292.32 MB, 420.33 MB, 548.32 MB, 612.32 MB, 724.29 MB, 916.28 MB, 1.10 GB, 1.22 GB, 1.30 GB, 1.34 GB, 1.34 GB, 1.33 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.80 GB, 1.89 GB, 1.89 GB, 728.56 MB, 485.78 MB, 267.23 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071891968) - PerHostPeakMemUsage: 3.86 GB (4146528336) - PrepareTime: 220.774ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 34s621ms - TotalNetworkReceiveTime: 11s652ms - TotalNetworkSendTime: 98.028ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 671.773ms, non-child: 671.773ms, % non-child: 100.00%) - CodegenTime: 2.067ms - CompileTime: 44.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 424.480ms - PrepareTime: 189.899ms DataStreamSender (dst_id=12):(Total: 3s004ms, non-child: 3s004ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139871704) - NetworkThroughput(*): 67.76 MB/sec - OverallThroughput: 44.39 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 770.998ms - ThriftTransmitTime(*): 1s968ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=4):(Total: 34s888ms, non-child: 8s790ms, % non-child: 25.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 8.426ms - GetResultsTime: 481.926ms - HTResizeTime: 1s085ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 380.91 K/sec - StreamingTime: 7s983ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 26s097ms, non-child: 12s690ms, % non-child: 48.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s286ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s906ms - GetNewBlockTime: 1.510ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s744ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 1.98 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.503us EXCHANGE_NODE (id=11):(Total: 4s143ms, non-child: 572.237ms, % non-child: 13.81%) BytesReceived(1s000ms): 12.53 MB, 75.89 MB, 144.69 MB, 205.96 MB, 267.98 MB, 294.66 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB, 297.68 MB - BytesReceived: 297.68 MB (312140841) - ConvertRowBatchTime: 275.403ms - DeserializeRowBatchTimer: 1s032ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 3.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 9s264ms, non-child: 3s196ms, % non-child: 34.51%) BytesReceived(1s000ms): 5.08 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 15.68 MB, 67.41 MB, 115.14 MB, 155.91 MB, 201.93 MB, 243.40 MB, 287.38 MB, 336.85 MB, 381.09 MB, 433.08 MB, 476.52 MB, 507.93 MB, 546.75 MB, 593.79 MB, 631.55 MB, 664.89 MB, 699.00 MB, 744.15 MB, 796.35 MB, 842.05 MB, 884.06 MB, 919.31 MB, 954.51 MB, 989.84 MB, 1013.92 MB, 1.02 GB - BytesReceived: 1.03 GB (1108364221) - ConvertRowBatchTime: 1s294ms - DeserializeRowBatchTimer: 6s084ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 5.57 M/sec - SendersBlockedTimer: 7s833ms - SendersBlockedTotalTimer(*): 1m42s Fragment F01: Instance ad4f3ef268d8fe31:65d07fc04e21471e (host=vb0232.halxg.cloudera.com:22000):(Total: 5s733ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 211.76 MB, 211.90 MB, 212.08 MB, 211.79 MB, 203.87 MB, 151.11 MB, 150.23 MB, 137.11 MB, 113.05 MB, 97.03 MB, 81.37 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.24 MB (222546192) - PerHostPeakMemUsage: 1.89 GB (2034635112) - PrepareTime: 194.570ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 39s327ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 146.027ms - TotalStorageWaitTime: 262.740ms CodeGen:(Total: 590.208ms, non-child: 590.208ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.774ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 386.343ms - PrepareTime: 179.225ms DataStreamSender (dst_id=11):(Total: 5s375ms, non-child: 5s375ms, % non-child: 100.00%) - BytesSent: 345.67 MB (362456728) - NetworkThroughput(*): 52.65 MB/sec - OverallThroughput: 64.31 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s069ms - ThriftTransmitTime(*): 6s565ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=2):(Total: 525.443ms, non-child: 525.443ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.09 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 795.979ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.78 MB (222062864) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 30.18 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.90K (2904) - ScannerThreadsTotalWallClockTime: 33s544ms - MaterializeTupleTime(*): 32s324ms - ScannerThreadsSysTime: 111.979ms - ScannerThreadsUserTime: 8s163ms - ScannerThreadsVoluntaryContextSwitches: 15.44K (15435) - TotalRawHdfsReadTime(*): 165.396ms - TotalReadThroughput: 30.66 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214720 (host=vb0234.halxg.cloudera.com:22000):(Total: 5s676ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 68.00 KB, 210.27 MB, 210.27 MB, 210.31 MB, 202.35 MB, 162.63 MB, 162.78 MB, 162.81 MB, 146.68 MB, 114.71 MB, 114.76 MB, 10.91 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 1 - AverageThreadTokens: 5.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.64 MB (220873480) - PerHostPeakMemUsage: 1.93 GB (2072869088) - PrepareTime: 193.303ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 38s243ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 157.596ms - TotalStorageWaitTime: 130.694ms CodeGen:(Total: 562.454ms, non-child: 562.454ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.408ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 365.266ms - PrepareTime: 180.062ms DataStreamSender (dst_id=11):(Total: 5s327ms, non-child: 5s327ms, % non-child: 100.00%) - BytesSent: 353.60 MB (370774092) - NetworkThroughput(*): 52.65 MB/sec - OverallThroughput: 66.37 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s210ms - ThriftTransmitTime(*): 6s715ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=2):(Total: 504.498ms, non-child: 504.498ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.45 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 822.186ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220406576) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 32.02 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.65K (2655) - ScannerThreadsTotalWallClockTime: 32s448ms - MaterializeTupleTime(*): 31s392ms - ScannerThreadsSysTime: 110.980ms - ScannerThreadsUserTime: 6s850ms - ScannerThreadsVoluntaryContextSwitches: 15.76K (15757) - TotalRawHdfsReadTime(*): 149.222ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214724 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s966ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.62 MB, 176.62 MB, 176.80 MB, 137.06 MB, 136.77 MB, 137.12 MB, 105.17 MB, 96.91 MB, 65.67 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185630024) - PerHostPeakMemUsage: 1.77 GB (1904304880) - PrepareTime: 202.413ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 28s472ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 149.802ms - TotalStorageWaitTime: 167.758ms CodeGen:(Total: 530.254ms, non-child: 530.254ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 325.083ms - PrepareTime: 189.520ms DataStreamSender (dst_id=11):(Total: 4s602ms, non-child: 4s602ms, % non-child: 100.00%) - BytesSent: 291.88 MB (306060981) - NetworkThroughput(*): 54.22 MB/sec - OverallThroughput: 63.42 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s646ms - ThriftTransmitTime(*): 5s382ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=2):(Total: 515.687ms, non-child: 515.687ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 447.662ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.59 MB (185171224) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 26.11 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.14K (2141) - ScannerThreadsTotalWallClockTime: 23s460ms - MaterializeTupleTime(*): 22s788ms - ScannerThreadsSysTime: 73.986ms - ScannerThreadsUserTime: 4s171ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13047) - TotalRawHdfsReadTime(*): 119.349ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214727 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s906ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 68.00 KB, 189.71 MB, 189.84 MB, 189.72 MB, 136.94 MB, 137.10 MB, 137.08 MB, 137.06 MB, 96.99 MB, 81.37 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.18 MB (199418632) - PerHostPeakMemUsage: 1.82 GB (1950232000) - PrepareTime: 193.528ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 30s095ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 135.520ms - TotalStorageWaitTime: 115.266ms CodeGen:(Total: 654.935ms, non-child: 654.935ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.954ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 458.542ms - PrepareTime: 179.192ms DataStreamSender (dst_id=11):(Total: 4s596ms, non-child: 4s596ms, % non-child: 100.00%) - BytesSent: 310.33 MB (325408421) - NetworkThroughput(*): 55.45 MB/sec - OverallThroughput: 67.52 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s690ms - ThriftTransmitTime(*): 5s596ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=2):(Total: 463.303ms, non-child: 463.303ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.33 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 465.706ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.71 MB (198925080) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 30.84 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1680) - ScannerThreadsTotalWallClockTime: 24s951ms - MaterializeTupleTime(*): 24s318ms - ScannerThreadsSysTime: 28.994ms - ScannerThreadsUserTime: 3s978ms - ScannerThreadsVoluntaryContextSwitches: 13.86K (13855) - TotalRawHdfsReadTime(*): 101.577ms - TotalReadThroughput: 33.14 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214723 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s883ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 68.00 KB, 176.51 MB, 176.69 MB, 176.62 MB, 176.66 MB, 137.14 MB, 137.17 MB, 137.16 MB, 97.13 MB, 97.11 MB, 57.78 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646408) - PerHostPeakMemUsage: 1.83 GB (1960762192) - PrepareTime: 181.650ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 28s345ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.226ms - TotalStorageWaitTime: 115.649ms CodeGen:(Total: 564.241ms, non-child: 564.241ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.123ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 375.984ms - PrepareTime: 178.589ms DataStreamSender (dst_id=11):(Total: 4s575ms, non-child: 4s575ms, % non-child: 100.00%) - BytesSent: 294.59 MB (308898908) - NetworkThroughput(*): 55.01 MB/sec - OverallThroughput: 64.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s649ms - ThriftTransmitTime(*): 5s354ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=2):(Total: 464.674ms, non-child: 464.674ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 149.36 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 463.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 28.95 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1743) - ScannerThreadsTotalWallClockTime: 23s309ms - MaterializeTupleTime(*): 22s679ms - ScannerThreadsSysTime: 55.988ms - ScannerThreadsUserTime: 3s931ms - ScannerThreadsVoluntaryContextSwitches: 13.10K (13101) - TotalRawHdfsReadTime(*): 148.237ms - TotalReadThroughput: 28.36 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214722 (host=vb0228.halxg.cloudera.com:22000):(Total: 4s844ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 201.54 MB, 201.76 MB, 201.85 MB, 201.82 MB, 154.11 MB, 154.03 MB, 137.14 MB, 97.06 MB, 97.08 MB, 9.60 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 6, 6, 6, 1 - AverageThreadTokens: 5.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.13 MB (211952432) - PerHostPeakMemUsage: 1.73 GB (1856572216) - PrepareTime: 192.399ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 30s792ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.468ms - TotalStorageWaitTime: 165.748ms CodeGen:(Total: 562.487ms, non-child: 562.487ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 363.322ms - PrepareTime: 179.094ms DataStreamSender (dst_id=11):(Total: 4s549ms, non-child: 4s549ms, % non-child: 100.00%) - BytesSent: 333.16 MB (349346678) - NetworkThroughput(*): 49.10 MB/sec - OverallThroughput: 73.23 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s715ms - ThriftTransmitTime(*): 6s785ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=2):(Total: 466.521ms, non-child: 466.521ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.10 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 499.242ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.74 MB (211534592) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 32.15 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1604) - ScannerThreadsTotalWallClockTime: 25s861ms - MaterializeTupleTime(*): 25s110ms - ScannerThreadsSysTime: 86.984ms - ScannerThreadsUserTime: 4s027ms - ScannerThreadsVoluntaryContextSwitches: 14.56K (14565) - TotalRawHdfsReadTime(*): 131.979ms - TotalReadThroughput: 31.62 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21471c (host=vb0216.halxg.cloudera.com:22000):(Total: 4s807ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.73 MB, 193.94 MB, 193.63 MB, 146.07 MB, 137.02 MB, 137.15 MB, 121.16 MB, 97.01 MB, 65.62 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.20 MB (203637464) - PerHostPeakMemUsage: 1.82 GB (1956263696) - PrepareTime: 191.137ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 29s762ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 154.790ms - TotalStorageWaitTime: 295.127ms CodeGen:(Total: 542.978ms, non-child: 542.978ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.832ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 347.501ms - PrepareTime: 177.918ms DataStreamSender (dst_id=11):(Total: 4s467ms, non-child: 4s467ms, % non-child: 100.00%) - BytesSent: 317.31 MB (332718591) - NetworkThroughput(*): 54.28 MB/sec - OverallThroughput: 71.03 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s607ms - ThriftTransmitTime(*): 5s845ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=2):(Total: 500.209ms, non-child: 500.209ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.44 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 475.704ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.77 MB (203184992) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 29.34 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1545) - ScannerThreadsTotalWallClockTime: 25s028ms - MaterializeTupleTime(*): 24s060ms - ScannerThreadsSysTime: 28.993ms - ScannerThreadsUserTime: 4s020ms - ScannerThreadsVoluntaryContextSwitches: 14.21K (14205) - TotalRawHdfsReadTime(*): 140.975ms - TotalReadThroughput: 34.03 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214726 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s803ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.41 MB, 176.75 MB, 176.76 MB, 137.24 MB, 137.06 MB, 136.97 MB, 137.05 MB, 96.87 MB, 97.15 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638168) - PerHostPeakMemUsage: 1.76 GB (1885365168) - PrepareTime: 194.035ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 27s655ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 141.555ms - TotalStorageWaitTime: 234.834ms CodeGen:(Total: 592.597ms, non-child: 592.597ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.187ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 394.992ms - PrepareTime: 182.119ms DataStreamSender (dst_id=11):(Total: 4s469ms, non-child: 4s469ms, % non-child: 100.00%) - BytesSent: 293.80 MB (308066886) - NetworkThroughput(*): 55.41 MB/sec - OverallThroughput: 65.74 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s595ms - ThriftTransmitTime(*): 5s301ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=2):(Total: 505.878ms, non-child: 505.878ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 447.069ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 26.61 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1671) - ScannerThreadsTotalWallClockTime: 22s799ms - MaterializeTupleTime(*): 22s011ms - ScannerThreadsSysTime: 71.986ms - ScannerThreadsUserTime: 3s748ms - ScannerThreadsVoluntaryContextSwitches: 13.16K (13161) - TotalRawHdfsReadTime(*): 136.945ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214728 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s724ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 177.62 MB, 177.70 MB, 178.08 MB, 177.60 MB, 124.52 MB, 111.41 MB, 111.43 MB, 79.39 MB, 79.13 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.17 MB (186827480) - PerHostPeakMemUsage: 1.68 GB (1801525000) - PrepareTime: 192.877ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 27s078ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 154.284ms - TotalStorageWaitTime: 292.482ms CodeGen:(Total: 560.391ms, non-child: 560.391ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 363.932ms - PrepareTime: 179.593ms DataStreamSender (dst_id=11):(Total: 4s404ms, non-child: 4s404ms, % non-child: 100.00%) - BytesSent: 283.23 MB (296985569) - NetworkThroughput(*): 53.04 MB/sec - OverallThroughput: 64.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s540ms - ThriftTransmitTime(*): 5s340ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=2):(Total: 491.615ms, non-child: 491.615ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 617.347ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.76 MB (186393304) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 26.60 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.14K (2142) - ScannerThreadsTotalWallClockTime: 22s402ms - MaterializeTupleTime(*): 21s404ms - ScannerThreadsSysTime: 84.984ms - ScannerThreadsUserTime: 5s616ms - ScannerThreadsVoluntaryContextSwitches: 12.71K (12707) - TotalRawHdfsReadTime(*): 127.114ms - TotalReadThroughput: 30.35 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214721 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s547ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.57 MB, 176.73 MB, 176.69 MB, 137.24 MB, 136.97 MB, 137.05 MB, 97.08 MB, 97.01 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.01 MB (185613640) - PerHostPeakMemUsage: 1.65 GB (1766830720) - PrepareTime: 192.824ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 26s079ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.046ms - TotalStorageWaitTime: 212.117ms CodeGen:(Total: 579.582ms, non-child: 579.582ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.599ms - PrepareTime: 179.595ms DataStreamSender (dst_id=11):(Total: 4s227ms, non-child: 4s227ms, % non-child: 100.00%) - BytesSent: 294.28 MB (308579670) - NetworkThroughput(*): 55.36 MB/sec - OverallThroughput: 69.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s474ms - ThriftTransmitTime(*): 5s315ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=2):(Total: 476.125ms, non-child: 476.125ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 437.014ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130360) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 28.27 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1508) - ScannerThreadsTotalWallClockTime: 21s473ms - MaterializeTupleTime(*): 20s700ms - ScannerThreadsSysTime: 26.994ms - ScannerThreadsUserTime: 3s707ms - ScannerThreadsVoluntaryContextSwitches: 13.01K (13014) - TotalRawHdfsReadTime(*): 109.015ms - TotalReadThroughput: 34.66 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214725 (host=vb0230.halxg.cloudera.com:22000):(Total: 4s430ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 68.00 KB, 176.73 MB, 176.65 MB, 176.79 MB, 137.19 MB, 136.92 MB, 136.85 MB, 97.06 MB, 97.10 MB, 49.01 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.01 MB (185613600) - PerHostPeakMemUsage: 1.65 GB (1768338184) - PrepareTime: 179.629ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 25s525ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 168.883ms - TotalStorageWaitTime: 97.884ms CodeGen:(Total: 516.896ms, non-child: 516.896ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 334.358ms - PrepareTime: 177.941ms DataStreamSender (dst_id=11):(Total: 4s159ms, non-child: 4s159ms, % non-child: 100.00%) - BytesSent: 293.42 MB (307670662) - NetworkThroughput(*): 47.54 MB/sec - OverallThroughput: 70.54 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s435ms - ThriftTransmitTime(*): 6s171ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=2):(Total: 429.819ms, non-child: 429.819ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 443.629ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 31.32 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.28K (1279) - ScannerThreadsTotalWallClockTime: 21s000ms - MaterializeTupleTime(*): 20s416ms - ScannerThreadsSysTime: 27.994ms - ScannerThreadsUserTime: 3s692ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13018) - TotalRawHdfsReadTime(*): 98.874ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21471d (host=vb0226.halxg.cloudera.com:22000):(Total: 4s352ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.16 MB, 168.26 MB, 168.26 MB, 128.48 MB, 128.46 MB, 111.39 MB, 79.42 MB, 79.38 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.52 MB (176708888) - PerHostPeakMemUsage: 1.61 GB (1730619680) - PrepareTime: 191.038ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 23s346ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 210.475ms - TotalStorageWaitTime: 98.667ms CodeGen:(Total: 545.606ms, non-child: 545.606ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.873ms - PrepareTime: 178.053ms DataStreamSender (dst_id=11):(Total: 4s040ms, non-child: 4s040ms, % non-child: 100.00%) - BytesSent: 265.41 MB (278305658) - NetworkThroughput(*): 53.58 MB/sec - OverallThroughput: 65.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s277ms - ThriftTransmitTime(*): 4s954ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=2):(Total: 477.623ms, non-child: 477.623ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.62 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 419.275ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.05 MB (176217416) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 25.69 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1445) - ScannerThreadsTotalWallClockTime: 18s920ms - MaterializeTupleTime(*): 18s355ms - ScannerThreadsSysTime: 59.989ms - ScannerThreadsUserTime: 3s467ms - ScannerThreadsVoluntaryContextSwitches: 11.94K (11936) - TotalRawHdfsReadTime(*): 87.483ms - TotalReadThroughput: 31.62 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21471f (host=vb0218.halxg.cloudera.com:22000):(Total: 4s339ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.41 MB, 176.66 MB, 176.80 MB, 137.13 MB, 137.11 MB, 137.03 MB, 97.07 MB, 97.00 MB, 12.23 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.07 MB (185670944) - PerHostPeakMemUsage: 1.65 GB (1767820720) - PrepareTime: 191.961ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 24s923ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 145.674ms - TotalStorageWaitTime: 135.897ms CodeGen:(Total: 574.643ms, non-child: 574.643ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.271ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.851ms - PrepareTime: 180.070ms DataStreamSender (dst_id=11):(Total: 4s032ms, non-child: 4s032ms, % non-child: 100.00%) - BytesSent: 290.04 MB (304126423) - NetworkThroughput(*): 54.51 MB/sec - OverallThroughput: 71.92 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s359ms - ThriftTransmitTime(*): 5s320ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=2):(Total: 471.712ms, non-child: 471.712ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 427.905ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 28.54 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1497) - ScannerThreadsTotalWallClockTime: 20s453ms - MaterializeTupleTime(*): 19s807ms - ScannerThreadsSysTime: 69.987ms - ScannerThreadsUserTime: 3s528ms - ScannerThreadsVoluntaryContextSwitches: 13.10K (13101) - TotalRawHdfsReadTime(*): 128.320ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21471b (host=vb0212.halxg.cloudera.com:22000):(Total: 3s880ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.13 MB, 143.04 MB, 143.10 MB, 111.35 MB, 111.37 MB, 79.40 MB, 79.33 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.41 MB (150378392) - PerHostPeakMemUsage: 1.60 GB (1722474248) - PrepareTime: 187.817ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 18s312ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 140.244ms - TotalStorageWaitTime: 230.604ms CodeGen:(Total: 540.877ms, non-child: 540.877ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.989ms - PrepareTime: 176.071ms DataStreamSender (dst_id=11):(Total: 3s539ms, non-child: 3s539ms, % non-child: 100.00%) - BytesSent: 235.03 MB (246448001) - NetworkThroughput(*): 53.31 MB/sec - OverallThroughput: 66.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s039ms - ThriftTransmitTime(*): 4s408ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=2):(Total: 492.395ms, non-child: 492.395ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 498.738ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.97 MB (149919592) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 21.87 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1512) - ScannerThreadsTotalWallClockTime: 14s424ms - MaterializeTupleTime(*): 13s629ms - ScannerThreadsSysTime: 99.983ms - ScannerThreadsUserTime: 4s025ms - ScannerThreadsVoluntaryContextSwitches: 10.41K (10412) - TotalRawHdfsReadTime(*): 99.669ms - TotalReadThroughput: 31.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214729 (host=vb0214.halxg.cloudera.com:22000):(Total: 3s793ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 163.82 MB, 164.10 MB, 164.25 MB, 124.59 MB, 111.30 MB, 111.39 MB, 79.35 MB, 48.01 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.49 MB (172481864) - PerHostPeakMemUsage: 1.59 GB (1703082960) - PrepareTime: 191.450ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 20s089ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 159.569ms - TotalStorageWaitTime: 74.781ms CodeGen:(Total: 534.877ms, non-child: 534.877ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 338.162ms - PrepareTime: 177.598ms DataStreamSender (dst_id=11):(Total: 3s506ms, non-child: 3s506ms, % non-child: 100.00%) - BytesSent: 263.66 MB (276463230) - NetworkThroughput(*): 47.43 MB/sec - OverallThroughput: 75.18 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s069ms - ThriftTransmitTime(*): 5s559ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=2):(Total: 447.637ms, non-child: 447.637ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 387.437ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.05 MB (172023112) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 27.12 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.06K (1056) - ScannerThreadsTotalWallClockTime: 16s166ms - MaterializeTupleTime(*): 15s663ms - ScannerThreadsSysTime: 19.994ms - ScannerThreadsUserTime: 3s201ms - ScannerThreadsVoluntaryContextSwitches: 11.76K (11761) - TotalRawHdfsReadTime(*): 104.381ms - TotalReadThroughput: 35.19 MB/sec Fragment F00: Instance ad4f3ef268d8fe31:65d07fc04e21472b (host=vb0230.halxg.cloudera.com:22000):(Total: 34s443ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.86 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.56 MB, 193.64 MB, 193.67 MB, 193.72 MB, 193.69 MB, 193.80 MB, 193.70 MB, 193.60 MB, 161.83 MB, 67.04 MB, 67.17 MB, 177.81 MB, 193.68 MB, 193.67 MB, 193.74 MB, 193.63 MB, 193.63 MB, 193.77 MB, 193.64 MB, 193.77 MB, 193.82 MB, 102.45 MB, 67.16 MB, 67.10 MB, 67.41 MB, 55.00 MB, 39.28 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.19 MB (204669424) - PerHostPeakMemUsage: 3.94 GB (4226095264) - PrepareTime: 190.575ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m40s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s293ms - TotalStorageWaitTime: 409.137ms CodeGen:(Total: 536.290ms, non-child: 536.290ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 342.679ms - PrepareTime: 179.390ms DataStreamSender (dst_id=10):(Total: 33s834ms, non-child: 33s834ms, % non-child: 100.00%) - BytesSent: 1.11 GB (1196831209) - NetworkThroughput(*): 8.58 MB/sec - OverallThroughput: 33.73 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s321ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=1):(Total: 727.090ms, non-child: 727.090ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 308.00 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 359.33 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s411ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.75 MB (204210664) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 73.74 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.79K (8790) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 4m17s - ScannerThreadsSysTime: 265.955ms - ScannerThreadsUserTime: 19s730ms - ScannerThreadsVoluntaryContextSwitches: 52.00K (52000) - TotalRawHdfsReadTime(*): 298.538ms - TotalReadThroughput: 10.56 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21472e (host=vb0234.halxg.cloudera.com:22000):(Total: 33s617ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 193.25 MB, 193.25 MB, 193.25 MB, 193.25 MB, 193.25 MB, 193.25 MB, 193.25 MB, 193.22 MB, 193.58 MB, 193.56 MB, 193.64 MB, 193.74 MB, 193.57 MB, 193.59 MB, 193.75 MB, 173.77 MB, 67.11 MB, 67.12 MB, 193.80 MB, 193.63 MB, 193.80 MB, 193.70 MB, 193.71 MB, 193.66 MB, 193.77 MB, 193.70 MB, 193.79 MB, 94.53 MB, 67.09 MB, 67.10 MB, 56.63 MB, 55.07 MB, 55.09 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.33 MB (204817744) - PerHostPeakMemUsage: 3.92 GB (4210368568) - PrepareTime: 193.225ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s289ms - TotalStorageWaitTime: 331.759ms CodeGen:(Total: 598.994ms, non-child: 598.994ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.890ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 399.422ms - PrepareTime: 180.293ms DataStreamSender (dst_id=10):(Total: 33s017ms, non-child: 33s017ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1144972111) - NetworkThroughput(*): 7.39 MB/sec - OverallThroughput: 33.07 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s992ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=1):(Total: 711.235ms, non-child: 711.235ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 246.39 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.05 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.37 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s377ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.87 MB (204334416) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 75.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.42K (7420) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 4m7s - ScannerThreadsSysTime: 233.960ms - ScannerThreadsUserTime: 16s894ms - ScannerThreadsVoluntaryContextSwitches: 52.26K (52262) - TotalRawHdfsReadTime(*): 240.195ms - TotalReadThroughput: 10.87 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214737 (host=vb0222.halxg.cloudera.com:22000):(Total: 33s543ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 82.75 MB, 165.87 MB, 165.87 MB, 165.87 MB, 165.87 MB, 165.87 MB, 165.87 MB, 165.87 MB, 165.87 MB, 188.23 MB, 188.16 MB, 188.16 MB, 188.18 MB, 188.24 MB, 188.20 MB, 188.12 MB, 160.21 MB, 83.10 MB, 82.96 MB, 177.66 MB, 193.61 MB, 193.68 MB, 193.69 MB, 193.72 MB, 193.69 MB, 193.74 MB, 181.75 MB, 177.83 MB, 115.30 MB, 82.99 MB, 83.02 MB, 69.00 MB, 55.08 MB, 47.13 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.41 MB (203856040) - PerHostPeakMemUsage: 3.91 GB (4199537280) - PrepareTime: 190.943ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s492ms - TotalStorageWaitTime: 500.874ms CodeGen:(Total: 570.346ms, non-child: 570.346ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 373.268ms - PrepareTime: 178.362ms DataStreamSender (dst_id=10):(Total: 32s924ms, non-child: 32s924ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1147465764) - NetworkThroughput(*): 10.05 MB/sec - OverallThroughput: 33.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s999ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=1):(Total: 735.408ms, non-child: 735.408ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 70.11 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 140.22 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 160.75 MB, 181.28 MB, 181.28 MB, 304.48 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.06 MB, 345.55 MB, 345.55 MB, 355.82 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s489ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.01 MB (203429184) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 72.13 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.59K (9594) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 4m9s - ScannerThreadsSysTime: 297.951ms - ScannerThreadsUserTime: 19s389ms - ScannerThreadsVoluntaryContextSwitches: 51.51K (51511) - TotalRawHdfsReadTime(*): 283.309ms - TotalReadThroughput: 10.77 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214736 (host=vb0224.halxg.cloudera.com:22000):(Total: 33s460ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 63.79 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 193.75 MB, 193.67 MB, 193.70 MB, 193.64 MB, 193.77 MB, 193.70 MB, 193.55 MB, 189.70 MB, 86.80 MB, 66.99 MB, 135.82 MB, 190.68 MB, 190.66 MB, 190.82 MB, 190.59 MB, 190.72 MB, 190.75 MB, 190.55 MB, 190.77 MB, 111.28 MB, 64.06 MB, 82.77 MB, 63.49 MB, 55.11 MB, 43.12 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.26 MB (203694392) - PerHostPeakMemUsage: 3.90 GB (4189624928) - PrepareTime: 189.802ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s334ms - TotalStorageWaitTime: 372.282ms CodeGen:(Total: 528.994ms, non-child: 528.994ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.634ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 334.127ms - PrepareTime: 176.523ms DataStreamSender (dst_id=10):(Total: 32s822ms, non-child: 32s822ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1111568823) - NetworkThroughput(*): 7.19 MB/sec - OverallThroughput: 32.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s829ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=1):(Total: 742.685ms, non-child: 742.685ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:0% 2:1.493% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 128.74 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 174.54 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 336.74 MB, 357.28 MB, 367.54 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.88 MB (203292984) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 71.74 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.49K (8492) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 4m7s - ScannerThreadsSysTime: 281.953ms - ScannerThreadsUserTime: 17s899ms - ScannerThreadsVoluntaryContextSwitches: 51.87K (51874) - TotalRawHdfsReadTime(*): 261.369ms - TotalReadThroughput: 10.97 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214730 (host=vb0226.halxg.cloudera.com:22000):(Total: 33s446ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 96.11 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.26 MB, 193.76 MB, 193.66 MB, 193.81 MB, 193.72 MB, 193.74 MB, 193.79 MB, 193.76 MB, 98.54 MB, 67.10 MB, 122.67 MB, 193.57 MB, 193.71 MB, 193.60 MB, 193.66 MB, 193.65 MB, 193.70 MB, 193.78 MB, 193.73 MB, 165.71 MB, 67.16 MB, 67.00 MB, 73.70 MB, 55.08 MB, 55.15 MB, 39.20 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 3, 3, 3 - AverageThreadTokens: 8.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517680) - PerHostPeakMemUsage: 3.90 GB (4192694240) - PrepareTime: 190.352ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s656ms - TotalStorageWaitTime: 408.957ms CodeGen:(Total: 582.342ms, non-child: 582.342ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 388.765ms - PrepareTime: 176.825ms DataStreamSender (dst_id=10):(Total: 32s864ms, non-child: 32s864ms, % non-child: 100.00%) - BytesSent: 1.09 GB (1165488417) - NetworkThroughput(*): 7.84 MB/sec - OverallThroughput: 33.82 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s933ms - ThriftTransmitTime(*): 2m21s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=1):(Total: 701.100ms, non-child: 701.100ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 236.12 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.06 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.45 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s420ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075352) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 76.43 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.57K (7570) - ScannerThreadsTotalWallClockTime: 4m7s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 192.965ms - ScannerThreadsUserTime: 18s964ms - ScannerThreadsVoluntaryContextSwitches: 52.30K (52299) - TotalRawHdfsReadTime(*): 340.586ms - TotalReadThroughput: 10.87 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21472a (host=vb0208.halxg.cloudera.com:22000):(Total: 33s427ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 92.89 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.80 MB, 187.65 MB, 187.59 MB, 187.67 MB, 187.76 MB, 187.74 MB, 187.70 MB, 162.85 MB, 82.98 MB, 82.97 MB, 179.21 MB, 190.66 MB, 190.74 MB, 190.58 MB, 190.63 MB, 190.71 MB, 182.81 MB, 174.86 MB, 183.13 MB, 115.30 MB, 89.18 MB, 98.81 MB, 70.48 MB, 55.14 MB, 31.64 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 3, 2 - AverageThreadTokens: 8.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.01 MB (204481408) - PerHostPeakMemUsage: 3.90 GB (4192232640) - PrepareTime: 181.125ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s757ms - TotalStorageWaitTime: 283.995ms CodeGen:(Total: 527.889ms, non-child: 527.889ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.417ms - PrepareTime: 178.368ms DataStreamSender (dst_id=10):(Total: 32s826ms, non-child: 32s826ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1123136278) - NetworkThroughput(*): 10.50 MB/sec - OverallThroughput: 32.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s744ms - ThriftTransmitTime(*): 1m41s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=1):(Total: 709.714ms, non-child: 709.714ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 79.48 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 158.96 MB, 169.22 MB, 179.49 MB, 179.49 MB, 311.53 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 321.80 MB, 332.07 MB, 342.33 MB, 352.60 MB, 362.86 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.51 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s610ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.55 MB (203998080) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 74.09 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.88K (7877) - ScannerThreadsTotalWallClockTime: 4m11s - MaterializeTupleTime(*): 4m9s - ScannerThreadsSysTime: 225.962ms - ScannerThreadsUserTime: 16s928ms - ScannerThreadsVoluntaryContextSwitches: 51.24K (51240) - TotalRawHdfsReadTime(*): 210.304ms - TotalReadThroughput: 10.67 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21472f (host=vb0204.halxg.cloudera.com:22000):(Total: 33s352ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 34.00 KB, 170.08 MB, 170.08 MB, 170.08 MB, 170.08 MB, 170.08 MB, 170.08 MB, 170.08 MB, 170.08 MB, 170.63 MB, 170.59 MB, 170.53 MB, 170.60 MB, 170.65 MB, 170.59 MB, 154.67 MB, 71.48 MB, 59.90 MB, 170.35 MB, 170.55 MB, 170.57 MB, 170.65 MB, 170.65 MB, 170.72 MB, 170.53 MB, 170.56 MB, 127.10 MB, 59.80 MB, 79.89 MB, 78.20 MB, 78.26 MB, 78.22 MB, 78.16 MB, 42.53 MB ThreadUsage(1s000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 4, 4, 4, 4, 4 - AverageThreadTokens: 7.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 171.06 MB (179366056) - PerHostPeakMemUsage: 3.81 GB (4095013856) - PrepareTime: 201.114ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 3m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s843ms - TotalStorageWaitTime: 389.135ms CodeGen:(Total: 560.049ms, non-child: 560.049ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 353.363ms - PrepareTime: 188.047ms DataStreamSender (dst_id=10):(Total: 32s734ms, non-child: 32s734ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1118159434) - NetworkThroughput(*): 7.24 MB/sec - OverallThroughput: 32.58 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s622ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=1):(Total: 718.699ms, non-child: 718.699ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 71.86 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 215.59 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.38 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s373ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 170.53 MB (178809088) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 70.42 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.83K (7829) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 3m29s - ScannerThreadsSysTime: 302.951ms - ScannerThreadsUserTime: 17s324ms - ScannerThreadsVoluntaryContextSwitches: 49.45K (49455) - TotalRawHdfsReadTime(*): 271.000ms - TotalReadThroughput: 10.42 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214733 (host=vb0206.halxg.cloudera.com:22000):(Total: 33s337ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 95.87 MB, 192.64 MB, 192.64 MB, 192.64 MB, 192.64 MB, 192.64 MB, 192.64 MB, 192.64 MB, 192.67 MB, 193.66 MB, 193.65 MB, 193.90 MB, 193.62 MB, 193.66 MB, 193.65 MB, 193.83 MB, 161.80 MB, 67.01 MB, 66.99 MB, 193.03 MB, 193.61 MB, 193.76 MB, 193.65 MB, 193.64 MB, 193.76 MB, 193.55 MB, 193.73 MB, 181.58 MB, 74.84 MB, 67.08 MB, 67.23 MB, 55.03 MB, 55.05 MB, 39.24 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.45 MB (204940392) - PerHostPeakMemUsage: 3.90 GB (4191374240) - PrepareTime: 186.259ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s248ms - TotalStorageWaitTime: 426.350ms CodeGen:(Total: 570.992ms, non-child: 570.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 381.928ms - PrepareTime: 181.590ms DataStreamSender (dst_id=10):(Total: 32s723ms, non-child: 32s723ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1127422510) - NetworkThroughput(*): 9.18 MB/sec - OverallThroughput: 32.86 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s851ms - ThriftTransmitTime(*): 1m57s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=1):(Total: 730.282ms, non-child: 730.282ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 369.58 MB, 369.58 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.46 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s553ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.06 MB (204530792) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 73.39 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.81K (8809) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 329.947ms - ScannerThreadsUserTime: 17s962ms - ScannerThreadsVoluntaryContextSwitches: 52.31K (52315) - TotalRawHdfsReadTime(*): 305.160ms - TotalReadThroughput: 10.87 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21472d (host=vb0212.halxg.cloudera.com:22000):(Total: 33s042ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 95.74 MB, 193.38 MB, 193.38 MB, 193.38 MB, 193.38 MB, 193.38 MB, 193.38 MB, 193.38 MB, 193.48 MB, 193.68 MB, 193.69 MB, 193.71 MB, 193.74 MB, 193.66 MB, 193.63 MB, 193.76 MB, 106.44 MB, 67.13 MB, 122.22 MB, 193.58 MB, 193.59 MB, 193.69 MB, 193.64 MB, 193.66 MB, 193.67 MB, 193.79 MB, 193.68 MB, 193.65 MB, 106.34 MB, 67.14 MB, 67.25 MB, 49.57 MB, 31.92 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.10 MB (203525824) - PerHostPeakMemUsage: 3.79 GB (4067394520) - PrepareTime: 186.811ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s119ms - TotalStorageWaitTime: 329.765ms CodeGen:(Total: 533.050ms, non-child: 533.050ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.294ms - PrepareTime: 175.336ms DataStreamSender (dst_id=10):(Total: 32s474ms, non-child: 32s474ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1140997945) - NetworkThroughput(*): 7.36 MB/sec - OverallThroughput: 33.51 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s475ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=1):(Total: 663.764ms, non-child: 663.764ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 236.12 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 338.78 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.58 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s428ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075256) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 76.24 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.00K (7003) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 4m7s - ScannerThreadsSysTime: 208.964ms - ScannerThreadsUserTime: 16s531ms - ScannerThreadsVoluntaryContextSwitches: 47.82K (47821) - TotalRawHdfsReadTime(*): 293.822ms - TotalReadThroughput: 10.42 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214738 (host=vb0218.halxg.cloudera.com:22000):(Total: 32s892ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 95.79 MB, 193.35 MB, 193.35 MB, 193.35 MB, 193.35 MB, 193.35 MB, 193.35 MB, 193.35 MB, 193.34 MB, 193.66 MB, 193.70 MB, 193.65 MB, 193.62 MB, 193.70 MB, 193.59 MB, 193.72 MB, 189.81 MB, 82.90 MB, 67.09 MB, 111.30 MB, 193.64 MB, 193.61 MB, 193.69 MB, 193.66 MB, 193.67 MB, 193.72 MB, 193.64 MB, 193.84 MB, 161.81 MB, 67.24 MB, 67.20 MB, 49.57 MB, 31.98 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.07 MB (203501240) - PerHostPeakMemUsage: 3.69 GB (3964974904) - PrepareTime: 177.028ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s250ms - TotalStorageWaitTime: 288.854ms CodeGen:(Total: 522.397ms, non-child: 522.397ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.455ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.662ms - PrepareTime: 174.119ms DataStreamSender (dst_id=10):(Total: 32s292ms, non-child: 32s292ms, % non-child: 100.00%) - BytesSent: 1001.44 MB (1050086131) - NetworkThroughput(*): 6.53 MB/sec - OverallThroughput: 31.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s093ms - ThriftTransmitTime(*): 2m33s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=1):(Total: 704.629ms, non-child: 704.629ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 225.87 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 338.80 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.58 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s361ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 71.84 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.16K (7159) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 4m7s - ScannerThreadsSysTime: 238.958ms - ScannerThreadsUserTime: 16s513ms - ScannerThreadsVoluntaryContextSwitches: 47.80K (47797) - TotalRawHdfsReadTime(*): 227.621ms - TotalReadThroughput: 10.42 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214735 (host=vb0228.halxg.cloudera.com:22000):(Total: 32s846ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(1s000ms): 85.77 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.77 MB, 187.62 MB, 187.58 MB, 187.72 MB, 187.70 MB, 187.68 MB, 187.72 MB, 187.62 MB, 183.57 MB, 90.77 MB, 82.94 MB, 122.53 MB, 193.38 MB, 193.55 MB, 193.83 MB, 193.73 MB, 193.74 MB, 193.64 MB, 181.86 MB, 177.84 MB, 165.71 MB, 90.68 MB, 82.86 MB, 62.56 MB, 32.02 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 2 - AverageThreadTokens: 8.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509384) - PerHostPeakMemUsage: 3.76 GB (4036151128) - PrepareTime: 188.788ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s608ms - TotalStorageWaitTime: 397.096ms CodeGen:(Total: 535.776ms, non-child: 535.776ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.239ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 342.205ms - PrepareTime: 176.528ms DataStreamSender (dst_id=10):(Total: 32s232ms, non-child: 32s232ms, % non-child: 100.00%) - BytesSent: 1023.71 MB (1073434165) - NetworkThroughput(*): 7.82 MB/sec - OverallThroughput: 31.76 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s369ms - ThriftTransmitTime(*): 2m10s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=1):(Total: 731.413ms, non-child: 731.413ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 69.75 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 180.48 MB, 180.48 MB, 231.81 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 334.48 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.59 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s335ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 68.27 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.51K (7513) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 4m8s - ScannerThreadsSysTime: 208.965ms - ScannerThreadsUserTime: 16s863ms - ScannerThreadsVoluntaryContextSwitches: 47.88K (47882) - TotalRawHdfsReadTime(*): 254.414ms - TotalReadThroughput: 10.29 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214731 (host=vb0232.halxg.cloudera.com:22000):(Total: 32s772ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.49 MB, 192.92 MB, 192.92 MB, 192.92 MB, 192.92 MB, 192.92 MB, 192.92 MB, 192.92 MB, 193.05 MB, 193.62 MB, 193.65 MB, 193.74 MB, 193.61 MB, 193.62 MB, 193.76 MB, 161.73 MB, 66.97 MB, 75.52 MB, 193.85 MB, 193.76 MB, 193.80 MB, 193.71 MB, 193.87 MB, 193.73 MB, 193.68 MB, 193.75 MB, 181.70 MB, 78.74 MB, 67.20 MB, 61.12 MB, 55.09 MB, 55.07 MB, 23.45 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3, 3 - AverageThreadTokens: 8.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.04 MB (204517712) - PerHostPeakMemUsage: 3.72 GB (3999215480) - PrepareTime: 193.401ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s273ms - TotalStorageWaitTime: 405.533ms CodeGen:(Total: 582.172ms, non-child: 582.172ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.470ms - PrepareTime: 176.491ms DataStreamSender (dst_id=10):(Total: 32s176ms, non-child: 32s176ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1104242339) - NetworkThroughput(*): 7.57 MB/sec - OverallThroughput: 32.73 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s581ms - ThriftTransmitTime(*): 2m19s - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=1):(Total: 716.670ms, non-child: 716.670ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 174.54 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.06 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.35 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s493ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.66 MB (204116304) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 74.75 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.69K (7690) - ScannerThreadsTotalWallClockTime: 3m59s - MaterializeTupleTime(*): 3m57s - ScannerThreadsSysTime: 209.964ms - ScannerThreadsUserTime: 19s349ms - ScannerThreadsVoluntaryContextSwitches: 52.07K (52067) - TotalRawHdfsReadTime(*): 277.995ms - TotalReadThroughput: 11.20 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e21472c (host=vb0214.halxg.cloudera.com:22000):(Total: 32s729ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(1s000ms): 59.74 MB, 192.87 MB, 192.87 MB, 192.87 MB, 192.87 MB, 192.87 MB, 192.87 MB, 192.87 MB, 192.87 MB, 193.53 MB, 193.62 MB, 193.71 MB, 193.55 MB, 193.71 MB, 193.67 MB, 193.65 MB, 161.77 MB, 67.16 MB, 67.21 MB, 185.32 MB, 193.53 MB, 193.80 MB, 193.71 MB, 193.65 MB, 193.63 MB, 193.57 MB, 193.77 MB, 193.64 MB, 161.80 MB, 67.11 MB, 67.06 MB, 48.60 MB, 29.94 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517712) - PerHostPeakMemUsage: 3.68 GB (3954166352) - PrepareTime: 191.144ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s967ms - TotalStorageWaitTime: 404.340ms CodeGen:(Total: 544.224ms, non-child: 544.224ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.239ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.369ms - PrepareTime: 176.926ms DataStreamSender (dst_id=10):(Total: 32s091ms, non-child: 32s091ms, % non-child: 100.00%) - BytesSent: 1019.79 MB (1069324120) - NetworkThroughput(*): 8.91 MB/sec - OverallThroughput: 31.78 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s592ms - ThriftTransmitTime(*): 1m54s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=1):(Total: 736.569ms, non-child: 736.569ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 125.02 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 236.11 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 328.50 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.58 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 68.41 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.98K (8981) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 309.949ms - ScannerThreadsUserTime: 17s717ms - ScannerThreadsVoluntaryContextSwitches: 48.07K (48071) - TotalRawHdfsReadTime(*): 267.002ms - TotalReadThroughput: 10.53 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214732 (host=vb0216.halxg.cloudera.com:22000):(Total: 30s760ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(500.000ms): 68.00 KB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 192.66 MB, 193.41 MB, 193.70 MB, 193.61 MB, 193.61 MB, 193.81 MB, 193.72 MB, 193.72 MB, 193.75 MB, 193.68 MB, 193.52 MB, 193.75 MB, 193.65 MB, 193.68 MB, 193.72 MB, 193.59 MB, 161.63 MB, 82.74 MB, 67.07 MB, 67.19 MB, 67.07 MB, 115.14 MB, 192.73 MB, 193.68 MB, 193.73 MB, 193.61 MB, 193.67 MB, 193.53 MB, 193.76 MB, 193.67 MB, 193.63 MB, 193.73 MB, 193.59 MB, 193.61 MB, 193.52 MB, 193.71 MB, 193.61 MB, 193.73 MB, 193.62 MB, 177.77 MB, 98.54 MB, 67.09 MB, 67.10 MB, 67.17 MB, 67.04 MB, 67.16 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.57 MB (205070224) - PerHostPeakMemUsage: 3.69 GB (3959164656) - PrepareTime: 188.944ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m22s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s508ms - TotalStorageWaitTime: 480.800ms CodeGen:(Total: 541.035ms, non-child: 541.035ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 349.003ms - PrepareTime: 178.168ms DataStreamSender (dst_id=10):(Total: 30s185ms, non-child: 30s185ms, % non-child: 100.00%) - BytesSent: 979.11 MB (1026670448) - NetworkThroughput(*): 7.62 MB/sec - OverallThroughput: 32.44 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s829ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=1):(Total: 690.379ms, non-child: 690.379ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 225.86 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s253ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.11 MB (204586936) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 69.02 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 7.83K (7831) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 4m1s - ScannerThreadsSysTime: 250.957ms - ScannerThreadsUserTime: 17s753ms - ScannerThreadsVoluntaryContextSwitches: 46.62K (46622) - TotalRawHdfsReadTime(*): 253.881ms - TotalReadThroughput: 10.60 MB/sec Instance ad4f3ef268d8fe31:65d07fc04e214734 (host=vb0220.halxg.cloudera.com:22000):(Total: 30s315ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(500.000ms): 0, 68.00 KB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 192.86 MB, 193.59 MB, 193.53 MB, 193.71 MB, 193.91 MB, 193.67 MB, 193.73 MB, 193.59 MB, 193.77 MB, 193.57 MB, 193.56 MB, 193.64 MB, 193.73 MB, 193.71 MB, 193.64 MB, 193.75 MB, 137.75 MB, 67.08 MB, 67.02 MB, 67.04 MB, 67.08 MB, 193.79 MB, 193.71 MB, 193.55 MB, 193.68 MB, 193.61 MB, 193.72 MB, 193.79 MB, 193.57 MB, 193.78 MB, 193.80 MB, 193.68 MB, 193.89 MB, 193.75 MB, 193.54 MB, 193.57 MB, 193.93 MB, 193.74 MB, 193.62 MB, 122.02 MB, 67.02 MB, 67.29 MB, 67.29 MB, 67.11 MB, 67.11 MB ThreadUsage(500.000ms): 1, 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.74 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.30 MB (203743456) - PerHostPeakMemUsage: 3.67 GB (3944902432) - PrepareTime: 191.814ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s605ms - TotalStorageWaitTime: 326.604ms CodeGen:(Total: 565.173ms, non-child: 565.173ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 367.612ms - PrepareTime: 177.936ms DataStreamSender (dst_id=10):(Total: 29s785ms, non-child: 29s785ms, % non-child: 100.00%) - BytesSent: 979.40 MB (1026979005) - NetworkThroughput(*): 7.21 MB/sec - OverallThroughput: 32.88 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s664ms - ThriftTransmitTime(*): 2m15s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=1):(Total: 646.954ms, non-child: 646.954ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s222ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.86 MB (203276512) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 73.62 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.46K (6460) - ScannerThreadsTotalWallClockTime: 4m1s - MaterializeTupleTime(*): 3m59s - ScannerThreadsSysTime: 175.970ms - ScannerThreadsUserTime: 15s214ms - ScannerThreadsVoluntaryContextSwitches: 46.53K (46529) - TotalRawHdfsReadTime(*): 263.630ms - TotalReadThroughput: 10.77 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------------+--------+----------+---------+----------+---------+-----------+ | 20:EXCHANGE | 1 | 13.06us | 0ns | 13.06us | 0 | 36.00M | | 19:AGGREGATE | 15 | 5.17s | 0ns | 5.81s | 0 | 36.00M | | 18:EXCHANGE | 15 | 968.60ms | 0ns | 1.08s | 395.39M | 36.00M | | 09:AGGREGATE | 15 | 4.35s | 0ns | 5.33s | 395.39M | 36.00M | | 00:UNION | 15 | 1.44s | 0ns | 1.66s | 398.68M | 36.00M | | |--17:AGGREGATE | 15 | 3.10s | 0ns | 3.52s | 199.34M | 18.00M | | | 16:EXCHANGE | 15 | 394.61ms | 0ns | 457.34ms | 199.34M | 18.00M | | | 08:AGGREGATE | 15 | 9.21s | 0ns | 9.92s | 199.34M | 18.00M | | | 07:HASH JOIN | 15 | 13.36s | 0ns | 14.29s | 774.31M | 18.00M | | | |--15:EXCHANGE | 15 | 933.75ms | 0ns | 1.54s | 204.99M | 45.00M | | | | 06:SCAN HDFS | 15 | 484.66ms | 0ns | 513.77ms | 204.99M | 45.00M | | | 14:EXCHANGE | 15 | 2.93s | 0ns | 3.48s | 774.31M | 180.00M | | | 05:SCAN HDFS | 15 | 725.34ms | 0ns | 806.95ms | 774.31M | 180.00M | | 13:AGGREGATE | 15 | 3.04s | 0ns | 3.77s | 199.34M | 18.00M | | 12:EXCHANGE | 15 | 387.56ms | 0ns | 479.88ms | 199.34M | 18.00M | | 04:AGGREGATE | 15 | 9.13s | 0ns | 9.72s | 199.34M | 18.00M | | 03:HASH JOIN | 15 | 13.31s | 0ns | 14.13s | 774.31M | 18.00M | | |--11:EXCHANGE | 15 | 945.50ms | 0ns | 1.51s | 204.99M | 45.00M | | | 02:SCAN HDFS | 15 | 466.49ms | 0ns | 507.30ms | 204.99M | 45.00M | | 10:EXCHANGE | 15 | 2.97s | 0ns | 3.50s | 774.31M | 180.00M | | 01:SCAN HDFS | 15 | 722.24ms | 0ns | 829.01ms | 774.31M | 180.00M | +--------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=fc4ebd07a3c493a1:101db40b9b2a9db6): Summary: Session ID: 8f4c30e4bd174b9e:d88d52614ae1ce9b Session Type: BEESWAX Start Time: 2016-03-23 01:07:10.758944000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 45089593363bb86c9944d70021d78b0963ed3d0f) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:40092 Default Db: tpch_300_parquet Sql Statement: -- Description : Fact to fact shuffle join on string column followed by group by. -- Target test case : Large Joins and aggregations done against string column -- done as part of ETL. SELECT Count(*) ROWCOUNT FROM ( SELECT /* +straight_join */ l_orderkey FROM lineitem l1 INNER JOIN /* +shuffle */ orders o1 ON l1.l_orderkey = o1.o_orderkey WHERE l_shipdate < '1995-01-01' AND o1.o_orderdate < '1995-01-01' GROUP BY l_orderkey UNION ALL SELECT /* +straight_join */ l_orderkey FROM lineitem l2 INNER JOIN /* +shuffle */ orders o2 ON l2.l_orderkey = o2.o_orderkey WHERE l_shipdate < '1995-01-01' AND o2.o_orderdate < '1995-01-01' GROUP BY l_orderkey ) a GROUP BY l_orderkey HAVING ROWCOUNT = 99999999 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.48GB VCores=3 20:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=8 row-size=16B cardinality=35999782 | 19:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: l_orderkey | having: count(*) = 99999999 | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 18:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=8 row-size=16B cardinality=35999782 | 09:AGGREGATE [STREAMING] | output: count(*) | group by: l_orderkey | hosts=15 per-host-mem=604.24MB | tuple-ids=8 row-size=16B cardinality=35999782 | 00:UNION | hosts=15 per-host-mem=0B | tuple-ids=6 row-size=8B cardinality=35999782 | |--17:AGGREGATE [FINALIZE] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 16:EXCHANGE [HASH(l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 08:AGGREGATE [STREAMING] | | group by: l_orderkey | | hosts=15 per-host-mem=151.06MB | | tuple-ids=5 row-size=8B cardinality=17999891 | | | 07:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: l2.l_orderkey = o2.o_orderkey | | runtime filters: RF001 <- o2.o_orderkey | | hosts=15 per-host-mem=107.00MB | | tuple-ids=3,4 row-size=68B cardinality=17999891 | | | |--15:EXCHANGE [HASH(o2.o_orderkey)] | | | hosts=15 per-host-mem=0B | | | tuple-ids=4 row-size=34B cardinality=45000000 | | | | | 06:SCAN HDFS [tpch_300_parquet.orders o2, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o2.o_orderdate < '1995-01-01' | | table stats: 450000000 rows total | | column stats: all | | hosts=15 per-host-mem=176.00MB | | tuple-ids=4 row-size=34B cardinality=45000000 | | | 14:EXCHANGE [HASH(l2.l_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=3 row-size=34B cardinality=179998909 | | | 05:SCAN HDFS [tpch_300_parquet.lineitem l2, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate < '1995-01-01' | runtime filters: RF001 -> l2.l_orderkey | table stats: 1799989091 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=3 row-size=34B cardinality=179998909 | 13:AGGREGATE [FINALIZE] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 12:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=8B cardinality=17999891 | 04:AGGREGATE [STREAMING] | group by: l_orderkey | hosts=15 per-host-mem=151.06MB | tuple-ids=2 row-size=8B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l1.l_orderkey = o1.o_orderkey | runtime filters: RF000 <- o1.o_orderkey | hosts=15 per-host-mem=107.00MB | tuple-ids=0,1 row-size=68B cardinality=17999891 | |--11:EXCHANGE [HASH(o1.o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=34B cardinality=45000000 | | | 02:SCAN HDFS [tpch_300_parquet.orders o1, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o1.o_orderdate < '1995-01-01' | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=1 row-size=34B cardinality=45000000 | 10:EXCHANGE [HASH(l1.l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=0 row-size=34B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem l1, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate < '1995-01-01' runtime filters: RF000 -> l1.l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=176.00MB tuple-ids=0 row-size=34B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1583990494 Estimated Per-Host VCores: 3 Request Pool: default-pool Planner Timeline: 22.896ms - Analysis finished: 6.317ms (6.317ms) - Equivalence classes computed: 6.630ms (313.196us) - Single node plan created: 13.926ms (7.296ms) - Runtime filters computed: 14.162ms (235.567us) - Distributed plan created: 17.940ms (3.777ms) - Lineage info computed: 18.790ms (850.228us) - Planning finished: 22.896ms (4.106ms) Query Timeline: 58s499ms - Start execution: 30.958us (30.958us) - Planning finished: 27.711ms (27.680ms) - Ready to start 120 remote fragments: 30.030ms (2.318ms) - All 120 remote fragments started: 41.825ms (11.794ms) - Rows available: 58s443ms (58s402ms) - First row fetched: 58s475ms (31.648ms) ImpalaServer: - ClientFetchWaitTimer: 31.658ms - RowMaterializationTimer: 0.000ns Execution Profile fc4ebd07a3c493a1:101db40b9b2a9db6:(Total: 58s425ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 120, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 2ms, 99.9th %-ile: 4ms Per Node Peak Memory Usage: vb0208.halxg.cloudera.com:22000(3.89 GB) vb0230.halxg.cloudera.com:22000(3.88 GB) vb0214.halxg.cloudera.com:22000(3.85 GB) vb0212.halxg.cloudera.com:22000(3.94 GB) vb0234.halxg.cloudera.com:22000(3.92 GB) vb0226.halxg.cloudera.com:22000(3.94 GB) vb0232.halxg.cloudera.com:22000(3.89 GB) vb0216.halxg.cloudera.com:22000(3.83 GB) vb0206.halxg.cloudera.com:22000(3.94 GB) vb0220.halxg.cloudera.com:22000(3.83 GB) vb0228.halxg.cloudera.com:22000(3.86 GB) vb0224.halxg.cloudera.com:22000(3.90 GB) vb0222.halxg.cloudera.com:22000(3.92 GB) vb0218.halxg.cloudera.com:22000(3.83 GB) vb0204.halxg.cloudera.com:22000(3.89 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F10:(Total: 58s401ms, non-child: 305.486us, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 34.295us - RowsProduced: 0 (0) - TotalCpuTime: 45.201ms - TotalNetworkReceiveTime: 58s401ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 58s401ms, non-child: 13.063us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 3.057us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 58s401ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F09:(Total: 57s962ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:58s310ms max:58s413ms mean: 58s386ms stddev:22.804ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.66 MB (969581287) - PerHostPeakMemUsage: 3.89 GB (4174266763) - PrepareTime: 194.820ms - RowsProduced: 0 (0) - TotalCpuTime: 6s434ms - TotalNetworkReceiveTime: 51s950ms - TotalNetworkSendTime: 180.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 613.295ms, non-child: 613.295ms, % non-child: 100.00%) - CodegenTime: 1.933ms - CompileTime: 28.928ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 392.385ms - PrepareTime: 186.344ms DataStreamSender (dst_id=20):(Total: 13.758us, non-child: 13.758us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s960ms, non-child: 5s173ms, % non-child: 8.93%) - BuildTime: 4s231ms - GetNewBlockTime: 491.750us - GetResultsTime: 685.610ms - HTResizeTime: 1s024ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.03 MB (966823635) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.243us EXCHANGE_NODE (id=18):(Total: 52s787ms, non-child: 52s787ms, % non-child: 100.00%) - BytesReceived: 283.97 MB (297759540) - ConvertRowBatchTime: 778.383ms - DeserializeRowBatchTimer: 720.024ms - FirstBatchArrivalWaitTime: 37s622ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 499.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns Averaged Fragment F08:(Total: 56s160ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:54s610ms max:57s721ms mean: 56s683ms stddev:836.719ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902171499) - PerHostPeakMemUsage: 3.89 GB (4174266763) - PrepareTime: 197.317ms - RowsProduced: 26.36M (26359274) - TotalCpuTime: 18s513ms - TotalNetworkReceiveTime: 37s015ms - TotalNetworkSendTime: 1s152ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 673.696ms, non-child: 673.696ms, % non-child: 100.00%) - CodegenTime: 3.505ms - CompileTime: 56.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 425.634ms - PrepareTime: 185.222ms DataStreamSender (dst_id=18):(Total: 6s480ms, non-child: 6s480ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297759540) - NetworkThroughput(*): 58.39 MB/sec - OverallThroughput: 44.43 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s373ms - ThriftTransmitTime(*): 4s981ms - UncompressedRowBatchSize: 704.02 MB (738214296) AGGREGATION_NODE (id=9):(Total: 49s643ms, non-child: 4s353ms, % non-child: 8.77%) - GetNewBlockTime: 261.726us - GetResultsTime: 138.145ms - HTResizeTime: 110.375ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264910) - RowsReturned: 26.36M (26359274) - RowsReturnedRate: 531.00 K/sec - StreamingTime: 3s961ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s289ms, non-child: 1s439ms, % non-child: 3.18%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578922) - RowsReturnedRate: 586.98 K/sec AGGREGATION_NODE (id=17):(Total: 5s678ms, non-child: 3s103ms, % non-child: 54.66%) - BuildTime: 2s398ms - GetNewBlockTime: 953.055us - GetResultsTime: 681.138ms - HTResizeTime: 912.878ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 2.38 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.121us EXCHANGE_NODE (id=16):(Total: 2s574ms, non-child: 2s574ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139882923) - ConvertRowBatchTime: 329.815ms - DeserializeRowBatchTimer: 309.956ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 6.02 M/sec - SendersBlockedTimer: 9s492ms - SendersBlockedTotalTimer(*): 9s492ms AGGREGATION_NODE (id=13):(Total: 38s171ms, non-child: 3s038ms, % non-child: 7.96%) - BuildTime: 2s365ms - GetNewBlockTime: 314.832us - GetResultsTime: 624.625ms - HTResizeTime: 828.523ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 348.15 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.308us EXCHANGE_NODE (id=12):(Total: 35s132ms, non-child: 35s132ms, % non-child: 100.00%) - BytesReceived: 133.40 MB (139881320) - ConvertRowBatchTime: 330.277ms - DeserializeRowBatchTimer: 337.429ms - FirstBatchArrivalWaitTime: 32s921ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 378.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 47s643ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:46s368ms max:49s491ms mean: 48s165ms stddev:874.276ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070446421) - PerHostPeakMemUsage: 3.89 GB (4174266763) - PrepareTime: 196.984ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 35s857ms - TotalNetworkReceiveTime: 10s238ms - TotalNetworkSendTime: 9s609ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 699.205ms, non-child: 699.205ms, % non-child: 100.00%) - CodegenTime: 1.099ms - CompileTime: 61.486ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 445.437ms - PrepareTime: 184.627ms DataStreamSender (dst_id=16):(Total: 12s976ms, non-child: 12s976ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139882923) - NetworkThroughput(*): 11.46 MB/sec - OverallThroughput: 10.33 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 775.816ms - ThriftTransmitTime(*): 11s719ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=8):(Total: 34s647ms, non-child: 9s207ms, % non-child: 26.57%) - GetNewBlockTime: 1.037ms - GetResultsTime: 470.232ms - HTResizeTime: 1s061ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 383.56 K/sec - StreamingTime: 8s428ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s440ms, non-child: 13s357ms, % non-child: 52.50%) - BuildPartitionTime: 1s549ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s888ms - GetNewBlockTime: 1.682ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s184ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.385us EXCHANGE_NODE (id=15):(Total: 3s503ms, non-child: 3s503ms, % non-child: 100.00%) - BytesReceived: 298.27 MB (312757505) - ConvertRowBatchTime: 345.500ms - DeserializeRowBatchTimer: 1s396ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s580ms, non-child: 8s580ms, % non-child: 100.00%) - BytesReceived: 1.03 GB (1103172515) - ConvertRowBatchTime: 1s308ms - DeserializeRowBatchTimer: 5s530ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.05 M/sec - SendersBlockedTimer: 8s712ms - SendersBlockedTotalTimer(*): 1m41s Averaged Fragment F05:(Total: 4s607ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:4s052ms max:5s792ms mean: 4s995ms stddev:423.224ms execution rates: min:236.57 MB/sec max:288.10 MB/sec mean:257.18 MB/sec stddev:12.62 MB/sec num instances: 15 - AverageThreadTokens: 5.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190589663) - PerHostPeakMemUsage: 1.73 GB (1858384461) - PrepareTime: 190.245ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 27s396ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 42.480ms - TotalStorageWaitTime: 130.263ms CodeGen:(Total: 548.284ms, non-child: 548.284ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 354.232ms - PrepareTime: 183.185ms DataStreamSender (dst_id=15):(Total: 4s290ms, non-child: 4s290ms, % non-child: 100.00%) - BytesSent: 298.27 MB (312757505) - NetworkThroughput(*): 48.06 MB/sec - OverallThroughput: 69.56 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s563ms - ThriftTransmitTime(*): 6s205ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=6):(Total: 484.657ms, non-child: 484.657ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 5.06 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 489.322ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.32 MB (190122733) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 28.19 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1755) - ScannerThreadsTotalWallClockTime: 22s574ms - MaterializeTupleTime(*): 21s883ms - ScannerThreadsSysTime: 62.321ms - ScannerThreadsUserTime: 4s227ms - ScannerThreadsVoluntaryContextSwitches: 13.28K (13280) - TotalRawHdfsReadTime(*): 110.868ms - TotalReadThroughput: 32.59 MB/sec Averaged Fragment F04:(Total: 33s141ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:31s850ms max:34s720ms mean: 33s672ms stddev:874.795ms execution rates: min:125.27 MB/sec max:136.04 MB/sec mean:130.45 MB/sec stddev:3.30 MB/sec num instances: 15 - AverageThreadTokens: 8.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 193.06 MB (202437360) - PerHostPeakMemUsage: 3.86 GB (4143753725) - PrepareTime: 191.906ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s797ms - TotalStorageWaitTime: 356.864ms CodeGen:(Total: 568.340ms, non-child: 568.340ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.873ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 372.173ms - PrepareTime: 183.082ms DataStreamSender (dst_id=14):(Total: 32s537ms, non-child: 32s537ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1103172515) - NetworkThroughput(*): 8.42 MB/sec - OverallThroughput: 32.33 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s521ms - ThriftTransmitTime(*): 2m6s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=5):(Total: 725.340ms, non-child: 725.340ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.59 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s415ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.61 MB (201962785) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 71.27 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.53K (7533) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 4m8s - ScannerThreadsSysTime: 228.627ms - ScannerThreadsUserTime: 17s295ms - ScannerThreadsVoluntaryContextSwitches: 49.92K (49921) - TotalRawHdfsReadTime(*): 262.899ms - TotalReadThroughput: 10.64 MB/sec Averaged Fragment F02:(Total: 37s172ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:37s046ms max:38s195ms mean: 37s696ms stddev:298.574ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070220433) - PerHostPeakMemUsage: 3.89 GB (4174266763) - PrepareTime: 195.991ms - RowsProduced: 13.29M (13289461) - TotalCpuTime: 35s712ms - TotalNetworkReceiveTime: 9s314ms - TotalNetworkSendTime: 152.881ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 700.232ms, non-child: 700.232ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 66.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 443.179ms - PrepareTime: 181.739ms DataStreamSender (dst_id=12):(Total: 3s590ms, non-child: 3s590ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139881320) - NetworkThroughput(*): 57.79 MB/sec - OverallThroughput: 37.42 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 790.290ms - ThriftTransmitTime(*): 2s365ms - UncompressedRowBatchSize: 253.53 MB (265841141) AGGREGATION_NODE (id=4):(Total: 33s562ms, non-child: 9s128ms, % non-child: 27.20%) - GetNewBlockTime: 1.201ms - GetResultsTime: 475.476ms - HTResizeTime: 1s075ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289461) - RowsReturnedRate: 395.96 K/sec - StreamingTime: 8s345ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s434ms, non-child: 13s309ms, % non-child: 54.47%) - BuildPartitionTime: 1s533ms - BuildRows: 13.67M (13665799) - BuildRowsPartitioned: 13.67M (13665799) - BuildTime: 1s840ms - GetNewBlockTime: 1.566ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51620515) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s222ms - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.316us EXCHANGE_NODE (id=11):(Total: 3s528ms, non-child: 3s528ms, % non-child: 100.00%) - BytesReceived: 298.10 MB (312585117) - ConvertRowBatchTime: 340.703ms - DeserializeRowBatchTimer: 1s389ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 3.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s596ms, non-child: 7s596ms, % non-child: 100.00%) - BytesReceived: 1.03 GB (1103947434) - ConvertRowBatchTime: 1s281ms - DeserializeRowBatchTimer: 5s551ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 6.87 M/sec - SendersBlockedTimer: 8s569ms - SendersBlockedTotalTimer(*): 1m44s Averaged Fragment F01:(Total: 4s444ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 127.18 MB completion times: min:4s199ms max:5s804ms mean: 4s853ms stddev:425.419ms execution rates: min:241.06 MB/sec max:290.72 MB/sec mean:264.85 MB/sec stddev:14.86 MB/sec num instances: 15 - AverageThreadTokens: 5.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 181.76 MB (190586404) - PerHostPeakMemUsage: 1.70 GB (1830190309) - PrepareTime: 189.240ms - RowsProduced: 13.67M (13665799) - TotalCpuTime: 26s300ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.246ms - TotalStorageWaitTime: 167.367ms CodeGen:(Total: 570.449ms, non-child: 570.449ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.701ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 376.069ms - PrepareTime: 181.285ms DataStreamSender (dst_id=11):(Total: 4s141ms, non-child: 4s141ms, % non-child: 100.00%) - BytesSent: 298.10 MB (312585117) - NetworkThroughput(*): 47.90 MB/sec - OverallThroughput: 72.11 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s498ms - ThriftTransmitTime(*): 6s226ms - UncompressedRowBatchSize: 599.61 MB (628733577) HDFS_SCAN_NODE (id=2):(Total: 466.485ms, non-child: 466.485ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 5.01 - BytesRead: 158.43 MB (166123086) - BytesReadDataNodeCache: 0 - BytesReadLocal: 158.43 MB (166123086) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 158.43 MB (166123086) - DecompressionTime: 476.124ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 181.31 MB (190116549) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 30.00M (30000000) - RowsReturned: 13.67M (13665799) - RowsReturnedRate: 29.30 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1547) - ScannerThreadsTotalWallClockTime: 21s648ms - MaterializeTupleTime(*): 20s908ms - ScannerThreadsSysTime: 40.257ms - ScannerThreadsUserTime: 4s068ms - ScannerThreadsVoluntaryContextSwitches: 13.23K (13229) - TotalRawHdfsReadTime(*): 127.274ms - TotalReadThroughput: 33.51 MB/sec Averaged Fragment F00:(Total: 32s076ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 176.11 MB completion times: min:30s360ms max:33s589ms mean: 32s573ms stddev:995.147ms execution rates: min:128.82 MB/sec max:138.98 MB/sec mean:134.86 MB/sec stddev:2.72 MB/sec num instances: 15 - AverageThreadTokens: 8.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 193.33 MB (202719209) - PerHostPeakMemUsage: 3.84 GB (4118462325) - PrepareTime: 189.201ms - RowsProduced: 51.62M (51620515) - TotalCpuTime: 4m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s701ms - TotalStorageWaitTime: 382.116ms CodeGen:(Total: 561.992ms, non-child: 561.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.925ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.527ms - PrepareTime: 179.454ms DataStreamSender (dst_id=10):(Total: 31s471ms, non-child: 31s471ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1103947434) - NetworkThroughput(*): 8.16 MB/sec - OverallThroughput: 33.45 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s458ms - ThriftTransmitTime(*): 2m10s - UncompressedRowBatchSize: 2.21 GB (2374947032) HDFS_SCAN_NODE (id=1):(Total: 722.236ms, non-child: 722.236ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 356.06 MB (373359920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.06 MB (373359920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.06 MB (373359920) - DecompressionTime: 1s418ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 192.88 MB (202249640) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 51.62M (51620515) - RowsReturnedRate: 71.69 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.82K (7817) - ScannerThreadsTotalWallClockTime: 4m1s - MaterializeTupleTime(*): 3m59s - ScannerThreadsSysTime: 244.425ms - ScannerThreadsUserTime: 17s618ms - ScannerThreadsVoluntaryContextSwitches: 49.90K (49898) - TotalRawHdfsReadTime(*): 260.638ms - TotalReadThroughput: 10.98 MB/sec Fragment F09: Instance fc4ebd07a3c493a1:101db40b9b2a9dc1 (host=vb0204.halxg.cloudera.com:22000):(Total: 58s024ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.64 MB, 131.74 MB, 261.29 MB, 398.31 MB, 569.89 MB, 766.47 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.07 MB, 882.05 MB, 882.06 MB, 882.05 MB, 906.08 MB, 906.04 MB, 906.04 MB, 906.04 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.51 MB (969416880) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 192.691ms - RowsProduced: 0 (0) - TotalCpuTime: 5s545ms - TotalNetworkReceiveTime: 52s845ms - TotalNetworkSendTime: 153.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 555.887ms, non-child: 555.887ms, % non-child: 100.00%) - CodegenTime: 1.310ms - CompileTime: 21.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.942ms - PrepareTime: 189.071ms DataStreamSender (dst_id=20):(Total: 13.364us, non-child: 13.364us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s023ms, non-child: 4s551ms, % non-child: 7.84%) ExecOption: Codegen Enabled - BuildTime: 3s618ms - GetNewBlockTime: 378.495us - GetResultsTime: 690.596ms - HTResizeTime: 976.405ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.325us EXCHANGE_NODE (id=18):(Total: 53s472ms, non-child: 716.051ms, % non-child: 1.34%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.23 MB, 30.95 MB, 52.88 MB, 78.79 MB, 106.62 MB, 135.78 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 143.78 MB, 169.76 MB, 201.21 MB, 232.86 MB, 263.39 MB, 283.93 MB, 284.01 MB, 284.01 MB - BytesReceived: 284.01 MB (297804794) - ConvertRowBatchTime: 582.470ms - DeserializeRowBatchTimer: 561.554ms - FirstBatchArrivalWaitTime: 37s679ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 493.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dbb (host=vb0228.halxg.cloudera.com:22000):(Total: 58s023ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 27.29 MB, 136.19 MB, 257.14 MB, 382.08 MB, 528.48 MB, 660.94 MB, 818.82 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.04 MB, 894.06 MB, 877.71 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.16 MB (970098880) - PerHostPeakMemUsage: 3.86 GB (4148003016) - PrepareTime: 197.304ms - RowsProduced: 0 (0) - TotalCpuTime: 6s648ms - TotalNetworkReceiveTime: 51s738ms - TotalNetworkSendTime: 248.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 557.466ms, non-child: 557.466ms, % non-child: 100.00%) - CodegenTime: 1.439ms - CompileTime: 19.776ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 342.508ms - PrepareTime: 185.139ms DataStreamSender (dst_id=20):(Total: 13.398us, non-child: 13.398us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s022ms, non-child: 5s405ms, % non-child: 9.32%) ExecOption: Codegen Enabled - BuildTime: 4s455ms - GetNewBlockTime: 356.520us - GetResultsTime: 688.228ms - HTResizeTime: 1s127ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.085us EXCHANGE_NODE (id=18):(Total: 52s616ms, non-child: 1s007ms, % non-child: 1.92%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.68 MB, 22.79 MB, 41.91 MB, 62.78 MB, 84.57 MB, 105.48 MB, 131.18 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 140.70 MB, 150.13 MB, 166.75 MB, 184.88 MB, 205.10 MB, 227.95 MB, 247.14 MB, 267.91 MB - BytesReceived: 283.82 MB (297606679) - ConvertRowBatchTime: 817.284ms - DeserializeRowBatchTimer: 676.133ms - FirstBatchArrivalWaitTime: 37s687ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 500.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9db9 (host=vb0222.halxg.cloudera.com:22000):(Total: 58s019ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 32.26 MB, 170.43 MB, 325.61 MB, 483.01 MB, 628.19 MB, 777.36 MB, 874.05 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.07 MB, 882.06 MB, 882.04 MB, 882.05 MB, 894.05 MB, 906.04 MB, 877.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.07 MB (968958576) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 197.937ms - RowsProduced: 0 (0) - TotalCpuTime: 6s744ms - TotalNetworkReceiveTime: 51s668ms - TotalNetworkSendTime: 162.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 588.665ms, non-child: 588.665ms, % non-child: 100.00%) - CodegenTime: 1.374ms - CompileTime: 25.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 366.902ms - PrepareTime: 188.092ms DataStreamSender (dst_id=20):(Total: 12.687us, non-child: 12.687us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s018ms, non-child: 5s410ms, % non-child: 9.32%) ExecOption: Codegen Enabled - BuildTime: 4s438ms - GetNewBlockTime: 381.856us - GetResultsTime: 714.414ms - HTResizeTime: 990.898ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.124us EXCHANGE_NODE (id=18):(Total: 52s608ms, non-child: 1s079ms, % non-child: 2.05%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.06 MB, 28.21 MB, 53.85 MB, 77.95 MB, 101.97 MB, 125.69 MB, 140.47 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 157.89 MB, 178.36 MB, 194.80 MB, 215.62 MB, 238.52 MB, 267.69 MB, 284.05 MB - BytesReceived: 284.05 MB (297848323) - ConvertRowBatchTime: 879.506ms - DeserializeRowBatchTimer: 668.867ms - FirstBatchArrivalWaitTime: 37s647ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 501.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc6 (host=vb0208.halxg.cloudera.com:22000):(Total: 58s013ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 59.51 MB, 240.89 MB, 462.78 MB, 672.64 MB, 860.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 902.92 MB, 906.03 MB, 849.40 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.55 MB (969460528) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 191.123ms - RowsProduced: 0 (0) - TotalCpuTime: 5s550ms - TotalNetworkReceiveTime: 52s851ms - TotalNetworkSendTime: 159.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 576.801ms, non-child: 576.801ms, % non-child: 100.00%) - CodegenTime: 1.354ms - CompileTime: 23.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 364.030ms - PrepareTime: 187.302ms DataStreamSender (dst_id=20):(Total: 13.429us, non-child: 13.429us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s012ms, non-child: 4s416ms, % non-child: 7.61%) ExecOption: Codegen Enabled - BuildTime: 3s467ms - GetNewBlockTime: 391.160us - GetResultsTime: 701.911ms - HTResizeTime: 906.721ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.440us EXCHANGE_NODE (id=18):(Total: 53s595ms, non-child: 854.675ms, % non-child: 1.59%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.44 MB, 41.44 MB, 74.90 MB, 108.43 MB, 137.11 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.75 MB, 140.76 MB, 154.46 MB, 175.76 MB, 197.82 MB, 218.98 MB, 237.86 MB, 257.64 MB, 281.01 MB - BytesReceived: 283.93 MB (297721311) - ConvertRowBatchTime: 693.556ms - DeserializeRowBatchTimer: 636.189ms - FirstBatchArrivalWaitTime: 37s663ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 491.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dba (host=vb0224.halxg.cloudera.com:22000):(Total: 58s003ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 23.39 MB, 134.20 MB, 249.81 MB, 325.60 MB, 434.54 MB, 547.47 MB, 660.42 MB, 822.71 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 894.04 MB, 906.04 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.86 MB (968740336) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 185.328ms - RowsProduced: 0 (0) - TotalCpuTime: 7s133ms - TotalNetworkReceiveTime: 51s266ms - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 578.695ms, non-child: 578.695ms, % non-child: 100.00%) - CodegenTime: 1.373ms - CompileTime: 29.832ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 365.575ms - PrepareTime: 181.720ms DataStreamSender (dst_id=20):(Total: 13.154us, non-child: 13.154us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s002ms, non-child: 5s811ms, % non-child: 10.02%) ExecOption: Codegen Enabled - BuildTime: 4s849ms - GetNewBlockTime: 445.879us - GetResultsTime: 701.342ms - HTResizeTime: 1s000ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.149us EXCHANGE_NODE (id=18):(Total: 52s190ms, non-child: 1s076ms, % non-child: 2.06%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.31 MB, 31.89 MB, 46.86 MB, 63.07 MB, 79.67 MB, 97.52 MB, 117.08 MB, 138.59 MB, 140.79 MB, 140.79 MB, 140.79 MB, 142.74 MB, 160.12 MB, 178.86 MB, 199.24 MB, 219.31 MB, 236.02 MB, 254.00 MB, 278.47 MB - BytesReceived: 284.01 MB (297802162) - ConvertRowBatchTime: 860.620ms - DeserializeRowBatchTimer: 700.248ms - FirstBatchArrivalWaitTime: 37s655ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 505.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc3 (host=vb0212.halxg.cloudera.com:22000):(Total: 58s001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 41.27 MB, 217.91 MB, 396.32 MB, 551.48 MB, 710.88 MB, 862.06 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.07 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 894.04 MB, 906.04 MB, 849.40 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.55 MB (970513536) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 187.258ms - RowsProduced: 0 (0) - TotalCpuTime: 5s682ms - TotalNetworkReceiveTime: 52s700ms - TotalNetworkSendTime: 144.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 565.146ms, non-child: 565.146ms, % non-child: 100.00%) - CodegenTime: 1.401ms - CompileTime: 18.483ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.399ms - PrepareTime: 181.452ms DataStreamSender (dst_id=20):(Total: 13.230us, non-child: 13.230us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 58s000ms, non-child: 4s556ms, % non-child: 7.86%) ExecOption: Codegen Enabled - BuildTime: 3s635ms - GetNewBlockTime: 338.030us - GetResultsTime: 682.147ms - HTResizeTime: 862.802ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.066us EXCHANGE_NODE (id=18):(Total: 53s444ms, non-child: 850.339ms, % non-child: 1.59%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.94 MB, 35.76 MB, 64.12 MB, 89.81 MB, 114.53 MB, 137.60 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 140.79 MB, 153.44 MB, 176.15 MB, 198.08 MB, 215.26 MB, 234.33 MB, 267.20 MB, 283.98 MB - BytesReceived: 283.98 MB (297773737) - ConvertRowBatchTime: 697.320ms - DeserializeRowBatchTimer: 581.572ms - FirstBatchArrivalWaitTime: 37s672ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 493.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9db8 (host=vb0218.halxg.cloudera.com:22000):(Total: 57s988ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 27.39 MB, 156.49 MB, 282.37 MB, 434.54 MB, 585.95 MB, 765.68 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.05 MB, 906.07 MB, 877.72 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.59 MB (969504176) - PerHostPeakMemUsage: 3.83 GB (4111289600) - PrepareTime: 196.573ms - RowsProduced: 0 (0) - TotalCpuTime: 6s573ms - TotalNetworkReceiveTime: 51s821ms - TotalNetworkSendTime: 152.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 600.679ms, non-child: 600.679ms, % non-child: 100.00%) - CodegenTime: 1.402ms - CompileTime: 38.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 367.456ms - PrepareTime: 188.501ms DataStreamSender (dst_id=20):(Total: 12.191us, non-child: 12.191us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s987ms, non-child: 5s302ms, % non-child: 9.14%) ExecOption: Codegen Enabled - BuildTime: 4s348ms - GetNewBlockTime: 390.526us - GetResultsTime: 696.630ms - HTResizeTime: 1s080ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.286us EXCHANGE_NODE (id=18):(Total: 52s684ms, non-child: 991.146ms, % non-child: 1.88%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.08 MB, 25.82 MB, 46.61 MB, 71.06 MB, 94.01 MB, 121.17 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.75 MB, 152.09 MB, 174.03 MB, 192.88 MB, 216.04 MB, 232.79 MB, 249.95 MB, 275.48 MB - BytesReceived: 283.91 MB (297702938) - ConvertRowBatchTime: 805.837ms - DeserializeRowBatchTimer: 766.566ms - FirstBatchArrivalWaitTime: 37s632ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 500.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dbe (host=vb0216.halxg.cloudera.com:22000):(Total: 57s970ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 67.45 MB, 173.42 MB, 295.37 MB, 443.66 MB, 547.47 MB, 706.89 MB, 829.83 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.04 MB, 894.07 MB, 906.04 MB, 764.47 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.78 MB (969706048) - PerHostPeakMemUsage: 3.83 GB (4111187200) - PrepareTime: 200.584ms - RowsProduced: 0 (0) - TotalCpuTime: 6s262ms - TotalNetworkReceiveTime: 52s124ms - TotalNetworkSendTime: 140.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 613.013ms, non-child: 613.013ms, % non-child: 100.00%) - CodegenTime: 1.569ms - CompileTime: 26.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 388.181ms - PrepareTime: 184.553ms DataStreamSender (dst_id=20):(Total: 12.508us, non-child: 12.508us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s969ms, non-child: 5s013ms, % non-child: 8.65%) ExecOption: Codegen Enabled - BuildTime: 4s060ms - GetNewBlockTime: 367.897us - GetResultsTime: 686.832ms - HTResizeTime: 1s015ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.305us EXCHANGE_NODE (id=18):(Total: 52s955ms, non-child: 971.495ms, % non-child: 1.83%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.77 MB, 29.35 MB, 47.24 MB, 69.48 MB, 89.71 MB, 113.82 MB, 134.67 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.74 MB, 140.91 MB, 155.03 MB, 176.18 MB, 195.28 MB, 215.74 MB, 241.76 MB, 267.05 MB, 283.89 MB - BytesReceived: 283.89 MB (297681899) - ConvertRowBatchTime: 775.399ms - DeserializeRowBatchTimer: 772.327ms - FirstBatchArrivalWaitTime: 37s623ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 497.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc4 (host=vb0214.halxg.cloudera.com:22000):(Total: 57s951ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.64 MB, 103.73 MB, 257.13 MB, 400.30 MB, 543.48 MB, 720.89 MB, 845.82 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.06 MB, 906.06 MB, 906.06 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 925.36 MB (970311664) - PerHostPeakMemUsage: 3.85 GB (4135587088) - PrepareTime: 206.042ms - RowsProduced: 0 (0) - TotalCpuTime: 6s761ms - TotalNetworkReceiveTime: 51s609ms - TotalNetworkSendTime: 218.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 617.951ms, non-child: 617.951ms, % non-child: 100.00%) - CodegenTime: 1.430ms - CompileTime: 33.587ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 383.178ms - PrepareTime: 187.626ms DataStreamSender (dst_id=20):(Total: 13.519us, non-child: 13.519us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s949ms, non-child: 5s419ms, % non-child: 9.35%) ExecOption: Codegen Enabled - BuildTime: 4s473ms - GetNewBlockTime: 1.898ms - GetResultsTime: 670.844ms - HTResizeTime: 1s093ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.470us EXCHANGE_NODE (id=18):(Total: 52s530ms, non-child: 1s067ms, % non-child: 2.03%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.86 MB, 30.45 MB, 54.36 MB, 75.93 MB, 103.27 MB, 126.76 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 140.72 MB, 144.06 MB, 166.97 MB, 185.78 MB, 203.85 MB, 223.85 MB, 244.01 MB, 267.51 MB, 283.87 MB - BytesReceived: 283.87 MB (297663710) - ConvertRowBatchTime: 851.684ms - DeserializeRowBatchTimer: 790.513ms - FirstBatchArrivalWaitTime: 37s613ms - PeakMemoryUsage: 0 - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 501.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dbc (host=vb0220.halxg.cloudera.com:22000):(Total: 57s926ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 18.66 MB, 136.36 MB, 257.13 MB, 386.99 MB, 491.01 MB, 620.68 MB, 793.71 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.06 MB, 906.05 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.63 MB (969547824) - PerHostPeakMemUsage: 3.83 GB (4109984000) - PrepareTime: 189.960ms - RowsProduced: 0 (0) - TotalCpuTime: 6s507ms - TotalNetworkReceiveTime: 51s878ms - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 465 (465) - BlocksRecycled: 215 (215) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 646.300ms, non-child: 646.300ms, % non-child: 100.00%) - CodegenTime: 1.377ms - CompileTime: 36.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 421.808ms - PrepareTime: 186.189ms DataStreamSender (dst_id=20):(Total: 17.860us, non-child: 17.860us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s925ms, non-child: 5s210ms, % non-child: 8.99%) ExecOption: Codegen Enabled - BuildTime: 4s269ms - GetNewBlockTime: 370.844us - GetResultsTime: 687.009ms - HTResizeTime: 1s071ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.267us EXCHANGE_NODE (id=18):(Total: 52s715ms, non-child: 974.765ms, % non-child: 1.85%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.22 MB, 32.24 MB, 51.68 MB, 69.98 MB, 89.46 MB, 112.75 MB, 137.53 MB, 140.84 MB, 140.84 MB, 140.84 MB, 140.84 MB, 142.50 MB, 155.57 MB, 171.45 MB, 187.68 MB, 203.96 MB, 223.51 MB, 245.73 MB, 269.99 MB - BytesReceived: 284.11 MB (297915628) - ConvertRowBatchTime: 779.882ms - DeserializeRowBatchTimer: 826.910ms - FirstBatchArrivalWaitTime: 37s591ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 500.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc0 (host=vb0226.halxg.cloudera.com:22000):(Total: 57s918ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 43.24 MB, 152.20 MB, 265.13 MB, 378.63 MB, 491.02 MB, 603.95 MB, 716.89 MB, 859.50 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.06 MB, 882.04 MB, 882.05 MB, 882.07 MB, 894.04 MB, 821.09 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.87 MB (968745792) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 191.824ms - RowsProduced: 0 (0) - TotalCpuTime: 6s780ms - TotalNetworkReceiveTime: 51s621ms - TotalNetworkSendTime: 122.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 673.108ms, non-child: 673.108ms, % non-child: 100.00%) - CodegenTime: 1.606ms - CompileTime: 26.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 456.611ms - PrepareTime: 187.934ms DataStreamSender (dst_id=20):(Total: 13.906us, non-child: 13.906us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s917ms, non-child: 5s386ms, % non-child: 9.30%) ExecOption: Codegen Enabled - BuildTime: 4s422ms - GetNewBlockTime: 391.318us - GetResultsTime: 702.814ms - HTResizeTime: 965.892ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.02 MB (966811632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.269us EXCHANGE_NODE (id=18):(Total: 52s530ms, non-child: 1s049ms, % non-child: 2.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.25 MB, 27.37 MB, 45.30 MB, 62.79 MB, 80.39 MB, 98.11 MB, 115.43 MB, 136.84 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 153.22 MB, 169.31 MB, 185.00 MB, 202.42 MB, 221.27 MB, 241.72 MB, 262.86 MB - BytesReceived: 283.96 MB (297749952) - ConvertRowBatchTime: 841.556ms - DeserializeRowBatchTimer: 807.285ms - FirstBatchArrivalWaitTime: 37s563ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 501.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dbd (host=vb0206.halxg.cloudera.com:22000):(Total: 57s910ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 26.87 MB, 144.19 MB, 273.13 MB, 411.18 MB, 509.16 MB, 607.95 MB, 763.36 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.04 MB, 906.03 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.74 MB (969656944) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 197.669ms - RowsProduced: 0 (0) - TotalCpuTime: 7s053ms - TotalNetworkReceiveTime: 51s336ms - TotalNetworkSendTime: 154.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 671.200ms, non-child: 671.200ms, % non-child: 100.00%) - CodegenTime: 3.883ms - CompileTime: 31.582ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 446.434ms - PrepareTime: 191.894ms DataStreamSender (dst_id=20):(Total: 14.192us, non-child: 14.192us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s909ms, non-child: 5s701ms, % non-child: 9.85%) ExecOption: Codegen Enabled - BuildTime: 4s750ms - GetNewBlockTime: 349.148us - GetResultsTime: 690.476ms - HTResizeTime: 1s072ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.079us EXCHANGE_NODE (id=18):(Total: 52s207ms, non-child: 1s014ms, % non-child: 1.94%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.78 MB, 24.17 MB, 46.01 MB, 64.84 MB, 82.38 MB, 99.33 MB, 122.33 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 140.77 MB, 151.86 MB, 168.02 MB, 183.49 MB, 199.34 MB, 215.17 MB, 235.60 MB, 253.54 MB - BytesReceived: 283.97 MB (297763659) - ConvertRowBatchTime: 806.275ms - DeserializeRowBatchTimer: 852.585ms - FirstBatchArrivalWaitTime: 37s561ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 504.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc2 (host=vb0234.halxg.cloudera.com:22000):(Total: 57s903ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.13 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 29.18 MB, 172.91 MB, 345.85 MB, 534.21 MB, 693.05 MB, 860.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.07 MB, 882.05 MB, 882.04 MB, 882.05 MB, 882.05 MB, 894.06 MB, 906.03 MB, 906.03 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.26 MB (969154992) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 185.164ms - RowsProduced: 0 (0) - TotalCpuTime: 5s605ms - TotalNetworkReceiveTime: 52s705ms - TotalNetworkSendTime: 158.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 588.863ms, non-child: 588.863ms, % non-child: 100.00%) - CodegenTime: 1.356ms - CompileTime: 34.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 370.747ms - PrepareTime: 181.501ms DataStreamSender (dst_id=20):(Total: 15.036us, non-child: 15.036us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s902ms, non-child: 4s560ms, % non-child: 7.88%) ExecOption: Codegen Enabled - BuildTime: 3s725ms - GetNewBlockTime: 388.255us - GetResultsTime: 610.428ms - HTResizeTime: 1s069ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.423us EXCHANGE_NODE (id=18):(Total: 53s341ms, non-child: 739.732ms, % non-child: 1.39%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.19 MB, 41.21 MB, 72.74 MB, 96.91 MB, 126.14 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 143.26 MB, 167.62 MB, 191.33 MB, 216.64 MB, 236.61 MB, 255.89 MB, 278.99 MB, 283.95 MB - BytesReceived: 283.95 MB (297741397) - ConvertRowBatchTime: 583.795ms - DeserializeRowBatchTimer: 511.778ms - FirstBatchArrivalWaitTime: 37s649ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 494.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc5 (host=vb0230.halxg.cloudera.com:22000):(Total: 57s896ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 24.88 MB, 132.20 MB, 245.15 MB, 351.45 MB, 473.40 MB, 595.96 MB, 749.13 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.04 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.04 MB, 882.06 MB, 882.07 MB, 882.06 MB, 882.06 MB, 906.04 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 923.86 MB (968740336) - PerHostPeakMemUsage: 3.88 GB (4170802424) - PrepareTime: 198.316ms - RowsProduced: 0 (0) - TotalCpuTime: 6s963ms - TotalNetworkReceiveTime: 51s409ms - TotalNetworkSendTime: 261.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 671.433ms, non-child: 671.433ms, % non-child: 100.00%) - CodegenTime: 1.333ms - CompileTime: 30.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 444.793ms - PrepareTime: 183.011ms DataStreamSender (dst_id=20):(Total: 13.271us, non-child: 13.271us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s895ms, non-child: 5s561ms, % non-child: 9.61%) ExecOption: Codegen Enabled - BuildTime: 4s614ms - GetNewBlockTime: 442.215us - GetResultsTime: 673.635ms - HTResizeTime: 1s076ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.012us EXCHANGE_NODE (id=18):(Total: 52s333ms, non-child: 1s083ms, % non-child: 2.07%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.46 MB, 21.87 MB, 39.11 MB, 56.28 MB, 74.46 MB, 96.21 MB, 120.70 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.77 MB, 151.37 MB, 167.80 MB, 184.12 MB, 201.45 MB, 220.98 MB, 238.75 MB, 255.38 MB - BytesReceived: 283.95 MB (297741236) - ConvertRowBatchTime: 861.187ms - DeserializeRowBatchTimer: 820.643ms - FirstBatchArrivalWaitTime: 37s564ms - PeakMemoryUsage: 0 - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 503.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dbf (host=vb0232.halxg.cloudera.com:22000):(Total: 57s879ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 43.26 MB, 198.92 MB, 313.61 MB, 438.54 MB, 626.62 MB, 755.35 MB, 870.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.06 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.05 MB, 882.06 MB, 882.05 MB, 882.07 MB, 764.48 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 926.17 MB (971162800) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 204.526ms - RowsProduced: 0 (0) - TotalCpuTime: 6s710ms - TotalNetworkReceiveTime: 51s675ms - TotalNetworkSendTime: 229.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 464 (464) - BlocksRecycled: 216 (216) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 3.77 GB (4044357632) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 694.220ms, non-child: 694.220ms, % non-child: 100.00%) - CodegenTime: 6.787ms - CompileTime: 35.814ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 462.216ms - PrepareTime: 191.169ms DataStreamSender (dst_id=20):(Total: 14.632us, non-child: 14.632us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=19):(Total: 57s878ms, non-child: 5s294ms, % non-child: 9.15%) ExecOption: Codegen Enabled - BuildTime: 4s336ms - GetNewBlockTime: 485.799us - GetResultsTime: 686.844ms - HTResizeTime: 1s055ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 922.04 MB (966828000) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.344us EXCHANGE_NODE (id=18):(Total: 52s583ms, non-child: 1s051ms, % non-child: 2.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.32 MB, 32.16 MB, 52.72 MB, 72.76 MB, 99.15 MB, 120.97 MB, 140.24 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.82 MB, 140.89 MB, 154.74 MB, 171.17 MB, 187.95 MB, 204.40 MB, 221.22 MB, 237.81 MB, 254.70 MB - BytesReceived: 284.08 MB (297875681) - ConvertRowBatchTime: 839.379ms - DeserializeRowBatchTimer: 827.192ms - FirstBatchArrivalWaitTime: 37s534ms - PeakMemoryUsage: 0 - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 501.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F08: Instance fc4ebd07a3c493a1:101db40b9b2a9dd4 (host=vb0230.halxg.cloudera.com:22000):(Total: 57s125ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 14.22 MB, 167.27 MB, 382.72 MB, 580.59 MB, 764.19 MB, 792.82 MB, 695.57 MB, 598.32 MB, 501.09 MB, 428.16 MB, 306.58 MB, 185.02 MB, 118.43 MB, 322.06 MB, 485.33 MB, 675.77 MB, 798.25 MB, 748.00 MB, 675.83 MB, 603.65 MB, 507.39 MB, 387.08 MB, 314.91 MB, 218.63 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.88 GB (4170802424) - PrepareTime: 199.294ms - RowsProduced: 26.36M (26358202) - TotalCpuTime: 18s955ms - TotalNetworkReceiveTime: 37s367ms - TotalNetworkSendTime: 1s355ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 707.100ms, non-child: 707.100ms, % non-child: 100.00%) - CodegenTime: 3.339ms - CompileTime: 49.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 462.224ms - PrepareTime: 181.145ms DataStreamSender (dst_id=18):(Total: 7s248ms, non-child: 7s248ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741236) - NetworkThroughput(*): 48.18 MB/sec - OverallThroughput: 39.17 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s603ms - ThriftTransmitTime(*): 5s893ms - UncompressedRowBatchSize: 703.99 MB (738184252) AGGREGATION_NODE (id=9):(Total: 49s832ms, non-child: 4s871ms, % non-child: 9.78%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 170.643us - GetResultsTime: 149.949ms - HTResizeTime: 111.314ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24265135) - RowsReturned: 26.36M (26358202) - RowsReturnedRate: 528.93 K/sec - StreamingTime: 4s455ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 44s961ms, non-child: 1s658ms, % non-child: 3.69%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577850) - RowsReturnedRate: 591.13 K/sec AGGREGATION_NODE (id=17):(Total: 5s121ms, non-child: 2s863ms, % non-child: 55.92%) ExecOption: Codegen Enabled - BuildTime: 2s056ms - GetNewBlockTime: 228.264us - GetResultsTime: 788.126ms - HTResizeTime: 815.286ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 2.59 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.006us EXCHANGE_NODE (id=16):(Total: 2s257ms, non-child: 315.154ms, % non-child: 13.96%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 562.88 KB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.80 MB, 51.75 MB, 82.24 MB, 113.33 MB - BytesReceived: 133.38 MB (139860829) - ConvertRowBatchTime: 255.130ms - DeserializeRowBatchTimer: 397.260ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 5.89 M/sec - SendersBlockedTimer: 10s167ms - SendersBlockedTotalTimer(*): 10s167ms AGGREGATION_NODE (id=13):(Total: 38s181ms, non-child: 2s565ms, % non-child: 6.72%) ExecOption: Codegen Enabled - BuildTime: 1s856ms - GetNewBlockTime: 375.808us - GetResultsTime: 688.330ms - HTResizeTime: 656.917ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 348.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.244us EXCHANGE_NODE (id=12):(Total: 35s616ms, non-child: 272.075ms, % non-child: 0.76%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.65 MB, 27.09 MB, 60.39 MB, 94.01 MB, 126.57 MB - BytesReceived: 133.39 MB (139865494) - ConvertRowBatchTime: 225.472ms - DeserializeRowBatchTimer: 405.892ms - FirstBatchArrivalWaitTime: 32s899ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 373.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dcc (host=vb0206.halxg.cloudera.com:22000):(Total: 57s109ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 22.39 MB, 166.46 MB, 375.50 MB, 576.46 MB, 739.98 MB, 792.85 MB, 695.61 MB, 598.35 MB, 476.80 MB, 379.55 MB, 306.60 MB, 160.74 MB, 113.19 MB, 321.04 MB, 485.34 MB, 675.21 MB, 798.26 MB, 748.01 MB, 675.84 MB, 603.66 MB, 507.38 MB, 411.13 MB, 314.89 MB, 218.64 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 193.310ms - RowsProduced: 26.36M (26359002) - TotalCpuTime: 20s706ms - TotalNetworkReceiveTime: 35s569ms - TotalNetworkSendTime: 1s400ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 716.216ms, non-child: 716.216ms, % non-child: 100.00%) - CodegenTime: 3.465ms - CompileTime: 79.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 448.010ms - PrepareTime: 187.341ms DataStreamSender (dst_id=18):(Total: 7s571ms, non-child: 7s571ms, % non-child: 100.00%) - BytesSent: 283.97 MB (297763659) - NetworkThroughput(*): 50.65 MB/sec - OverallThroughput: 37.50 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 3s026ms - ThriftTransmitTime(*): 5s606ms - UncompressedRowBatchSize: 704.01 MB (738206656) AGGREGATION_NODE (id=9):(Total: 49s500ms, non-child: 4s700ms, % non-child: 9.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 186.464us - GetResultsTime: 135.123ms - HTResizeTime: 125.509ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24264760) - RowsReturned: 26.36M (26359002) - RowsReturnedRate: 532.50 K/sec - StreamingTime: 4s309ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 44s799ms, non-child: 1s575ms, % non-child: 3.52%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26578650) - RowsReturnedRate: 593.28 K/sec AGGREGATION_NODE (id=17):(Total: 5s059ms, non-child: 3s430ms, % non-child: 67.80%) ExecOption: Codegen Enabled - BuildTime: 2s653ms - GetNewBlockTime: 390.017us - GetResultsTime: 754.226ms - HTResizeTime: 1s029ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 2.63 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 965.000ns EXCHANGE_NODE (id=16):(Total: 1s629ms, non-child: 415.889ms, % non-child: 25.53%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 477.99 KB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.84 MB, 50.41 MB, 82.11 MB, 113.99 MB - BytesReceived: 133.39 MB (139868638) - ConvertRowBatchTime: 363.376ms - DeserializeRowBatchTimer: 312.523ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 8.16 M/sec - SendersBlockedTimer: 10s142ms - SendersBlockedTotalTimer(*): 10s142ms AGGREGATION_NODE (id=13):(Total: 38s163ms, non-child: 3s425ms, % non-child: 8.97%) ExecOption: Codegen Enabled - BuildTime: 2s713ms - GetNewBlockTime: 284.654us - GetResultsTime: 681.899ms - HTResizeTime: 931.814ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 348.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.349us EXCHANGE_NODE (id=12):(Total: 34s738ms, non-child: 479.876ms, % non-child: 1.38%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.05 MB, 27.10 MB, 59.64 MB, 92.20 MB, 123.43 MB - BytesReceived: 133.39 MB (139872570) - ConvertRowBatchTime: 400.423ms - DeserializeRowBatchTimer: 348.239ms - FirstBatchArrivalWaitTime: 32s869ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 382.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dce (host=vb0232.halxg.cloudera.com:22000):(Total: 57s101ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 38.46 MB, 241.89 MB, 463.39 MB, 673.52 MB, 804.44 MB, 792.86 MB, 646.99 MB, 549.73 MB, 452.49 MB, 282.28 MB, 160.73 MB, 131.14 MB, 332.29 MB, 529.82 MB, 752.50 MB, 792.16 MB, 806.19 MB, 748.02 MB, 651.75 MB, 555.51 MB, 459.28 MB, 387.08 MB, 314.88 MB, 218.64 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 188.232ms - RowsProduced: 26.37M (26369216) - TotalCpuTime: 19s620ms - TotalNetworkReceiveTime: 36s824ms - TotalNetworkSendTime: 1s255ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 734.818ms, non-child: 734.818ms, % non-child: 100.00%) - CodegenTime: 3.326ms - CompileTime: 53.612ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 497.089ms - PrepareTime: 182.382ms DataStreamSender (dst_id=18):(Total: 6s879ms, non-child: 6s879ms, % non-child: 100.00%) - BytesSent: 284.08 MB (297875681) - NetworkThroughput(*): 53.71 MB/sec - OverallThroughput: 41.30 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s453ms - ThriftTransmitTime(*): 5s288ms - UncompressedRowBatchSize: 704.28 MB (738492708) AGGREGATION_NODE (id=9):(Total: 50s181ms, non-child: 4s689ms, % non-child: 9.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.431us - GetResultsTime: 117.897ms - HTResizeTime: 124.547ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270593) - RowsReturned: 26.37M (26369216) - RowsReturnedRate: 525.48 K/sec - StreamingTime: 4s317ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s491ms, non-child: 1s561ms, % non-child: 3.43%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26588864) - RowsReturnedRate: 584.48 K/sec AGGREGATION_NODE (id=17):(Total: 5s835ms, non-child: 3s265ms, % non-child: 55.96%) ExecOption: Codegen Enabled - BuildTime: 2s414ms - GetNewBlockTime: 224.637us - GetResultsTime: 828.721ms - HTResizeTime: 912.145ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 2.28 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.010us EXCHANGE_NODE (id=16):(Total: 2s569ms, non-child: 407.743ms, % non-child: 15.87%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.06 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.22 MB, 53.32 MB, 89.62 MB, 125.25 MB, 133.46 MB - BytesReceived: 133.46 MB (139945447) - ConvertRowBatchTime: 343.070ms - DeserializeRowBatchTimer: 284.445ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 5.17 M/sec - SendersBlockedTimer: 9s498ms - SendersBlockedTotalTimer(*): 9s498ms AGGREGATION_NODE (id=13):(Total: 38s094ms, non-child: 3s100ms, % non-child: 8.14%) ExecOption: Codegen Enabled - BuildTime: 2s434ms - GetNewBlockTime: 303.716us - GetResultsTime: 641.926ms - HTResizeTime: 766.440ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 348.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.371us EXCHANGE_NODE (id=12):(Total: 34s993ms, non-child: 426.247ms, % non-child: 1.22%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.85 MB, 38.32 MB, 75.64 MB, 110.61 MB, 133.45 MB - BytesReceived: 133.45 MB (139935199) - ConvertRowBatchTime: 365.799ms - DeserializeRowBatchTimer: 286.596ms - FirstBatchArrivalWaitTime: 32s841ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 379.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dcf (host=vb0226.halxg.cloudera.com:22000):(Total: 56s861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 22.23 MB, 189.26 MB, 417.61 MB, 623.03 MB, 788.44 MB, 792.85 MB, 695.59 MB, 598.37 MB, 501.10 MB, 403.84 MB, 306.62 MB, 209.35 MB, 88.95 MB, 238.99 MB, 428.86 MB, 623.01 MB, 802.26 MB, 748.03 MB, 651.77 MB, 603.66 MB, 507.38 MB, 387.09 MB, 266.76 MB, 170.25 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 209.444ms - RowsProduced: 26.36M (26358018) - TotalCpuTime: 20s025ms - TotalNetworkReceiveTime: 35s989ms - TotalNetworkSendTime: 1s385ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 695.581ms, non-child: 695.581ms, % non-child: 100.00%) - CodegenTime: 4.344ms - CompileTime: 51.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 442.813ms - PrepareTime: 187.969ms DataStreamSender (dst_id=18):(Total: 7s471ms, non-child: 7s471ms, % non-child: 100.00%) - BytesSent: 283.96 MB (297749952) - NetworkThroughput(*): 46.89 MB/sec - OverallThroughput: 38.00 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s628ms - ThriftTransmitTime(*): 6s055ms - UncompressedRowBatchSize: 703.98 MB (738179100) AGGREGATION_NODE (id=9):(Total: 49s351ms, non-child: 4s863ms, % non-child: 9.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 189.259us - GetResultsTime: 145.046ms - HTResizeTime: 103.896ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24262912) - RowsReturned: 26.36M (26358018) - RowsReturnedRate: 534.08 K/sec - StreamingTime: 4s441ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 44s487ms, non-child: 1s652ms, % non-child: 3.71%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26577666) - RowsReturnedRate: 597.41 K/sec AGGREGATION_NODE (id=17):(Total: 4s572ms, non-child: 3s518ms, % non-child: 76.94%) ExecOption: Codegen Enabled - BuildTime: 2s741ms - GetNewBlockTime: 2.150ms - GetResultsTime: 741.457ms - HTResizeTime: 906.966ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 2.91 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.657us EXCHANGE_NODE (id=16):(Total: 1s054ms, non-child: 456.620ms, % non-child: 43.31%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.30 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.45 MB, 39.23 MB, 71.59 MB, 104.02 MB - BytesReceived: 133.40 MB (139877375) - ConvertRowBatchTime: 373.548ms - DeserializeRowBatchTimer: 336.726ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 12.60 M/sec - SendersBlockedTimer: 10s658ms - SendersBlockedTotalTimer(*): 10s658ms AGGREGATION_NODE (id=13):(Total: 38s263ms, non-child: 2s696ms, % non-child: 7.05%) ExecOption: Codegen Enabled - BuildTime: 1s915ms - GetNewBlockTime: 213.701us - GetResultsTime: 761.334ms - HTResizeTime: 736.132ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 347.30 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.196us EXCHANGE_NODE (id=12):(Total: 35s566ms, non-child: 277.355ms, % non-child: 0.78%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.59 MB, 31.46 MB, 66.54 MB, 101.55 MB, 130.67 MB - BytesReceived: 133.39 MB (139869518) - ConvertRowBatchTime: 226.780ms - DeserializeRowBatchTimer: 417.475ms - FirstBatchArrivalWaitTime: 32s890ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 373.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dcb (host=vb0220.halxg.cloudera.com:22000):(Total: 56s740ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 131.55 MB, 338.52 MB, 526.08 MB, 720.96 MB, 786.46 MB, 719.91 MB, 598.34 MB, 501.09 MB, 403.83 MB, 282.26 MB, 136.39 MB, 188.42 MB, 389.78 MB, 598.45 MB, 773.64 MB, 802.36 MB, 796.14 MB, 699.91 MB, 603.64 MB, 507.41 MB, 411.16 MB, 314.89 MB, 194.31 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4109984000) - PrepareTime: 203.342ms - RowsProduced: 26.37M (26373344) - TotalCpuTime: 19s889ms - TotalNetworkReceiveTime: 36s082ms - TotalNetworkSendTime: 1s319ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 708.181ms, non-child: 708.181ms, % non-child: 100.00%) - CodegenTime: 3.485ms - CompileTime: 49.294ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 460.806ms - PrepareTime: 191.813ms DataStreamSender (dst_id=18):(Total: 6s904ms, non-child: 6s904ms, % non-child: 100.00%) - BytesSent: 284.11 MB (297915628) - NetworkThroughput(*): 51.85 MB/sec - OverallThroughput: 41.15 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s501ms - ThriftTransmitTime(*): 5s480ms - UncompressedRowBatchSize: 704.39 MB (738608316) AGGREGATION_NODE (id=9):(Total: 49s798ms, non-child: 4s733ms, % non-child: 9.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.117ms - GetResultsTime: 143.621ms - HTResizeTime: 109.048ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24278191) - RowsReturned: 26.37M (26373344) - RowsReturnedRate: 529.60 K/sec - StreamingTime: 4s322ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s065ms, non-child: 1s505ms, % non-child: 3.34%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26592992) - RowsReturnedRate: 590.10 K/sec AGGREGATION_NODE (id=17):(Total: 5s433ms, non-child: 3s285ms, % non-child: 60.48%) ExecOption: Codegen Enabled - BuildTime: 2s523ms - GetNewBlockTime: 238.459us - GetResultsTime: 738.973ms - HTResizeTime: 969.383ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 2.45 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.154us EXCHANGE_NODE (id=16):(Total: 2s147ms, non-child: 422.822ms, % non-child: 19.69%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 15.03 MB, 46.05 MB, 80.52 MB, 117.27 MB, 133.47 MB - BytesReceived: 133.47 MB (139957527) - ConvertRowBatchTime: 355.581ms - DeserializeRowBatchTimer: 314.069ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 6.19 M/sec - SendersBlockedTimer: 9s740ms - SendersBlockedTotalTimer(*): 9s740ms AGGREGATION_NODE (id=13):(Total: 38s126ms, non-child: 3s402ms, % non-child: 8.92%) ExecOption: Codegen Enabled - BuildTime: 2s736ms - GetNewBlockTime: 309.105us - GetResultsTime: 639.297ms - HTResizeTime: 901.635ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 348.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.454us EXCHANGE_NODE (id=12):(Total: 34s724ms, non-child: 465.684ms, % non-child: 1.34%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.29 MB, 37.29 MB, 68.78 MB, 101.71 MB, 129.79 MB - BytesReceived: 133.46 MB (139944608) - ConvertRowBatchTime: 400.372ms - DeserializeRowBatchTimer: 354.562ms - FirstBatchArrivalWaitTime: 32s874ms - PeakMemoryUsage: 0 - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 382.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dca (host=vb0228.halxg.cloudera.com:22000):(Total: 56s632ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 7.83 MB, 117.13 MB, 303.76 MB, 498.12 MB, 677.57 MB, 792.84 MB, 695.61 MB, 598.36 MB, 501.10 MB, 355.22 MB, 257.99 MB, 112.09 MB, 225.95 MB, 425.06 MB, 630.74 MB, 800.63 MB, 802.26 MB, 772.07 MB, 699.90 MB, 603.66 MB, 483.34 MB, 363.01 MB, 266.77 MB, 141.96 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.86 GB (4148003016) - PrepareTime: 190.056ms - RowsProduced: 26.35M (26345692) - TotalCpuTime: 19s255ms - TotalNetworkReceiveTime: 36s542ms - TotalNetworkSendTime: 1s268ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 583.709ms, non-child: 583.709ms, % non-child: 100.00%) - CodegenTime: 3.271ms - CompileTime: 48.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.806ms - PrepareTime: 183.652ms DataStreamSender (dst_id=18):(Total: 6s771ms, non-child: 6s771ms, % non-child: 100.00%) - BytesSent: 283.82 MB (297606679) - NetworkThroughput(*): 52.16 MB/sec - OverallThroughput: 41.92 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s453ms - ThriftTransmitTime(*): 5s441ms - UncompressedRowBatchSize: 703.65 MB (737833900) AGGREGATION_NODE (id=9):(Total: 49s825ms, non-child: 4s537ms, % non-child: 9.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 142.782us - GetResultsTime: 144.537ms - HTResizeTime: 133.328ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.25M (24251561) - RowsReturned: 26.35M (26345692) - RowsReturnedRate: 528.76 K/sec - StreamingTime: 4s146ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s288ms, non-child: 1s509ms, % non-child: 3.33%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26565340) - RowsReturnedRate: 586.59 K/sec AGGREGATION_NODE (id=17):(Total: 5s359ms, non-child: 2s780ms, % non-child: 51.89%) ExecOption: Codegen Enabled - BuildTime: 2s069ms - GetNewBlockTime: 237.611us - GetResultsTime: 694.526ms - HTResizeTime: 817.300ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 2.48 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 996.000ns EXCHANGE_NODE (id=16):(Total: 2s578ms, non-child: 321.907ms, % non-child: 12.48%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.03 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 33.70 MB, 70.46 MB, 106.85 MB, 133.34 MB - BytesReceived: 133.34 MB (139812373) - ConvertRowBatchTime: 248.981ms - DeserializeRowBatchTimer: 406.362ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 9s836ms - SendersBlockedTotalTimer(*): 9s836ms AGGREGATION_NODE (id=13):(Total: 38s419ms, non-child: 3s769ms, % non-child: 9.81%) ExecOption: Codegen Enabled - BuildTime: 2s951ms - GetNewBlockTime: 295.847us - GetResultsTime: 649.951ms - HTResizeTime: 1s111ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 345.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.321us EXCHANGE_NODE (id=12):(Total: 34s650ms, non-child: 460.407ms, % non-child: 1.33%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 516.33 KB, 18.15 MB, 49.15 MB, 80.06 MB, 110.93 MB - BytesReceived: 133.34 MB (139816357) - ConvertRowBatchTime: 404.717ms - DeserializeRowBatchTimer: 634.239ms - FirstBatchArrivalWaitTime: 33s003ms - PeakMemoryUsage: 0 - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 383.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc9 (host=vb0224.halxg.cloudera.com:22000):(Total: 56s474ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 6.28 MB, 174.60 MB, 416.34 MB, 639.57 MB, 804.41 MB, 786.47 MB, 695.58 MB, 598.34 MB, 549.70 MB, 452.44 MB, 355.21 MB, 257.95 MB, 112.09 MB, 205.79 MB, 418.86 MB, 626.74 MB, 802.35 MB, 772.09 MB, 651.78 MB, 555.53 MB, 459.27 MB, 363.02 MB, 266.77 MB, 141.98 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 186.578ms - RowsProduced: 26.36M (26362284) - TotalCpuTime: 19s907ms - TotalNetworkReceiveTime: 35s924ms - TotalNetworkSendTime: 1s201ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 696.060ms, non-child: 696.060ms, % non-child: 100.00%) - CodegenTime: 3.583ms - CompileTime: 54.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 459.660ms - PrepareTime: 180.320ms DataStreamSender (dst_id=18):(Total: 6s941ms, non-child: 6s941ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297802162) - NetworkThroughput(*): 52.96 MB/sec - OverallThroughput: 40.91 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s559ms - ThriftTransmitTime(*): 5s362ms - UncompressedRowBatchSize: 704.10 MB (738298572) AGGREGATION_NODE (id=9):(Total: 49s476ms, non-child: 5s326ms, % non-child: 10.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 173.816us - GetResultsTime: 164.246ms - HTResizeTime: 126.858ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24270008) - RowsReturned: 26.36M (26362284) - RowsReturnedRate: 532.83 K/sec - StreamingTime: 4s908ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 44s149ms, non-child: 1s478ms, % non-child: 3.35%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581932) - RowsReturnedRate: 602.09 K/sec AGGREGATION_NODE (id=17):(Total: 4s433ms, non-child: 3s195ms, % non-child: 72.07%) ExecOption: Codegen Enabled - BuildTime: 2s453ms - GetNewBlockTime: 246.230us - GetResultsTime: 718.309ms - HTResizeTime: 934.514ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 3.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 994.000ns EXCHANGE_NODE (id=16):(Total: 1s238ms, non-child: 430.374ms, % non-child: 34.75%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 16.35 MB, 50.79 MB, 88.02 MB, 124.74 MB - BytesReceived: 133.41 MB (139894158) - ConvertRowBatchTime: 354.912ms - DeserializeRowBatchTimer: 293.472ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 10.73 M/sec - SendersBlockedTimer: 10s815ms - SendersBlockedTotalTimer(*): 10s815ms AGGREGATION_NODE (id=13):(Total: 38s237ms, non-child: 2s928ms, % non-child: 7.66%) ExecOption: Codegen Enabled - BuildTime: 2s150ms - GetNewBlockTime: 276.594us - GetResultsTime: 679.135ms - HTResizeTime: 856.416ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 347.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.129us EXCHANGE_NODE (id=12):(Total: 35s308ms, non-child: 279.296ms, % non-child: 0.79%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.32 MB, 47.18 MB, 86.35 MB, 124.75 MB, 133.42 MB - BytesReceived: 133.42 MB (139899189) - ConvertRowBatchTime: 240.422ms - DeserializeRowBatchTimer: 207.586ms - FirstBatchArrivalWaitTime: 32s868ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 376.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc7 (host=vb0218.halxg.cloudera.com:22000):(Total: 56s286ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 22.57 MB, 167.86 MB, 385.55 MB, 546.07 MB, 739.95 MB, 792.82 MB, 695.59 MB, 574.03 MB, 452.44 MB, 306.57 MB, 185.02 MB, 121.19 MB, 299.92 MB, 477.40 MB, 675.20 MB, 792.14 MB, 810.26 MB, 748.01 MB, 651.77 MB, 555.51 MB, 411.14 MB, 314.89 MB, 218.63 MB, 89.36 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4111289600) - PrepareTime: 189.440ms - RowsProduced: 26.35M (26354464) - TotalCpuTime: 18s544ms - TotalNetworkReceiveTime: 36s917ms - TotalNetworkSendTime: 1s310ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 635.613ms, non-child: 635.613ms, % non-child: 100.00%) - CodegenTime: 3.385ms - CompileTime: 67.338ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 383.043ms - PrepareTime: 182.587ms DataStreamSender (dst_id=18):(Total: 6s546ms, non-child: 6s546ms, % non-child: 100.00%) - BytesSent: 283.91 MB (297702938) - NetworkThroughput(*): 53.08 MB/sec - OverallThroughput: 43.37 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s314ms - ThriftTransmitTime(*): 5s348ms - UncompressedRowBatchSize: 703.89 MB (738079564) AGGREGATION_NODE (id=9):(Total: 49s703ms, non-child: 4s141ms, % non-child: 8.33%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 118.374us - GetResultsTime: 143.723ms - HTResizeTime: 98.226ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260583) - RowsReturned: 26.35M (26354464) - RowsReturnedRate: 530.23 K/sec - StreamingTime: 3s754ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s562ms, non-child: 1s388ms, % non-child: 3.05%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26574112) - RowsReturnedRate: 583.25 K/sec AGGREGATION_NODE (id=17):(Total: 6s026ms, non-child: 3s207ms, % non-child: 53.22%) ExecOption: Codegen Enabled - BuildTime: 2s502ms - GetNewBlockTime: 222.259us - GetResultsTime: 676.995ms - HTResizeTime: 902.631ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 2.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 951.000ns EXCHANGE_NODE (id=16):(Total: 2s818ms, non-child: 444.218ms, % non-child: 15.76%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 826.29 KB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 20.06 MB, 49.16 MB, 79.84 MB, 113.78 MB, 133.37 MB - BytesReceived: 133.37 MB (139848812) - ConvertRowBatchTime: 369.832ms - DeserializeRowBatchTimer: 315.353ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 4.71 M/sec - SendersBlockedTimer: 9s135ms - SendersBlockedTotalTimer(*): 9s135ms AGGREGATION_NODE (id=13):(Total: 38s146ms, non-child: 3s233ms, % non-child: 8.48%) ExecOption: Codegen Enabled - BuildTime: 2s620ms - GetNewBlockTime: 343.922us - GetResultsTime: 583.719ms - HTResizeTime: 863.827ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 348.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.278us EXCHANGE_NODE (id=12):(Total: 34s912ms, non-child: 477.043ms, % non-child: 1.37%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.13 MB, 27.27 MB, 58.51 MB, 91.09 MB, 123.97 MB - BytesReceived: 133.38 MB (139861589) - ConvertRowBatchTime: 407.688ms - DeserializeRowBatchTimer: 335.807ms - FirstBatchArrivalWaitTime: 32s950ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 380.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dd5 (host=vb0208.halxg.cloudera.com:22000):(Total: 55s990ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 22.22 MB, 218.47 MB, 437.16 MB, 657.30 MB, 804.43 MB, 768.54 MB, 622.67 MB, 428.17 MB, 233.67 MB, 76.50 MB, 235.30 MB, 418.87 MB, 612.75 MB, 784.14 MB, 792.14 MB, 792.14 MB, 810.26 MB, 748.02 MB, 627.71 MB, 507.39 MB, 411.16 MB, 314.89 MB, 194.31 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 203.813ms - RowsProduced: 26.36M (26355734) - TotalCpuTime: 16s700ms - TotalNetworkReceiveTime: 38s951ms - TotalNetworkSendTime: 855.140ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 685.785ms, non-child: 685.785ms, % non-child: 100.00%) - CodegenTime: 3.529ms - CompileTime: 60.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 425.634ms - PrepareTime: 186.905ms DataStreamSender (dst_id=18):(Total: 5s555ms, non-child: 5s555ms, % non-child: 100.00%) - BytesSent: 283.93 MB (297721311) - NetworkThroughput(*): 72.08 MB/sec - OverallThroughput: 51.11 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s055ms - ThriftTransmitTime(*): 3s939ms - UncompressedRowBatchSize: 703.92 MB (738115132) AGGREGATION_NODE (id=9):(Total: 50s399ms, non-child: 3s750ms, % non-child: 7.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 148.719us - GetResultsTime: 141.156ms - HTResizeTime: 100.124ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24260176) - RowsReturned: 26.36M (26355734) - RowsReturnedRate: 522.93 K/sec - StreamingTime: 3s359ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s649ms, non-child: 1s238ms, % non-child: 2.65%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26575382) - RowsReturnedRate: 569.68 K/sec AGGREGATION_NODE (id=17):(Total: 7s430ms, non-child: 2s890ms, % non-child: 38.90%) ExecOption: Codegen Enabled - BuildTime: 2s229ms - GetNewBlockTime: 190.837us - GetResultsTime: 640.440ms - HTResizeTime: 901.359ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 1.79 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.221us EXCHANGE_NODE (id=16):(Total: 4s539ms, non-child: 317.669ms, % non-child: 7.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.71 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.43 MB, 37.22 MB, 68.97 MB, 102.93 MB, 132.11 MB, 133.38 MB, 133.38 MB - BytesReceived: 133.38 MB (139857238) - ConvertRowBatchTime: 275.475ms - DeserializeRowBatchTimer: 221.647ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 2.93 M/sec - SendersBlockedTimer: 7s709ms - SendersBlockedTotalTimer(*): 7s709ms AGGREGATION_NODE (id=13):(Total: 37s980ms, non-child: 2s885ms, % non-child: 7.60%) ExecOption: Codegen Enabled - BuildTime: 2s390ms - GetNewBlockTime: 273.662us - GetResultsTime: 474.425ms - HTResizeTime: 810.450ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 349.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.301us EXCHANGE_NODE (id=12):(Total: 35s095ms, non-child: 440.040ms, % non-child: 1.25%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.35 MB, 33.79 MB, 71.25 MB, 108.59 MB, 133.38 MB - BytesReceived: 133.38 MB (139857938) - ConvertRowBatchTime: 380.516ms - DeserializeRowBatchTimer: 230.690ms - FirstBatchArrivalWaitTime: 32s898ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 378.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dd3 (host=vb0214.halxg.cloudera.com:22000):(Total: 55s927ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 6.47 MB, 151.58 MB, 352.20 MB, 546.08 MB, 764.04 MB, 786.46 MB, 744.20 MB, 598.34 MB, 476.77 MB, 355.22 MB, 209.33 MB, 97.69 MB, 224.98 MB, 429.08 MB, 626.73 MB, 784.14 MB, 822.35 MB, 748.02 MB, 627.72 MB, 507.13 MB, 411.16 MB, 314.89 MB, 218.63 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.85 GB (4135587088) - PrepareTime: 196.445ms - RowsProduced: 26.35M (26350486) - TotalCpuTime: 18s731ms - TotalNetworkReceiveTime: 36s507ms - TotalNetworkSendTime: 1s173ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 642.182ms, non-child: 642.182ms, % non-child: 100.00%) - CodegenTime: 3.247ms - CompileTime: 63.560ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 386.162ms - PrepareTime: 184.881ms DataStreamSender (dst_id=18):(Total: 6s521ms, non-child: 6s521ms, % non-child: 100.00%) - BytesSent: 283.87 MB (297663710) - NetworkThroughput(*): 58.28 MB/sec - OverallThroughput: 43.53 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s342ms - ThriftTransmitTime(*): 4s870ms - UncompressedRowBatchSize: 703.78 MB (737968160) AGGREGATION_NODE (id=9):(Total: 49s371ms, non-child: 4s159ms, % non-child: 8.43%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 162.041us - GetResultsTime: 126.643ms - HTResizeTime: 97.749ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24255945) - RowsReturned: 26.35M (26350486) - RowsReturnedRate: 533.72 K/sec - StreamingTime: 3s782ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s211ms, non-child: 1s452ms, % non-child: 3.21%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26570134) - RowsReturnedRate: 587.69 K/sec AGGREGATION_NODE (id=17):(Total: 5s581ms, non-child: 3s175ms, % non-child: 56.90%) ExecOption: Codegen Enabled - BuildTime: 2s508ms - GetNewBlockTime: 232.694us - GetResultsTime: 646.371ms - HTResizeTime: 936.636ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 2.38 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 977.000ns EXCHANGE_NODE (id=16):(Total: 2s405ms, non-child: 441.492ms, % non-child: 18.35%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.78 MB, 52.43 MB, 87.94 MB, 122.92 MB, 133.36 MB - BytesReceived: 133.36 MB (139838937) - ConvertRowBatchTime: 368.583ms - DeserializeRowBatchTimer: 286.246ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 5.52 M/sec - SendersBlockedTimer: 9s596ms - SendersBlockedTotalTimer(*): 9s596ms AGGREGATION_NODE (id=13):(Total: 38s177ms, non-child: 3s270ms, % non-child: 8.57%) ExecOption: Codegen Enabled - BuildTime: 2s627ms - GetNewBlockTime: 297.625us - GetResultsTime: 619.591ms - HTResizeTime: 882.829ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 347.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.655us EXCHANGE_NODE (id=12):(Total: 34s907ms, non-child: 469.694ms, % non-child: 1.35%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.24 MB, 40.27 MB, 73.93 MB, 107.83 MB, 133.36 MB - BytesReceived: 133.36 MB (139840099) - ConvertRowBatchTime: 401.060ms - DeserializeRowBatchTimer: 263.336ms - FirstBatchArrivalWaitTime: 32s970ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 380.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dcd (host=vb0216.halxg.cloudera.com:22000):(Total: 55s704ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 38.67 MB, 201.86 MB, 400.67 MB, 586.69 MB, 772.64 MB, 792.83 MB, 671.27 MB, 574.03 MB, 452.46 MB, 355.21 MB, 209.32 MB, 112.08 MB, 191.55 MB, 384.39 MB, 582.27 MB, 759.90 MB, 806.16 MB, 748.02 MB, 627.71 MB, 507.38 MB, 411.14 MB, 266.78 MB, 141.98 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.83 GB (4111187200) - PrepareTime: 214.927ms - RowsProduced: 26.35M (26353346) - TotalCpuTime: 19s216ms - TotalNetworkReceiveTime: 35s845ms - TotalNetworkSendTime: 1s189ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 703.006ms, non-child: 703.006ms, % non-child: 100.00%) - CodegenTime: 3.792ms - CompileTime: 67.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 436.978ms - PrepareTime: 184.988ms DataStreamSender (dst_id=18):(Total: 6s526ms, non-child: 6s526ms, % non-child: 100.00%) - BytesSent: 283.89 MB (297681899) - NetworkThroughput(*): 56.34 MB/sec - OverallThroughput: 43.50 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s333ms - ThriftTransmitTime(*): 5s039ms - UncompressedRowBatchSize: 703.86 MB (738048256) AGGREGATION_NODE (id=9):(Total: 49s139ms, non-child: 4s375ms, % non-child: 8.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 672.327us - GetResultsTime: 129.524ms - HTResizeTime: 122.347ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24259001) - RowsReturned: 26.35M (26353346) - RowsReturnedRate: 536.29 K/sec - StreamingTime: 3s982ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 44s763ms, non-child: 1s479ms, % non-child: 3.31%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.57M (26572994) - RowsReturnedRate: 593.63 K/sec AGGREGATION_NODE (id=17):(Total: 5s121ms, non-child: 3s189ms, % non-child: 62.28%) ExecOption: Codegen Enabled - BuildTime: 2s508ms - GetNewBlockTime: 7.025ms - GetResultsTime: 650.813ms - HTResizeTime: 949.714ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 2.59 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.654us EXCHANGE_NODE (id=16):(Total: 1s931ms, non-child: 417.990ms, % non-child: 21.64%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.88 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 29.43 MB, 64.08 MB, 98.26 MB, 128.62 MB - BytesReceived: 133.39 MB (139870793) - ConvertRowBatchTime: 359.347ms - DeserializeRowBatchTimer: 237.092ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 6.88 M/sec - SendersBlockedTimer: 10s011ms - SendersBlockedTotalTimer(*): 10s011ms AGGREGATION_NODE (id=13):(Total: 38s162ms, non-child: 3s444ms, % non-child: 9.03%) ExecOption: Codegen Enabled - BuildTime: 2s736ms - GetNewBlockTime: 528.303us - GetResultsTime: 683.399ms - HTResizeTime: 946.667ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 348.15 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.292us EXCHANGE_NODE (id=12):(Total: 34s718ms, non-child: 469.645ms, % non-child: 1.35%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.35 MB, 33.26 MB, 64.77 MB, 96.65 MB, 126.87 MB - BytesReceived: 133.39 MB (139865800) - ConvertRowBatchTime: 408.659ms - DeserializeRowBatchTimer: 256.761ms - FirstBatchArrivalWaitTime: 32s866ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 382.70 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dc8 (host=vb0222.halxg.cloudera.com:22000):(Total: 55s649ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 22.47 MB, 167.68 MB, 352.21 MB, 542.52 MB, 721.95 MB, 792.84 MB, 671.26 MB, 549.71 MB, 403.84 MB, 282.28 MB, 160.71 MB, 116.92 MB, 279.46 MB, 467.68 MB, 626.75 MB, 776.15 MB, 806.26 MB, 723.94 MB, 603.65 MB, 531.46 MB, 411.14 MB, 290.81 MB, 141.99 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 190.793ms - RowsProduced: 26.37M (26367748) - TotalCpuTime: 17s808ms - TotalNetworkReceiveTime: 37s268ms - TotalNetworkSendTime: 1s018ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 595.684ms, non-child: 595.684ms, % non-child: 100.00%) - CodegenTime: 3.265ms - CompileTime: 47.561ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.521ms - PrepareTime: 184.903ms DataStreamSender (dst_id=18):(Total: 6s110ms, non-child: 6s110ms, % non-child: 100.00%) - BytesSent: 284.05 MB (297848323) - NetworkThroughput(*): 61.30 MB/sec - OverallThroughput: 46.48 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s272ms - ThriftTransmitTime(*): 4s634ms - UncompressedRowBatchSize: 704.24 MB (738451596) AGGREGATION_NODE (id=9):(Total: 49s507ms, non-child: 4s130ms, % non-child: 8.34%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 144.240us - GetResultsTime: 154.263ms - HTResizeTime: 114.584ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.28M (24275086) - RowsReturned: 26.37M (26367748) - RowsReturnedRate: 532.60 K/sec - StreamingTime: 3s729ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s376ms, non-child: 1s339ms, % non-child: 2.95%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.59M (26587396) - RowsReturnedRate: 585.92 K/sec AGGREGATION_NODE (id=17):(Total: 5s817ms, non-child: 3s311ms, % non-child: 56.92%) ExecOption: Codegen Enabled - BuildTime: 2s652ms - GetNewBlockTime: 382.798us - GetResultsTime: 629.413ms - HTResizeTime: 915.379ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 2.29 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.014us EXCHANGE_NODE (id=16):(Total: 2s506ms, non-child: 457.341ms, % non-child: 18.25%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.18 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 16.78 MB, 45.54 MB, 75.90 MB, 106.06 MB, 131.09 MB - BytesReceived: 133.46 MB (139940963) - ConvertRowBatchTime: 394.520ms - DeserializeRowBatchTimer: 325.764ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 5.30 M/sec - SendersBlockedTimer: 9s286ms - SendersBlockedTotalTimer(*): 9s286ms AGGREGATION_NODE (id=13):(Total: 38s220ms, non-child: 2s757ms, % non-child: 7.22%) ExecOption: Codegen Enabled - BuildTime: 2s117ms - GetNewBlockTime: 278.269us - GetResultsTime: 616.970ms - HTResizeTime: 760.307ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 347.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.322us EXCHANGE_NODE (id=12):(Total: 35s462ms, non-child: 315.557ms, % non-child: 0.89%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.09 MB, 26.53 MB, 57.23 MB, 88.36 MB, 118.95 MB - BytesReceived: 133.45 MB (139931123) - ConvertRowBatchTime: 274.415ms - DeserializeRowBatchTimer: 230.947ms - FirstBatchArrivalWaitTime: 33s017ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 374.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dd2 (host=vb0212.halxg.cloudera.com:22000):(Total: 55s448ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 14.22 MB, 148.55 MB, 352.20 MB, 546.07 MB, 739.95 MB, 792.83 MB, 622.64 MB, 476.77 MB, 355.19 MB, 209.34 MB, 94.07 MB, 235.07 MB, 419.20 MB, 582.25 MB, 755.90 MB, 792.13 MB, 826.25 MB, 748.01 MB, 627.71 MB, 507.41 MB, 411.16 MB, 314.91 MB, 141.97 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.38 MB (902172592) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 187.380ms - RowsProduced: 26.36M (26361370) - TotalCpuTime: 16s117ms - TotalNetworkReceiveTime: 38s886ms - TotalNetworkSendTime: 913.779ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 619.383ms, non-child: 619.383ms, % non-child: 100.00%) - CodegenTime: 3.411ms - CompileTime: 59.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 376.287ms - PrepareTime: 179.463ms DataStreamSender (dst_id=18):(Total: 5s704ms, non-child: 5s704ms, % non-child: 100.00%) - BytesSent: 283.98 MB (297773737) - NetworkThroughput(*): 65.56 MB/sec - OverallThroughput: 49.78 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s083ms - ThriftTransmitTime(*): 4s331ms - UncompressedRowBatchSize: 704.07 MB (738272976) AGGREGATION_NODE (id=9):(Total: 49s715ms, non-child: 3s743ms, % non-child: 7.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 168.205us - GetResultsTime: 90.693ms - HTResizeTime: 99.555ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24268396) - RowsReturned: 26.36M (26361370) - RowsReturnedRate: 530.24 K/sec - StreamingTime: 3s415ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s972ms, non-child: 1s291ms, % non-child: 2.81%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26581018) - RowsReturnedRate: 578.19 K/sec AGGREGATION_NODE (id=17):(Total: 6s548ms, non-child: 2s769ms, % non-child: 42.30%) ExecOption: Codegen Enabled - BuildTime: 2s121ms - GetNewBlockTime: 235.214us - GetResultsTime: 627.666ms - HTResizeTime: 897.681ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.006us EXCHANGE_NODE (id=16):(Total: 3s778ms, non-child: 304.727ms, % non-child: 8.07%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.85 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.69 MB, 36.78 MB, 67.33 MB, 98.26 MB, 127.48 MB, 133.42 MB - BytesReceived: 133.42 MB (139899316) - ConvertRowBatchTime: 264.020ms - DeserializeRowBatchTimer: 343.332ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 3.52 M/sec - SendersBlockedTimer: 8s566ms - SendersBlockedTotalTimer(*): 8s566ms AGGREGATION_NODE (id=13):(Total: 38s132ms, non-child: 2s496ms, % non-child: 6.55%) ExecOption: Codegen Enabled - BuildTime: 1s926ms - GetNewBlockTime: 276.071us - GetResultsTime: 552.241ms - HTResizeTime: 689.130ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 348.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.128us EXCHANGE_NODE (id=12):(Total: 35s636ms, non-child: 287.506ms, % non-child: 0.81%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.32 MB, 24.76 MB, 57.10 MB, 90.29 MB, 123.63 MB - BytesReceived: 133.41 MB (139888339) - ConvertRowBatchTime: 238.080ms - DeserializeRowBatchTimer: 361.102ms - FirstBatchArrivalWaitTime: 33s088ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 372.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dd1 (host=vb0234.halxg.cloudera.com:22000):(Total: 55s273ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 123.54 MB, 333.04 MB, 497.60 MB, 687.49 MB, 786.47 MB, 671.28 MB, 525.39 MB, 355.21 MB, 233.64 MB, 95.34 MB, 284.08 MB, 499.58 MB, 719.69 MB, 792.16 MB, 792.16 MB, 802.36 MB, 748.03 MB, 603.63 MB, 483.33 MB, 363.02 MB, 266.79 MB, 141.96 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.37 MB (902164400) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 191.383ms - RowsProduced: 26.36M (26356928) - TotalCpuTime: 15s974ms - TotalNetworkReceiveTime: 39s042ms - TotalNetworkSendTime: 791.840ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 688.118ms, non-child: 688.118ms, % non-child: 100.00%) - CodegenTime: 3.314ms - CompileTime: 50.206ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 450.882ms - PrepareTime: 185.880ms DataStreamSender (dst_id=18):(Total: 5s273ms, non-child: 5s273ms, % non-child: 100.00%) - BytesSent: 283.95 MB (297741397) - NetworkThroughput(*): 77.75 MB/sec - OverallThroughput: 53.84 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 2s047ms - ThriftTransmitTime(*): 3s652ms - UncompressedRowBatchSize: 703.95 MB (738148572) AGGREGATION_NODE (id=9):(Total: 49s966ms, non-child: 3s781ms, % non-child: 7.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.812us - GetResultsTime: 137.007ms - HTResizeTime: 93.862ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.26M (24261381) - RowsReturned: 26.36M (26356928) - RowsReturnedRate: 527.49 K/sec - StreamingTime: 3s405ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 46s184ms, non-child: 1s229ms, % non-child: 2.66%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26576576) - RowsReturnedRate: 575.44 K/sec AGGREGATION_NODE (id=17):(Total: 6s771ms, non-child: 2s744ms, % non-child: 40.52%) ExecOption: Codegen Enabled - BuildTime: 2s129ms - GetNewBlockTime: 224.573us - GetResultsTime: 597.905ms - HTResizeTime: 873.552ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 1.96 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.113us EXCHANGE_NODE (id=16):(Total: 4s027ms, non-child: 329.934ms, % non-child: 8.19%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 27.34 MB, 64.29 MB, 102.53 MB, 132.15 MB, 133.38 MB, 133.38 MB - BytesReceived: 133.38 MB (139863008) - ConvertRowBatchTime: 266.659ms - DeserializeRowBatchTimer: 296.323ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 3.30 M/sec - SendersBlockedTimer: 8s273ms - SendersBlockedTotalTimer(*): 8s273ms AGGREGATION_NODE (id=13):(Total: 38s183ms, non-child: 2s624ms, % non-child: 6.87%) ExecOption: Codegen Enabled - BuildTime: 1s926ms - GetNewBlockTime: 300.534us - GetResultsTime: 513.684ms - HTResizeTime: 686.657ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 348.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.373us EXCHANGE_NODE (id=12):(Total: 35s559ms, non-child: 302.362ms, % non-child: 0.85%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.67 MB, 35.37 MB, 65.93 MB, 97.87 MB, 127.44 MB - BytesReceived: 133.39 MB (139865835) - ConvertRowBatchTime: 249.134ms - DeserializeRowBatchTimer: 419.525ms - FirstBatchArrivalWaitTime: 32s894ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 373.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance fc4ebd07a3c493a1:101db40b9b2a9dd0 (host=vb0204.halxg.cloudera.com:22000):(Total: 54s086ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.92 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 5.84 MB, 131.64 MB, 336.20 MB, 538.19 MB, 723.95 MB, 810.79 MB, 695.59 MB, 598.34 MB, 476.78 MB, 330.91 MB, 160.71 MB, 150.66 MB, 372.77 MB, 597.52 MB, 776.14 MB, 792.14 MB, 802.36 MB, 748.03 MB, 579.59 MB, 411.15 MB, 242.69 MB, 46.30 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.39 MB (902188976) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 215.320ms - RowsProduced: 26.36M (26363288) - TotalCpuTime: 16s245ms - TotalNetworkReceiveTime: 37s519ms - TotalNetworkSendTime: 844.013ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 694.008ms, non-child: 694.008ms, % non-child: 100.00%) - CodegenTime: 3.816ms - CompileTime: 42.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 444.597ms - PrepareTime: 194.105ms DataStreamSender (dst_id=18):(Total: 5s177ms, non-child: 5s177ms, % non-child: 100.00%) - BytesSent: 284.01 MB (297804794) - NetworkThroughput(*): 75.11 MB/sec - OverallThroughput: 54.85 MB/sec - PeakMemoryUsage: 107.92 KB (110512) - SerializeBatchTime: 1s926ms - ThriftTransmitTime(*): 3s781ms - UncompressedRowBatchSize: 704.12 MB (738326688) AGGREGATION_NODE (id=9):(Total: 48s876ms, non-child: 3s501ms, % non-child: 7.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 203.160us - GetResultsTime: 148.752ms - HTResizeTime: 94.685ms - HashBuckets: 4.77M (4771840) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.84 MB (152920064) - PinTime: 0.000ns - ReductionFactorEstimate: 1.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 24.27M (24269924) - RowsReturned: 26.36M (26363288) - RowsReturnedRate: 539.38 K/sec - StreamingTime: 3s090ms - UnpinTime: 0.000ns UNION_NODE (id=0):(Total: 45s374ms, non-child: 1s226ms, % non-child: 2.70%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 26.58M (26582936) - RowsReturnedRate: 585.85 K/sec AGGREGATION_NODE (id=17):(Total: 6s067ms, non-child: 2s927ms, % non-child: 48.25%) ExecOption: Codegen Enabled - BuildTime: 2s418ms - GetNewBlockTime: 2.065ms - GetResultsTime: 483.128ms - HTResizeTime: 931.611ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.095us EXCHANGE_NODE (id=16):(Total: 3s140ms, non-child: 435.309ms, % non-child: 13.86%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.18 MB, 41.54 MB, 79.91 MB, 119.22 MB, 133.43 MB, 133.43 MB - BytesReceived: 133.43 MB (139908440) - ConvertRowBatchTime: 354.195ms - DeserializeRowBatchTimer: 278.726ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 4.23 M/sec - SendersBlockedTimer: 8s947ms - SendersBlockedTotalTimer(*): 8s947ms AGGREGATION_NODE (id=13):(Total: 38s080ms, non-child: 2s984ms, % non-child: 7.84%) ExecOption: Codegen Enabled - BuildTime: 2s376ms - GetNewBlockTime: 364.672us - GetResultsTime: 583.471ms - HTResizeTime: 827.418ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 794.02 MB (832593920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 349.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.211us EXCHANGE_NODE (id=12):(Total: 35s095ms, non-child: 390.670ms, % non-child: 1.11%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.95 MB, 37.04 MB, 70.09 MB, 104.07 MB, 131.04 MB - BytesReceived: 133.42 MB (139906149) - ConvertRowBatchTime: 330.620ms - DeserializeRowBatchTimer: 308.674ms - FirstBatchArrivalWaitTime: 32s888ms - PeakMemoryUsage: 0 - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 378.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F06: Instance fc4ebd07a3c493a1:101db40b9b2a9dde (host=vb0216.halxg.cloudera.com:22000):(Total: 48s969ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.86 MB, 228.34 MB, 356.37 MB, 484.35 MB, 612.35 MB, 708.32 MB, 884.30 MB, 1.07 GB, 1.16 GB, 1.32 GB, 1.32 GB, 1.34 GB, 1.34 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 534.32 MB, 388.65 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070202368) - PerHostPeakMemUsage: 3.83 GB (4111187200) - PrepareTime: 197.382ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 36s803ms - TotalNetworkReceiveTime: 9s300ms - TotalNetworkSendTime: 10s751ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 698.376ms, non-child: 698.376ms, % non-child: 100.00%) - CodegenTime: 919.506us - CompileTime: 80.172ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 424.162ms - PrepareTime: 181.323ms DataStreamSender (dst_id=16):(Total: 14s296ms, non-child: 14s296ms, % non-child: 100.00%) - BytesSent: 133.40 MB (139877375) - NetworkThroughput(*): 10.28 MB/sec - OverallThroughput: 9.33 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 753.805ms - ThriftTransmitTime(*): 12s978ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=8):(Total: 34s642ms, non-child: 9s922ms, % non-child: 28.64%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 568.195us - GetResultsTime: 467.718ms - HTResizeTime: 1s143ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 383.60 K/sec - StreamingTime: 9s124ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 24s720ms, non-child: 13s528ms, % non-child: 54.73%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s297ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s718ms - GetNewBlockTime: 1.154ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s767ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.09 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us EXCHANGE_NODE (id=15):(Total: 3s757ms, non-child: 566.496ms, % non-child: 15.08%) BytesReceived(1s000ms): 8.89 MB, 69.25 MB, 138.02 MB, 206.66 MB, 270.77 MB, 296.91 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB - BytesReceived: 298.23 MB (312719688) - ConvertRowBatchTime: 271.658ms - DeserializeRowBatchTimer: 1s065ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 7s434ms, non-child: 3s277ms, % non-child: 44.09%) BytesReceived(1s000ms): 5.03 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 23.73 MB, 82.62 MB, 127.28 MB, 170.81 MB, 211.56 MB, 250.91 MB, 291.81 MB, 328.17 MB, 364.24 MB, 399.95 MB, 434.95 MB, 470.84 MB, 511.85 MB, 547.27 MB, 584.73 MB, 624.90 MB, 667.97 MB, 702.61 MB, 737.38 MB, 780.83 MB, 820.37 MB, 868.00 MB, 912.65 MB, 962.03 MB, 1002.00 MB, 1.01 GB - BytesReceived: 1.03 GB (1102844503) - ConvertRowBatchTime: 1s427ms - DeserializeRowBatchTimer: 6s164ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 6.94 M/sec - SendersBlockedTimer: 7s968ms - SendersBlockedTotalTimer(*): 52s519ms Instance fc4ebd07a3c493a1:101db40b9b2a9de3 (host=vb0222.halxg.cloudera.com:22000):(Total: 48s595ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 77.70 MB, 172.37 MB, 292.38 MB, 420.34 MB, 548.37 MB, 676.36 MB, 868.33 MB, 1.07 GB, 1.15 GB, 1.29 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.48 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.00 MB, 485.76 MB, 315.80 MB, 145.84 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069767168) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 202.250ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 34s623ms - TotalNetworkReceiveTime: 11s313ms - TotalNetworkSendTime: 10s547ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 684.760ms, non-child: 684.760ms, % non-child: 100.00%) - CodegenTime: 1.215ms - CompileTime: 69.340ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 417.585ms - PrepareTime: 185.609ms DataStreamSender (dst_id=16):(Total: 13s875ms, non-child: 13s875ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139860829) - NetworkThroughput(*): 10.34 MB/sec - OverallThroughput: 9.61 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 952.176ms - ThriftTransmitTime(*): 12s901ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=8):(Total: 34s695ms, non-child: 9s148ms, % non-child: 26.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.522ms - GetResultsTime: 495.879ms - HTResizeTime: 1s040ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 383.02 K/sec - StreamingTime: 8s341ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s546ms, non-child: 12s530ms, % non-child: 49.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s253ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s793ms - GetNewBlockTime: 3.361ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s835ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.147us EXCHANGE_NODE (id=15):(Total: 3s817ms, non-child: 607.156ms, % non-child: 15.90%) BytesReceived(1s000ms): 3.37 MB, 56.44 MB, 125.48 MB, 194.02 MB, 259.96 MB, 295.51 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB - BytesReceived: 298.29 MB (312784656) - ConvertRowBatchTime: 279.291ms - DeserializeRowBatchTimer: 1s088ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s198ms, non-child: 2s819ms, % non-child: 30.66%) BytesReceived(1s000ms): 2.93 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 18.13 MB, 71.73 MB, 120.57 MB, 159.55 MB, 204.35 MB, 245.52 MB, 285.08 MB, 321.66 MB, 357.91 MB, 393.73 MB, 428.26 MB, 464.07 MB, 505.64 MB, 540.73 MB, 578.06 MB, 616.95 MB, 661.60 MB, 696.37 MB, 731.14 MB, 773.04 MB, 813.49 MB, 859.19 MB, 904.83 MB, 952.75 MB, 997.35 MB, 1.00 GB - BytesReceived: 1.03 GB (1103063902) - ConvertRowBatchTime: 1s246ms - DeserializeRowBatchTimer: 5s642ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 5.61 M/sec - SendersBlockedTimer: 7s260ms - SendersBlockedTotalTimer(*): 1m12s Instance fc4ebd07a3c493a1:101db40b9b2a9dd8 (host=vb0214.halxg.cloudera.com:22000):(Total: 48s586ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 3.34 MB, 164.40 MB, 292.59 MB, 420.42 MB, 548.38 MB, 676.35 MB, 836.33 MB, 1.02 GB, 1.16 GB, 1.29 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.73 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 607.17 MB, 388.64 MB, 170.10 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069383168) - PerHostPeakMemUsage: 3.85 GB (4135587088) - PrepareTime: 204.695ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 34s996ms - TotalNetworkReceiveTime: 10s568ms - TotalNetworkSendTime: 10s940ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 665.523ms, non-child: 665.523ms, % non-child: 100.00%) - CodegenTime: 1.953ms - CompileTime: 53.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 413.474ms - PrepareTime: 187.294ms DataStreamSender (dst_id=16):(Total: 13s871ms, non-child: 13s871ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139894158) - NetworkThroughput(*): 10.32 MB/sec - OverallThroughput: 9.62 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 754.182ms - ThriftTransmitTime(*): 12s921ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=8):(Total: 34s695ms, non-child: 8s988ms, % non-child: 25.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 907.120us - GetResultsTime: 488.981ms - HTResizeTime: 1s080ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 383.07 K/sec - StreamingTime: 8s199ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s707ms, non-child: 13s314ms, % non-child: 51.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s754ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s757ms - GetNewBlockTime: 1.403ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s077ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.01 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.237us EXCHANGE_NODE (id=15):(Total: 3s320ms, non-child: 1s409ms, % non-child: 42.46%) BytesReceived(1s000ms): 15.73 MB, 81.75 MB, 150.40 MB, 218.45 MB, 278.96 MB, 297.83 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB - BytesReceived: 298.26 MB (312750124) - ConvertRowBatchTime: 369.331ms - DeserializeRowBatchTimer: 1s928ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s072ms, non-child: 2s622ms, % non-child: 28.90%) BytesReceived(1s000ms): 5.40 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 32.84 MB, 90.04 MB, 133.49 MB, 178.96 MB, 220.28 MB, 261.86 MB, 298.42 MB, 334.67 MB, 371.10 MB, 406.69 MB, 441.29 MB, 478.70 MB, 516.98 MB, 554.36 MB, 591.67 MB, 633.67 MB, 674.37 MB, 708.88 MB, 743.83 MB, 789.89 MB, 828.38 MB, 876.85 MB, 921.53 MB, 971.95 MB, 1005.57 MB, 1.01 GB - BytesReceived: 1.03 GB (1103407418) - ConvertRowBatchTime: 1s265ms - DeserializeRowBatchTimer: 5s279ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 5.69 M/sec - SendersBlockedTimer: 7s312ms - SendersBlockedTotalTimer(*): 1m5s Instance fc4ebd07a3c493a1:101db40b9b2a9ddb (host=vb0204.halxg.cloudera.com:22000):(Total: 48s566ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.01 MB, 164.38 MB, 292.68 MB, 420.87 MB, 548.43 MB, 676.34 MB, 820.33 MB, 1.00 GB, 1.16 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.54 GB, 1.54 GB, 1.61 GB, 1.67 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.73 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 534.33 MB, 340.07 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070458368) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 212.060ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 35s918ms - TotalNetworkReceiveTime: 10s371ms - TotalNetworkSendTime: 10s203ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 712.661ms, non-child: 712.661ms, % non-child: 100.00%) - CodegenTime: 893.484us - CompileTime: 64.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 443.131ms - PrepareTime: 190.607ms DataStreamSender (dst_id=16):(Total: 13s869ms, non-child: 13s869ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139868638) - NetworkThroughput(*): 10.75 MB/sec - OverallThroughput: 9.62 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 739.061ms - ThriftTransmitTime(*): 12s407ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=8):(Total: 34s676ms, non-child: 8s870ms, % non-child: 25.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.038ms - GetResultsTime: 494.618ms - HTResizeTime: 996.920ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 383.23 K/sec - StreamingTime: 8s049ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s805ms, non-child: 13s485ms, % non-child: 52.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s827ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s766ms - GetNewBlockTime: 1.640ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s148ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.044us EXCHANGE_NODE (id=15):(Total: 3s202ms, non-child: 1s373ms, % non-child: 42.90%) BytesReceived(1s000ms): 14.19 MB, 79.38 MB, 148.06 MB, 216.16 MB, 277.60 MB, 297.72 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB - BytesReceived: 298.26 MB (312752654) - ConvertRowBatchTime: 409.869ms - DeserializeRowBatchTimer: 1s839ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 4.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s118ms, non-child: 3s024ms, % non-child: 33.16%) BytesReceived(1s000ms): 5.21 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 30.86 MB, 88.16 MB, 131.43 MB, 177.28 MB, 218.52 MB, 260.33 MB, 297.21 MB, 333.53 MB, 369.88 MB, 405.57 MB, 440.17 MB, 477.35 MB, 515.77 MB, 553.11 MB, 590.52 MB, 632.14 MB, 673.41 MB, 707.95 MB, 742.74 MB, 788.28 MB, 827.00 MB, 875.65 MB, 919.53 MB, 970.09 MB, 1004.52 MB, 1.01 GB - BytesReceived: 1.03 GB (1103019515) - ConvertRowBatchTime: 1s328ms - DeserializeRowBatchTimer: 5s387ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 5.66 M/sec - SendersBlockedTimer: 10s631ms - SendersBlockedTotalTimer(*): 2m7s Instance fc4ebd07a3c493a1:101db40b9b2a9ddc (host=vb0226.halxg.cloudera.com:22000):(Total: 48s258ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.85 MB, 230.19 MB, 357.75 MB, 484.60 MB, 548.46 MB, 692.31 MB, 852.30 MB, 1.05 GB, 1.15 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.51 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.55 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.45 MB, 437.20 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070586368) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 191.828ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 36s644ms - TotalNetworkReceiveTime: 9s556ms - TotalNetworkSendTime: 10s098ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 643.574ms, non-child: 643.574ms, % non-child: 100.00%) - CodegenTime: 838.332us - CompileTime: 64.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 390.322ms - PrepareTime: 185.994ms DataStreamSender (dst_id=16):(Total: 13s531ms, non-child: 13s531ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139870793) - NetworkThroughput(*): 11.00 MB/sec - OverallThroughput: 9.86 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 801.366ms - ThriftTransmitTime(*): 12s126ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=8):(Total: 34s713ms, non-child: 9s290ms, % non-child: 26.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 759.890us - GetResultsTime: 478.610ms - HTResizeTime: 1s135ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 382.75 K/sec - StreamingTime: 8s510ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s422ms, non-child: 13s896ms, % non-child: 54.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s128ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s872ms - GetNewBlockTime: 1.840ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s161ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.427us EXCHANGE_NODE (id=15):(Total: 2s974ms, non-child: 1s535ms, % non-child: 51.63%) BytesReceived(1s000ms): 5.74 MB, 62.22 MB, 131.33 MB, 199.75 MB, 265.00 MB, 296.10 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB, 298.19 MB - BytesReceived: 298.19 MB (312670750) - ConvertRowBatchTime: 485.470ms - DeserializeRowBatchTimer: 1s899ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 4.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s551ms, non-child: 2s870ms, % non-child: 33.56%) BytesReceived(1s000ms): 5.06 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 20.69 MB, 76.78 MB, 124.53 MB, 164.14 MB, 207.17 MB, 246.26 MB, 287.84 MB, 324.44 MB, 360.69 MB, 396.48 MB, 431.17 MB, 466.88 MB, 509.67 MB, 543.79 MB, 581.20 MB, 620.58 MB, 664.71 MB, 699.15 MB, 733.84 MB, 776.60 MB, 816.34 MB, 862.98 MB, 908.62 MB, 957.00 MB, 999.87 MB, 1.00 GB - BytesReceived: 1.03 GB (1102998580) - ConvertRowBatchTime: 1s281ms - DeserializeRowBatchTimer: 5s769ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 7s397ms - SendersBlockedTotalTimer(*): 1m21s Instance fc4ebd07a3c493a1:101db40b9b2a9dd7 (host=vb0230.halxg.cloudera.com:22000):(Total: 47s864ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 11.88 MB, 164.37 MB, 292.38 MB, 420.42 MB, 548.35 MB, 676.36 MB, 820.33 MB, 1012.33 MB, 1.16 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.76 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.31 MB, 534.32 MB, 364.37 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072019968) - PerHostPeakMemUsage: 3.88 GB (4170802424) - PrepareTime: 191.771ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 36s603ms - TotalNetworkReceiveTime: 9s964ms - TotalNetworkSendTime: 9s422ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 743.751ms, non-child: 743.751ms, % non-child: 100.00%) - CodegenTime: 824.779us - CompileTime: 59.426ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 495.748ms - PrepareTime: 179.744ms DataStreamSender (dst_id=16):(Total: 13s241ms, non-child: 13s241ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139940963) - NetworkThroughput(*): 11.12 MB/sec - OverallThroughput: 10.08 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 778.767ms - ThriftTransmitTime(*): 11s999ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=8):(Total: 34s609ms, non-child: 9s042ms, % non-child: 26.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 772.647us - GetResultsTime: 476.381ms - HTResizeTime: 985.898ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 384.11 K/sec - StreamingTime: 8s259ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s567ms, non-child: 13s646ms, % non-child: 53.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s932ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s901ms - GetNewBlockTime: 2.237ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s027ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.02 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.232us EXCHANGE_NODE (id=15):(Total: 3s080ms, non-child: 830.761ms, % non-child: 26.97%) BytesReceived(1s000ms): 2.49 MB, 54.13 MB, 122.99 MB, 191.61 MB, 257.77 MB, 295.21 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB - BytesReceived: 298.35 MB (312841759) - ConvertRowBatchTime: 445.547ms - DeserializeRowBatchTimer: 1s163ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 4.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s839ms, non-child: 3s043ms, % non-child: 34.43%) BytesReceived(1s000ms): 2.00 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 17.03 MB, 69.45 MB, 118.17 MB, 159.58 MB, 202.15 MB, 244.67 MB, 283.67 MB, 320.44 MB, 356.72 MB, 392.84 MB, 427.38 MB, 462.93 MB, 503.92 MB, 539.44 MB, 576.80 MB, 615.49 MB, 660.42 MB, 695.22 MB, 729.87 MB, 771.47 MB, 812.47 MB, 857.69 MB, 903.31 MB, 951.08 MB, 996.78 MB, 1023.94 MB - BytesReceived: 1.03 GB (1103520600) - ConvertRowBatchTime: 1s310ms - DeserializeRowBatchTimer: 5s914ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 5.84 M/sec - SendersBlockedTimer: 7s481ms - SendersBlockedTotalTimer(*): 52s455ms Instance fc4ebd07a3c493a1:101db40b9b2a9dda (host=vb0234.halxg.cloudera.com:22000):(Total: 47s744ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.18 MB, 164.44 MB, 292.38 MB, 420.35 MB, 548.36 MB, 676.34 MB, 788.33 MB, 996.33 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.44 MB, 437.21 MB, 242.95 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071712768) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 189.279ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 34s806ms - TotalNetworkReceiveTime: 11s094ms - TotalNetworkSendTime: 9s851ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 682.609ms, non-child: 682.609ms, % non-child: 100.00%) - CodegenTime: 834.519us - CompileTime: 63.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 432.716ms - PrepareTime: 184.573ms DataStreamSender (dst_id=16):(Total: 13s089ms, non-child: 13s089ms, % non-child: 100.00%) - BytesSent: 133.47 MB (139957527) - NetworkThroughput(*): 11.21 MB/sec - OverallThroughput: 10.20 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 767.343ms - ThriftTransmitTime(*): 11s903ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=8):(Total: 34s639ms, non-child: 8s819ms, % non-child: 25.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 591.745us - GetResultsTime: 450.153ms - HTResizeTime: 1s064ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 383.86 K/sec - StreamingTime: 8s073ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s819ms, non-child: 12s989ms, % non-child: 50.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s373ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s808ms - GetNewBlockTime: 1.284ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s068ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.766us EXCHANGE_NODE (id=15):(Total: 3s702ms, non-child: 628.655ms, % non-child: 16.98%) BytesReceived(1s000ms): 13.10 MB, 77.63 MB, 146.37 MB, 214.59 MB, 276.69 MB, 297.77 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB, 298.44 MB - BytesReceived: 298.44 MB (312934339) - ConvertRowBatchTime: 294.537ms - DeserializeRowBatchTimer: 1s079ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 3.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s128ms, non-child: 2s584ms, % non-child: 28.31%) BytesReceived(1s000ms): 5.13 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 29.35 MB, 87.18 MB, 129.67 MB, 176.10 MB, 217.20 MB, 258.88 MB, 296.42 MB, 332.75 MB, 368.91 MB, 404.59 MB, 439.24 MB, 476.24 MB, 514.87 MB, 552.07 MB, 589.39 MB, 630.51 MB, 672.45 MB, 707.13 MB, 742.06 MB, 787.34 MB, 826.30 MB, 875.08 MB, 918.94 MB, 969.08 MB, 1004.69 MB, 1.01 GB - BytesReceived: 1.03 GB (1103675202) - ConvertRowBatchTime: 1s267ms - DeserializeRowBatchTimer: 5s146ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 5.66 M/sec - SendersBlockedTimer: 7s360ms - SendersBlockedTotalTimer(*): 1m43s Instance fc4ebd07a3c493a1:101db40b9b2a9dd9 (host=vb0212.halxg.cloudera.com:22000):(Total: 47s720ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 80.51 MB, 228.38 MB, 356.37 MB, 440.43 MB, 548.40 MB, 692.36 MB, 852.33 MB, 1.04 GB, 1.15 GB, 1.30 GB, 1.34 GB, 1.33 GB, 1.34 GB, 1.36 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.78 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 582.90 MB, 388.64 MB, 170.11 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069280768) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 197.910ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 36s602ms - TotalNetworkReceiveTime: 9s178ms - TotalNetworkSendTime: 9s975ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 704.620ms, non-child: 704.620ms, % non-child: 100.00%) - CodegenTime: 994.457us - CompileTime: 61.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 448.854ms - PrepareTime: 182.530ms DataStreamSender (dst_id=16):(Total: 13s068ms, non-child: 13s068ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139812373) - NetworkThroughput(*): 10.83 MB/sec - OverallThroughput: 10.20 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 776.648ms - ThriftTransmitTime(*): 12s307ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=8):(Total: 34s636ms, non-child: 9s810ms, % non-child: 28.33%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 650.184us - GetResultsTime: 460.089ms - HTResizeTime: 1s028ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 383.49 K/sec - StreamingTime: 9s023ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 24s825ms, non-child: 13s718ms, % non-child: 55.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s445ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s834ms - GetNewBlockTime: 1.777ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s661ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.625us EXCHANGE_NODE (id=15):(Total: 3s611ms, non-child: 1s018ms, % non-child: 28.20%) BytesReceived(1s000ms): 4.52 MB, 59.30 MB, 128.29 MB, 196.78 MB, 262.40 MB, 295.74 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB, 298.14 MB - BytesReceived: 298.14 MB (312617425) - ConvertRowBatchTime: 310.142ms - DeserializeRowBatchTimer: 1s566ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 3.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 7s496ms, non-child: 3s476ms, % non-child: 46.38%) BytesReceived(1s000ms): 4.05 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 19.42 MB, 74.28 MB, 123.05 MB, 161.70 MB, 206.13 MB, 246.11 MB, 286.57 MB, 323.07 MB, 359.31 MB, 395.15 MB, 429.59 MB, 465.34 MB, 507.53 MB, 541.98 MB, 579.32 MB, 618.40 MB, 663.00 MB, 697.41 MB, 732.17 MB, 774.36 MB, 814.59 MB, 860.84 MB, 906.42 MB, 954.58 MB, 998.37 MB, 1.00 GB - BytesReceived: 1.03 GB (1102738834) - ConvertRowBatchTime: 1s423ms - DeserializeRowBatchTimer: 5s472ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.88 M/sec - SendersBlockedTimer: 13s613ms - SendersBlockedTotalTimer(*): 2m42s Instance fc4ebd07a3c493a1:101db40b9b2a9de2 (host=vb0224.halxg.cloudera.com:22000):(Total: 47s677ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.52 MB, 164.40 MB, 292.38 MB, 420.37 MB, 548.34 MB, 676.36 MB, 788.33 MB, 980.33 MB, 1.14 GB, 1.29 GB, 1.31 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 582.89 MB, 388.64 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068103168) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 184.597ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 35s888ms - TotalNetworkReceiveTime: 10s187ms - TotalNetworkSendTime: 9s702ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 677.715ms, non-child: 677.715ms, % non-child: 100.00%) - CodegenTime: 947.665us - CompileTime: 60.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 436.284ms - PrepareTime: 179.715ms DataStreamSender (dst_id=16):(Total: 13s008ms, non-child: 13s008ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139838937) - NetworkThroughput(*): 11.30 MB/sec - OverallThroughput: 10.25 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 784.007ms - ThriftTransmitTime(*): 11s804ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=8):(Total: 34s632ms, non-child: 9s742ms, % non-child: 28.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 588.541us - GetResultsTime: 458.811ms - HTResizeTime: 1s084ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 383.60 K/sec - StreamingTime: 8s990ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 24s890ms, non-child: 12s979ms, % non-child: 52.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s294ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s982ms - GetNewBlockTime: 1.065ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s033ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.07 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.386us EXCHANGE_NODE (id=15):(Total: 3s772ms, non-child: 568.338ms, % non-child: 15.07%) BytesReceived(1s000ms): 14.86 MB, 80.36 MB, 149.07 MB, 217.15 MB, 278.10 MB, 297.70 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB, 298.17 MB - BytesReceived: 298.17 MB (312655420) - ConvertRowBatchTime: 271.011ms - DeserializeRowBatchTimer: 1s031ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s138ms, non-child: 2s760ms, % non-child: 33.91%) BytesReceived(1s000ms): 5.29 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 31.63 MB, 88.73 MB, 132.10 MB, 177.69 MB, 218.95 MB, 260.77 MB, 297.38 MB, 333.63 MB, 370.08 MB, 405.72 MB, 440.29 MB, 477.51 MB, 515.78 MB, 553.32 MB, 590.65 MB, 632.41 MB, 673.57 MB, 708.16 MB, 743.06 MB, 788.62 MB, 827.31 MB, 875.76 MB, 919.98 MB, 970.59 MB, 1004.42 MB, 1.01 GB - BytesReceived: 1.03 GB (1102916871) - ConvertRowBatchTime: 1s277ms - DeserializeRowBatchTimer: 5s381ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 6.34 M/sec - SendersBlockedTimer: 7s470ms - SendersBlockedTotalTimer(*): 1m52s Instance fc4ebd07a3c493a1:101db40b9b2a9dd6 (host=vb0208.halxg.cloudera.com:22000):(Total: 47s522ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 79.99 MB, 228.66 MB, 357.21 MB, 420.46 MB, 548.43 MB, 692.33 MB, 820.33 MB, 1012.33 MB, 1.16 GB, 1.29 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.49 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.01 MB, 510.04 MB, 340.08 MB, 145.83 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070765568) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 203.534ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 36s277ms - TotalNetworkReceiveTime: 10s263ms - TotalNetworkSendTime: 9s185ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 726.392ms, non-child: 726.392ms, % non-child: 100.00%) - CodegenTime: 786.124us - CompileTime: 56.177ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 470.244ms - PrepareTime: 188.334ms DataStreamSender (dst_id=16):(Total: 12s890ms, non-child: 12s890ms, % non-child: 100.00%) - BytesSent: 133.37 MB (139848812) - NetworkThroughput(*): 11.80 MB/sec - OverallThroughput: 10.35 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 741.056ms - ThriftTransmitTime(*): 11s300ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=8):(Total: 34s614ms, non-child: 9s155ms, % non-child: 26.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 614.120us - GetResultsTime: 459.946ms - HTResizeTime: 1s061ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 383.86 K/sec - StreamingTime: 8s391ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s458ms, non-child: 13s319ms, % non-child: 52.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s734ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s996ms - GetNewBlockTime: 1.511ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s812ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.690us EXCHANGE_NODE (id=15):(Total: 3s285ms, non-child: 1s370ms, % non-child: 41.73%) BytesReceived(1s000ms): 4.25 MB, 58.67 MB, 127.67 MB, 196.24 MB, 261.92 MB, 295.77 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB, 298.23 MB - BytesReceived: 298.23 MB (312718107) - ConvertRowBatchTime: 397.511ms - DeserializeRowBatchTimer: 1s862ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 4.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s853ms, non-child: 2s438ms, % non-child: 27.54%) BytesReceived(1s000ms): 3.82 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 19.09 MB, 73.63 MB, 122.48 MB, 160.99 MB, 205.63 MB, 246.11 MB, 286.25 MB, 322.72 MB, 358.96 MB, 394.93 MB, 429.40 MB, 465.17 MB, 507.43 MB, 541.97 MB, 579.19 MB, 618.26 MB, 662.91 MB, 697.30 MB, 732.10 MB, 774.23 MB, 814.47 MB, 860.49 MB, 905.94 MB, 954.07 MB, 998.06 MB, 1.00 GB - BytesReceived: 1.03 GB (1102841639) - ConvertRowBatchTime: 1s285ms - DeserializeRowBatchTimer: 4s823ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 5.83 M/sec - SendersBlockedTimer: 7s573ms - SendersBlockedTotalTimer(*): 53s685ms Instance fc4ebd07a3c493a1:101db40b9b2a9ddd (host=vb0232.halxg.cloudera.com:22000):(Total: 47s342ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.87 MB, 228.36 MB, 356.36 MB, 484.37 MB, 612.36 MB, 692.33 MB, 884.33 MB, 1.05 GB, 1.15 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.66 GB, 1.67 GB, 1.66 GB, 1.64 GB, 1.64 GB, 1.82 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 680.03 MB, 485.77 MB, 291.52 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2072403968) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 192.739ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 35s371ms - TotalNetworkReceiveTime: 10s522ms - TotalNetworkSendTime: 9s506ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 732.664ms, non-child: 732.664ms, % non-child: 100.00%) - CodegenTime: 800.711us - CompileTime: 82.813ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 463.608ms - PrepareTime: 183.235ms DataStreamSender (dst_id=16):(Total: 12s736ms, non-child: 12s736ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139945447) - NetworkThroughput(*): 12.01 MB/sec - OverallThroughput: 10.48 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 714.425ms - ThriftTransmitTime(*): 11s109ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=8):(Total: 34s588ms, non-child: 9s175ms, % non-child: 26.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 678.829us - GetResultsTime: 449.827ms - HTResizeTime: 1s107ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 384.36 K/sec - StreamingTime: 8s429ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s413ms, non-child: 13s144ms, % non-child: 51.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s245ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 1s830ms - GetNewBlockTime: 1.634ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s284ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.489us EXCHANGE_NODE (id=15):(Total: 3s777ms, non-child: 581.328ms, % non-child: 15.39%) BytesReceived(1s000ms): 8.45 MB, 68.36 MB, 137.13 MB, 205.89 MB, 270.15 MB, 296.95 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB, 298.37 MB - BytesReceived: 298.37 MB (312866516) - ConvertRowBatchTime: 265.661ms - DeserializeRowBatchTimer: 1s091ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 3.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s491ms, non-child: 2s919ms, % non-child: 34.38%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 23.37 MB, 81.98 MB, 126.94 MB, 169.93 MB, 210.94 MB, 250.14 MB, 291.56 MB, 328.02 MB, 363.98 MB, 399.85 MB, 434.67 MB, 470.71 MB, 511.98 MB, 547.20 MB, 584.61 MB, 624.78 MB, 668.08 MB, 702.71 MB, 737.47 MB, 780.88 MB, 820.37 MB, 867.97 MB, 912.84 MB, 962.11 MB, 1002.46 MB, 1.01 GB - BytesReceived: 1.03 GB (1103759367) - ConvertRowBatchTime: 1s297ms - DeserializeRowBatchTimer: 5s450ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 6.08 M/sec - SendersBlockedTimer: 9s161ms - SendersBlockedTotalTimer(*): 1m48s Instance fc4ebd07a3c493a1:101db40b9b2a9de1 (host=vb0228.halxg.cloudera.com:22000):(Total: 47s181ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 15.46 MB, 164.35 MB, 292.34 MB, 420.38 MB, 548.42 MB, 676.35 MB, 836.33 MB, 1.02 GB, 1.16 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.48 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.66 GB, 1.67 GB, 1.67 GB, 1.73 GB, 1.91 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.58 MB, 582.89 MB, 437.21 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2073427968) - PerHostPeakMemUsage: 3.86 GB (4148003016) - PrepareTime: 205.519ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 36s857ms - TotalNetworkReceiveTime: 9s611ms - TotalNetworkSendTime: 8s749ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 699.906ms, non-child: 699.906ms, % non-child: 100.00%) - CodegenTime: 1.005ms - CompileTime: 49.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 453.226ms - PrepareTime: 183.140ms DataStreamSender (dst_id=16):(Total: 12s525ms, non-child: 12s525ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139899316) - NetworkThroughput(*): 12.26 MB/sec - OverallThroughput: 10.65 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 771.741ms - ThriftTransmitTime(*): 10s884ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=8):(Total: 34s638ms, non-child: 9s421ms, % non-child: 27.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.360ms - GetResultsTime: 456.423ms - HTResizeTime: 1s043ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 383.69 K/sec - StreamingTime: 8s651ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s217ms, non-child: 13s818ms, % non-child: 54.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s418ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s915ms - GetNewBlockTime: 1.252ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s800ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.05 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.018us EXCHANGE_NODE (id=15):(Total: 3s631ms, non-child: 834.522ms, % non-child: 22.98%) BytesReceived(1s000ms): 2.96 MB, 55.24 MB, 124.25 MB, 192.82 MB, 258.85 MB, 295.35 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB - BytesReceived: 298.31 MB (312798400) - ConvertRowBatchTime: 325.121ms - DeserializeRowBatchTimer: 1s321ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 3.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 7s767ms, non-child: 2s976ms, % non-child: 38.32%) BytesReceived(1s000ms): 2.50 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 17.67 MB, 70.57 MB, 119.32 MB, 159.42 MB, 203.15 MB, 244.95 MB, 284.28 MB, 320.93 MB, 357.22 MB, 393.32 MB, 427.76 MB, 463.55 MB, 504.85 MB, 540.08 MB, 577.50 MB, 616.22 MB, 661.00 MB, 695.87 MB, 730.57 MB, 772.39 MB, 813.05 MB, 858.48 MB, 904.34 MB, 952.15 MB, 997.14 MB, 1.00 GB - BytesReceived: 1.03 GB (1103265663) - ConvertRowBatchTime: 1s274ms - DeserializeRowBatchTimer: 5s339ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 6.65 M/sec - SendersBlockedTimer: 10s873ms - SendersBlockedTotalTimer(*): 2m26s Instance fc4ebd07a3c493a1:101db40b9b2a9ddf (host=vb0206.halxg.cloudera.com:22000):(Total: 46s657ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 11.71 MB, 164.37 MB, 292.36 MB, 420.38 MB, 548.35 MB, 676.34 MB, 788.33 MB, 980.33 MB, 1.15 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.74 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 631.46 MB, 412.93 MB, 194.39 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069280768) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 195.658ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 33s825ms - TotalNetworkReceiveTime: 12s054ms - TotalNetworkSendTime: 9s072ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 727.072ms, non-child: 727.072ms, % non-child: 100.00%) - CodegenTime: 2.683ms - CompileTime: 61.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 476.336ms - PrepareTime: 188.127ms DataStreamSender (dst_id=16):(Total: 12s027ms, non-child: 12s027ms, % non-child: 100.00%) - BytesSent: 133.43 MB (139908440) - NetworkThroughput(*): 12.07 MB/sec - OverallThroughput: 11.09 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 781.487ms - ThriftTransmitTime(*): 11s054ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=8):(Total: 34s612ms, non-child: 8s166ms, % non-child: 23.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.209ms - GetResultsTime: 461.139ms - HTResizeTime: 1s057ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 384.01 K/sec - StreamingTime: 7s405ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 26s445ms, non-child: 12s755ms, % non-child: 48.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s095ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 2s082ms - GetNewBlockTime: 1.666ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s831ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 1.95 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.909us EXCHANGE_NODE (id=15):(Total: 3s933ms, non-child: 587.290ms, % non-child: 14.93%) BytesReceived(1s000ms): 2.43 MB, 54.10 MB, 122.93 MB, 191.49 MB, 257.67 MB, 295.15 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB, 298.31 MB - BytesReceived: 298.31 MB (312802345) - ConvertRowBatchTime: 266.703ms - DeserializeRowBatchTimer: 1s063ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 3.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 9s756ms, non-child: 2s936ms, % non-child: 30.09%) BytesReceived(1s000ms): 1.98 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 17.11 MB, 69.57 MB, 118.30 MB, 159.71 MB, 202.30 MB, 244.87 MB, 283.81 MB, 320.49 MB, 356.76 MB, 392.86 MB, 427.34 MB, 462.89 MB, 503.97 MB, 539.47 MB, 576.81 MB, 615.41 MB, 660.46 MB, 695.22 MB, 729.93 MB, 771.40 MB, 812.41 MB, 857.51 MB, 903.05 MB, 950.83 MB, 996.56 MB, 1023.77 MB - BytesReceived: 1.03 GB (1103414422) - ConvertRowBatchTime: 1s191ms - DeserializeRowBatchTimer: 5s924ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 5.29 M/sec - SendersBlockedTimer: 7s677ms - SendersBlockedTotalTimer(*): 1m54s Instance fc4ebd07a3c493a1:101db40b9b2a9de0 (host=vb0220.halxg.cloudera.com:22000):(Total: 46s106ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.25 MB, 164.43 MB, 292.44 MB, 420.43 MB, 548.40 MB, 676.35 MB, 772.33 MB, 980.33 MB, 1.13 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.35 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.53 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 704.30 MB, 534.32 MB, 315.80 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2068973568) - PerHostPeakMemUsage: 3.83 GB (4109984000) - PrepareTime: 192.016ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 37s087ms - TotalNetworkReceiveTime: 8s927ms - TotalNetworkSendTime: 8s381ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 707.231ms, non-child: 707.231ms, % non-child: 100.00%) - CodegenTime: 916.386us - CompileTime: 50.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 467.699ms - PrepareTime: 184.750ms DataStreamSender (dst_id=16):(Total: 11s438ms, non-child: 11s438ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139863008) - NetworkThroughput(*): 12.75 MB/sec - OverallThroughput: 11.66 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 778.619ms - ThriftTransmitTime(*): 10s458ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=8):(Total: 34s652ms, non-child: 9s331ms, % non-child: 26.93%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 736.892us - GetResultsTime: 486.067ms - HTResizeTime: 1s019ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 383.47 K/sec - StreamingTime: 8s536ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s320ms, non-child: 14s287ms, % non-child: 56.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s167ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 2s106ms - GetNewBlockTime: 2.194ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s252ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.04 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.466us EXCHANGE_NODE (id=15):(Total: 2s867ms, non-child: 1s475ms, % non-child: 51.47%) BytesReceived(1s000ms): 13.20 MB, 77.82 MB, 146.52 MB, 214.72 MB, 276.63 MB, 297.60 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB, 298.26 MB - BytesReceived: 298.26 MB (312748691) - ConvertRowBatchTime: 491.473ms - DeserializeRowBatchTimer: 1s860ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 4.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s165ms, non-child: 3s257ms, % non-child: 39.89%) BytesReceived(1s000ms): 5.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 29.60 MB, 87.26 MB, 129.84 MB, 176.18 MB, 217.29 MB, 258.92 MB, 296.30 MB, 332.58 MB, 368.80 MB, 404.57 MB, 439.29 MB, 476.23 MB, 514.67 MB, 551.95 MB, 589.37 MB, 630.56 MB, 672.28 MB, 706.99 MB, 741.87 MB, 787.08 MB, 825.86 MB, 874.47 MB, 918.42 MB, 968.74 MB, 1004.32 MB, 1.01 GB - BytesReceived: 1.03 GB (1103031853) - ConvertRowBatchTime: 1s393ms - DeserializeRowBatchTimer: 5s453ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 6.32 M/sec - SendersBlockedTimer: 11s452ms - SendersBlockedTotalTimer(*): 2m39s Instance fc4ebd07a3c493a1:101db40b9b2a9de4 (host=vb0218.halxg.cloudera.com:22000):(Total: 45s865ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 76.02 MB, 164.36 MB, 292.38 MB, 420.36 MB, 548.39 MB, 676.34 MB, 820.33 MB, 1.02 GB, 1.16 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.46 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.75 GB, 1.89 GB, 1.33 GB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 728.59 MB, 582.89 MB, 412.93 MB, 218.68 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070330368) - PerHostPeakMemUsage: 3.83 GB (4111289600) - PrepareTime: 193.523ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 35s548ms - TotalNetworkReceiveTime: 10s665ms - TotalNetworkSendTime: 7s753ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 681.215ms, non-child: 681.215ms, % non-child: 100.00%) - CodegenTime: 874.564us - CompileTime: 43.264ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 448.164ms - PrepareTime: 184.425ms DataStreamSender (dst_id=16):(Total: 11s180ms, non-child: 11s180ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139857238) - NetworkThroughput(*): 13.84 MB/sec - OverallThroughput: 11.93 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 742.566ms - ThriftTransmitTime(*): 9s637ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=8):(Total: 34s668ms, non-child: 9s222ms, % non-child: 26.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 569.016us - GetResultsTime: 468.838ms - HTResizeTime: 1s071ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 383.27 K/sec - StreamingTime: 8s445ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=7):(Total: 25s445ms, non-child: 12s945ms, % non-child: 50.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s271ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s957ms - GetNewBlockTime: 1.214ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s006ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.179us EXCHANGE_NODE (id=15):(Total: 3s811ms, non-child: 617.054ms, % non-child: 16.19%) BytesReceived(1s000ms): 2.71 MB, 54.63 MB, 123.58 MB, 192.17 MB, 258.20 MB, 295.17 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB - BytesReceived: 298.22 MB (312701707) - ConvertRowBatchTime: 299.167ms - DeserializeRowBatchTimer: 1s079ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 3.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=14):(Total: 8s688ms, non-child: 2s986ms, % non-child: 34.38%) BytesReceived(1s000ms): 2.25 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 17.38 MB, 70.08 MB, 118.80 MB, 159.67 MB, 202.84 MB, 245.02 MB, 284.00 MB, 320.75 MB, 356.98 MB, 392.99 MB, 427.32 MB, 463.18 MB, 504.25 MB, 539.63 MB, 576.89 MB, 615.58 MB, 660.56 MB, 695.34 MB, 730.06 MB, 771.81 MB, 812.65 MB, 857.95 MB, 903.61 MB, 951.39 MB, 996.72 MB, 1023.98 MB - BytesReceived: 1.03 GB (1103089364) - ConvertRowBatchTime: 1s350ms - DeserializeRowBatchTimer: 5s807ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 5.94 M/sec - SendersBlockedTimer: 7s460ms - SendersBlockedTotalTimer(*): 1m44s Fragment F05: Instance fc4ebd07a3c493a1:101db40b9b2a9dea (host=vb0234.halxg.cloudera.com:22000):(Total: 5s406ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 126.69 MB, 210.27 MB, 210.24 MB, 210.45 MB, 162.56 MB, 162.66 MB, 162.57 MB, 162.79 MB, 114.67 MB, 114.62 MB, 67.58 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.66 MB (220889856) - PerHostPeakMemUsage: 1.93 GB (2072393984) - PrepareTime: 182.549ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 36s734ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 44.204ms - TotalStorageWaitTime: 111.899ms CodeGen:(Total: 539.413ms, non-child: 539.413ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.912ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 353.401ms - PrepareTime: 180.764ms DataStreamSender (dst_id=15):(Total: 5s072ms, non-child: 5s072ms, % non-child: 100.00%) - BytesSent: 351.23 MB (368288730) - NetworkThroughput(*): 49.66 MB/sec - OverallThroughput: 69.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s050ms - ThriftTransmitTime(*): 7s073ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=6):(Total: 493.060ms, non-child: 493.060ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:0% 2:0% 3:0% 4:0% 5:9.091% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 80.59 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 556.723ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.20 MB (220406576) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 32.77 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1786) - ScannerThreadsTotalWallClockTime: 31s098ms - MaterializeTupleTime(*): 30s370ms - ScannerThreadsSysTime: 57.989ms - ScannerThreadsUserTime: 4s703ms - ScannerThreadsVoluntaryContextSwitches: 15.78K (15782) - TotalRawHdfsReadTime(*): 134.095ms - TotalReadThroughput: 34.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9de8 (host=vb0232.halxg.cloudera.com:22000):(Total: 5s172ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 211.97 MB, 211.92 MB, 211.94 MB, 211.81 MB, 156.42 MB, 150.32 MB, 137.06 MB, 120.91 MB, 96.97 MB, 57.95 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.30 MB (222611640) - PerHostPeakMemUsage: 1.86 GB (1994151304) - PrepareTime: 187.131ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 35s546ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.965ms - TotalStorageWaitTime: 172.010ms CodeGen:(Total: 588.287ms, non-child: 588.287ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 395.562ms - PrepareTime: 183.955ms DataStreamSender (dst_id=15):(Total: 4s834ms, non-child: 4s834ms, % non-child: 100.00%) - BytesSent: 341.97 MB (358585300) - NetworkThroughput(*): 50.92 MB/sec - OverallThroughput: 70.73 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s879ms - ThriftTransmitTime(*): 6s716ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=6):(Total: 496.879ms, non-child: 496.879ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.10 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 538.908ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.84 MB (222128312) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 31.91 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.00K (2001) - ScannerThreadsTotalWallClockTime: 30s144ms - MaterializeTupleTime(*): 29s371ms - ScannerThreadsSysTime: 68.987ms - ScannerThreadsUserTime: 4s838ms - ScannerThreadsVoluntaryContextSwitches: 15.50K (15502) - TotalRawHdfsReadTime(*): 167.928ms - TotalReadThroughput: 33.45 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dec (host=vb0228.halxg.cloudera.com:22000):(Total: 5s067ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 201.48 MB, 201.78 MB, 201.72 MB, 201.69 MB, 154.14 MB, 154.22 MB, 137.14 MB, 105.17 MB, 97.08 MB, 58.18 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.14 MB (211960624) - PerHostPeakMemUsage: 1.80 GB (1928253824) - PrepareTime: 196.787ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 32s253ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41.049ms - TotalStorageWaitTime: 231.764ms CodeGen:(Total: 564.379ms, non-child: 564.379ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 363.203ms - PrepareTime: 182.291ms DataStreamSender (dst_id=15):(Total: 4s721ms, non-child: 4s721ms, % non-child: 100.00%) - BytesSent: 325.80 MB (341626093) - NetworkThroughput(*): 47.57 MB/sec - OverallThroughput: 69.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s846ms - ThriftTransmitTime(*): 6s849ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=6):(Total: 513.774ms, non-child: 513.774ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.60 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 517.373ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.70 MB (211493680) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 29.19 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.90K (1904) - ScannerThreadsTotalWallClockTime: 27s057ms - MaterializeTupleTime(*): 26s097ms - ScannerThreadsSysTime: 108.980ms - ScannerThreadsUserTime: 4s641ms - ScannerThreadsVoluntaryContextSwitches: 14.59K (14592) - TotalRawHdfsReadTime(*): 138.037ms - TotalReadThroughput: 31.62 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df0 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s747ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.52 MB, 176.79 MB, 176.67 MB, 137.07 MB, 137.05 MB, 137.08 MB, 121.05 MB, 97.15 MB, 96.87 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185630024) - PerHostPeakMemUsage: 1.76 GB (1891284656) - PrepareTime: 197.931ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 27s418ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 46.863ms - TotalStorageWaitTime: 190.126ms CodeGen:(Total: 601.657ms, non-child: 601.657ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 397.257ms - PrepareTime: 187.349ms DataStreamSender (dst_id=15):(Total: 4s428ms, non-child: 4s428ms, % non-child: 100.00%) - BytesSent: 298.88 MB (313394907) - NetworkThroughput(*): 45.03 MB/sec - OverallThroughput: 67.49 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s622ms - ThriftTransmitTime(*): 6s637ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=6):(Total: 495.364ms, non-child: 495.364ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 483.376ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130360) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 27.17 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1652) - ScannerThreadsTotalWallClockTime: 22s479ms - MaterializeTupleTime(*): 21s674ms - ScannerThreadsSysTime: 48.990ms - ScannerThreadsUserTime: 4s025ms - ScannerThreadsVoluntaryContextSwitches: 13.00K (12999) - TotalRawHdfsReadTime(*): 113.753ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9de6 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s717ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.86 MB, 193.81 MB, 193.85 MB, 146.18 MB, 138.06 MB, 136.94 MB, 96.96 MB, 96.96 MB, 57.75 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.17 MB (203604792) - PerHostPeakMemUsage: 1.86 GB (1994686192) - PrepareTime: 193.994ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 29s704ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.481ms - TotalStorageWaitTime: 109.521ms CodeGen:(Total: 524.017ms, non-child: 524.017ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 326.551ms - PrepareTime: 180.903ms DataStreamSender (dst_id=15):(Total: 4s393ms, non-child: 4s393ms, % non-child: 100.00%) - BytesSent: 319.22 MB (334723368) - NetworkThroughput(*): 50.26 MB/sec - OverallThroughput: 72.66 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s676ms - ThriftTransmitTime(*): 6s351ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=6):(Total: 497.845ms, non-child: 497.845ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.44 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 492.399ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.70 MB (203105072) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 29.48 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.00K (2002) - ScannerThreadsTotalWallClockTime: 24s776ms - MaterializeTupleTime(*): 24s122ms - ScannerThreadsSysTime: 95.982ms - ScannerThreadsUserTime: 4s177ms - ScannerThreadsVoluntaryContextSwitches: 14.37K (14370) - TotalRawHdfsReadTime(*): 114.779ms - TotalReadThroughput: 34.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9deb (host=vb0220.halxg.cloudera.com:22000):(Total: 4s691ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 104.16 MB, 176.62 MB, 176.73 MB, 176.62 MB, 137.01 MB, 137.05 MB, 137.05 MB, 97.08 MB, 97.00 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.02 MB (185621840) - PerHostPeakMemUsage: 1.76 GB (1892930176) - PrepareTime: 187.404ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 27s243ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.690ms - TotalStorageWaitTime: 127.517ms CodeGen:(Total: 530.963ms, non-child: 530.963ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.533ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 340.529ms - PrepareTime: 183.528ms DataStreamSender (dst_id=15):(Total: 4s381ms, non-child: 4s381ms, % non-child: 100.00%) - BytesSent: 295.18 MB (309518853) - NetworkThroughput(*): 45.34 MB/sec - OverallThroughput: 67.37 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s609ms - ThriftTransmitTime(*): 6s509ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=6):(Total: 475.769ms, non-child: 475.769ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 86.69 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 483.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 28.29 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1711) - ScannerThreadsTotalWallClockTime: 22s349ms - MaterializeTupleTime(*): 21s682ms - ScannerThreadsSysTime: 55.989ms - ScannerThreadsUserTime: 4s074ms - ScannerThreadsVoluntaryContextSwitches: 13.09K (13088) - TotalRawHdfsReadTime(*): 107.003ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9def (host=vb0230.halxg.cloudera.com:22000):(Total: 4s666ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 68.00 KB, 176.51 MB, 176.87 MB, 176.69 MB, 137.08 MB, 137.12 MB, 137.16 MB, 121.01 MB, 97.02 MB, 73.40 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646376) - PerHostPeakMemUsage: 1.83 GB (1960888784) - PrepareTime: 184.644ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 27s122ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.877ms - TotalStorageWaitTime: 102.064ms CodeGen:(Total: 532.104ms, non-child: 532.104ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 343.544ms - PrepareTime: 177.513ms DataStreamSender (dst_id=15):(Total: 4s324ms, non-child: 4s324ms, % non-child: 100.00%) - BytesSent: 289.31 MB (303366790) - NetworkThroughput(*): 48.61 MB/sec - OverallThroughput: 66.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s551ms - ThriftTransmitTime(*): 5s951ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=6):(Total: 504.996ms, non-child: 504.996ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 766.474ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195856) - PerReadThreadRawHdfsThroughput: 1.78 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 26.66 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.56K (2559) - ScannerThreadsTotalWallClockTime: 22s223ms - MaterializeTupleTime(*): 21s287ms - ScannerThreadsSysTime: 82.984ms - ScannerThreadsUserTime: 6s491ms - ScannerThreadsVoluntaryContextSwitches: 13.07K (13073) - TotalRawHdfsReadTime(*): 85.686ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df1 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s609ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 189.61 MB, 189.64 MB, 189.81 MB, 176.94 MB, 136.91 MB, 137.18 MB, 136.80 MB, 97.19 MB, 97.06 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.18 MB (199418584) - PerHostPeakMemUsage: 1.76 GB (1892998328) - PrepareTime: 181.982ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 28s249ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 48.173ms - TotalStorageWaitTime: 127.590ms CodeGen:(Total: 513.983ms, non-child: 513.983ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 328.439ms - PrepareTime: 179.340ms DataStreamSender (dst_id=15):(Total: 4s298ms, non-child: 4s298ms, % non-child: 100.00%) - BytesSent: 306.78 MB (321679644) - NetworkThroughput(*): 50.04 MB/sec - OverallThroughput: 71.37 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s596ms - ThriftTransmitTime(*): 6s130ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=6):(Total: 470.906ms, non-child: 470.906ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.33 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 462.960ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.70 MB (198910720) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 30.34 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.88K (1879) - ScannerThreadsTotalWallClockTime: 23s455ms - MaterializeTupleTime(*): 22s816ms - ScannerThreadsSysTime: 72.986ms - ScannerThreadsUserTime: 4s176ms - ScannerThreadsVoluntaryContextSwitches: 13.98K (13977) - TotalRawHdfsReadTime(*): 107.811ms - TotalReadThroughput: 36.82 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9ded (host=vb0206.halxg.cloudera.com:22000):(Total: 4s552ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 68.00 KB, 176.74 MB, 176.74 MB, 176.76 MB, 136.96 MB, 137.06 MB, 137.08 MB, 96.97 MB, 97.04 MB, 57.91 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185654560) - PerHostPeakMemUsage: 1.71 GB (1833178680) - PrepareTime: 187.006ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 26s468ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.068ms - TotalStorageWaitTime: 89.002ms CodeGen:(Total: 544.240ms, non-child: 544.240ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 353.318ms - PrepareTime: 185.196ms DataStreamSender (dst_id=15):(Total: 4s233ms, non-child: 4s233ms, % non-child: 100.00%) - BytesSent: 288.90 MB (302932689) - NetworkThroughput(*): 50.75 MB/sec - OverallThroughput: 68.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s482ms - ThriftTransmitTime(*): 5s693ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=6):(Total: 483.709ms, non-child: 483.709ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 449.993ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 27.81 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.94K (1941) - ScannerThreadsTotalWallClockTime: 21s648ms - MaterializeTupleTime(*): 21s061ms - ScannerThreadsSysTime: 67.987ms - ScannerThreadsUserTime: 3s755ms - ScannerThreadsVoluntaryContextSwitches: 13.00K (13001) - TotalRawHdfsReadTime(*): 90.962ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dee (host=vb0204.halxg.cloudera.com:22000):(Total: 4s510ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.56 MB, 176.69 MB, 168.75 MB, 137.10 MB, 137.06 MB, 128.99 MB, 96.99 MB, 73.48 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.11 MB (185711912) - PerHostPeakMemUsage: 1.65 GB (1775207448) - PrepareTime: 203.510ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 25s957ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41.377ms - TotalStorageWaitTime: 111.285ms CodeGen:(Total: 589.239ms, non-child: 589.239ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.993ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 381.280ms - PrepareTime: 194.181ms DataStreamSender (dst_id=15):(Total: 4s186ms, non-child: 4s186ms, % non-child: 100.00%) - BytesSent: 305.06 MB (319876904) - NetworkThroughput(*): 46.95 MB/sec - OverallThroughput: 72.87 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s520ms - ThriftTransmitTime(*): 6s497ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=6):(Total: 501.447ms, non-child: 501.447ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 459.109ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.68 MB (185261352) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 26.85 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1446) - ScannerThreadsTotalWallClockTime: 21s185ms - MaterializeTupleTime(*): 20s570ms - ScannerThreadsSysTime: 42.991ms - ScannerThreadsUserTime: 3s813ms - ScannerThreadsVoluntaryContextSwitches: 13.07K (13072) - TotalRawHdfsReadTime(*): 143.354ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9de7 (host=vb0226.halxg.cloudera.com:22000):(Total: 4s473ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.22 MB, 168.19 MB, 168.36 MB, 128.54 MB, 128.68 MB, 111.40 MB, 87.38 MB, 79.34 MB, 8.88 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5, 1 - AverageThreadTokens: 4.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.57 MB (176758056) - PerHostPeakMemUsage: 1.62 GB (1739683704) - PrepareTime: 199.135ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 24s167ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40.046ms - TotalStorageWaitTime: 200.629ms CodeGen:(Total: 577.916ms, non-child: 577.916ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.751ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 375.518ms - PrepareTime: 186.937ms DataStreamSender (dst_id=15):(Total: 4s147ms, non-child: 4s147ms, % non-child: 100.00%) - BytesSent: 272.46 MB (285700205) - NetworkThroughput(*): 45.03 MB/sec - OverallThroughput: 65.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s464ms - ThriftTransmitTime(*): 6s051ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=6):(Total: 499.277ms, non-child: 499.277ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.11 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 441.865ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.18 MB (176348456) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 24.58 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.46K (1455) - ScannerThreadsTotalWallClockTime: 19s532ms - MaterializeTupleTime(*): 18s772ms - ScannerThreadsSysTime: 34.992ms - ScannerThreadsUserTime: 3s757ms - ScannerThreadsVoluntaryContextSwitches: 11.83K (11834) - TotalRawHdfsReadTime(*): 94.967ms - TotalReadThroughput: 28.46 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df2 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s420ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 177.70 MB, 177.82 MB, 177.83 MB, 177.84 MB, 124.62 MB, 111.24 MB, 111.35 MB, 79.42 MB, 30.30 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 5, 3 - AverageThreadTokens: 5.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.16 MB (186811096) - PerHostPeakMemUsage: 1.58 GB (1693928160) - PrepareTime: 184.120ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 25s706ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38.935ms - TotalStorageWaitTime: 149.312ms CodeGen:(Total: 549.179ms, non-child: 549.179ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.569ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.985ms - PrepareTime: 182.304ms DataStreamSender (dst_id=15):(Total: 4s126ms, non-child: 4s126ms, % non-child: 100.00%) - BytesSent: 282.86 MB (296603184) - NetworkThroughput(*): 50.02 MB/sec - OverallThroughput: 68.55 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s441ms - ThriftTransmitTime(*): 5s655ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=6):(Total: 457.298ms, non-child: 457.298ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.78 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 468.950ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.76 MB (186393304) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 28.60 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.02K (2022) - ScannerThreadsTotalWallClockTime: 21s080ms - MaterializeTupleTime(*): 20s407ms - ScannerThreadsSysTime: 74.986ms - ScannerThreadsUserTime: 4s179ms - ScannerThreadsVoluntaryContextSwitches: 12.69K (12686) - TotalRawHdfsReadTime(*): 99.229ms - TotalReadThroughput: 30.35 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df3 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s365ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 164.16 MB, 164.14 MB, 164.30 MB, 140.27 MB, 124.52 MB, 111.46 MB, 79.34 MB, 79.23 MB, 48.08 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.60 MB (172596512) - PerHostPeakMemUsage: 1.61 GB (1730388344) - PrepareTime: 195.691ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 23s362ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.450ms - TotalStorageWaitTime: 73.386ms CodeGen:(Total: 514.479ms, non-child: 514.479ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 315.982ms - PrepareTime: 182.986ms DataStreamSender (dst_id=15):(Total: 4s076ms, non-child: 4s076ms, % non-child: 100.00%) - BytesSent: 269.25 MB (282327217) - NetworkThroughput(*): 45.27 MB/sec - OverallThroughput: 66.05 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s409ms - ThriftTransmitTime(*): 5s948ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=6):(Total: 464.752ms, non-child: 464.752ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.56 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 455.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.12 MB (172088656) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 26.12 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1625) - ScannerThreadsTotalWallClockTime: 18s772ms - MaterializeTupleTime(*): 18s196ms - ScannerThreadsSysTime: 73.987ms - ScannerThreadsUserTime: 4s213ms - ScannerThreadsVoluntaryContextSwitches: 11.74K (11742) - TotalRawHdfsReadTime(*): 88.293ms - TotalReadThroughput: 31.27 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9de9 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s046ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.75 MB, 176.59 MB, 176.80 MB, 136.92 MB, 137.02 MB, 120.98 MB, 96.87 MB, 57.96 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.03 MB (185624424) - PerHostPeakMemUsage: 1.65 GB (1767952744) - PrepareTime: 182.428ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 23s383ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45.311ms - TotalStorageWaitTime: 83.817ms CodeGen:(Total: 507.221ms, non-child: 507.221ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 322.100ms - PrepareTime: 179.694ms DataStreamSender (dst_id=15):(Total: 3s762ms, non-child: 3s762ms, % non-child: 100.00%) - BytesSent: 292.34 MB (306536897) - NetworkThroughput(*): 49.20 MB/sec - OverallThroughput: 77.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s289ms - ThriftTransmitTime(*): 5s942ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=6):(Total: 449.686ms, non-child: 449.686ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 413.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.56 MB (185132904) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 29.93 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.28K (1277) - ScannerThreadsTotalWallClockTime: 19s121ms - MaterializeTupleTime(*): 18s584ms - ScannerThreadsSysTime: 21.994ms - ScannerThreadsUserTime: 3s685ms - ScannerThreadsVoluntaryContextSwitches: 13.08K (13078) - TotalRawHdfsReadTime(*): 101.894ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9de5 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s670ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.17 MB, 143.09 MB, 143.08 MB, 111.46 MB, 111.42 MB, 79.18 MB, 55.79 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.34 MB (150304656) - PerHostPeakMemUsage: 1.59 GB (1707840600) - PrepareTime: 189.358ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 17s630ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 44.711ms - TotalStorageWaitTime: 74.024ms CodeGen:(Total: 547.181ms, non-child: 547.181ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 354.807ms - PrepareTime: 180.834ms DataStreamSender (dst_id=15):(Total: 3s373ms, non-child: 3s373ms, % non-child: 100.00%) - BytesSent: 234.80 MB (246201800) - NetworkThroughput(*): 46.34 MB/sec - OverallThroughput: 69.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s016ms - ThriftTransmitTime(*): 5s066ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=6):(Total: 465.089ms, non-child: 465.089ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 347.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.91 MB (149854096) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 23.15 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.07K (1071) - ScannerThreadsTotalWallClockTime: 13s697ms - MaterializeTupleTime(*): 13s241ms - ScannerThreadsSysTime: 24.994ms - ScannerThreadsUserTime: 2s884ms - ScannerThreadsVoluntaryContextSwitches: 10.40K (10405) - TotalRawHdfsReadTime(*): 75.224ms - TotalReadThroughput: 31.20 MB/sec Fragment F04: Instance fc4ebd07a3c493a1:101db40b9b2a9dfa (host=vb0226.halxg.cloudera.com:22000):(Total: 34s181ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 96.68 MB, 193.29 MB, 193.29 MB, 193.29 MB, 193.29 MB, 193.29 MB, 193.29 MB, 193.29 MB, 193.49 MB, 193.64 MB, 193.67 MB, 193.70 MB, 193.78 MB, 193.77 MB, 193.60 MB, 193.75 MB, 189.70 MB, 98.42 MB, 67.06 MB, 67.09 MB, 192.90 MB, 193.68 MB, 193.73 MB, 193.80 MB, 193.59 MB, 193.71 MB, 193.78 MB, 193.68 MB, 193.64 MB, 161.72 MB, 67.17 MB, 67.10 MB, 55.10 MB, 55.04 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.32 MB (204809248) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 185.073ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s384ms - TotalStorageWaitTime: 275.852ms CodeGen:(Total: 513.521ms, non-child: 513.521ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 325.179ms - PrepareTime: 182.953ms DataStreamSender (dst_id=14):(Total: 33s559ms, non-child: 33s559ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1139763247) - NetworkThroughput(*): 8.76 MB/sec - OverallThroughput: 32.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s752ms - ThriftTransmitTime(*): 2m4s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=5):(Total: 737.513ms, non-child: 737.513ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.56 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s492ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.82 MB (204284960) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 72.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.57K (7571) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m15s - ScannerThreadsSysTime: 344.943ms - ScannerThreadsUserTime: 18s549ms - ScannerThreadsVoluntaryContextSwitches: 52.31K (52315) - TotalRawHdfsReadTime(*): 232.434ms - TotalReadThroughput: 10.71 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dfd (host=vb0206.halxg.cloudera.com:22000):(Total: 34s164ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 95.93 MB, 192.42 MB, 192.42 MB, 192.42 MB, 192.42 MB, 192.42 MB, 192.42 MB, 192.42 MB, 193.09 MB, 193.62 MB, 193.76 MB, 193.69 MB, 193.61 MB, 193.70 MB, 193.66 MB, 193.71 MB, 193.62 MB, 98.50 MB, 67.10 MB, 67.01 MB, 155.18 MB, 193.63 MB, 193.78 MB, 193.55 MB, 193.59 MB, 193.75 MB, 193.68 MB, 193.60 MB, 193.68 MB, 169.79 MB, 74.95 MB, 67.07 MB, 58.63 MB, 55.07 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203534008) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 188.989ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s228ms - TotalStorageWaitTime: 457.439ms CodeGen:(Total: 593.869ms, non-child: 593.869ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 401.668ms - PrepareTime: 187.161ms DataStreamSender (dst_id=14):(Total: 33s551ms, non-child: 33s551ms, % non-child: 100.00%) - BytesSent: 1.09 GB (1171549456) - NetworkThroughput(*): 9.62 MB/sec - OverallThroughput: 33.30 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s962ms - ThriftTransmitTime(*): 1m56s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=5):(Total: 729.932ms, non-child: 729.932ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 277.19 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 369.58 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s469ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 73.43 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.50K (7499) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 4m15s - ScannerThreadsSysTime: 235.960ms - ScannerThreadsUserTime: 16s943ms - ScannerThreadsVoluntaryContextSwitches: 52.23K (52227) - TotalRawHdfsReadTime(*): 276.342ms - TotalReadThroughput: 10.71 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e01 (host=vb0222.halxg.cloudera.com:22000):(Total: 33s872ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 85.33 MB, 171.93 MB, 171.93 MB, 171.93 MB, 171.93 MB, 171.93 MB, 171.93 MB, 171.93 MB, 182.74 MB, 193.68 MB, 193.66 MB, 193.63 MB, 193.74 MB, 193.66 MB, 193.73 MB, 193.66 MB, 149.75 MB, 71.08 MB, 67.16 MB, 67.11 MB, 180.16 MB, 188.21 MB, 188.21 MB, 188.18 MB, 188.29 MB, 188.20 MB, 188.12 MB, 188.16 MB, 188.27 MB, 160.19 MB, 86.86 MB, 83.06 MB, 55.13 MB, 47.21 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.97 MB (204438024) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 194.127ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s204ms - TotalStorageWaitTime: 326.758ms CodeGen:(Total: 604.064ms, non-child: 604.064ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.872ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 404.607ms - PrepareTime: 183.018ms DataStreamSender (dst_id=14):(Total: 33s276ms, non-child: 33s276ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1152851791) - NetworkThroughput(*): 10.17 MB/sec - OverallThroughput: 33.04 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s783ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=5):(Total: 719.565ms, non-child: 719.565ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 72.27 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 154.80 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 165.06 MB, 314.75 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 325.01 MB, 345.55 MB, 345.55 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.54 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s355ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.54 MB (203987464) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 73.72 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.33K (7325) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 227.962ms - ScannerThreadsUserTime: 16s834ms - ScannerThreadsVoluntaryContextSwitches: 51.69K (51690) - TotalRawHdfsReadTime(*): 253.583ms - TotalReadThroughput: 10.61 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df8 (host=vb0234.halxg.cloudera.com:22000):(Total: 33s824ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 192.99 MB, 192.99 MB, 192.99 MB, 192.99 MB, 192.99 MB, 192.99 MB, 192.99 MB, 193.37 MB, 193.74 MB, 193.70 MB, 193.71 MB, 193.82 MB, 193.66 MB, 193.58 MB, 193.71 MB, 173.70 MB, 82.73 MB, 67.09 MB, 67.05 MB, 192.84 MB, 193.65 MB, 193.59 MB, 193.65 MB, 193.76 MB, 193.70 MB, 193.65 MB, 193.64 MB, 193.67 MB, 130.44 MB, 67.04 MB, 66.86 MB, 55.12 MB, 55.10 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.49 MB (204984608) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 190.265ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s858ms - TotalStorageWaitTime: 385.186ms CodeGen:(Total: 559.393ms, non-child: 559.393ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 366.283ms - PrepareTime: 183.324ms DataStreamSender (dst_id=14):(Total: 33s134ms, non-child: 33s134ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1133465991) - NetworkThroughput(*): 8.78 MB/sec - OverallThroughput: 32.62 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s880ms - ThriftTransmitTime(*): 2m3s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=5):(Total: 806.951ms, non-child: 806.951ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 246.38 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 349.05 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s517ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.05 MB (204525856) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 66.42 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.40K (8403) - ScannerThreadsTotalWallClockTime: 4m13s - MaterializeTupleTime(*): 4m11s - ScannerThreadsSysTime: 266.955ms - ScannerThreadsUserTime: 19s534ms - ScannerThreadsVoluntaryContextSwitches: 52.21K (52208) - TotalRawHdfsReadTime(*): 300.933ms - TotalReadThroughput: 10.87 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df7 (host=vb0212.halxg.cloudera.com:22000):(Total: 33s799ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 96.43 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.52 MB, 193.56 MB, 193.77 MB, 193.68 MB, 193.64 MB, 193.77 MB, 193.75 MB, 193.68 MB, 193.60 MB, 193.82 MB, 98.56 MB, 67.28 MB, 67.15 MB, 170.50 MB, 193.77 MB, 193.84 MB, 193.80 MB, 193.53 MB, 193.81 MB, 193.53 MB, 193.79 MB, 193.68 MB, 193.71 MB, 102.44 MB, 67.11 MB, 74.89 MB, 32.81 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 8.68 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.50 MB (203952304) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 191.565ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s043ms - TotalStorageWaitTime: 340.768ms CodeGen:(Total: 573.291ms, non-child: 573.291ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.616ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 378.680ms - PrepareTime: 179.848ms DataStreamSender (dst_id=14):(Total: 33s214ms, non-child: 33s214ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1124377615) - NetworkThroughput(*): 9.92 MB/sec - OverallThroughput: 32.28 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s843ms - ThriftTransmitTime(*): 1m48s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=5):(Total: 710.009ms, non-child: 710.009ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 297.76 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 338.78 MB, 349.05 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.79 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s324ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.98 MB (203403480) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 71.27 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.93K (7926) - ScannerThreadsTotalWallClockTime: 4m22s - MaterializeTupleTime(*): 4m20s - ScannerThreadsSysTime: 222.961ms - ScannerThreadsUserTime: 16s985ms - ScannerThreadsVoluntaryContextSwitches: 47.59K (47593) - TotalRawHdfsReadTime(*): 305.803ms - TotalReadThroughput: 10.27 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df4 (host=vb0208.halxg.cloudera.com:22000):(Total: 33s728ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 96.01 MB, 192.55 MB, 192.55 MB, 192.55 MB, 192.55 MB, 192.55 MB, 192.55 MB, 192.55 MB, 193.04 MB, 193.80 MB, 193.70 MB, 193.60 MB, 193.65 MB, 193.78 MB, 193.68 MB, 193.81 MB, 193.66 MB, 114.20 MB, 66.99 MB, 67.08 MB, 148.15 MB, 184.70 MB, 184.76 MB, 184.74 MB, 184.73 MB, 184.64 MB, 184.74 MB, 184.80 MB, 184.73 MB, 152.26 MB, 79.87 MB, 98.89 MB, 55.04 MB, 43.11 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203542248) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 194.327ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s268ms - TotalStorageWaitTime: 336.993ms CodeGen:(Total: 569.311ms, non-child: 569.311ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.496ms - PrepareTime: 183.444ms DataStreamSender (dst_id=14):(Total: 33s103ms, non-child: 33s103ms, % non-child: 100.00%) - BytesSent: 1.02 GB (1098256581) - NetworkThroughput(*): 9.80 MB/sec - OverallThroughput: 31.64 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 12s004ms - ThriftTransmitTime(*): 1m46s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=5):(Total: 748.875ms, non-child: 748.875ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 272.37 MB, 321.00 MB, 321.00 MB, 321.00 MB, 321.00 MB, 321.00 MB, 321.00 MB, 321.00 MB, 321.00 MB, 331.92 MB, 342.33 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.64 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s380ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 70.22 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.66K (7663) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 257.956ms - ScannerThreadsUserTime: 17s250ms - ScannerThreadsVoluntaryContextSwitches: 51.33K (51333) - TotalRawHdfsReadTime(*): 262.953ms - TotalReadThroughput: 10.67 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df5 (host=vb0230.halxg.cloudera.com:22000):(Total: 33s628ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.91 MB, 192.61 MB, 192.61 MB, 192.61 MB, 192.61 MB, 192.61 MB, 192.61 MB, 192.61 MB, 193.04 MB, 193.62 MB, 193.71 MB, 193.68 MB, 193.76 MB, 193.75 MB, 193.72 MB, 193.65 MB, 161.81 MB, 67.06 MB, 67.04 MB, 129.44 MB, 193.70 MB, 193.63 MB, 193.73 MB, 193.64 MB, 193.71 MB, 193.64 MB, 193.69 MB, 193.80 MB, 181.77 MB, 78.92 MB, 67.11 MB, 70.45 MB, 55.09 MB, 39.30 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517672) - PerHostPeakMemUsage: 3.88 GB (4170802424) - PrepareTime: 193.812ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s871ms - TotalStorageWaitTime: 428.154ms CodeGen:(Total: 608.288ms, non-child: 608.288ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 408.019ms - PrepareTime: 179.644ms DataStreamSender (dst_id=14):(Total: 33s026ms, non-child: 33s026ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1131498791) - NetworkThroughput(*): 7.81 MB/sec - OverallThroughput: 32.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s728ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=5):(Total: 730.553ms, non-child: 730.553ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 246.41 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 328.55 MB, 359.38 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s377ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075208) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 73.40 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.58K (6582) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 4m8s - ScannerThreadsSysTime: 225.961ms - ScannerThreadsUserTime: 17s268ms - ScannerThreadsVoluntaryContextSwitches: 52.36K (52356) - TotalRawHdfsReadTime(*): 297.169ms - TotalReadThroughput: 10.87 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e00 (host=vb0224.halxg.cloudera.com:22000):(Total: 33s300ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 95.81 MB, 193.53 MB, 193.53 MB, 193.53 MB, 193.53 MB, 193.53 MB, 193.53 MB, 193.53 MB, 193.61 MB, 193.70 MB, 193.67 MB, 193.71 MB, 193.67 MB, 193.78 MB, 193.64 MB, 193.49 MB, 121.94 MB, 67.07 MB, 67.10 MB, 128.09 MB, 190.78 MB, 190.63 MB, 190.59 MB, 190.67 MB, 190.65 MB, 190.74 MB, 190.70 MB, 190.63 MB, 178.73 MB, 95.31 MB, 82.88 MB, 73.99 MB, 55.17 MB, 39.27 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.06 MB (203484944) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 181.542ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s757ms - TotalStorageWaitTime: 333.896ms CodeGen:(Total: 532.205ms, non-child: 532.205ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.856ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 346.359ms - PrepareTime: 179.474ms DataStreamSender (dst_id=14):(Total: 32s711ms, non-child: 32s711ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1117972713) - NetworkThroughput(*): 7.37 MB/sec - OverallThroughput: 32.59 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s534ms - ThriftTransmitTime(*): 2m24s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=5):(Total: 689.597ms, non-child: 689.597ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.51% 1:1.493% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 163.31 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 326.48 MB, 336.75 MB, 351.06 MB, 367.54 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s537ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 77.26 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.70K (7699) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 4m7s - ScannerThreadsSysTime: 200.964ms - ScannerThreadsUserTime: 18s886ms - ScannerThreadsVoluntaryContextSwitches: 51.40K (51400) - TotalRawHdfsReadTime(*): 250.043ms - TotalReadThroughput: 10.97 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dfb (host=vb0232.halxg.cloudera.com:22000):(Total: 33s042ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.58 MB, 193.08 MB, 193.08 MB, 193.08 MB, 193.08 MB, 193.08 MB, 193.08 MB, 193.08 MB, 193.39 MB, 193.68 MB, 193.73 MB, 193.74 MB, 193.68 MB, 193.82 MB, 193.68 MB, 169.64 MB, 74.90 MB, 66.98 MB, 67.10 MB, 193.50 MB, 193.70 MB, 193.73 MB, 193.80 MB, 193.68 MB, 193.56 MB, 193.65 MB, 193.68 MB, 193.66 MB, 98.57 MB, 67.06 MB, 61.16 MB, 55.06 MB, 47.09 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 3 - AverageThreadTokens: 8.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509520) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 183.859ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s390ms - TotalStorageWaitTime: 323.796ms CodeGen:(Total: 556.035ms, non-child: 556.035ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 369.089ms - PrepareTime: 180.969ms DataStreamSender (dst_id=14):(Total: 32s369ms, non-child: 32s369ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1108290853) - NetworkThroughput(*): 8.61 MB/sec - OverallThroughput: 32.65 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s575ms - ThriftTransmitTime(*): 2m2s - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=5):(Total: 785.649ms, non-child: 785.649ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.14 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 349.06 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.45 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s389ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 68.19 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.34K (7341) - ScannerThreadsTotalWallClockTime: 4m6s - MaterializeTupleTime(*): 4m4s - ScannerThreadsSysTime: 201.964ms - ScannerThreadsUserTime: 17s425ms - ScannerThreadsVoluntaryContextSwitches: 52.32K (52317) - TotalRawHdfsReadTime(*): 268.591ms - TotalReadThroughput: 11.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dff (host=vb0228.halxg.cloudera.com:22000):(Total: 33s040ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(1s000ms): 95.93 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.56 MB, 193.65 MB, 193.71 MB, 193.62 MB, 193.64 MB, 193.71 MB, 193.76 MB, 193.80 MB, 193.69 MB, 193.74 MB, 102.44 MB, 67.17 MB, 67.07 MB, 171.49 MB, 187.65 MB, 187.70 MB, 187.77 MB, 187.65 MB, 187.70 MB, 187.79 MB, 187.70 MB, 187.81 MB, 183.66 MB, 102.55 MB, 82.91 MB, 51.09 MB, 16.02 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 1 - AverageThreadTokens: 8.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.15 MB (203583168) - PerHostPeakMemUsage: 3.86 GB (4148003016) - PrepareTime: 192.064ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s575ms - TotalStorageWaitTime: 288.685ms CodeGen:(Total: 514.456ms, non-child: 514.456ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 319.504ms - PrepareTime: 180.151ms DataStreamSender (dst_id=14):(Total: 32s403ms, non-child: 32s403ms, % non-child: 100.00%) - BytesSent: 1012.37 MB (1061549744) - NetworkThroughput(*): 7.08 MB/sec - OverallThroughput: 31.24 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s513ms - ThriftTransmitTime(*): 2m22s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=5):(Total: 756.738ms, non-child: 756.738ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.45 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 164.89 MB, 303.67 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.76 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s429ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 65.99 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.71K (8711) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 307.949ms - ScannerThreadsUserTime: 18s563ms - ScannerThreadsVoluntaryContextSwitches: 47.72K (47724) - TotalRawHdfsReadTime(*): 199.494ms - TotalReadThroughput: 10.29 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df9 (host=vb0204.halxg.cloudera.com:22000):(Total: 32s900ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 34.00 KB, 169.57 MB, 169.57 MB, 169.57 MB, 169.57 MB, 169.57 MB, 169.57 MB, 169.57 MB, 170.06 MB, 170.56 MB, 170.58 MB, 170.53 MB, 170.46 MB, 170.51 MB, 170.58 MB, 99.23 MB, 59.89 MB, 59.93 MB, 169.84 MB, 170.62 MB, 170.59 MB, 170.65 MB, 170.60 MB, 170.62 MB, 170.47 MB, 170.56 MB, 150.73 MB, 71.54 MB, 59.77 MB, 86.24 MB, 78.18 MB, 78.08 MB, 54.50 MB ThreadUsage(1s000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 4, 4, 4 - AverageThreadTokens: 7.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 172.39 MB (180760864) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 203.305ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 3m51s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s037ms - TotalStorageWaitTime: 394.461ms CodeGen:(Total: 599.010ms, non-child: 599.010ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.473ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 390.775ms - PrepareTime: 190.502ms DataStreamSender (dst_id=14):(Total: 32s323ms, non-child: 32s323ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1107694480) - NetworkThroughput(*): 8.67 MB/sec - OverallThroughput: 32.68 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s237ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=5):(Total: 714.652ms, non-child: 714.652ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 71.86 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB, 215.60 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 287.47 MB, 308.05 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.51 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s369ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 171.97 MB (180318504) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 70.82 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.96K (6964) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 3m30s - ScannerThreadsSysTime: 181.968ms - ScannerThreadsUserTime: 16s082ms - ScannerThreadsVoluntaryContextSwitches: 49.48K (49479) - TotalRawHdfsReadTime(*): 264.009ms - TotalReadThroughput: 10.58 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9df6 (host=vb0214.halxg.cloudera.com:22000):(Total: 32s839ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(1s000ms): 37.76 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 190.86 MB, 191.28 MB, 191.64 MB, 191.70 MB, 191.59 MB, 191.70 MB, 191.81 MB, 191.73 MB, 191.70 MB, 191.68 MB, 100.36 MB, 65.12 MB, 71.99 MB, 176.44 MB, 193.78 MB, 193.66 MB, 193.76 MB, 193.78 MB, 193.59 MB, 193.66 MB, 193.77 MB, 193.58 MB, 153.86 MB, 67.04 MB, 83.40 MB, 31.95 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 8.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.04 MB (203468560) - PerHostPeakMemUsage: 3.85 GB (4135587088) - PrepareTime: 197.628ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s748ms - TotalStorageWaitTime: 418.472ms CodeGen:(Total: 578.872ms, non-child: 578.872ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.168ms - PrepareTime: 184.776ms DataStreamSender (dst_id=14):(Total: 32s244ms, non-child: 32s244ms, % non-child: 100.00%) - BytesSent: 1022.28 MB (1071933881) - NetworkThroughput(*): 7.94 MB/sec - OverallThroughput: 31.70 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s443ms - ThriftTransmitTime(*): 2m8s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=5):(Total: 720.181ms, non-child: 720.181ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:96.97% 1:0% 2:1.515% 3:1.515% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 101.74 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 162.71 MB, 227.39 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 337.23 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 7.68 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s440ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 69.96 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.38K (7381) - ScannerThreadsTotalWallClockTime: 4m11s - MaterializeTupleTime(*): 4m8s - ScannerThreadsSysTime: 250.958ms - ScannerThreadsUserTime: 16s579ms - ScannerThreadsVoluntaryContextSwitches: 46.86K (46862) - TotalRawHdfsReadTime(*): 270.710ms - TotalReadThroughput: 10.53 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e02 (host=vb0218.halxg.cloudera.com:22000):(Total: 31s805ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 95.90 MB, 193.67 MB, 193.67 MB, 193.67 MB, 193.67 MB, 193.67 MB, 193.67 MB, 193.67 MB, 193.66 MB, 193.66 MB, 193.74 MB, 193.71 MB, 193.60 MB, 193.67 MB, 193.61 MB, 193.70 MB, 98.54 MB, 67.22 MB, 67.11 MB, 129.73 MB, 193.59 MB, 193.54 MB, 193.68 MB, 193.71 MB, 193.77 MB, 193.84 MB, 193.66 MB, 193.61 MB, 169.78 MB, 67.18 MB, 67.05 MB, 31.95 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 8.54 - BloomFilterBytes: 0 - PeakMemoryUsage: 196.42 MB (205956328) - PerHostPeakMemUsage: 3.69 GB (3966311248) - PrepareTime: 192.582ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s675ms - TotalStorageWaitTime: 354.036ms CodeGen:(Total: 543.548ms, non-child: 543.548ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 345.320ms - PrepareTime: 182.678ms DataStreamSender (dst_id=14):(Total: 31s269ms, non-child: 31s269ms, % non-child: 100.00%) - BytesSent: 1019.44 MB (1068958382) - NetworkThroughput(*): 6.76 MB/sec - OverallThroughput: 32.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s973ms - ThriftTransmitTime(*): 2m30s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=5):(Total: 670.888ms, non-child: 670.888ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.14 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 246.41 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.66 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s269ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 196.05 MB (205571304) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 75.45 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.65K (7648) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 4m3s - ScannerThreadsSysTime: 142.975ms - ScannerThreadsUserTime: 15s516ms - ScannerThreadsVoluntaryContextSwitches: 48.17K (48170) - TotalRawHdfsReadTime(*): 282.826ms - TotalReadThroughput: 10.74 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dfc (host=vb0216.halxg.cloudera.com:22000):(Total: 31s749ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(1s000ms): 96.59 MB, 193.10 MB, 193.10 MB, 193.10 MB, 193.10 MB, 193.10 MB, 193.10 MB, 193.10 MB, 193.33 MB, 193.66 MB, 193.66 MB, 193.66 MB, 193.73 MB, 193.62 MB, 193.71 MB, 193.60 MB, 161.77 MB, 67.17 MB, 67.12 MB, 104.90 MB, 193.71 MB, 193.61 MB, 193.70 MB, 193.64 MB, 193.62 MB, 193.68 MB, 193.71 MB, 193.85 MB, 193.65 MB, 153.99 MB, 67.04 MB, 67.20 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.11 MB (203542248) - PerHostPeakMemUsage: 3.69 GB (3963746072) - PrepareTime: 196.406ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s759ms - TotalStorageWaitTime: 301.547ms CodeGen:(Total: 579.879ms, non-child: 579.879ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 380.893ms - PrepareTime: 181.373ms DataStreamSender (dst_id=14):(Total: 31s198ms, non-child: 31s198ms, % non-child: 100.00%) - BytesSent: 1004.58 MB (1053376658) - NetworkThroughput(*): 7.00 MB/sec - OverallThroughput: 32.20 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s834ms - ThriftTransmitTime(*): 2m23s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=5):(Total: 664.570ms, non-child: 664.570ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:98.41% 1:1.587% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 209.43 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s240ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 71.70 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.19K (6190) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 4m10s - ScannerThreadsSysTime: 167.970ms - ScannerThreadsUserTime: 15s500ms - ScannerThreadsVoluntaryContextSwitches: 46.56K (46564) - TotalRawHdfsReadTime(*): 243.718ms - TotalReadThroughput: 10.27 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9dfe (host=vb0220.halxg.cloudera.com:22000):(Total: 31s245ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(1s000ms): 34.00 KB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 192.85 MB, 193.19 MB, 193.61 MB, 193.74 MB, 193.65 MB, 193.72 MB, 193.64 MB, 193.71 MB, 193.64 MB, 193.68 MB, 106.39 MB, 66.99 MB, 67.09 MB, 158.91 MB, 193.69 MB, 193.68 MB, 193.70 MB, 193.70 MB, 193.55 MB, 193.73 MB, 193.71 MB, 193.67 MB, 153.88 MB, 67.06 MB, 67.07 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.75 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.05 MB (203476664) - PerHostPeakMemUsage: 3.67 GB (3944707912) - PrepareTime: 193.053ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s153ms - TotalStorageWaitTime: 386.921ms CodeGen:(Total: 599.360ms, non-child: 599.360ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 400.560ms - PrepareTime: 186.918ms DataStreamSender (dst_id=14):(Total: 30s680ms, non-child: 30s680ms, % non-child: 100.00%) - BytesSent: 959.44 MB (1006047550) - NetworkThroughput(*): 8.01 MB/sec - OverallThroughput: 31.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s759ms - ThriftTransmitTime(*): 1m59s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=5):(Total: 694.433ms, non-child: 694.433ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.39% 1:1.613% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 246.42 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s646ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009808) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 68.59 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 8.10K (8095) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 4m6s - ScannerThreadsSysTime: 191.967ms - ScannerThreadsUserTime: 17s507ms - ScannerThreadsVoluntaryContextSwitches: 46.59K (46589) - TotalRawHdfsReadTime(*): 234.879ms - TotalReadThroughput: 10.43 MB/sec Fragment F02: Instance fc4ebd07a3c493a1:101db40b9b2a9e06 (host=vb0212.halxg.cloudera.com:22000):(Total: 37s675ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 80.26 MB, 228.40 MB, 358.77 MB, 485.86 MB, 608.37 MB, 676.35 MB, 868.33 MB, 1.07 GB, 1.15 GB, 1.29 GB, 1.31 GB, 1.33 GB, 1.34 GB, 1.36 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.75 GB, 1.89 GB, 1.33 GB, 680.01 MB, 485.78 MB, 340.07 MB, 145.84 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069171968) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 193.793ms - RowsProduced: 13.28M (13282670) - TotalCpuTime: 35s567ms - TotalNetworkReceiveTime: 9s530ms - TotalNetworkSendTime: 395.000ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 700.583ms, non-child: 700.583ms, % non-child: 100.00%) - CodegenTime: 858.168us - CompileTime: 74.554ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 435.691ms - PrepareTime: 178.999ms DataStreamSender (dst_id=12):(Total: 4s124ms, non-child: 4s124ms, % non-child: 100.00%) - BytesSent: 133.34 MB (139816357) - NetworkThroughput(*): 45.60 MB/sec - OverallThroughput: 32.33 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 774.518ms - ThriftTransmitTime(*): 2s924ms - UncompressedRowBatchSize: 253.40 MB (265705288) AGGREGATION_NODE (id=4):(Total: 33s531ms, non-child: 9s026ms, % non-child: 26.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 495.894us - GetResultsTime: 453.929ms - HTResizeTime: 1s187ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.89 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.28M (13282670) - RowsReturnedRate: 396.13 K/sec - StreamingTime: 8s270ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s504ms, non-child: 13s033ms, % non-child: 53.19%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s665ms - BuildRows: 13.66M (13659391) - BuildRowsPartitioned: 13.66M (13659391) - BuildTime: 1s665ms - GetNewBlockTime: 1.963ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51600874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s992ms - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.336us EXCHANGE_NODE (id=11):(Total: 3s393ms, non-child: 1s169ms, % non-child: 34.47%) BytesReceived(1s000ms): 4.32 MB, 61.58 MB, 132.79 MB, 204.24 MB, 270.95 MB, 296.22 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB, 297.97 MB - BytesReceived: 297.97 MB (312443911) - ConvertRowBatchTime: 404.478ms - DeserializeRowBatchTimer: 1s556ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13659391) - RowsReturnedRate: 4.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s078ms, non-child: 2s969ms, % non-child: 36.76%) BytesReceived(1s000ms): 3.95 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 20.05 MB, 64.82 MB, 102.99 MB, 140.70 MB, 181.02 MB, 237.12 MB, 282.53 MB, 335.32 MB, 373.38 MB, 406.77 MB, 439.92 MB, 477.78 MB, 512.91 MB, 550.53 MB, 586.07 MB, 632.23 MB, 677.88 MB, 723.84 MB, 771.40 MB, 817.34 MB, 864.63 MB, 914.63 MB, 960.08 MB, 998.34 MB, 1023.25 MB - BytesReceived: 1.03 GB (1103585122) - ConvertRowBatchTime: 1s346ms - DeserializeRowBatchTimer: 5s645ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51600874) - RowsReturnedRate: 6.39 M/sec - SendersBlockedTimer: 7s173ms - SendersBlockedTotalTimer(*): 1m33s Instance fc4ebd07a3c493a1:101db40b9b2a9e04 (host=vb0230.halxg.cloudera.com:22000):(Total: 37s466ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 11.11 MB, 212.35 MB, 356.34 MB, 484.40 MB, 548.35 MB, 676.33 MB, 836.30 MB, 1.04 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.35 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.75 GB, 1.89 GB, 1.33 GB, 655.73 MB, 485.76 MB, 291.50 MB, 97.26 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070368024) - PerHostPeakMemUsage: 3.88 GB (4170802424) - PrepareTime: 194.746ms - RowsProduced: 13.29M (13293698) - TotalCpuTime: 35s935ms - TotalNetworkReceiveTime: 9s307ms - TotalNetworkSendTime: 58.167ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 719.519ms, non-child: 719.519ms, % non-child: 100.00%) - CodegenTime: 927.847us - CompileTime: 67.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 460.406ms - PrepareTime: 179.082ms DataStreamSender (dst_id=12):(Total: 3s907ms, non-child: 3s907ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139931123) - NetworkThroughput(*): 60.18 MB/sec - OverallThroughput: 34.15 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 770.251ms - ThriftTransmitTime(*): 2s217ms - UncompressedRowBatchSize: 253.61 MB (265925892) AGGREGATION_NODE (id=4):(Total: 33s541ms, non-child: 9s077ms, % non-child: 27.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 868.588us - GetResultsTime: 457.661ms - HTResizeTime: 1s079ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13293698) - RowsReturnedRate: 396.33 K/sec - StreamingTime: 8s295ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s464ms, non-child: 13s300ms, % non-child: 54.37%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s916ms - BuildRows: 13.67M (13669673) - BuildRowsPartitioned: 13.67M (13669673) - BuildTime: 1s674ms - GetNewBlockTime: 1.806ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s008ms - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.144us EXCHANGE_NODE (id=11):(Total: 3s127ms, non-child: 810.148ms, % non-child: 25.90%) BytesReceived(1s000ms): 2.09 MB, 55.99 MB, 127.23 MB, 198.87 MB, 267.01 MB, 295.89 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB, 298.20 MB - BytesReceived: 298.20 MB (312684666) - ConvertRowBatchTime: 421.333ms - DeserializeRowBatchTimer: 1s157ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13669673) - RowsReturnedRate: 4.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s036ms, non-child: 2s993ms, % non-child: 37.25%) BytesReceived(1s000ms): 2.04 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 17.60 MB, 62.00 MB, 98.14 MB, 138.66 MB, 177.04 MB, 234.43 MB, 278.49 MB, 331.53 MB, 370.90 MB, 404.33 MB, 437.34 MB, 475.18 MB, 511.09 MB, 547.77 MB, 583.07 MB, 628.66 MB, 675.26 MB, 719.83 MB, 767.99 MB, 814.45 MB, 861.47 MB, 911.37 MB, 957.66 MB, 997.35 MB, 1020.50 MB - BytesReceived: 1.03 GB (1104305454) - ConvertRowBatchTime: 1s247ms - DeserializeRowBatchTimer: 5s853ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633923) - RowsReturnedRate: 6.42 M/sec - SendersBlockedTimer: 7s190ms - SendersBlockedTotalTimer(*): 50s401ms Instance fc4ebd07a3c493a1:101db40b9b2a9e09 (host=vb0226.halxg.cloudera.com:22000):(Total: 37s444ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.90 MB, 229.23 MB, 356.35 MB, 484.34 MB, 612.36 MB, 692.32 MB, 868.30 MB, 1.04 GB, 1.16 GB, 1.30 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.79 GB, 1.89 GB, 1.33 GB, 631.45 MB, 437.21 MB, 242.96 MB, 72.97 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069647672) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 197.464ms - RowsProduced: 13.29M (13286497) - TotalCpuTime: 36s258ms - TotalNetworkReceiveTime: 9s154ms - TotalNetworkSendTime: 92.604ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 690.253ms, non-child: 690.253ms, % non-child: 100.00%) - CodegenTime: 1.088ms - CompileTime: 58.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 438.119ms - PrepareTime: 181.639ms DataStreamSender (dst_id=12):(Total: 3s852ms, non-child: 3s852ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139865800) - NetworkThroughput(*): 57.97 MB/sec - OverallThroughput: 34.62 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 786.686ms - ThriftTransmitTime(*): 2s301ms - UncompressedRowBatchSize: 253.47 MB (265781844) AGGREGATION_NODE (id=4):(Total: 33s574ms, non-child: 9s477ms, % non-child: 28.23%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 751.122us - GetResultsTime: 483.443ms - HTResizeTime: 1s069ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13286497) - RowsReturnedRate: 395.73 K/sec - StreamingTime: 8s688ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s096ms, non-child: 13s080ms, % non-child: 54.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s439ms - BuildRows: 13.66M (13662674) - BuildRowsPartitioned: 13.66M (13662674) - BuildTime: 1s937ms - GetNewBlockTime: 1.337ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s032ms - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 2.14 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.418us EXCHANGE_NODE (id=11):(Total: 3s637ms, non-child: 1s390ms, % non-child: 38.24%) BytesReceived(1s000ms): 5.58 MB, 64.66 MB, 135.97 MB, 207.33 MB, 273.07 MB, 296.48 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB, 298.03 MB - BytesReceived: 298.03 MB (312508983) - ConvertRowBatchTime: 331.636ms - DeserializeRowBatchTimer: 1s904ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13662674) - RowsReturnedRate: 3.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s378ms, non-child: 3s079ms, % non-child: 41.73%) BytesReceived(1s000ms): 5.02 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 21.28 MB, 66.25 MB, 105.45 MB, 143.13 MB, 182.27 MB, 237.73 MB, 284.36 MB, 337.05 MB, 374.53 MB, 407.94 MB, 441.21 MB, 479.25 MB, 514.04 MB, 551.95 MB, 587.70 MB, 634.18 MB, 679.21 MB, 725.92 MB, 772.77 MB, 819.22 MB, 866.71 MB, 916.97 MB, 962.14 MB, 999.68 MB, 1.00 GB - BytesReceived: 1.03 GB (1103822938) - ConvertRowBatchTime: 1s329ms - DeserializeRowBatchTimer: 5s796ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610663) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 7s419ms - SendersBlockedTotalTimer(*): 59s351ms Instance fc4ebd07a3c493a1:101db40b9b2a9e0d (host=vb0220.halxg.cloudera.com:22000):(Total: 37s414ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 795.50 KB, 164.79 MB, 292.41 MB, 420.74 MB, 548.78 MB, 676.36 MB, 788.33 MB, 980.33 MB, 1.14 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.34 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.49 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.89 GB, 680.01 MB, 510.06 MB, 340.08 MB, 145.82 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069070920) - PerHostPeakMemUsage: 3.83 GB (4109984000) - PrepareTime: 194.466ms - RowsProduced: 13.29M (13288288) - TotalCpuTime: 36s389ms - TotalNetworkReceiveTime: 8s882ms - TotalNetworkSendTime: 281.586ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 713.098ms, non-child: 713.098ms, % non-child: 100.00%) - CodegenTime: 819.048us - CompileTime: 57.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 464.642ms - PrepareTime: 185.191ms DataStreamSender (dst_id=12):(Total: 3s835ms, non-child: 3s835ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139865835) - NetworkThroughput(*): 46.14 MB/sec - OverallThroughput: 34.78 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 864.340ms - ThriftTransmitTime(*): 2s891ms - UncompressedRowBatchSize: 253.50 MB (265817668) AGGREGATION_NODE (id=4):(Total: 33s562ms, non-child: 9s185ms, % non-child: 27.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 590.337us - GetResultsTime: 495.970ms - HTResizeTime: 1s181ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288288) - RowsReturnedRate: 395.92 K/sec - StreamingTime: 8s389ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s377ms, non-child: 13s608ms, % non-child: 55.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s865ms - BuildRows: 13.67M (13665207) - BuildRowsPartitioned: 13.67M (13665207) - BuildTime: 1s946ms - GetNewBlockTime: 1.614ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51607534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s062ms - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.292us EXCHANGE_NODE (id=11):(Total: 3s181ms, non-child: 1s419ms, % non-child: 44.61%) BytesReceived(1s000ms): 13.42 MB, 80.62 MB, 151.52 MB, 223.31 MB, 282.46 MB, 297.55 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB, 298.11 MB - BytesReceived: 298.11 MB (312586387) - ConvertRowBatchTime: 427.543ms - DeserializeRowBatchTimer: 1s840ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665207) - RowsReturnedRate: 4.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s588ms, non-child: 2s769ms, % non-child: 36.49%) BytesReceived(1s000ms): 5.07 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 31.03 MB, 72.65 MB, 110.11 MB, 153.09 MB, 196.01 MB, 248.00 MB, 295.50 MB, 347.45 MB, 382.32 MB, 415.42 MB, 450.13 MB, 488.70 MB, 521.58 MB, 560.19 MB, 596.82 MB, 646.71 MB, 688.10 MB, 736.62 MB, 782.86 MB, 829.15 MB, 878.53 MB, 927.26 MB, 971.36 MB, 1004.55 MB, 1.01 GB - BytesReceived: 1.03 GB (1103778471) - ConvertRowBatchTime: 1s262ms - DeserializeRowBatchTimer: 5s512ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51607534) - RowsReturnedRate: 6.80 M/sec - SendersBlockedTimer: 7s504ms - SendersBlockedTotalTimer(*): 1m44s Instance fc4ebd07a3c493a1:101db40b9b2a9e0e (host=vb0228.halxg.cloudera.com:22000):(Total: 37s375ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 76.60 MB, 228.38 MB, 356.37 MB, 484.38 MB, 548.53 MB, 676.34 MB, 820.33 MB, 1012.33 MB, 1.16 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.34 GB, 1.39 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.75 GB, 1.89 GB, 1.33 GB, 680.02 MB, 485.77 MB, 291.51 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069296272) - PerHostPeakMemUsage: 3.86 GB (4148003016) - PrepareTime: 200.961ms - RowsProduced: 13.29M (13290509) - TotalCpuTime: 36s046ms - TotalNetworkReceiveTime: 9s325ms - TotalNetworkSendTime: 145.265ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 642.466ms, non-child: 642.466ms, % non-child: 100.00%) - CodegenTime: 1.585ms - CompileTime: 84.786ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 365.726ms - PrepareTime: 178.733ms DataStreamSender (dst_id=12):(Total: 3s646ms, non-child: 3s646ms, % non-child: 100.00%) - BytesSent: 133.41 MB (139888339) - NetworkThroughput(*): 52.03 MB/sec - OverallThroughput: 36.58 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 803.119ms - ThriftTransmitTime(*): 2s563ms - UncompressedRowBatchSize: 253.55 MB (265862100) AGGREGATION_NODE (id=4):(Total: 33s712ms, non-child: 9s099ms, % non-child: 26.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.258ms - GetResultsTime: 460.806ms - HTResizeTime: 1s068ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290509) - RowsReturnedRate: 394.23 K/sec - StreamingTime: 8s330ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s613ms, non-child: 13s579ms, % non-child: 55.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s405ms - BuildRows: 13.67M (13667262) - BuildRowsPartitioned: 13.67M (13667262) - BuildTime: 1s978ms - GetNewBlockTime: 1.362ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51625420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s494ms - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 2.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.311us EXCHANGE_NODE (id=11):(Total: 3s714ms, non-child: 769.497ms, % non-child: 20.72%) BytesReceived(1s000ms): 2.61 MB, 57.34 MB, 128.57 MB, 200.13 MB, 267.98 MB, 295.95 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB - BytesReceived: 298.13 MB (312612509) - ConvertRowBatchTime: 284.149ms - DeserializeRowBatchTimer: 1s296ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667262) - RowsReturnedRate: 3.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s319ms, non-child: 2s776ms, % non-child: 37.93%) BytesReceived(1s000ms): 2.48 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 18.19 MB, 62.73 MB, 99.15 MB, 138.49 MB, 178.03 MB, 235.26 MB, 279.25 MB, 332.14 MB, 371.23 MB, 404.63 MB, 437.56 MB, 475.56 MB, 511.24 MB, 548.12 MB, 583.38 MB, 629.09 MB, 675.35 MB, 720.24 MB, 768.25 MB, 814.68 MB, 861.78 MB, 911.70 MB, 957.82 MB, 997.37 MB, 1021.04 MB - BytesReceived: 1.03 GB (1104072382) - ConvertRowBatchTime: 1s238ms - DeserializeRowBatchTimer: 5s377ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51625420) - RowsReturnedRate: 7.05 M/sec - SendersBlockedTimer: 7s507ms - SendersBlockedTotalTimer(*): 1m37s Instance fc4ebd07a3c493a1:101db40b9b2a9e08 (host=vb0204.halxg.cloudera.com:22000):(Total: 37s299ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.17 MB, 165.79 MB, 295.26 MB, 420.42 MB, 548.37 MB, 676.34 MB, 804.30 MB, 1012.30 MB, 1.14 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.50 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.54 GB, 1.60 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.71 GB, 1.89 GB, 1.33 GB, 680.01 MB, 485.77 MB, 291.52 MB, 97.27 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070744816) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 201.862ms - RowsProduced: 13.29M (13289325) - TotalCpuTime: 35s782ms - TotalNetworkReceiveTime: 9s242ms - TotalNetworkSendTime: 375.969ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 683.069ms, non-child: 683.069ms, % non-child: 100.00%) - CodegenTime: 844.767us - CompileTime: 78.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 405.967ms - PrepareTime: 187.902ms DataStreamSender (dst_id=12):(Total: 3s673ms, non-child: 3s673ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139872570) - NetworkThroughput(*): 49.68 MB/sec - OverallThroughput: 36.32 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 947.255ms - ThriftTransmitTime(*): 2s685ms - UncompressedRowBatchSize: 253.52 MB (265838412) AGGREGATION_NODE (id=4):(Total: 33s602ms, non-child: 8s836ms, % non-child: 26.30%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 546.106us - GetResultsTime: 500.520ms - HTResizeTime: 1s036ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13289325) - RowsReturnedRate: 395.49 K/sec - StreamingTime: 8s029ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s765ms, non-child: 13s588ms, % non-child: 54.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s057ms - BuildRows: 13.67M (13665447) - BuildRowsPartitioned: 13.67M (13665447) - BuildTime: 1s913ms - GetNewBlockTime: 1.876ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51614200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s862ms - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 2.08 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.069us EXCHANGE_NODE (id=11):(Total: 3s012ms, non-child: 1s476ms, % non-child: 49.01%) BytesReceived(1s000ms): 14.30 MB, 82.23 MB, 153.15 MB, 224.91 MB, 283.32 MB, 297.59 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB - BytesReceived: 298.10 MB (312579499) - ConvertRowBatchTime: 452.599ms - DeserializeRowBatchTimer: 1s853ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665447) - RowsReturnedRate: 4.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s164ms, non-child: 2s930ms, % non-child: 35.89%) BytesReceived(1s000ms): 5.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 32.33 MB, 73.08 MB, 111.63 MB, 154.05 MB, 197.47 MB, 249.25 MB, 296.77 MB, 348.54 MB, 383.33 MB, 416.25 MB, 451.00 MB, 489.58 MB, 522.67 MB, 561.02 MB, 597.91 MB, 647.96 MB, 689.12 MB, 737.78 MB, 784.27 MB, 830.16 MB, 879.77 MB, 928.06 MB, 972.56 MB, 1004.58 MB, 1.01 GB - BytesReceived: 1.03 GB (1103818996) - ConvertRowBatchTime: 1s273ms - DeserializeRowBatchTimer: 5s312ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51614200) - RowsReturnedRate: 6.32 M/sec - SendersBlockedTimer: 9s123ms - SendersBlockedTotalTimer(*): 2m9s Instance fc4ebd07a3c493a1:101db40b9b2a9e07 (host=vb0234.halxg.cloudera.com:22000):(Total: 37s283ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 770.50 KB, 164.36 MB, 292.37 MB, 420.35 MB, 548.35 MB, 676.34 MB, 788.30 MB, 996.30 MB, 1.14 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.40 GB, 1.40 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.49 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.66 GB, 1.64 GB, 1.71 GB, 1.90 GB, 1.89 GB, 680.02 MB, 485.77 MB, 291.51 MB, 97.25 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071682624) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 181.568ms - RowsProduced: 13.30M (13296496) - TotalCpuTime: 36s035ms - TotalNetworkReceiveTime: 9s015ms - TotalNetworkSendTime: 264.180ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 685.592ms, non-child: 685.592ms, % non-child: 100.00%) - CodegenTime: 834.045us - CompileTime: 91.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 416.102ms - PrepareTime: 177.259ms DataStreamSender (dst_id=12):(Total: 3s699ms, non-child: 3s699ms, % non-child: 100.00%) - BytesSent: 133.46 MB (139944608) - NetworkThroughput(*): 48.70 MB/sec - OverallThroughput: 36.08 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 826.692ms - ThriftTransmitTime(*): 2s740ms - UncompressedRowBatchSize: 253.66 MB (265981860) AGGREGATION_NODE (id=4):(Total: 33s570ms, non-child: 9s203ms, % non-child: 27.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 718.407us - GetResultsTime: 488.280ms - HTResizeTime: 1s093ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.30M (13296496) - RowsReturnedRate: 396.07 K/sec - StreamingTime: 8s416ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s366ms, non-child: 13s562ms, % non-child: 55.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s355ms - BuildRows: 13.67M (13674099) - BuildRowsPartitioned: 13.67M (13674099) - BuildTime: 1s802ms - GetNewBlockTime: 1.245ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.64M (51643881) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s647ms - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.089us EXCHANGE_NODE (id=11):(Total: 3s733ms, non-child: 635.619ms, % non-child: 17.02%) BytesReceived(1s000ms): 13.32 MB, 80.43 MB, 151.37 MB, 223.24 MB, 282.54 MB, 297.72 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB, 298.29 MB - BytesReceived: 298.29 MB (312783454) - ConvertRowBatchTime: 295.702ms - DeserializeRowBatchTimer: 1s070ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13674099) - RowsReturnedRate: 3.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s070ms, non-child: 2s713ms, % non-child: 38.38%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 30.79 MB, 72.61 MB, 109.94 MB, 152.99 MB, 195.82 MB, 247.90 MB, 295.47 MB, 347.69 MB, 382.52 MB, 415.65 MB, 450.45 MB, 489.02 MB, 521.90 MB, 560.49 MB, 597.04 MB, 646.87 MB, 688.38 MB, 736.98 MB, 783.35 MB, 829.64 MB, 879.05 MB, 927.68 MB, 971.76 MB, 1004.97 MB, 1.01 GB - BytesReceived: 1.03 GB (1104376166) - ConvertRowBatchTime: 1s313ms - DeserializeRowBatchTimer: 5s030ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.64M (51643881) - RowsReturnedRate: 7.30 M/sec - SendersBlockedTimer: 7s414ms - SendersBlockedTotalTimer(*): 1m28s Instance fc4ebd07a3c493a1:101db40b9b2a9e03 (host=vb0208.halxg.cloudera.com:22000):(Total: 37s217ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.72 MB, 229.16 MB, 358.40 MB, 484.70 MB, 596.36 MB, 676.33 MB, 852.30 MB, 1.07 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.62 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.76 GB, 1.89 GB, 1.33 GB, 631.46 MB, 437.21 MB, 242.96 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070847824) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 199.237ms - RowsProduced: 13.29M (13287056) - TotalCpuTime: 35s571ms - TotalNetworkReceiveTime: 9s418ms - TotalNetworkSendTime: 62.649ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 734.036ms, non-child: 734.036ms, % non-child: 100.00%) - CodegenTime: 1.221ms - CompileTime: 62.332ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 476.247ms - PrepareTime: 183.833ms DataStreamSender (dst_id=12):(Total: 3s652ms, non-child: 3s652ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139861589) - NetworkThroughput(*): 57.94 MB/sec - OverallThroughput: 36.52 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 740.196ms - ThriftTransmitTime(*): 2s302ms - UncompressedRowBatchSize: 253.48 MB (265793024) AGGREGATION_NODE (id=4):(Total: 33s547ms, non-child: 8s962ms, % non-child: 26.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 729.294us - GetResultsTime: 496.863ms - HTResizeTime: 1s003ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287056) - RowsReturnedRate: 396.07 K/sec - StreamingTime: 8s160ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s584ms, non-child: 13s274ms, % non-child: 53.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s040ms - BuildRows: 13.66M (13663746) - BuildRowsPartitioned: 13.66M (13663746) - BuildTime: 1s681ms - GetNewBlockTime: 1.794ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.60M (51602489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s851ms - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 2.10 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.337us EXCHANGE_NODE (id=11):(Total: 2s981ms, non-child: 1s474ms, % non-child: 49.45%) BytesReceived(1s000ms): 4.04 MB, 60.93 MB, 132.15 MB, 203.62 MB, 270.55 MB, 296.22 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB, 298.04 MB - BytesReceived: 298.04 MB (312515103) - ConvertRowBatchTime: 464.017ms - DeserializeRowBatchTimer: 1s862ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663746) - RowsReturnedRate: 4.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s329ms, non-child: 2s377ms, % non-child: 28.55%) BytesReceived(1s000ms): 3.73 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 19.76 MB, 64.48 MB, 102.37 MB, 140.13 MB, 180.55 MB, 236.90 MB, 281.89 MB, 334.51 MB, 372.72 MB, 406.12 MB, 439.26 MB, 477.15 MB, 512.41 MB, 549.76 MB, 585.38 MB, 631.56 MB, 677.41 MB, 723.22 MB, 771.00 MB, 816.98 MB, 864.16 MB, 914.07 MB, 959.67 MB, 998.15 MB, 1022.87 MB - BytesReceived: 1.03 GB (1103589759) - ConvertRowBatchTime: 1s236ms - DeserializeRowBatchTimer: 4s793ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.60M (51602489) - RowsReturnedRate: 6.20 M/sec - SendersBlockedTimer: 7s190ms - SendersBlockedTotalTimer(*): 1m33s Instance fc4ebd07a3c493a1:101db40b9b2a9e10 (host=vb0222.halxg.cloudera.com:22000):(Total: 37s183ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 77.62 MB, 228.36 MB, 356.35 MB, 484.40 MB, 548.37 MB, 676.36 MB, 868.33 MB, 1.05 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.34 GB, 1.35 GB, 1.42 GB, 1.41 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.77 GB, 1.89 GB, 1.33 GB, 631.45 MB, 437.21 MB, 242.94 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069142720) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 197.349ms - RowsProduced: 13.29M (13288925) - TotalCpuTime: 34s599ms - TotalNetworkReceiveTime: 10s460ms - TotalNetworkSendTime: 102.599ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 640.908ms, non-child: 640.908ms, % non-child: 100.00%) - CodegenTime: 1.148ms - CompileTime: 64.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 384.296ms - PrepareTime: 180.773ms DataStreamSender (dst_id=12):(Total: 3s557ms, non-child: 3s557ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139865494) - NetworkThroughput(*): 54.27 MB/sec - OverallThroughput: 37.49 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 763.591ms - ThriftTransmitTime(*): 2s457ms - UncompressedRowBatchSize: 253.52 MB (265830412) AGGREGATION_NODE (id=4):(Total: 33s600ms, non-child: 8s502ms, % non-child: 25.30%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.870ms - GetResultsTime: 463.493ms - HTResizeTime: 977.327ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288925) - RowsReturnedRate: 395.49 K/sec - StreamingTime: 7s734ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 25s098ms, non-child: 12s991ms, % non-child: 51.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s292ms - BuildRows: 13.67M (13665251) - BuildRowsPartitioned: 13.67M (13665251) - BuildTime: 1s864ms - GetNewBlockTime: 2.063ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51619643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s183ms - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 2.06 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.126us EXCHANGE_NODE (id=11):(Total: 3s833ms, non-child: 599.399ms, % non-child: 15.64%) BytesReceived(1s000ms): 3.07 MB, 58.58 MB, 129.85 MB, 201.38 MB, 268.88 MB, 296.03 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB, 298.10 MB - BytesReceived: 298.10 MB (312577096) - ConvertRowBatchTime: 275.410ms - DeserializeRowBatchTimer: 1s060ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665251) - RowsReturnedRate: 3.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s274ms, non-child: 3s054ms, % non-child: 36.91%) BytesReceived(1s000ms): 2.89 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 18.78 MB, 63.38 MB, 100.43 MB, 138.69 MB, 179.28 MB, 236.12 MB, 280.27 MB, 333.14 MB, 371.86 MB, 405.14 MB, 438.16 MB, 476.24 MB, 511.79 MB, 548.92 MB, 584.31 MB, 630.19 MB, 676.37 MB, 721.51 MB, 769.44 MB, 815.82 MB, 862.86 MB, 912.83 MB, 958.68 MB, 997.66 MB, 1021.64 MB - BytesReceived: 1.03 GB (1103868025) - ConvertRowBatchTime: 1s194ms - DeserializeRowBatchTimer: 5s761ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51619643) - RowsReturnedRate: 6.24 M/sec - SendersBlockedTimer: 8s775ms - SendersBlockedTotalTimer(*): 1m49s Instance fc4ebd07a3c493a1:101db40b9b2a9e0c (host=vb0206.halxg.cloudera.com:22000):(Total: 37s161ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 10.99 MB, 216.35 MB, 356.37 MB, 484.37 MB, 548.36 MB, 676.35 MB, 804.33 MB, 980.33 MB, 1.15 GB, 1.30 GB, 1.31 GB, 1.34 GB, 1.33 GB, 1.35 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.59 GB, 1.65 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.71 GB, 1.90 GB, 1.33 GB, 655.75 MB, 485.76 MB, 267.22 MB, 73.00 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2073417920) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 194.514ms - RowsProduced: 13.29M (13291468) - TotalCpuTime: 37s213ms - TotalNetworkReceiveTime: 8s009ms - TotalNetworkSendTime: 215.451ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 752.780ms, non-child: 752.780ms, % non-child: 100.00%) - CodegenTime: 917.991us - CompileTime: 65.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 498.624ms - PrepareTime: 186.854ms DataStreamSender (dst_id=12):(Total: 3s650ms, non-child: 3s650ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139906149) - NetworkThroughput(*): 53.51 MB/sec - OverallThroughput: 36.55 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 828.807ms - ThriftTransmitTime(*): 2s493ms - UncompressedRowBatchSize: 253.56 MB (265881280) AGGREGATION_NODE (id=4):(Total: 33s495ms, non-child: 9s715ms, % non-child: 29.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.046ms - GetResultsTime: 471.702ms - HTResizeTime: 1s092ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13291468) - RowsReturnedRate: 396.81 K/sec - StreamingTime: 8s940ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 23s780ms, non-child: 14s038ms, % non-child: 59.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s397ms - BuildRows: 13.67M (13667244) - BuildRowsPartitioned: 13.67M (13667244) - BuildTime: 2s074ms - GetNewBlockTime: 1.564ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51632966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s817ms - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 2.17 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.066us EXCHANGE_NODE (id=11):(Total: 3s619ms, non-child: 586.859ms, % non-child: 16.21%) BytesReceived(1s000ms): 2.05 MB, 55.97 MB, 127.16 MB, 198.73 MB, 266.88 MB, 295.80 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB, 298.13 MB - BytesReceived: 298.13 MB (312611782) - ConvertRowBatchTime: 285.700ms - DeserializeRowBatchTimer: 1s057ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13667244) - RowsReturnedRate: 3.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 6s123ms, non-child: 3s412ms, % non-child: 55.74%) BytesReceived(1s000ms): 2.02 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 17.65 MB, 62.04 MB, 98.06 MB, 138.66 MB, 177.06 MB, 234.47 MB, 278.48 MB, 331.33 MB, 370.68 MB, 404.08 MB, 437.06 MB, 474.92 MB, 510.88 MB, 547.56 MB, 582.97 MB, 628.49 MB, 675.15 MB, 719.73 MB, 767.97 MB, 814.39 MB, 861.38 MB, 911.20 MB, 957.43 MB, 997.15 MB, 1020.31 MB - BytesReceived: 1.03 GB (1104239817) - ConvertRowBatchTime: 1s258ms - DeserializeRowBatchTimer: 5s938ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51632966) - RowsReturnedRate: 8.43 M/sec - SendersBlockedTimer: 12s869ms - SendersBlockedTotalTimer(*): 2m48s Instance fc4ebd07a3c493a1:101db40b9b2a9e0f (host=vb0224.halxg.cloudera.com:22000):(Total: 37s072ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.58 MB, 164.36 MB, 292.36 MB, 420.40 MB, 548.37 MB, 676.36 MB, 772.33 MB, 996.33 MB, 1.14 GB, 1.23 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.40 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.42 GB, 1.48 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.53 GB, 1.58 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.71 GB, 1.90 GB, 1.33 GB, 680.03 MB, 485.77 MB, 291.52 MB, 72.98 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2067543568) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 194.585ms - RowsProduced: 13.29M (13285067) - TotalCpuTime: 37s086ms - TotalNetworkReceiveTime: 8s076ms - TotalNetworkSendTime: 49.583ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 696.951ms, non-child: 696.951ms, % non-child: 100.00%) - CodegenTime: 2.973ms - CompileTime: 60.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 456.466ms - PrepareTime: 177.442ms DataStreamSender (dst_id=12):(Total: 3s476ms, non-child: 3s476ms, % non-child: 100.00%) - BytesSent: 133.36 MB (139840099) - NetworkThroughput(*): 70.74 MB/sec - OverallThroughput: 38.36 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 757.788ms - ThriftTransmitTime(*): 1s885ms - UncompressedRowBatchSize: 253.44 MB (265753236) AGGREGATION_NODE (id=4):(Total: 33s567ms, non-child: 9s585ms, % non-child: 28.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.895ms - GetResultsTime: 474.930ms - HTResizeTime: 1s060ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13285067) - RowsReturnedRate: 395.78 K/sec - StreamingTime: 8s781ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 23s981ms, non-child: 14s133ms, % non-child: 58.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s201ms - BuildRows: 13.66M (13660685) - BuildRowsPartitioned: 13.66M (13660685) - BuildTime: 1s975ms - GetNewBlockTime: 1.173ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51610308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s237ms - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 2.15 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.410us EXCHANGE_NODE (id=11):(Total: 3s856ms, non-child: 559.094ms, % non-child: 14.50%) BytesReceived(1s000ms): 14.88 MB, 83.24 MB, 154.16 MB, 225.96 MB, 283.80 MB, 297.54 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB, 298.02 MB - BytesReceived: 298.02 MB (312491407) - ConvertRowBatchTime: 269.748ms - DeserializeRowBatchTimer: 1s007ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13660685) - RowsReturnedRate: 3.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 5s992ms, non-child: 3s502ms, % non-child: 58.45%) BytesReceived(1s000ms): 5.26 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 33.09 MB, 73.63 MB, 112.33 MB, 154.58 MB, 198.24 MB, 249.84 MB, 297.23 MB, 348.81 MB, 383.35 MB, 416.25 MB, 451.12 MB, 489.79 MB, 522.94 MB, 561.30 MB, 598.24 MB, 648.27 MB, 689.43 MB, 738.29 MB, 784.95 MB, 830.72 MB, 880.32 MB, 928.65 MB, 973.01 MB, 1004.57 MB, 1.01 GB - BytesReceived: 1.03 GB (1103685887) - ConvertRowBatchTime: 1s313ms - DeserializeRowBatchTimer: 5s390ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51610308) - RowsReturnedRate: 8.61 M/sec - SendersBlockedTimer: 15s659ms - SendersBlockedTotalTimer(*): 3m20s Instance fc4ebd07a3c493a1:101db40b9b2a9e0b (host=vb0216.halxg.cloudera.com:22000):(Total: 36s960ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.87 MB, 228.37 MB, 356.35 MB, 484.39 MB, 612.34 MB, 692.34 MB, 900.33 MB, 1.08 GB, 1.16 GB, 1.31 GB, 1.30 GB, 1.35 GB, 1.34 GB, 1.37 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.81 GB, 1.89 GB, 1.30 GB, 582.90 MB, 388.63 MB, 194.38 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070426168) - PerHostPeakMemUsage: 3.83 GB (4111187200) - PrepareTime: 196.300ms - RowsProduced: 13.29M (13288833) - TotalCpuTime: 35s272ms - TotalNetworkReceiveTime: 9s536ms - TotalNetworkSendTime: 78.011ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 711.150ms, non-child: 711.150ms, % non-child: 100.00%) - CodegenTime: 844.951us - CompileTime: 62.042ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 456.161ms - PrepareTime: 179.864ms DataStreamSender (dst_id=12):(Total: 3s414ms, non-child: 3s414ms, % non-child: 100.00%) - BytesSent: 133.39 MB (139869518) - NetworkThroughput(*): 54.50 MB/sec - OverallThroughput: 39.07 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 742.241ms - ThriftTransmitTime(*): 2s447ms - UncompressedRowBatchSize: 253.51 MB (265828572) AGGREGATION_NODE (id=4):(Total: 33s517ms, non-child: 9s198ms, % non-child: 27.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 714.313us - GetResultsTime: 461.329ms - HTResizeTime: 1s073ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13288833) - RowsReturnedRate: 396.48 K/sec - StreamingTime: 8s430ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s318ms, non-child: 13s048ms, % non-child: 53.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s155ms - BuildRows: 13.67M (13665227) - BuildRowsPartitioned: 13.67M (13665227) - BuildTime: 1s730ms - GetNewBlockTime: 1.357ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.61M (51608280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s421ms - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.134us EXCHANGE_NODE (id=11):(Total: 3s894ms, non-child: 574.409ms, % non-child: 14.75%) BytesReceived(1s000ms): 9.03 MB, 71.86 MB, 142.96 MB, 214.55 MB, 277.46 MB, 297.00 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB, 298.07 MB - BytesReceived: 298.07 MB (312548559) - ConvertRowBatchTime: 256.173ms - DeserializeRowBatchTimer: 1s065ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13665227) - RowsReturnedRate: 3.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s375ms, non-child: 3s387ms, % non-child: 45.92%) BytesReceived(1s000ms): 5.05 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 24.38 MB, 69.80 MB, 107.57 MB, 148.18 MB, 187.89 MB, 241.86 MB, 289.37 MB, 342.17 MB, 378.02 MB, 411.22 MB, 445.59 MB, 483.23 MB, 516.80 MB, 555.59 MB, 591.74 MB, 639.68 MB, 683.14 MB, 730.70 MB, 776.53 MB, 823.56 MB, 871.77 MB, 921.38 MB, 965.94 MB, 1002.11 MB, 1.01 GB - BytesReceived: 1.03 GB (1103610435) - ConvertRowBatchTime: 1s296ms - DeserializeRowBatchTimer: 6s376ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.61M (51608280) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 8s247ms - SendersBlockedTotalTimer(*): 1m25s Instance fc4ebd07a3c493a1:101db40b9b2a9e0a (host=vb0232.halxg.cloudera.com:22000):(Total: 36s807ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 82.88 MB, 228.36 MB, 356.36 MB, 484.34 MB, 612.36 MB, 692.34 MB, 852.33 MB, 1.02 GB, 1.17 GB, 1.30 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.81 GB, 1.89 GB, 1.30 GB, 582.88 MB, 364.36 MB, 145.84 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2071967320) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 197.668ms - RowsProduced: 13.29M (13294432) - TotalCpuTime: 35s469ms - TotalNetworkReceiveTime: 9s530ms - TotalNetworkSendTime: 41.125ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 747.925ms, non-child: 747.925ms, % non-child: 100.00%) - CodegenTime: 1.155ms - CompileTime: 56.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 503.121ms - PrepareTime: 182.117ms DataStreamSender (dst_id=12):(Total: 3s285ms, non-child: 3s285ms, % non-child: 100.00%) - BytesSent: 133.45 MB (139935199) - NetworkThroughput(*): 72.46 MB/sec - OverallThroughput: 40.61 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 765.127ms - ThriftTransmitTime(*): 1s841ms - UncompressedRowBatchSize: 253.62 MB (265940572) AGGREGATION_NODE (id=4):(Total: 33s507ms, non-child: 8s780ms, % non-child: 26.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.927ms - GetResultsTime: 483.639ms - HTResizeTime: 1s056ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13294432) - RowsReturnedRate: 396.75 K/sec - StreamingTime: 7s999ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s727ms, non-child: 13s504ms, % non-child: 54.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s209ms - BuildRows: 13.67M (13672010) - BuildRowsPartitioned: 13.67M (13672010) - BuildTime: 2s006ms - GetNewBlockTime: 1.359ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.65M (51645841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s525ms - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 2.09 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.651us EXCHANGE_NODE (id=11):(Total: 3s807ms, non-child: 594.126ms, % non-child: 15.61%) BytesReceived(1s000ms): 8.55 MB, 70.93 MB, 142.39 MB, 213.74 MB, 277.02 MB, 297.09 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB, 298.22 MB - BytesReceived: 298.22 MB (312702268) - ConvertRowBatchTime: 258.117ms - DeserializeRowBatchTimer: 1s086ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13672010) - RowsReturnedRate: 3.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 7s415ms, non-child: 2s806ms, % non-child: 37.84%) BytesReceived(1s000ms): 5.06 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 23.96 MB, 69.34 MB, 107.24 MB, 147.66 MB, 187.15 MB, 241.42 MB, 288.99 MB, 341.74 MB, 377.89 MB, 411.15 MB, 445.50 MB, 483.08 MB, 516.97 MB, 555.74 MB, 591.70 MB, 639.43 MB, 683.07 MB, 730.72 MB, 776.64 MB, 823.75 MB, 872.01 MB, 921.71 MB, 966.31 MB, 1002.63 MB, 1.01 GB - BytesReceived: 1.03 GB (1104471882) - ConvertRowBatchTime: 1s257ms - DeserializeRowBatchTimer: 5s461ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.65M (51645841) - RowsReturnedRate: 6.96 M/sec - SendersBlockedTimer: 7s594ms - SendersBlockedTotalTimer(*): 1m31s Instance fc4ebd07a3c493a1:101db40b9b2a9e11 (host=vb0218.halxg.cloudera.com:22000):(Total: 36s707ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 12.17 MB, 228.35 MB, 356.36 MB, 484.35 MB, 548.40 MB, 676.35 MB, 868.33 MB, 1.08 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.35 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.53 GB, 1.59 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.75 GB, 1.89 GB, 1.33 GB, 631.45 MB, 388.64 MB, 194.40 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2070352720) - PerHostPeakMemUsage: 3.83 GB (4111289600) - PrepareTime: 194.526ms - RowsProduced: 13.29M (13287691) - TotalCpuTime: 33s632ms - TotalNetworkReceiveTime: 10s770ms - TotalNetworkSendTime: 61.160ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 679.400ms, non-child: 679.400ms, % non-child: 100.00%) - CodegenTime: 836.216us - CompileTime: 55.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 432.885ms - PrepareTime: 181.764ms DataStreamSender (dst_id=12):(Total: 3s129ms, non-child: 3s129ms, % non-child: 100.00%) - BytesSent: 133.38 MB (139857938) - NetworkThroughput(*): 67.84 MB/sec - OverallThroughput: 42.62 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 762.864ms - ThriftTransmitTime(*): 1s965ms - UncompressedRowBatchSize: 253.49 MB (265805728) AGGREGATION_NODE (id=4):(Total: 33s563ms, non-child: 9s233ms, % non-child: 27.51%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 597.607us - GetResultsTime: 457.699ms - HTResizeTime: 1s071ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13287691) - RowsReturnedRate: 395.90 K/sec - StreamingTime: 8s470ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s329ms, non-child: 11s780ms, % non-child: 48.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s171ms - BuildRows: 13.66M (13663062) - BuildRowsPartitioned: 13.66M (13663062) - BuildTime: 1s661ms - GetNewBlockTime: 1.303ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.62M (51618612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s313ms - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 2.12 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 899.000ns EXCHANGE_NODE (id=11):(Total: 3s926ms, non-child: 615.188ms, % non-child: 15.67%) BytesReceived(1s000ms): 2.35 MB, 56.64 MB, 127.85 MB, 199.42 MB, 267.38 MB, 295.80 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB, 298.06 MB - BytesReceived: 298.06 MB (312534484) - ConvertRowBatchTime: 282.851ms - DeserializeRowBatchTimer: 1s081ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.66M (13663062) - RowsReturnedRate: 3.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s622ms, non-child: 2s969ms, % non-child: 34.44%) BytesReceived(1s000ms): 2.30 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 17.96 MB, 62.47 MB, 98.81 MB, 138.72 MB, 177.79 MB, 235.09 MB, 279.24 MB, 332.22 MB, 371.37 MB, 404.75 MB, 437.70 MB, 475.56 MB, 511.32 MB, 547.99 MB, 583.32 MB, 628.95 MB, 675.41 MB, 720.09 MB, 768.09 MB, 814.49 MB, 861.51 MB, 911.17 MB, 957.37 MB, 996.85 MB, 1020.27 MB - BytesReceived: 1.03 GB (1103826704) - ConvertRowBatchTime: 1s317ms - DeserializeRowBatchTimer: 5s678ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.62M (51618612) - RowsReturnedRate: 5.99 M/sec - SendersBlockedTimer: 7s112ms - SendersBlockedTotalTimer(*): 1m39s Instance fc4ebd07a3c493a1:101db40b9b2a9e05 (host=vb0214.halxg.cloudera.com:22000):(Total: 36s517ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 2.42 MB, 165.69 MB, 294.74 MB, 420.47 MB, 549.13 MB, 676.35 MB, 836.33 MB, 1.04 GB, 1.15 GB, 1.29 GB, 1.30 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.51 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.53 GB, 1.59 GB, 1.66 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.72 GB, 1.89 GB, 1.33 GB, 631.46 MB, 412.93 MB, 170.11 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.93 GB (2069625968) - PerHostPeakMemUsage: 3.85 GB (4135587088) - PrepareTime: 200.821ms - RowsProduced: 13.29M (13290966) - TotalCpuTime: 34s828ms - TotalNetworkReceiveTime: 9s455ms - TotalNetworkSendTime: 69.866ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 705.744ms, non-child: 705.744ms, % non-child: 100.00%) - CodegenTime: 1.013ms - CompileTime: 56.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 453.228ms - PrepareTime: 184.638ms DataStreamSender (dst_id=12):(Total: 2s951ms, non-child: 2s951ms, % non-child: 100.00%) - BytesSent: 133.42 MB (139899189) - NetworkThroughput(*): 75.36 MB/sec - OverallThroughput: 45.21 MB/sec - PeakMemoryUsage: 148.00 KB (151552) - SerializeBatchTime: 720.882ms - ThriftTransmitTime(*): 1s770ms - UncompressedRowBatchSize: 253.55 MB (265871240) AGGREGATION_NODE (id=4):(Total: 33s548ms, non-child: 9s045ms, % non-child: 26.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.014ms - GetResultsTime: 481.880ms - HTResizeTime: 1s079ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 793.06 MB (831580160) - PinTime: 0.000ns - ReductionFactorEstimate: 3.88 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 13.29M (13290966) - RowsReturnedRate: 396.17 K/sec - StreamingTime: 8s245ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=3):(Total: 24s503ms, non-child: 13s116ms, % non-child: 53.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s834ms - BuildRows: 13.67M (13666017) - BuildRowsPartitioned: 13.67M (13666017) - BuildTime: 1s697ms - GetNewBlockTime: 1.672ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 51.63M (51633100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8s885ms - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 2.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.462us EXCHANGE_NODE (id=11):(Total: 3s209ms, non-child: 1s507ms, % non-child: 46.98%) BytesReceived(1s000ms): 15.76 MB, 84.67 MB, 155.56 MB, 227.38 MB, 284.62 MB, 297.68 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB, 298.12 MB - BytesReceived: 298.12 MB (312596658) - ConvertRowBatchTime: 401.086ms - DeserializeRowBatchTimer: 1s939ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 13.67M (13666017) - RowsReturnedRate: 4.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=10):(Total: 8s177ms, non-child: 2s880ms, % non-child: 35.23%) BytesReceived(1s000ms): 5.46 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 34.28 MB, 74.61 MB, 113.74 MB, 155.82 MB, 199.87 MB, 251.22 MB, 298.71 MB, 350.13 MB, 384.56 MB, 417.44 MB, 452.39 MB, 491.14 MB, 524.27 MB, 562.40 MB, 599.43 MB, 649.49 MB, 690.61 MB, 739.60 MB, 786.53 MB, 832.21 MB, 881.81 MB, 930.19 MB, 974.40 MB, 1005.50 MB, 1.01 GB - BytesReceived: 1.03 GB (1104159474) - ConvertRowBatchTime: 1s333ms - DeserializeRowBatchTimer: 5s342ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 51.63M (51633100) - RowsReturnedRate: 6.31 M/sec - SendersBlockedTimer: 7s754ms - SendersBlockedTotalTimer(*): 1m40s Fragment F01: Instance fc4ebd07a3c493a1:101db40b9b2a9e17 (host=vb0234.halxg.cloudera.com:22000):(Total: 5s393ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB MemoryUsage(500.000ms): 0, 68.00 KB, 210.30 MB, 210.35 MB, 210.29 MB, 162.80 MB, 162.74 MB, 162.64 MB, 162.54 MB, 114.73 MB, 114.71 MB, 67.65 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.70 MB (220930824) - PerHostPeakMemUsage: 1.93 GB (2072393984) - PrepareTime: 187.313ms - RowsProduced: 16.16M (16155227) - TotalCpuTime: 36s506ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.193ms - TotalStorageWaitTime: 178.395ms CodeGen:(Total: 562.847ms, non-child: 562.847ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 369.830ms - PrepareTime: 181.294ms DataStreamSender (dst_id=11):(Total: 5s065ms, non-child: 5s065ms, % non-child: 100.00%) - BytesSent: 351.30 MB (368367627) - NetworkThroughput(*): 49.79 MB/sec - OverallThroughput: 69.36 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 3s039ms - ThriftTransmitTime(*): 7s055ms - UncompressedRowBatchSize: 708.83 MB (743266690) HDFS_SCAN_NODE (id=2):(Total: 482.552ms, non-child: 482.552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB, 187.18 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 187.18 MB (196271281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.18 MB (196271281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.18 MB (196271281) - DecompressionTime: 576.800ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 210.26 MB (220472072) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.46M (35457944) - RowsReturned: 16.16M (16155227) - RowsReturnedRate: 33.48 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.44K (2443) - ScannerThreadsTotalWallClockTime: 30s912ms - MaterializeTupleTime(*): 30s026ms - ScannerThreadsSysTime: 120.979ms - ScannerThreadsUserTime: 4s830ms - ScannerThreadsVoluntaryContextSwitches: 15.79K (15787) - TotalRawHdfsReadTime(*): 169.621ms - TotalReadThroughput: 34.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e13 (host=vb0216.halxg.cloudera.com:22000):(Total: 5s087ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 193.74 MB, 193.77 MB, 194.00 MB, 193.82 MB, 146.11 MB, 137.02 MB, 137.05 MB, 97.05 MB, 97.22 MB, 49.00 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.21 MB (203645656) - PerHostPeakMemUsage: 1.86 GB (1994686192) - PrepareTime: 194.277ms - RowsProduced: 14.67M (14674816) - TotalCpuTime: 31s971ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.071ms - TotalStorageWaitTime: 149.936ms CodeGen:(Total: 605.328ms, non-child: 605.328ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 403.911ms - PrepareTime: 179.853ms DataStreamSender (dst_id=11):(Total: 4s765ms, non-child: 4s765ms, % non-child: 100.00%) - BytesSent: 319.30 MB (334814246) - NetworkThroughput(*): 50.22 MB/sec - OverallThroughput: 67.01 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s810ms - ThriftTransmitTime(*): 6s358ms - UncompressedRowBatchSize: 643.88 MB (675156216) HDFS_SCAN_NODE (id=2):(Total: 479.549ms, non-child: 479.549ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.08 MB 7:1/253.09 MB 3:2/367.32 MB 5:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB, 170.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.40 - BytesRead: 170.14 MB (178404563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.14 MB (178404563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.14 MB (178404563) - DecompressionTime: 498.333ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 193.76 MB (203170520) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.21M (32210795) - RowsReturned: 14.67M (14674816) - RowsReturnedRate: 30.60 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.96K (1964) - ScannerThreadsTotalWallClockTime: 26s632ms - MaterializeTupleTime(*): 25s909ms - ScannerThreadsSysTime: 50.990ms - ScannerThreadsUserTime: 4s252ms - ScannerThreadsVoluntaryContextSwitches: 14.19K (14188) - TotalRawHdfsReadTime(*): 147.972ms - TotalReadThroughput: 30.93 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1c (host=vb0230.halxg.cloudera.com:22000):(Total: 4s754ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB MemoryUsage(500.000ms): 68.00 KB, 176.63 MB, 176.72 MB, 176.57 MB, 168.80 MB, 136.78 MB, 137.14 MB, 136.99 MB, 96.89 MB, 97.08 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 1.83 GB (1960888784) - PrepareTime: 188.237ms - RowsProduced: 13.46M (13461399) - TotalCpuTime: 27s636ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31.174ms - TotalStorageWaitTime: 136.845ms CodeGen:(Total: 579.304ms, non-child: 579.304ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 386.040ms - PrepareTime: 175.932ms DataStreamSender (dst_id=11):(Total: 4s412ms, non-child: 4s412ms, % non-child: 100.00%) - BytesSent: 288.99 MB (303030382) - NetworkThroughput(*): 48.85 MB/sec - OverallThroughput: 65.49 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s599ms - ThriftTransmitTime(*): 5s915ms - UncompressedRowBatchSize: 590.64 MB (619329546) HDFS_SCAN_NODE (id=2):(Total: 507.301ms, non-child: 507.301ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 0:2/506.18 MB 2:2/506.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563953) - DecompressionTime: 793.907ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548639) - RowsReturned: 13.46M (13461399) - RowsReturnedRate: 26.54 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 2.47K (2471) - ScannerThreadsTotalWallClockTime: 22s627ms - MaterializeTupleTime(*): 21s624ms - ScannerThreadsSysTime: 73.986ms - ScannerThreadsUserTime: 6s637ms - ScannerThreadsVoluntaryContextSwitches: 13.03K (13034) - TotalRawHdfsReadTime(*): 131.913ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e15 (host=vb0232.halxg.cloudera.com:22000):(Total: 4s670ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB MemoryUsage(500.000ms): 68.00 KB, 211.96 MB, 212.06 MB, 211.94 MB, 212.00 MB, 150.31 MB, 137.04 MB, 137.13 MB, 97.06 MB, 57.91 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.23 MB (222537952) - PerHostPeakMemUsage: 1.86 GB (1994151304) - PrepareTime: 188.829ms - RowsProduced: 15.86M (15855813) - TotalCpuTime: 31s641ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30.682ms - TotalStorageWaitTime: 263.659ms CodeGen:(Total: 615.263ms, non-child: 615.263ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.262ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 420.789ms - PrepareTime: 187.054ms DataStreamSender (dst_id=11):(Total: 4s364ms, non-child: 4s364ms, % non-child: 100.00%) - BytesSent: 342.23 MB (358850790) - NetworkThroughput(*): 51.59 MB/sec - OverallThroughput: 78.42 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s697ms - ThriftTransmitTime(*): 6s634ms - UncompressedRowBatchSize: 695.70 MB (729491302) HDFS_SCAN_NODE (id=2):(Total: 469.934ms, non-child: 469.934ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 3:1/253.08 MB 1:1/253.07 MB 5:1/95.86 MB 2:2/382.96 MB 8:2/506.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 183.96 MB (192893696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192893696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192893696) - DecompressionTime: 502.895ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 211.78 MB (222062864) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 34.81M (34809234) - RowsReturned: 15.86M (15855813) - RowsReturnedRate: 33.74 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1391) - ScannerThreadsTotalWallClockTime: 26s807ms - MaterializeTupleTime(*): 25s897ms - ScannerThreadsSysTime: 19.993ms - ScannerThreadsUserTime: 4s686ms - ScannerThreadsVoluntaryContextSwitches: 15.38K (15379) - TotalRawHdfsReadTime(*): 176.289ms - TotalReadThroughput: 36.79 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1e (host=vb0224.halxg.cloudera.com:22000):(Total: 4s610ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB MemoryUsage(500.000ms): 0, 68.00 KB, 190.00 MB, 189.78 MB, 189.99 MB, 137.06 MB, 137.02 MB, 137.12 MB, 97.04 MB, 96.80 MB ThreadUsage(500.000ms): 1, 1, 7, 7, 7, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 190.16 MB (199402248) - PerHostPeakMemUsage: 1.76 GB (1892998328) - PrepareTime: 180.217ms - RowsProduced: 14.29M (14288169) - TotalCpuTime: 28s077ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.768ms - TotalStorageWaitTime: 145.105ms CodeGen:(Total: 585.138ms, non-child: 585.138ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 398.513ms - PrepareTime: 178.261ms DataStreamSender (dst_id=11):(Total: 4s309ms, non-child: 4s309ms, % non-child: 100.00%) - BytesSent: 307.15 MB (322070576) - NetworkThroughput(*): 49.89 MB/sec - OverallThroughput: 71.27 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s574ms - ThriftTransmitTime(*): 6s156ms - UncompressedRowBatchSize: 626.91 MB (657367426) HDFS_SCAN_NODE (id=2):(Total: 437.454ms, non-child: 437.454ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 5:2/331.24 MB 7:1/253.09 MB 1:2/506.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB, 165.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.38 - BytesRead: 165.71 MB (173755079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.71 MB (173755079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.71 MB (173755079) - DecompressionTime: 453.873ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 189.76 MB (198976264) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 31.37M (31366782) - RowsReturned: 14.29M (14288169) - RowsReturnedRate: 32.66 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1406) - ScannerThreadsTotalWallClockTime: 23s213ms - MaterializeTupleTime(*): 22s494ms - ScannerThreadsSysTime: 22.993ms - ScannerThreadsUserTime: 3s786ms - ScannerThreadsVoluntaryContextSwitches: 13.84K (13840) - TotalRawHdfsReadTime(*): 108.220ms - TotalReadThroughput: 36.82 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e16 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s530ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB MemoryUsage(500.000ms): 68.00 KB, 176.55 MB, 176.63 MB, 176.82 MB, 137.03 MB, 137.10 MB, 136.88 MB, 97.30 MB, 97.03 MB, 57.95 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.01 MB (185613640) - PerHostPeakMemUsage: 1.65 GB (1767952744) - PrepareTime: 179.604ms - RowsProduced: 13.46M (13460842) - TotalCpuTime: 26s250ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.680ms - TotalStorageWaitTime: 162.162ms CodeGen:(Total: 505.452ms, non-child: 505.452ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.993ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 323.303ms - PrepareTime: 178.001ms DataStreamSender (dst_id=11):(Total: 4s214ms, non-child: 4s214ms, % non-child: 100.00%) - BytesSent: 292.10 MB (306287118) - NetworkThroughput(*): 49.35 MB/sec - OverallThroughput: 69.31 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s509ms - ThriftTransmitTime(*): 5s918ms - UncompressedRowBatchSize: 590.61 MB (619303932) HDFS_SCAN_NODE (id=2):(Total: 473.560ms, non-child: 473.560ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163569874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163569874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163569874) - DecompressionTime: 473.887ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549877) - RowsReturned: 13.46M (13460842) - RowsReturnedRate: 28.42 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.88K (1878) - ScannerThreadsTotalWallClockTime: 21s559ms - MaterializeTupleTime(*): 20s870ms - ScannerThreadsSysTime: 55.990ms - ScannerThreadsUserTime: 3s944ms - ScannerThreadsVoluntaryContextSwitches: 13.05K (13050) - TotalRawHdfsReadTime(*): 112.912ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e19 (host=vb0228.halxg.cloudera.com:22000):(Total: 4s522ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 201.85 MB, 201.80 MB, 201.84 MB, 154.19 MB, 154.30 MB, 137.97 MB, 113.01 MB, 97.07 MB, 57.87 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 202.19 MB (212009736) - PerHostPeakMemUsage: 1.74 GB (1869392064) - PrepareTime: 192.289ms - RowsProduced: 15.00M (14998963) - TotalCpuTime: 28s773ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34.906ms - TotalStorageWaitTime: 134.403ms CodeGen:(Total: 553.895ms, non-child: 553.895ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.702ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 358.340ms - PrepareTime: 181.154ms DataStreamSender (dst_id=11):(Total: 4s233ms, non-child: 4s233ms, % non-child: 100.00%) - BytesSent: 326.67 MB (342536663) - NetworkThroughput(*): 47.43 MB/sec - OverallThroughput: 77.17 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s578ms - ThriftTransmitTime(*): 6s887ms - UncompressedRowBatchSize: 658.10 MB (690069510) HDFS_SCAN_NODE (id=2):(Total: 457.021ms, non-child: 457.021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 6:1/253.08 MB 9:1/144.90 MB 8:1/253.06 MB 4:2/506.16 MB 1:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB, 173.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.56 - BytesRead: 173.91 MB (182353384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.91 MB (182353384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.91 MB (182353384) - DecompressionTime: 474.055ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 201.70 MB (211493680) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.93M (32927132) - RowsReturned: 15.00M (14998963) - RowsReturnedRate: 32.82 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1348) - ScannerThreadsTotalWallClockTime: 24s031ms - MaterializeTupleTime(*): 23s363ms - ScannerThreadsSysTime: 10.994ms - ScannerThreadsUserTime: 3s955ms - ScannerThreadsVoluntaryContextSwitches: 14.56K (14556) - TotalRawHdfsReadTime(*): 143.051ms - TotalReadThroughput: 34.78 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e18 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s389ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB MemoryUsage(500.000ms): 0, 68.00 KB, 176.59 MB, 176.80 MB, 160.82 MB, 137.13 MB, 137.00 MB, 120.88 MB, 97.08 MB, 73.35 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185638176) - PerHostPeakMemUsage: 1.65 GB (1768372168) - PrepareTime: 185.481ms - RowsProduced: 13.46M (13458466) - TotalCpuTime: 25s146ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.163ms - TotalStorageWaitTime: 258.163ms CodeGen:(Total: 561.915ms, non-child: 561.915ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 371.613ms - PrepareTime: 182.282ms DataStreamSender (dst_id=11):(Total: 4s097ms, non-child: 4s097ms, % non-child: 100.00%) - BytesSent: 294.79 MB (309111585) - NetworkThroughput(*): 44.69 MB/sec - OverallThroughput: 71.94 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s463ms - ThriftTransmitTime(*): 6s596ms - UncompressedRowBatchSize: 590.51 MB (619194600) HDFS_SCAN_NODE (id=2):(Total: 455.202ms, non-child: 455.202ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 4:3/759.24 MB 6:1/253.08 MB 0:1/253.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.98 MB (163561019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163561019) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163561019) - DecompressionTime: 450.973ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548814) - RowsReturned: 13.46M (13458466) - RowsReturnedRate: 29.57 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1558) - ScannerThreadsTotalWallClockTime: 20s647ms - MaterializeTupleTime(*): 19s814ms - ScannerThreadsSysTime: 24.994ms - ScannerThreadsUserTime: 4s166ms - ScannerThreadsVoluntaryContextSwitches: 12.98K (12976) - TotalRawHdfsReadTime(*): 116.353ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e20 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s310ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB MemoryUsage(500.000ms): 0, 163.86 MB, 164.28 MB, 164.23 MB, 124.60 MB, 124.28 MB, 111.48 MB, 79.19 MB, 79.35 MB, 9.85 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 5, 5, 5, 1 - AverageThreadTokens: 4.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 164.58 MB (172571936) - PerHostPeakMemUsage: 1.61 GB (1730388344) - PrepareTime: 192.476ms - RowsProduced: 12.14M (12141451) - TotalCpuTime: 22s994ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41.972ms - TotalStorageWaitTime: 105.813ms CodeGen:(Total: 522.089ms, non-child: 522.089ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.095ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 325.985ms - PrepareTime: 179.686ms DataStreamSender (dst_id=11):(Total: 4s017ms, non-child: 4s017ms, % non-child: 100.00%) - BytesSent: 269.29 MB (282375443) - NetworkThroughput(*): 45.07 MB/sec - OverallThroughput: 67.02 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s402ms - ThriftTransmitTime(*): 5s975ms - UncompressedRowBatchSize: 532.72 MB (558601626) HDFS_SCAN_NODE (id=2):(Total: 462.756ms, non-child: 462.756ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 6:1/253.10 MB 8:1/253.07 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB, 140.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.11 - BytesRead: 140.76 MB (147601227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.76 MB (147601227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.76 MB (147601227) - DecompressionTime: 447.699ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 164.05 MB (172023160) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.65M (26648098) - RowsReturned: 12.14M (12141451) - RowsReturnedRate: 26.24 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1452) - ScannerThreadsTotalWallClockTime: 18s478ms - MaterializeTupleTime(*): 17s840ms - ScannerThreadsSysTime: 54.989ms - ScannerThreadsUserTime: 3s837ms - ScannerThreadsVoluntaryContextSwitches: 11.74K (11739) - TotalRawHdfsReadTime(*): 126.867ms - TotalReadThroughput: 31.27 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1b (host=vb0204.halxg.cloudera.com:22000):(Total: 4s302ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB MemoryUsage(500.000ms): 0, 176.20 MB, 176.70 MB, 176.76 MB, 137.03 MB, 137.04 MB, 137.15 MB, 96.87 MB, 97.03 MB, 31.23 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.04 MB (185641200) - PerHostPeakMemUsage: 1.60 GB (1719859048) - PrepareTime: 191.809ms - RowsProduced: 13.46M (13464642) - TotalCpuTime: 24s750ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.413ms - TotalStorageWaitTime: 101.763ms CodeGen:(Total: 521.203ms, non-child: 521.203ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.730ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 326.209ms - PrepareTime: 185.127ms DataStreamSender (dst_id=11):(Total: 3s998ms, non-child: 3s998ms, % non-child: 100.00%) - BytesSent: 302.41 MB (317100352) - NetworkThroughput(*): 45.74 MB/sec - OverallThroughput: 75.63 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s447ms - ThriftTransmitTime(*): 6s611ms - UncompressedRowBatchSize: 590.78 MB (619478748) HDFS_SCAN_NODE (id=2):(Total: 475.424ms, non-child: 475.424ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.08 MB 5:1/253.11 MB 1:1/253.09 MB 9:1/253.08 MB 0:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 155.99 MB (163568692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163568692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163568692) - DecompressionTime: 444.858ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.59 MB (185171272) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549427) - RowsReturned: 13.46M (13464642) - RowsReturnedRate: 28.32 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.46K (1456) - ScannerThreadsTotalWallClockTime: 20s229ms - MaterializeTupleTime(*): 19s635ms - ScannerThreadsSysTime: 38.992ms - ScannerThreadsUserTime: 3s902ms - ScannerThreadsVoluntaryContextSwitches: 13.11K (13105) - TotalRawHdfsReadTime(*): 125.023ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1a (host=vb0206.halxg.cloudera.com:22000):(Total: 4s298ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB MemoryUsage(500.000ms): 68.00 KB, 151.35 MB, 176.73 MB, 176.60 MB, 137.19 MB, 136.88 MB, 136.96 MB, 97.00 MB, 96.92 MB, 6.39 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.01 MB (185613592) - PerHostPeakMemUsage: 1.64 GB (1765824328) - PrepareTime: 189.416ms - RowsProduced: 13.45M (13452881) - TotalCpuTime: 24s843ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.591ms - TotalStorageWaitTime: 191.279ms CodeGen:(Total: 603.922ms, non-child: 603.922ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 407.134ms - PrepareTime: 185.447ms DataStreamSender (dst_id=11):(Total: 3s984ms, non-child: 3s984ms, % non-child: 100.00%) - BytesSent: 289.63 MB (303700399) - NetworkThroughput(*): 51.28 MB/sec - OverallThroughput: 72.69 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s425ms - ThriftTransmitTime(*): 5s648ms - UncompressedRowBatchSize: 590.26 MB (618937658) HDFS_SCAN_NODE (id=2):(Total: 484.024ms, non-child: 484.024ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 5:1/253.08 MB 8:2/506.16 MB 2:1/253.09 MB 1:1/253.07 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 125.78 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB, 155.98 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 155.98 MB (163558904) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.98 MB (163558904) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.98 MB (163558904) - DecompressionTime: 420.663ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.55 MB (185130312) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29548279) - RowsReturned: 13.45M (13452881) - RowsReturnedRate: 27.79 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1322) - ScannerThreadsTotalWallClockTime: 20s319ms - MaterializeTupleTime(*): 19s517ms - ScannerThreadsSysTime: 18.995ms - ScannerThreadsUserTime: 3s769ms - ScannerThreadsVoluntaryContextSwitches: 12.96K (12963) - TotalRawHdfsReadTime(*): 129.334ms - TotalReadThroughput: 31.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1d (host=vb0208.halxg.cloudera.com:22000):(Total: 4s186ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB MemoryUsage(500.000ms): 68.00 KB, 176.92 MB, 176.69 MB, 176.78 MB, 136.97 MB, 137.02 MB, 136.91 MB, 97.11 MB, 89.21 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 177.05 MB (185646360) - PerHostPeakMemUsage: 1.65 GB (1774494888) - PrepareTime: 191.257ms - RowsProduced: 13.46M (13460007) - TotalCpuTime: 24s163ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 35.575ms - TotalStorageWaitTime: 140.401ms CodeGen:(Total: 580.683ms, non-child: 580.683ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.290ms - PrepareTime: 181.183ms DataStreamSender (dst_id=11):(Total: 3s904ms, non-child: 3s904ms, % non-child: 100.00%) - BytesSent: 298.11 MB (312592831) - NetworkThroughput(*): 43.95 MB/sec - OverallThroughput: 76.34 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s397ms - ThriftTransmitTime(*): 6s783ms - UncompressedRowBatchSize: 590.58 MB (619265506) HDFS_SCAN_NODE (id=2):(Total: 454.324ms, non-child: 454.324ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 2:1/253.07 MB 10:1/253.09 MB 3:1/253.08 MB 8:2/506.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB, 155.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 155.99 MB (163563830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.99 MB (163563830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.99 MB (163563830) - DecompressionTime: 439.914ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 176.62 MB (185195808) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 29.55M (29549088) - RowsReturned: 13.46M (13460007) - RowsReturnedRate: 29.63 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1195) - ScannerThreadsTotalWallClockTime: 19s741ms - MaterializeTupleTime(*): 19s099ms - ScannerThreadsSysTime: 23.994ms - ScannerThreadsUserTime: 3s625ms - ScannerThreadsVoluntaryContextSwitches: 13.02K (13016) - TotalRawHdfsReadTime(*): 131.731ms - TotalReadThroughput: 34.66 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e1f (host=vb0222.halxg.cloudera.com:22000):(Total: 3s920ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB MemoryUsage(500.000ms): 68.00 KB, 177.37 MB, 177.70 MB, 177.87 MB, 153.93 MB, 124.59 MB, 111.38 MB, 79.35 MB, 39.05 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 5, 5, 4 - AverageThreadTokens: 5.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 178.20 MB (186860256) - PerHostPeakMemUsage: 1.58 GB (1693928160) - PrepareTime: 192.720ms - RowsProduced: 13.08M (13077343) - TotalCpuTime: 22s642ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.090ms - TotalStorageWaitTime: 239.343ms CodeGen:(Total: 604.712ms, non-child: 604.712ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.430ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 407.008ms - PrepareTime: 181.134ms DataStreamSender (dst_id=11):(Total: 3s631ms, non-child: 3s631ms, % non-child: 100.00%) - BytesSent: 283.02 MB (296772905) - NetworkThroughput(*): 50.29 MB/sec - OverallThroughput: 77.93 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s247ms - ThriftTransmitTime(*): 5s628ms - UncompressedRowBatchSize: 573.79 MB (601659974) HDFS_SCAN_NODE (id=2):(Total: 456.271ms, non-child: 456.271ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 5:3/759.26 MB 9:2/217.44 MB 10:1/253.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB, 151.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 151.75 MB (159126087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 151.75 MB (159126087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151.75 MB (159126087) - DecompressionTime: 406.159ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 177.82 MB (186458848) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 28.71M (28707685) - RowsReturned: 13.08M (13077343) - RowsReturnedRate: 28.66 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.18K (1180) - ScannerThreadsTotalWallClockTime: 18s559ms - MaterializeTupleTime(*): 17s766ms - ScannerThreadsSysTime: 19.993ms - ScannerThreadsUserTime: 3s327ms - ScannerThreadsVoluntaryContextSwitches: 12.63K (12626) - TotalRawHdfsReadTime(*): 116.431ms - TotalReadThroughput: 33.72 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e14 (host=vb0226.halxg.cloudera.com:22000):(Total: 3s908ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB MemoryUsage(500.000ms): 68.00 KB, 168.23 MB, 168.17 MB, 168.16 MB, 128.54 MB, 112.34 MB, 79.39 MB, 79.38 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 168.54 MB (176725280) - PerHostPeakMemUsage: 1.62 GB (1739683704) - PrepareTime: 194.062ms - RowsProduced: 12.27M (12269850) - TotalCpuTime: 21s050ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31.233ms - TotalStorageWaitTime: 103.923ms CodeGen:(Total: 570.062ms, non-child: 570.062ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.457ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 371.017ms - PrepareTime: 182.316ms DataStreamSender (dst_id=11):(Total: 3s628ms, non-child: 3s628ms, % non-child: 100.00%) - BytesSent: 271.80 MB (285004013) - NetworkThroughput(*): 43.93 MB/sec - OverallThroughput: 74.91 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s215ms - ThriftTransmitTime(*): 6s187ms - UncompressedRowBatchSize: 538.36 MB (564508988) HDFS_SCAN_NODE (id=2):(Total: 449.413ms, non-child: 449.413ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 5 Hdfs split stats (:<# splits>/): 8:1/253.13 MB 3:2/506.18 MB 7:2/394.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:10 BytesRead(500.000ms): 0, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 142.29 MB (149206519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149206519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149206519) - DecompressionTime: 386.611ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 168.12 MB (176282912) - PerReadThreadRawHdfsThroughput: 1.53 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 26.94M (26939474) - RowsReturned: 12.27M (12269850) - RowsReturnedRate: 27.30 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 997 (997) - ScannerThreadsTotalWallClockTime: 16s880ms - MaterializeTupleTime(*): 16s346ms - ScannerThreadsSysTime: 26.994ms - ScannerThreadsUserTime: 3s183ms - ScannerThreadsVoluntaryContextSwitches: 11.87K (11869) - TotalRawHdfsReadTime(*): 90.612ms - TotalReadThroughput: 35.57 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e12 (host=vb0212.halxg.cloudera.com:22000):(Total: 3s782ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB MemoryUsage(500.000ms): 68.00 KB, 143.16 MB, 143.10 MB, 127.26 MB, 111.45 MB, 111.32 MB, 79.29 MB, 79.48 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 143.36 MB (150321040) - PerHostPeakMemUsage: 1.59 GB (1707840600) - PrepareTime: 190.606ms - RowsProduced: 10.77M (10767126) - TotalCpuTime: 18s052ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.175ms - TotalStorageWaitTime: 199.316ms CodeGen:(Total: 584.927ms, non-child: 584.927ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.724ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 386.051ms - PrepareTime: 180.545ms DataStreamSender (dst_id=11):(Total: 3s498ms, non-child: 3s498ms, % non-child: 100.00%) - BytesSent: 234.76 MB (246161836) - NetworkThroughput(*): 46.50 MB/sec - OverallThroughput: 67.10 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 2s072ms - ThriftTransmitTime(*): 5s048ms - UncompressedRowBatchSize: 472.42 MB (495371936) HDFS_SCAN_NODE (id=2):(Total: 452.487ms, non-child: 452.487ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 4 Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:1/253.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB, 124.79 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 124.79 MB (130848195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.79 MB (130848195) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.79 MB (130848195) - DecompressionTime: 371.237ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 142.91 MB (149854096) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 23.64M (23638732) - RowsReturned: 10.77M (10767126) - RowsReturnedRate: 23.80 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1155) - ScannerThreadsTotalWallClockTime: 14s086ms - MaterializeTupleTime(*): 13s421ms - ScannerThreadsSysTime: 38.992ms - ScannerThreadsUserTime: 3s124ms - ScannerThreadsVoluntaryContextSwitches: 10.32K (10316) - TotalRawHdfsReadTime(*): 82.789ms - TotalReadThroughput: 31.20 MB/sec Fragment F00: Instance fc4ebd07a3c493a1:101db40b9b2a9e2a (host=vb0206.halxg.cloudera.com:22000):(Total: 33s079ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB MemoryUsage(1s000ms): 95.75 MB, 192.01 MB, 192.01 MB, 192.01 MB, 192.01 MB, 192.01 MB, 192.01 MB, 192.01 MB, 192.79 MB, 193.63 MB, 193.70 MB, 193.68 MB, 193.63 MB, 193.59 MB, 193.60 MB, 193.74 MB, 165.73 MB, 82.81 MB, 67.14 MB, 67.28 MB, 192.66 MB, 193.69 MB, 193.56 MB, 193.68 MB, 193.66 MB, 193.75 MB, 193.73 MB, 193.66 MB, 161.78 MB, 67.11 MB, 64.04 MB, 55.08 MB, 55.09 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517720) - PerHostPeakMemUsage: 3.94 GB (4225946752) - PrepareTime: 185.865ms - RowsProduced: 53.60M (53597336) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s701ms - TotalStorageWaitTime: 364.849ms CodeGen:(Total: 589.440ms, non-child: 589.440ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 398.899ms - PrepareTime: 181.719ms DataStreamSender (dst_id=10):(Total: 32s517ms, non-child: 32s517ms, % non-child: 100.00%) - BytesSent: 1.09 GB (1172618820) - NetworkThroughput(*): 9.18 MB/sec - OverallThroughput: 34.39 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s849ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.30 GB (2465896216) HDFS_SCAN_NODE (id=1):(Total: 681.383ms, non-child: 681.383ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.40 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 8:2/506.80 MB 3:1/253.40 MB 1:1/253.39 MB 2:2/506.79 MB 9:4/1013.55 MB 10:1/253.41 MB 6:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 369.58 MB, 369.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 369.58 MB (387529997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.58 MB (387529997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.58 MB (387529997) - DecompressionTime: 1s366ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580598) - RowsReturned: 53.60M (53597336) - RowsReturnedRate: 78.66 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.10K (7104) - ScannerThreadsTotalWallClockTime: 4m6s - MaterializeTupleTime(*): 4m4s - ScannerThreadsSysTime: 252.957ms - ScannerThreadsUserTime: 17s134ms - ScannerThreadsVoluntaryContextSwitches: 52.08K (52081) - TotalRawHdfsReadTime(*): 310.196ms - TotalReadThroughput: 11.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e27 (host=vb0226.halxg.cloudera.com:22000):(Total: 32s972ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB MemoryUsage(1s000ms): 96.62 MB, 193.12 MB, 193.12 MB, 193.12 MB, 193.12 MB, 193.12 MB, 193.12 MB, 193.12 MB, 193.32 MB, 193.68 MB, 193.72 MB, 193.64 MB, 193.69 MB, 193.75 MB, 193.81 MB, 193.55 MB, 157.76 MB, 67.13 MB, 67.16 MB, 102.93 MB, 193.72 MB, 193.64 MB, 193.63 MB, 193.67 MB, 193.65 MB, 193.69 MB, 193.74 MB, 193.67 MB, 161.65 MB, 67.03 MB, 80.75 MB, 55.07 MB, 55.01 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 199.71 MB (209416176) - PerHostPeakMemUsage: 3.94 GB (4227207632) - PrepareTime: 190.813ms - RowsProduced: 53.58M (53583047) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s073ms - TotalStorageWaitTime: 373.468ms CodeGen:(Total: 527.852ms, non-child: 527.852ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 332.207ms - PrepareTime: 178.713ms DataStreamSender (dst_id=10):(Total: 32s354ms, non-child: 32s354ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1140149553) - NetworkThroughput(*): 9.51 MB/sec - OverallThroughput: 33.61 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s844ms - ThriftTransmitTime(*): 1m54s - UncompressedRowBatchSize: 2.30 GB (2465238810) HDFS_SCAN_NODE (id=1):(Total: 737.230ms, non-child: 737.230ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:3/760.17 MB 7:1/253.41 MB 3:2/506.77 MB 0:3/760.17 MB 2:1/253.38 MB 1:2/506.82 MB 10:1/253.40 MB 9:1/253.41 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:0% 2:0% 3:0% 4:1.515% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 202.23 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 349.05 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 7.55 - BytesRead: 369.59 MB (387539153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387539153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387539153) - DecompressionTime: 1s516ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 199.32 MB (208998392) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581298) - RowsReturned: 53.58M (53583047) - RowsReturnedRate: 72.68 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.86K (8863) - ScannerThreadsTotalWallClockTime: 4m7s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 248.959ms - ScannerThreadsUserTime: 21s186ms - ScannerThreadsVoluntaryContextSwitches: 52.13K (52127) - TotalRawHdfsReadTime(*): 227.687ms - TotalReadThroughput: 11.03 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e24 (host=vb0212.halxg.cloudera.com:22000):(Total: 32s930ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB MemoryUsage(1s000ms): 96.23 MB, 192.68 MB, 192.68 MB, 192.68 MB, 192.68 MB, 192.68 MB, 192.68 MB, 192.68 MB, 193.24 MB, 193.80 MB, 193.64 MB, 193.72 MB, 193.67 MB, 193.73 MB, 193.76 MB, 193.61 MB, 181.62 MB, 94.51 MB, 67.15 MB, 67.16 MB, 154.55 MB, 193.58 MB, 193.66 MB, 193.76 MB, 193.64 MB, 193.75 MB, 193.71 MB, 193.68 MB, 193.73 MB, 157.79 MB, 67.10 MB, 67.11 MB, 49.52 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5 - AverageThreadTokens: 8.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.44 MB (204935504) - PerHostPeakMemUsage: 3.94 GB (4230670872) - PrepareTime: 188.327ms - RowsProduced: 50.60M (50602920) - TotalCpuTime: 4m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s643ms - TotalStorageWaitTime: 506.245ms CodeGen:(Total: 582.493ms, non-child: 582.493ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 389.586ms - PrepareTime: 177.040ms DataStreamSender (dst_id=10):(Total: 32s351ms, non-child: 32s351ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1130210039) - NetworkThroughput(*): 8.48 MB/sec - OverallThroughput: 33.32 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s457ms - ThriftTransmitTime(*): 2m7s - UncompressedRowBatchSize: 2.17 GB (2328129676) HDFS_SCAN_NODE (id=1):(Total: 698.885ms, non-child: 698.885ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 6:1/253.40 MB 8:3/760.18 MB 1:2/506.79 MB 0:1/253.40 MB 10:1/253.41 MB 4:3/760.21 MB 5:2/506.77 MB 3:2/506.80 MB 2:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 277.18 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 328.51 MB, 338.78 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.79 - BytesRead: 349.05 MB (366001402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.05 MB (366001402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.05 MB (366001402) - DecompressionTime: 1s290ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 195.03 MB (204501328) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659813) - RowsReturned: 50.60M (50602920) - RowsReturnedRate: 72.41 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.57K (7567) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 4m13s - ScannerThreadsSysTime: 206.963ms - ScannerThreadsUserTime: 16s275ms - ScannerThreadsVoluntaryContextSwitches: 48.19K (48187) - TotalRawHdfsReadTime(*): 223.913ms - TotalReadThroughput: 10.42 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e2e (host=vb0222.halxg.cloudera.com:22000):(Total: 32s890ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB MemoryUsage(1s000ms): 85.34 MB, 171.69 MB, 171.69 MB, 171.69 MB, 171.69 MB, 171.69 MB, 171.69 MB, 171.69 MB, 182.71 MB, 193.68 MB, 193.72 MB, 193.59 MB, 193.68 MB, 193.75 MB, 193.79 MB, 193.70 MB, 114.20 MB, 67.09 MB, 67.25 MB, 113.59 MB, 188.08 MB, 188.16 MB, 188.19 MB, 188.16 MB, 188.19 MB, 188.09 MB, 188.28 MB, 188.21 MB, 154.99 MB, 83.05 MB, 82.91 MB, 55.17 MB, 47.15 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3 - AverageThreadTokens: 8.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.93 MB (204396800) - PerHostPeakMemUsage: 3.92 GB (4209844216) - PrepareTime: 190.508ms - RowsProduced: 53.05M (53045475) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s934ms - TotalStorageWaitTime: 329.417ms CodeGen:(Total: 562.780ms, non-child: 562.780ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 368.631ms - PrepareTime: 179.444ms DataStreamSender (dst_id=10):(Total: 32s184ms, non-child: 32s184ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1152731006) - NetworkThroughput(*): 10.35 MB/sec - OverallThroughput: 34.16 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s885ms - ThriftTransmitTime(*): 1m46s - UncompressedRowBatchSize: 2.27 GB (2440506290) HDFS_SCAN_NODE (id=1):(Total: 829.007ms, non-child: 829.007ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 2:1/253.37 MB 0:2/260.87 MB 9:3/760.19 MB 7:1/253.40 MB 4:2/506.80 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:3/760.21 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 72.27 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 144.54 MB, 154.81 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 165.07 MB, 222.30 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 325.02 MB, 335.28 MB, 345.55 MB, 345.55 MB, 366.08 MB, 366.08 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.53 - BytesRead: 366.08 MB (383864364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 366.08 MB (383864364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 366.08 MB (383864364) - DecompressionTime: 1s509ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.51 MB (203962624) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.30M (123303865) - RowsReturned: 53.05M (53045475) - RowsReturnedRate: 63.99 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.87K (7870) - ScannerThreadsTotalWallClockTime: 4m7s - MaterializeTupleTime(*): 4m5s - ScannerThreadsSysTime: 269.956ms - ScannerThreadsUserTime: 17s278ms - ScannerThreadsVoluntaryContextSwitches: 51.51K (51506) - TotalRawHdfsReadTime(*): 253.386ms - TotalReadThroughput: 10.93 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e25 (host=vb0234.halxg.cloudera.com:22000):(Total: 32s840ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB MemoryUsage(1s000ms): 34.00 KB, 192.65 MB, 192.65 MB, 192.65 MB, 192.65 MB, 192.65 MB, 192.65 MB, 192.65 MB, 193.12 MB, 193.76 MB, 193.70 MB, 193.73 MB, 193.73 MB, 193.71 MB, 193.71 MB, 193.62 MB, 149.93 MB, 67.18 MB, 67.13 MB, 88.49 MB, 193.62 MB, 193.72 MB, 193.66 MB, 193.67 MB, 193.64 MB, 193.72 MB, 193.66 MB, 193.75 MB, 150.05 MB, 67.04 MB, 80.12 MB, 55.04 MB, 55.10 MB ThreadUsage(1s000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 3, 3 - AverageThreadTokens: 8.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.32 MB (204807616) - PerHostPeakMemUsage: 3.92 GB (4211666952) - PrepareTime: 185.853ms - RowsProduced: 53.59M (53594439) - TotalCpuTime: 4m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s813ms - TotalStorageWaitTime: 444.537ms CodeGen:(Total: 601.194ms, non-child: 601.194ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.730ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 408.552ms - PrepareTime: 178.902ms DataStreamSender (dst_id=10):(Total: 32s117ms, non-child: 32s117ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1133837017) - NetworkThroughput(*): 8.00 MB/sec - OverallThroughput: 33.67 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s858ms - ThriftTransmitTime(*): 2m15s - UncompressedRowBatchSize: 2.30 GB (2465762938) HDFS_SCAN_NODE (id=1):(Total: 828.501ms, non-child: 828.501ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 10:3/760.16 MB 9:2/506.79 MB 7:1/253.40 MB 4:2/506.77 MB 8:2/506.77 MB 3:3/760.17 MB 1:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 164.27 MB, 277.19 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 328.52 MB, 369.59 MB, 369.59 MB, 369.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.52 - BytesRead: 369.59 MB (387540592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.59 MB (387540592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.59 MB (387540592) - DecompressionTime: 1s650ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.87 MB (204340712) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581345) - RowsReturned: 53.59M (53594439) - RowsReturnedRate: 64.69 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.56K (9564) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 4m3s - ScannerThreadsSysTime: 361.939ms - ScannerThreadsUserTime: 19s981ms - ScannerThreadsVoluntaryContextSwitches: 52.09K (52089) - TotalRawHdfsReadTime(*): 272.073ms - TotalReadThroughput: 11.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e28 (host=vb0232.halxg.cloudera.com:22000):(Total: 32s600ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB MemoryUsage(1s000ms): 96.33 MB, 192.58 MB, 192.58 MB, 192.58 MB, 192.58 MB, 192.58 MB, 192.58 MB, 192.58 MB, 193.14 MB, 193.62 MB, 193.78 MB, 193.68 MB, 193.70 MB, 193.66 MB, 193.77 MB, 193.62 MB, 161.67 MB, 67.15 MB, 67.10 MB, 114.98 MB, 193.44 MB, 193.71 MB, 193.78 MB, 193.68 MB, 193.68 MB, 193.70 MB, 193.62 MB, 193.70 MB, 86.62 MB, 66.97 MB, 67.68 MB, 55.02 MB, 39.27 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4, 3, 3 - AverageThreadTokens: 8.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.27 MB (203706776) - PerHostPeakMemUsage: 3.89 GB (4179049416) - PrepareTime: 187.787ms - RowsProduced: 53.57M (53572429) - TotalCpuTime: 4m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s690ms - TotalStorageWaitTime: 371.035ms CodeGen:(Total: 602.218ms, non-child: 602.218ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.268ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 411.896ms - PrepareTime: 179.948ms DataStreamSender (dst_id=10):(Total: 31s957ms, non-child: 31s957ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1109323438) - NetworkThroughput(*): 8.74 MB/sec - OverallThroughput: 33.10 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s685ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.30 GB (2464750290) HDFS_SCAN_NODE (id=1):(Total: 747.250ms, non-child: 747.250ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.40 MB 4:2/506.79 MB 9:2/506.77 MB 3:2/506.80 MB 6:3/760.20 MB 2:1/253.38 MB 1:2/506.78 MB 0:1/253.40 MB 5:2/506.81 MB 10:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 225.87 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.49 - BytesRead: 369.60 MB (387549564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387549564) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387549564) - DecompressionTime: 1s491ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.83 MB (203240968) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581168) - RowsReturned: 53.57M (53572429) - RowsReturnedRate: 71.69 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.60K (7599) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 4m1s - ScannerThreadsSysTime: 215.962ms - ScannerThreadsUserTime: 18s066ms - ScannerThreadsVoluntaryContextSwitches: 52.21K (52207) - TotalRawHdfsReadTime(*): 274.505ms - TotalReadThroughput: 11.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e2d (host=vb0224.halxg.cloudera.com:22000):(Total: 32s590ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(1s000ms): 24.69 MB, 193.03 MB, 193.03 MB, 193.03 MB, 193.03 MB, 193.03 MB, 193.03 MB, 193.03 MB, 193.30 MB, 193.87 MB, 193.70 MB, 193.64 MB, 193.84 MB, 193.59 MB, 193.63 MB, 193.68 MB, 157.75 MB, 67.18 MB, 67.21 MB, 75.45 MB, 193.56 MB, 193.68 MB, 193.81 MB, 193.69 MB, 193.73 MB, 193.61 MB, 193.77 MB, 193.69 MB, 118.22 MB, 67.14 MB, 67.46 MB, 52.19 MB, 52.14 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 3, 3 - AverageThreadTokens: 8.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 195.34 MB (204831808) - PerHostPeakMemUsage: 3.90 GB (4188431440) - PrepareTime: 177.581ms - RowsProduced: 53.28M (53278771) - TotalCpuTime: 4m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s726ms - TotalStorageWaitTime: 338.740ms CodeGen:(Total: 560.166ms, non-child: 560.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.543ms - PrepareTime: 175.596ms DataStreamSender (dst_id=10):(Total: 31s995ms, non-child: 31s995ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1117429366) - NetworkThroughput(*): 8.77 MB/sec - OverallThroughput: 33.31 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s666ms - ThriftTransmitTime(*): 2m1s - UncompressedRowBatchSize: 2.28 GB (2451239734) HDFS_SCAN_NODE (id=1):(Total: 683.599ms, non-child: 683.599ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.46% 1:0% 2:0% 3:0% 4:0% 5:0% 6:1.538% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.52 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 256.67 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 367.54 MB, 367.54 MB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 7.57 - BytesRead: 367.54 MB (385397969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 367.54 MB (385397969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 367.54 MB (385397969) - DecompressionTime: 1s375ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.94 MB (204405824) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 53.28M (53278771) - RowsReturnedRate: 77.94 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.32K (8316) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 272.956ms - ScannerThreadsUserTime: 19s133ms - ScannerThreadsVoluntaryContextSwitches: 51.77K (51770) - TotalRawHdfsReadTime(*): 258.552ms - TotalReadThroughput: 11.31 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e21 (host=vb0208.halxg.cloudera.com:22000):(Total: 32s464ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB MemoryUsage(1s000ms): 91.48 MB, 184.20 MB, 184.20 MB, 184.20 MB, 184.20 MB, 184.20 MB, 184.20 MB, 184.20 MB, 184.46 MB, 184.76 MB, 184.59 MB, 184.68 MB, 184.72 MB, 184.60 MB, 184.72 MB, 159.59 MB, 91.73 MB, 89.17 MB, 98.79 MB, 182.29 MB, 193.76 MB, 193.68 MB, 193.61 MB, 193.72 MB, 193.74 MB, 181.80 MB, 173.83 MB, 161.98 MB, 106.41 MB, 90.79 MB, 76.90 MB, 55.10 MB, 35.73 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 6, 3, 2 - AverageThreadTokens: 8.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.67 MB (204121800) - PerHostPeakMemUsage: 3.89 GB (4178529952) - PrepareTime: 193.460ms - RowsProduced: 52.58M (52584004) - TotalCpuTime: 4m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s620ms - TotalStorageWaitTime: 297.411ms CodeGen:(Total: 544.572ms, non-child: 544.572ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 348.148ms - PrepareTime: 181.760ms DataStreamSender (dst_id=10):(Total: 31s871ms, non-child: 31s871ms, % non-child: 100.00%) - BytesSent: 1.02 GB (1099244982) - NetworkThroughput(*): 7.04 MB/sec - OverallThroughput: 32.89 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s749ms - ThriftTransmitTime(*): 2m28s - UncompressedRowBatchSize: 2.25 GB (2419275020) HDFS_SCAN_NODE (id=1):(Total: 722.202ms, non-child: 722.202ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 1:1/253.39 MB 3:1/253.40 MB 6:4/1013.57 MB 7:3/486.59 MB 4:3/760.15 MB 9:2/506.79 MB 10:1/187.22 MB 0:3/760.18 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:38 BytesRead(1s000ms): 78.37 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 156.75 MB, 167.01 MB, 177.28 MB, 187.55 MB, 197.81 MB, 311.52 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 321.79 MB, 342.32 MB, 352.59 MB, 362.86 MB, 362.86 MB, 362.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.52 - BytesRead: 362.86 MB (380487750) - BytesReadDataNodeCache: 0 - BytesReadLocal: 362.86 MB (380487750) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 362.86 MB (380487750) - DecompressionTime: 1s505ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.21 MB (203646664) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.21M (122205805) - RowsReturned: 52.58M (52584004) - RowsReturnedRate: 72.81 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.89K (8891) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 4m2s - ScannerThreadsSysTime: 219.960ms - ScannerThreadsUserTime: 19s289ms - ScannerThreadsVoluntaryContextSwitches: 50.70K (50703) - TotalRawHdfsReadTime(*): 246.458ms - TotalReadThroughput: 11.00 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e26 (host=vb0204.halxg.cloudera.com:22000):(Total: 32s454ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB MemoryUsage(1s000ms): 81.37 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.54 MB, 170.64 MB, 170.64 MB, 170.62 MB, 170.63 MB, 170.69 MB, 170.55 MB, 138.71 MB, 59.81 MB, 59.75 MB, 113.98 MB, 170.55 MB, 170.55 MB, 170.63 MB, 170.54 MB, 170.67 MB, 170.48 MB, 170.62 MB, 130.90 MB, 59.92 MB, 79.36 MB, 78.24 MB, 78.10 MB, 78.18 MB, 46.50 MB ThreadUsage(1s000ms): 4, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 4, 4, 4, 4 - AverageThreadTokens: 7.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 171.07 MB (179382448) - PerHostPeakMemUsage: 3.89 GB (4175800888) - PrepareTime: 198.375ms - RowsProduced: 50.61M (50610802) - TotalCpuTime: 3m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s000ms - TotalStorageWaitTime: 358.822ms CodeGen:(Total: 530.774ms, non-child: 530.774ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.205ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 329.753ms - PrepareTime: 184.630ms DataStreamSender (dst_id=10):(Total: 31s822ms, non-child: 31s822ms, % non-child: 100.00%) - BytesSent: 1.03 GB (1110474400) - NetworkThroughput(*): 7.47 MB/sec - OverallThroughput: 33.28 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s501ms - ThriftTransmitTime(*): 2m21s - UncompressedRowBatchSize: 2.17 GB (2328492324) HDFS_SCAN_NODE (id=1):(Total: 758.130ms, non-child: 758.130ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 6:1/253.41 MB 5:2/506.83 MB 9:1/253.41 MB 3:1/253.39 MB 1:3/760.17 MB 7:2/506.78 MB 4:4/1013.58 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:96.92% 1:1.538% 2:1.538% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 139.58 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB, 285.24 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 287.46 MB, 349.06 MB, 349.06 MB, 349.06 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 6.49 - BytesRead: 349.06 MB (366020175) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366020175) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366020175) - DecompressionTime: 1s325ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 170.65 MB (178940080) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659991) - RowsReturned: 50.61M (50610802) - RowsReturnedRate: 66.76 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.90K (7903) - ScannerThreadsTotalWallClockTime: 3m29s - MaterializeTupleTime(*): 3m27s - ScannerThreadsSysTime: 294.952ms - ScannerThreadsUserTime: 16s419ms - ScannerThreadsVoluntaryContextSwitches: 49.48K (49482) - TotalRawHdfsReadTime(*): 258.666ms - TotalReadThroughput: 10.74 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e22 (host=vb0230.halxg.cloudera.com:22000):(Total: 32s208ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB MemoryUsage(1s000ms): 95.83 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 192.72 MB, 193.19 MB, 193.74 MB, 193.58 MB, 193.60 MB, 193.63 MB, 193.62 MB, 193.71 MB, 193.61 MB, 145.94 MB, 67.08 MB, 67.16 MB, 121.78 MB, 193.70 MB, 193.62 MB, 193.64 MB, 193.71 MB, 193.63 MB, 193.82 MB, 193.63 MB, 185.77 MB, 86.65 MB, 67.16 MB, 55.48 MB, 55.08 MB, 39.29 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3, 3, 3 - AverageThreadTokens: 8.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.14 MB (203566776) - PerHostPeakMemUsage: 3.88 GB (4170775752) - PrepareTime: 188.115ms - RowsProduced: 53.62M (53619068) - TotalCpuTime: 4m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s792ms - TotalStorageWaitTime: 420.115ms CodeGen:(Total: 579.000ms, non-child: 579.000ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 387.398ms - PrepareTime: 175.638ms DataStreamSender (dst_id=10):(Total: 31s632ms, non-child: 31s632ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1132536154) - NetworkThroughput(*): 7.93 MB/sec - OverallThroughput: 34.14 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s601ms - ThriftTransmitTime(*): 2m16s - UncompressedRowBatchSize: 2.30 GB (2466896060) HDFS_SCAN_NODE (id=1):(Total: 697.623ms, non-child: 697.623ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.77 MB 0:1/253.40 MB 8:4/1013.55 MB 1:1/253.41 MB 5:1/253.38 MB 6:1/253.40 MB 2:1/253.40 MB 9:3/760.18 MB 4:4/1013.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(1s000ms): 82.13 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 236.13 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 369.60 MB, 369.60 MB, 369.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.45 - BytesRead: 369.60 MB (387553744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 369.60 MB (387553744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 369.60 MB (387553744) - DecompressionTime: 1s491ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581333) - RowsReturned: 53.62M (53619068) - RowsReturnedRate: 76.86 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.36K (7360) - ScannerThreadsTotalWallClockTime: 4m1s - MaterializeTupleTime(*): 3m59s - ScannerThreadsSysTime: 235.960ms - ScannerThreadsUserTime: 17s198ms - ScannerThreadsVoluntaryContextSwitches: 52.39K (52393) - TotalRawHdfsReadTime(*): 288.373ms - TotalReadThroughput: 11.20 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e2f (host=vb0218.halxg.cloudera.com:22000):(Total: 31s732ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB MemoryUsage(1s000ms): 96.04 MB, 193.02 MB, 193.02 MB, 193.02 MB, 193.02 MB, 193.02 MB, 193.02 MB, 193.02 MB, 193.35 MB, 193.76 MB, 193.58 MB, 193.82 MB, 193.64 MB, 193.70 MB, 193.75 MB, 193.74 MB, 126.12 MB, 67.14 MB, 67.16 MB, 129.89 MB, 193.81 MB, 193.69 MB, 193.83 MB, 193.78 MB, 193.71 MB, 193.73 MB, 193.70 MB, 193.64 MB, 98.56 MB, 67.17 MB, 49.64 MB, 24.11 MB ThreadUsage(1s000ms): 5, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.47 MB (203915528) - PerHostPeakMemUsage: 3.69 GB (3966311248) - PrepareTime: 193.227ms - RowsProduced: 50.62M (50619341) - TotalCpuTime: 4m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s007ms - TotalStorageWaitTime: 492.518ms CodeGen:(Total: 560.052ms, non-child: 560.052ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 361.439ms - PrepareTime: 183.067ms DataStreamSender (dst_id=10):(Total: 31s141ms, non-child: 31s141ms, % non-child: 100.00%) - BytesSent: 1020.58 MB (1070160522) - NetworkThroughput(*): 7.57 MB/sec - OverallThroughput: 32.77 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s141ms - ThriftTransmitTime(*): 2m14s - UncompressedRowBatchSize: 2.17 GB (2328885186) HDFS_SCAN_NODE (id=1):(Total: 715.400ms, non-child: 715.400ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 3:1/253.38 MB 5:1/253.41 MB 8:1/253.40 MB 9:1/253.38 MB 4:1/253.40 MB 6:2/506.81 MB 7:4/1013.55 MB 0:2/506.78 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(1s000ms): 82.12 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 246.39 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 328.53 MB, 338.79 MB, 349.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.67 - BytesRead: 349.06 MB (366019017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.06 MB (366019017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.06 MB (366019017) - DecompressionTime: 1s336ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 194.04 MB (203464968) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660112) - RowsReturned: 50.62M (50619341) - RowsReturnedRate: 70.76 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.68K (7676) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 3m58s - ScannerThreadsSysTime: 253.958ms - ScannerThreadsUserTime: 16s607ms - ScannerThreadsVoluntaryContextSwitches: 47.67K (47672) - TotalRawHdfsReadTime(*): 236.917ms - TotalReadThroughput: 10.91 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e23 (host=vb0214.halxg.cloudera.com:22000):(Total: 30s983ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(500.000ms): 0, 185.89 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.61 MB, 193.76 MB, 193.45 MB, 193.66 MB, 193.62 MB, 193.61 MB, 193.80 MB, 193.66 MB, 193.71 MB, 193.74 MB, 193.79 MB, 193.71 MB, 193.72 MB, 193.55 MB, 193.68 MB, 129.74 MB, 74.94 MB, 67.12 MB, 67.09 MB, 67.20 MB, 67.07 MB, 67.22 MB, 190.98 MB, 191.66 MB, 191.56 MB, 191.73 MB, 191.72 MB, 191.72 MB, 191.68 MB, 191.81 MB, 191.78 MB, 191.64 MB, 191.61 MB, 191.71 MB, 191.50 MB, 191.89 MB, 191.75 MB, 191.63 MB, 191.57 MB, 183.77 MB, 119.92 MB, 65.26 MB, 65.27 MB, 82.66 MB, 75.80 MB, 31.99 MB, 32.01 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8, 2, 2 - AverageThreadTokens: 8.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.08 MB (203509424) - PerHostPeakMemUsage: 3.69 GB (3965587240) - PrepareTime: 192.427ms - RowsProduced: 50.39M (50385733) - TotalCpuTime: 4m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s105ms - TotalStorageWaitTime: 376.535ms CodeGen:(Total: 542.549ms, non-child: 542.549ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 346.316ms - PrepareTime: 179.373ms DataStreamSender (dst_id=10):(Total: 30s403ms, non-child: 30s403ms, % non-child: 100.00%) - BytesSent: 1021.67 MB (1071295260) - NetworkThroughput(*): 8.11 MB/sec - OverallThroughput: 33.60 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s245ms - ThriftTransmitTime(*): 2m5s - UncompressedRowBatchSize: 2.16 GB (2318137382) HDFS_SCAN_NODE (id=1):(Total: 696.027ms, non-child: 696.027ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 3:2/506.79 MB 0:1/253.42 MB 5:2/487.72 MB 1:3/760.14 MB 9:1/253.39 MB 6:2/506.75 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:98.39% 1:1.613% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:34 BytesRead(500.000ms): 157.89 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 164.25 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 326.97 MB, 347.50 MB, 347.50 MB, 347.50 MB, 347.50 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.76 - BytesRead: 347.50 MB (364381246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 347.50 MB (364381246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 347.50 MB (364381246) - DecompressionTime: 1s425ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009760) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138949) - RowsReturned: 50.39M (50385733) - RowsReturnedRate: 72.39 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 7.56K (7564) - ScannerThreadsTotalWallClockTime: 3m57s - MaterializeTupleTime(*): 3m55s - ScannerThreadsSysTime: 209.964ms - ScannerThreadsUserTime: 16s568ms - ScannerThreadsVoluntaryContextSwitches: 47.71K (47714) - TotalRawHdfsReadTime(*): 260.582ms - TotalReadThroughput: 11.21 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e2c (host=vb0228.halxg.cloudera.com:22000):(Total: 30s914ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB MemoryUsage(500.000ms): 68.00 KB, 163.43 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.12 MB, 187.56 MB, 187.50 MB, 187.70 MB, 187.58 MB, 187.71 MB, 187.78 MB, 187.75 MB, 187.56 MB, 187.75 MB, 187.59 MB, 187.73 MB, 187.77 MB, 187.53 MB, 187.66 MB, 187.62 MB, 145.49 MB, 90.65 MB, 82.95 MB, 82.95 MB, 82.97 MB, 83.03 MB, 82.99 MB, 193.07 MB, 193.68 MB, 193.74 MB, 193.47 MB, 193.70 MB, 193.77 MB, 193.68 MB, 193.61 MB, 193.64 MB, 193.68 MB, 193.72 MB, 193.78 MB, 185.90 MB, 177.89 MB, 177.88 MB, 177.79 MB, 177.97 MB, 137.51 MB, 83.13 MB, 83.12 MB, 82.81 MB, 82.99 MB, 31.97 MB, 16.13 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 2, 2 - AverageThreadTokens: 8.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.09 MB (203517624) - PerHostPeakMemUsage: 3.67 GB (3938658544) - PrepareTime: 190.705ms - RowsProduced: 49.94M (49935771) - TotalCpuTime: 4m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s467ms - TotalStorageWaitTime: 400.757ms CodeGen:(Total: 553.765ms, non-child: 553.765ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 359.802ms - PrepareTime: 178.432ms DataStreamSender (dst_id=10):(Total: 30s356ms, non-child: 30s356ms, % non-child: 100.00%) - BytesSent: 1008.77 MB (1057770657) - NetworkThroughput(*): 7.17 MB/sec - OverallThroughput: 33.23 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 11s025ms - ThriftTransmitTime(*): 2m20s - UncompressedRowBatchSize: 2.14 GB (2297435622) HDFS_SCAN_NODE (id=1):(Total: 679.493ms, non-child: 679.493ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:1/253.38 MB 8:1/253.39 MB 1:1/253.41 MB 2:1/253.41 MB 0:3/698.44 MB 7:2/506.81 MB 10:4/1013.58 MB 5:4/765.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 139.40 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 159.94 MB, 180.47 MB, 180.47 MB, 180.47 MB, 180.47 MB, 180.47 MB, 180.47 MB, 180.47 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 324.21 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB, 344.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.77 - BytesRead: 344.74 MB (361490201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.74 MB (361490201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.74 MB (361490201) - DecompressionTime: 1s281ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.61 MB (203009856) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 116.10M (116100655) - RowsReturned: 49.94M (49935771) - RowsReturnedRate: 73.49 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.74K (7736) - ScannerThreadsTotalWallClockTime: 3m59s - MaterializeTupleTime(*): 3m57s - ScannerThreadsSysTime: 202.965ms - ScannerThreadsUserTime: 17s809ms - ScannerThreadsVoluntaryContextSwitches: 47.26K (47259) - TotalRawHdfsReadTime(*): 282.901ms - TotalReadThroughput: 10.94 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e29 (host=vb0216.halxg.cloudera.com:22000):(Total: 30s593ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB MemoryUsage(500.000ms): 68.00 KB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.26 MB, 193.43 MB, 193.62 MB, 193.65 MB, 193.69 MB, 193.75 MB, 193.87 MB, 193.82 MB, 193.62 MB, 193.64 MB, 193.71 MB, 193.61 MB, 193.77 MB, 193.78 MB, 193.67 MB, 177.76 MB, 129.86 MB, 67.14 MB, 67.02 MB, 67.07 MB, 67.03 MB, 66.99 MB, 60.97 MB, 192.41 MB, 193.68 MB, 193.76 MB, 193.58 MB, 193.73 MB, 193.72 MB, 193.57 MB, 193.65 MB, 193.61 MB, 193.75 MB, 193.86 MB, 193.68 MB, 193.70 MB, 193.68 MB, 193.73 MB, 193.61 MB, 193.71 MB, 145.74 MB, 74.78 MB, 67.02 MB, 67.21 MB, 66.94 MB, 28.20 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 3 - AverageThreadTokens: 8.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.16 MB (203587168) - PerHostPeakMemUsage: 3.69 GB (3963746072) - PrepareTime: 191.125ms - RowsProduced: 47.65M (47649144) - TotalCpuTime: 4m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s925ms - TotalStorageWaitTime: 304.403ms CodeGen:(Total: 545.793ms, non-child: 545.793ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 350.221ms - PrepareTime: 177.784ms DataStreamSender (dst_id=10):(Total: 30s036ms, non-child: 30s036ms, % non-child: 100.00%) - BytesSent: 1006.07 MB (1054943308) - NetworkThroughput(*): 7.13 MB/sec - OverallThroughput: 33.49 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s792ms - ThriftTransmitTime(*): 2m21s - UncompressedRowBatchSize: 2.04 GB (2192232924) HDFS_SCAN_NODE (id=1):(Total: 682.696ms, non-child: 682.696ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 4:1/253.41 MB 9:1/253.39 MB 3:2/506.80 MB 2:2/506.78 MB 7:1/253.39 MB 6:3/760.20 MB 0:1/253.38 MB 10:4/1013.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 164.26 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB, 328.54 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.90 - BytesRead: 328.54 MB (344497082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.54 MB (344497082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.54 MB (344497082) - DecompressionTime: 1s360ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.72 MB (203128416) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738825) - RowsReturned: 47.65M (47649144) - RowsReturnedRate: 69.80 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.42K (6423) - ScannerThreadsTotalWallClockTime: 4m2s - MaterializeTupleTime(*): 4m - ScannerThreadsSysTime: 206.965ms - ScannerThreadsUserTime: 15s695ms - ScannerThreadsVoluntaryContextSwitches: 46.66K (46656) - TotalRawHdfsReadTime(*): 250.606ms - TotalReadThroughput: 10.60 MB/sec Instance fc4ebd07a3c493a1:101db40b9b2a9e2b (host=vb0220.halxg.cloudera.com:22000):(Total: 29s891ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB MemoryUsage(500.000ms): 0, 9.25 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.45 MB, 193.44 MB, 193.59 MB, 193.68 MB, 193.70 MB, 193.64 MB, 193.61 MB, 193.60 MB, 193.71 MB, 193.71 MB, 193.86 MB, 193.68 MB, 193.82 MB, 193.79 MB, 193.90 MB, 193.66 MB, 193.68 MB, 130.02 MB, 67.07 MB, 67.28 MB, 67.01 MB, 67.20 MB, 67.21 MB, 68.93 MB, 193.74 MB, 193.68 MB, 193.68 MB, 193.74 MB, 193.82 MB, 193.70 MB, 193.66 MB, 193.79 MB, 193.70 MB, 193.60 MB, 193.75 MB, 193.71 MB, 193.64 MB, 193.70 MB, 193.71 MB, 193.74 MB, 185.62 MB, 121.99 MB, 66.99 MB, 67.22 MB, 67.12 MB, 60.68 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 8 - AverageThreadTokens: 8.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 194.14 MB (203574976) - PerHostPeakMemUsage: 3.67 GB (3944707912) - PrepareTime: 183.849ms - RowsProduced: 47.63M (47629454) - TotalCpuTime: 4m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s025ms - TotalStorageWaitTime: 352.890ms CodeGen:(Total: 547.230ms, non-child: 547.230ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 357.509ms - PrepareTime: 179.758ms DataStreamSender (dst_id=10):(Total: 29s328ms, non-child: 29s328ms, % non-child: 100.00%) - BytesSent: 959.86 MB (1006486990) - NetworkThroughput(*): 6.91 MB/sec - OverallThroughput: 32.73 MB/sec - PeakMemoryUsage: 480.00 KB (491520) - SerializeBatchTime: 10s575ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 2.04 GB (2191327012) HDFS_SCAN_NODE (id=1):(Total: 676.119ms, non-child: 676.119ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 1:1/253.41 MB 8:1/253.39 MB 10:1/253.39 MB 7:2/506.82 MB 5:1/253.39 MB 0:3/760.18 MB 2:2/506.82 MB 4:3/760.19 MB 6:2/506.78 MB Hdfs Read Thread Concurrency Bucket: 0:98.33% 1:1.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 500.00 KB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.28 MB, 164.38 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB, 328.57 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.98 - BytesRead: 328.57 MB (344526548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.57 MB (344526548) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.57 MB (344526548) - DecompressionTime: 1s352ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 193.67 MB (203075304) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738793) - RowsReturned: 47.63M (47629454) - RowsReturnedRate: 70.45 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 6.83K (6829) - ScannerThreadsTotalWallClockTime: 3m57s - MaterializeTupleTime(*): 3m55s - ScannerThreadsSysTime: 211.965ms - ScannerThreadsUserTime: 15s639ms - ScannerThreadsVoluntaryContextSwitches: 46.63K (46629) - TotalRawHdfsReadTime(*): 264.748ms - TotalReadThroughput: 10.95 MB/sec ================================================================================