Query (id=c441d45ac6132d78:99a92025da50deba) InactiveTotalTime: 0 TotalTime: 0 Summary ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 21:MERGING-EXCHANGE 1 82.933us 82.933us 4 1.64M 0 -1.00 B UNPARTITIONED 12:SORT 7 2.606ms 12.275ms 4 1.64M 24.02 MB 48.00 MB 20:AGGREGATE 7 11s308ms 1m17s 4 1.64M 2.28 MB 10.00 MB FINALIZE 19:EXCHANGE 7 44.765us 80.177us 24 1.64M 0 0 HASH(supp_nation,cust_natio... 11:AGGREGATE 7 11s631ms 1m17s 24 1.64M 12.75 MB 114.04 MB STREAMING 10:HASH JOIN 7 2s590ms 4s666ms 499.76K 59.31M 8.39 MB 855.00 B INNER JOIN, BROADCAST |--18:EXCHANGE 7 7.757us 14.299us 25 25 0 0 BROADCAST | 05:SCAN HDFS 1 16.652ms 16.652ms 25 25 58.00 KB 32.00 MB tpch_100_parquet.nation n2 09:HASH JOIN 7 1s737ms 2s791ms 156.10M 59.31M 3.12 MB 855.00 B INNER JOIN, BROADCAST |--17:EXCHANGE 7 6.865us 10.042us 25 25 0 0 BROADCAST | 04:SCAN HDFS 1 5.555ms 5.555ms 25 25 58.00 KB 32.00 MB tpch_100_parquet.nation n1 08:HASH JOIN 7 2m49s 18m21s 182.10M 59.31M 906.79 MB 251.77 MB INNER JOIN, BROADCAST |--16:EXCHANGE 7 2s047ms 3s369ms 15.00M 15.00M 0 0 BROADCAST | 03:SCAN HDFS 6 1s177ms 1s520ms 15.00M 15.00M 18.13 MB 176.00 MB tpch_100_parquet.customer 07:HASH JOIN 7 55s317ms 1m22s 182.11M 59.31M 1.01 GB 359.67 MB INNER JOIN, PARTITIONED |--15:EXCHANGE 7 1s874ms 2s100ms 150.00M 150.00M 0 0 HASH(o_orderkey) | 02:SCAN HDFS 7 5s391ms 6s062ms 150.00M 150.00M 65.13 MB 176.00 MB tpch_100_parquet.orders 14:EXCHANGE 7 11s588ms 26s125ms 182.12M 59.31M 0 0 HASH(l_orderkey) 06:HASH JOIN 7 38s139ms 1m42s 182.12M 59.31M 170.97 MB 16.78 MB INNER JOIN, BROADCAST |--13:EXCHANGE 7 462.438ms 1s686ms 1.00M 1.00M 0 0 BROADCAST | 00:SCAN HDFS 7 910.330ms 1s020ms 1.00M 1.00M 7.58 MB 48.00 MB tpch_100_parquet.supplier 01:SCAN HDFS 7 7s974ms 10s508ms 182.30M 60.00M 122.79 MB 440.00 MB tpch_100_parquet.lineitem Network Address: 172.26.26.3:52330 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=6124732416 Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 22f71f3e82151c1064bf2983dd3e9025c4cce5b3) HiveServer2 Protocol Version: V6 Sql Statement: /* Mem: 5841 MB. Coordinator: vc0706.halxg.cloudera.com. */ select supp_nation, cust_nation, l_year, sum(volume) as revenue from ( select n1.n_name as supp_nation, n2.n_name as cust_nation, year(l_shipdate) as l_year, l_extendedprice * (1 - l_discount) as volume from supplier, lineitem, orders, customer, nation n1, nation n2 where s_suppkey = l_suppkey and o_orderkey = l_orderkey and c_custkey = o_custkey and s_nationkey = n1.n_nationkey and c_nationkey = n2.n_nationkey and ( (n1.n_name = 'FRANCE' and n2.n_name = 'GERMANY') or (n1.n_name = 'GERMANY' and n2.n_name = 'FRANCE') ) and l_shipdate between '1995-01-01' and '1996-12-31' ) as shipping group by supp_nation, cust_nation, l_year order by supp_nation, cust_nation, l_year Request Pool: default-pool Start Time: 2016-02-22 13:39:13.072259000 End Time: 2016-02-22 14:10:15.167549000 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.16GB VCores=7 21:MERGING-EXCHANGE [UNPARTITIONED] | order by: supp_nation ASC, cust_nation ASC, l_year ASC | hosts=7 per-host-mem=unavailable | tuple-ids=8 row-size=66B cardinality=1643125 | 12:SORT | order by: supp_nation ASC, cust_nation ASC, l_year ASC | hosts=7 per-host-mem=48.00MB | tuple-ids=8 row-size=66B cardinality=1643125 | 20:AGGREGATE [FINALIZE] | output: sum:merge(volume) | group by: supp_nation, cust_nation, l_year | hosts=7 per-host-mem=10.00MB | tuple-ids=7 row-size=66B cardinality=1643125 | 19:EXCHANGE [HASH(supp_nation,cust_nation,l_year)] | hosts=7 per-host-mem=0B | tuple-ids=7 row-size=66B cardinality=1643125 | 11:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: n1.n_name, n2.n_name, year(l_shipdate) | hosts=7 per-host-mem=114.04MB | tuple-ids=7 row-size=66B cardinality=1643125 | 10:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: c_nationkey = n2.n_nationkey | other predicates: ((n1.n_name = 'FRANCE' AND n2.n_name = 'GERMANY') OR (n1.n_name = 'GERMANY' AND n2.n_name = 'FRANCE')) | runtime filters: RF000 <- n2.n_nationkey | hosts=7 per-host-mem=855B | tuple-ids=1,0,2,3,4,5 row-size=168B cardinality=59311624 | |--18:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=5 row-size=31B cardinality=25 | | | 05:SCAN HDFS [tpch_100_parquet.nation n2, RANDOM] | partitions=1/1 files=1 size=2.18KB | table stats: 25 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=5 row-size=31B cardinality=25 | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: s_nationkey = n1.n_nationkey | runtime filters: RF001 <- n1.n_nationkey | hosts=7 per-host-mem=855B | tuple-ids=1,0,2,3,4 row-size=137B cardinality=59311624 | |--17:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=4 row-size=31B cardinality=25 | | | 04:SCAN HDFS [tpch_100_parquet.nation n1, RANDOM] | partitions=1/1 files=1 size=2.18KB | table stats: 25 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=4 row-size=31B cardinality=25 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: o_custkey = c_custkey | runtime filters: RF002 <- c_custkey | hosts=7 per-host-mem=251.77MB | tuple-ids=1,0,2,3 row-size=106B cardinality=59311624 | |--16:EXCHANGE [BROADCAST] | | hosts=7 per-host-mem=0B | | tuple-ids=3 row-size=16B cardinality=15000000 | | | 03:SCAN HDFS [tpch_100_parquet.customer, RANDOM] | partitions=1/1 files=7 size=1.17GB | runtime filters: RF000 -> c_nationkey | table stats: 15000000 rows total | column stats: all | hosts=7 per-host-mem=176.00MB | tuple-ids=3 row-size=16B cardinality=15000000 | 07:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF003 <- o_orderkey | hosts=7 per-host-mem=359.67MB | tuple-ids=1,0,2 row-size=90B cardinality=59311624 | |--15:EXCHANGE [HASH(o_orderkey)] | | hosts=7 per-host-mem=0B | | tuple-ids=2 row-size=16B cardinality=150000000 | | | 02:SCAN HDFS [tpch_100_parquet.orders, RANDOM] | partitions=1/1 files=28 size=6.16GB | runtime filters: RF002 -> o_custkey | table stats: 150000000 rows total | column stats: all | hosts=7 per-host-mem=176.00MB | tuple-ids=2 row-size=16B cardinality=150000000 | 14:EXCHANGE [HASH(l_orderkey)] | hosts=7 per-host-mem=0B | tuple-ids=1,0 row-size=74B cardinality=59311624 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l_suppkey = s_suppkey | runtime filters: RF004 <- s_suppkey | hosts=7 per-host-mem=16.78MB | tuple-ids=1,0 row-size=74B cardinality=59311624 | |--13:EXCHANGE [BROADCAST] | | hosts=7 per-host-mem=0B | | tuple-ids=0 row-size=16B cardinality=1000000 | | | 00:SCAN HDFS [tpch_100_parquet.supplier, RANDOM] | partitions=1/1 files=7 size=79.69MB | runtime filters: RF001 -> s_nationkey | table stats: 1000000 rows total | column stats: all | hosts=7 per-host-mem=48.00MB | tuple-ids=0 row-size=16B cardinality=1000000 | 01:SCAN HDFS [tpch_100_parquet.lineitem, RANDOM] partitions=1/1 files=91 size=21.25GB predicates: l_shipdate >= '1995-01-01', l_shipdate <= '1996-12-31' runtime filters: RF003 -> l_orderkey, RF004 -> l_suppkey table stats: 600037902 rows total column stats: all hosts=7 per-host-mem=440.00MB tuple-ids=1 row-size=58B cardinality=60003790 ---------------- Query Type: QUERY Connected User: jenkins Session ID: fb4c2d52384638d6:60a23d22f79033b9 User: jenkins Default Db: tpch_100_parquet Delegated User: Query State: FINISHED Session Type: HIVESERVER2 Query Status: OK Estimated Per-Host VCores: 7 Coordinator: vc0706.halxg.cloudera.com:22000 Estimated Per-Host Mem: 1250183844 InactiveTotalTime: 0 TotalTime: 0 ImpalaServer ClientFetchWaitTimer: 93244682 InactiveTotalTime: 0 RowMaterializationTimer: 20390 TotalTime: 0 Execution Profile c441d45ac6132d78:99a92025da50deba Fragment start latencies: Count: 43, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 4ms, 90th %-ile: 184ms, 95th %-ile: 297ms, 99.9th %-ile: 307ms Per Node Peak Memory Usage: vc0336.halxg.cloudera.com:22000(2.05 GB) vc0712.halxg.cloudera.com:22000(2.23 GB) vc0718.halxg.cloudera.com:22000(2.20 GB) vc0708.halxg.cloudera.com:22000(2.13 GB) vc0704.halxg.cloudera.com:22000(2.19 GB) vc0714.halxg.cloudera.com:22000(2.08 GB) vc0706.halxg.cloudera.com:22000(2.14 GB) FiltersReceived: 0 FinalizationTimer: 0 InactiveTotalTime: 0 TotalTime: 1861963432529 Coordinator Fragment F08 AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 24608 PerHostPeakMemUsage: 0 PrepareTime: 60569 RowsProduced: 4 TotalCpuTime: 1861977639219 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 0 TotalStorageWaitTime: 0 TotalTime: 1861643697619 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 568 BlocksRecycled: 744 BufferedPins: 144 BytesWritten: 1895825408 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2122844160 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 29373754760 TotalTime: 0 EXCHANGE_NODE (id=21) BytesReceived: 272 ConvertRowBatchTime: 0 DeserializeRowBatchTimer: 31653 FirstBatchArrivalWaitTime: 1861642624295 InactiveTotalTime: 1861642626636 MergeGetNext: 24322 MergeGetNextBatch: 17447 PeakMemoryUsage: 0 RowsReturned: 4 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861642709569 Averaged Fragment F07 completion times: min:31m1s max:31m1s mean: 31m1s stddev:67.925ms split sizes: min: 0, max: 0, avg: 0, stddev: 0 execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27557892 PerHostPeakMemUsage: 2304047301 PrepareTime: 11307197569 RowsProduced: 0 TotalCpuTime: 12167269901 TotalNetworkReceiveTime: 1849747014314 TotalNetworkSendTime: 88453 TotalStorageWaitTime: 0 TotalTime: 1861130814285 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 496 BlocksRecycled: 704 BufferedPins: 120 BytesWritten: 1402295637 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2142417237 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 29732159921 TotalTime: 0 CodeGen CodegenTime: 3296008 CompileTime: 106943303 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 653300951 PrepareTime: 11086289715 TotalTime: 12061084049 DataStreamSender (dst_id=21) BytesSent: 38 InactiveTotalTime: 0 NetworkThroughput(*): 301313 OverallThroughput: 824092 PeakMemoryUsage: 2336 SerializeBatchTime: 12830 ThriftTransmitTime(*): 75253 TotalTime: 37005 UncompressedRowBatchSize: 44 SORT_NODE (id=12) InMemorySortTime: 1403 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25178697 RowsReturned: 0 RowsReturnedRate: 0 SortDataSize: 39 TotalMergesPerformed: 0 TotalTime: 1861058071724 AGGREGATION_NODE (id=20) BuildTime: 20365 GetNewBlockTime: 771053 GetResultsTime: 1340 HTResizeTime: 4140 HashBuckets: 585 InactiveTotalTime: 0 LargestPartitionPercent: 9 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2381531 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861055465279 UnpinTime: 1027 EXCHANGE_NODE (id=19) BytesReceived: 233 ConvertRowBatchTime: 8137 DeserializeRowBatchTimer: 37740 FirstBatchArrivalWaitTime: 1808279445121 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 3 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1849747037375 Averaged Fragment F03 completion times: min:29m49s max:31m1s mean: 30m34s stddev:21s080ms split sizes: min: 0, max: 0, avg: 0, stddev: 0 execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1498308010 PerHostPeakMemUsage: 2304047301 PrepareTime: 11318106521 RowsProduced: 3 TotalCpuTime: 250148852429 TotalNetworkReceiveTime: 1584129499009 TotalNetworkSendTime: 14910438 TotalStorageWaitTime: 0 TotalTime: 1832676723139 CodeGen CodegenTime: 3590836 CompileTime: 462684043 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 1048139923 PrepareTime: 11280079036 TotalTime: 12792804551 DataStreamSender (dst_id=19) BytesSent: 233 InactiveTotalTime: 0 NetworkThroughput(*): 218659 OverallThroughput: 5178890 PeakMemoryUsage: 30395 SerializeBatchTime: 42708 ThriftTransmitTime(*): 14800730 TotalTime: 48781 UncompressedRowBatchSize: 264 AGGREGATION_NODE (id=11) GetNewBlockTime: 356241 GetResultsTime: 5332 HTResizeTime: 0 HashBuckets: 2633 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 9634350 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 3 RowsReturnedRate: 0 StreamingTime: 349101731 TotalTime: 1832627158168 UnpinTime: 0 HASH_JOIN_NODE (id=10) BuildPartitionTime: 4285105 BuildRows: 21 BuildRowsPartitioned: 21 BuildTime: 8780 GetNewBlockTime: 62763 HashBuckets: 54 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 24 LocalTime: 2590760829 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 3713918 PinTime: 0 ProbeRows: 22299444 ProbeRowsPartitioned: 0 ProbeTime: 2396521883 RowsReturned: 71394 RowsReturnedRate: 38 SpilledPartitions: 0 TotalTime: 1820995843258 UnpinTime: 926 EXCHANGE_NODE (id=18) BytesReceived: 646 ConvertRowBatchTime: 1315 DeserializeRowBatchTimer: 8262 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 21 RowsReturnedRate: 2533242 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 11120384316 HASH_JOIN_NODE (id=9) BuildPartitionTime: 6905 BuildRows: 21 BuildRowsPartitioned: 21 BuildTime: 8531 GetNewBlockTime: 147898 HashBuckets: 54 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 24 LocalTime: 1737948260 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2358217 PinTime: 0 ProbeRows: 26014436 ProbeRowsPartitioned: 0 ProbeTime: 1639513312 RowsReturned: 22299444 RowsReturnedRate: 12263 SpilledPartitions: 0 TotalTime: 1807284698112 UnpinTime: 842 EXCHANGE_NODE (id=17) BytesReceived: 651 ConvertRowBatchTime: 1206 DeserializeRowBatchTimer: 8477 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 21 RowsReturnedRate: 1940019 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 33291124548 HASH_JOIN_NODE (id=8) BuildPartitionTime: 160233429319 BuildRows: 14999268 BuildRowsPartitioned: 14999268 BuildTime: 2298093776 GetNewBlockTime: 5613433 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 169833219546 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950276358 PinTime: 0 ProbeRows: 26015759 ProbeRowsPartitioned: 0 ProbeTime: 6008739806 RowsReturned: 26014436 RowsReturnedRate: 14687 SpilledPartitions: 0 TotalTime: 1772255625303 UnpinTime: 924 EXCHANGE_NODE (id=16) BytesReceived: 222189838 ConvertRowBatchTime: 454763711 DeserializeRowBatchTimer: 162924105469 FirstBatchArrivalWaitTime: 67526517 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 14999268 RowsReturnedRate: 22191 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1125505580611 HASH_JOIN_NODE (id=7) BuildPartitionTime: 6840877919 BuildRows: 21427986 BuildRowsPartitioned: 34054955 BuildTime: 3545992366 GetNewBlockTime: 1095634456 HashBuckets: 34752804 HashCollisions: 4245 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 55317263641 MaxPartitionLevel: 0 NumRepartitions: 12 PartitionsCreated: 166 PeakMemoryUsage: 528211844 PinTime: 29682915793 ProbeRows: 26016468 ProbeRowsPartitioned: 19294122 ProbeTime: 13757244622 RowsReturned: 26015759 RowsReturnedRate: 54678 SpilledPartitions: 12 TotalTime: 476916825145 UnpinTime: 110732243 EXCHANGE_NODE (id=15) BytesReceived: 399025881 ConvertRowBatchTime: 650937764 DeserializeRowBatchTimer: 15957226934 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 21427986 RowsReturnedRate: 289529 SendersBlockedTimer: 1143781753284 SendersBlockedTotalTimer(*): 6046387459884 TotalTime: 74014297767 EXCHANGE_NODE (id=14) BytesReceived: 1333876465 ConvertRowBatchTime: 5915745694 DeserializeRowBatchTimer: 60414897607 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 26016468 RowsReturnedRate: 74874 SendersBlockedTimer: 1220360795022 SendersBlockedTotalTimer(*): 4708913327050 TotalTime: 347585263737 Averaged Fragment F06 completion times: min:1m18s max:1m18s mean: 1m18s stddev:0.000ns split sizes: min: 2.18 KB, max: 2.18 KB, avg: 2.18 KB, stddev: 0 execution rates: min:28.00 B/sec max:28.00 B/sec mean:28.00 B/sec stddev:0.00 /sec num instances: 1 AverageThreadTokens: 4607211104147962443 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 96256 PerHostPeakMemUsage: 140150776 PrepareTime: 135743 RowsProduced: 25 TotalCpuTime: 2862571324 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 75785587051 TotalStorageWaitTime: 9086543 TotalTime: 43672590 DataStreamSender (dst_id=18) BytesSent: 5278 InactiveTotalTime: 0 NetworkThroughput(*): 68 OverallThroughput: 58599518 PeakMemoryUsage: 28672 SerializeBatchTime: 27289 ThriftTransmitTime(*): 76758223283 TotalTime: 90069 UncompressedRowBatchSize: 7567 HDFS_SCAN_NODE (id=5) AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607182418800017408 BytesRead: 2720 BytesReadDataNodeCache: 0 BytesReadLocal: 2720 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 2720 DecompressionTime: 4673 InactiveTotalTime: 0 MaterializeTupleTime(*): 10975 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 59392 PerReadThreadRawHdfsThroughput: 100729548 RemoteScanRanges: 0 RowsRead: 25 RowsReturned: 25 RowsReturnedRate: 1501 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 0 ScannerThreadsSysTime: 0 ScannerThreadsTotalWallClockTime: 10213293 ScannerThreadsUserTime: 0 ScannerThreadsVoluntaryContextSwitches: 6 TotalRawHdfsReadTime(*): 27003 TotalReadThroughput: 0 TotalTime: 16652318 Averaged Fragment F05 completion times: min:1m18s max:1m18s mean: 1m18s stddev:0.000ns split sizes: min: 2.18 KB, max: 2.18 KB, avg: 2.18 KB, stddev: 0 execution rates: min:28.00 B/sec max:28.00 B/sec mean:28.00 B/sec stddev:0.00 /sec num instances: 1 AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 96256 PerHostPeakMemUsage: 140150776 PrepareTime: 132990 RowsProduced: 25 TotalCpuTime: 1588509495 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 77345305245 TotalStorageWaitTime: 4505614 TotalTime: 43324325 DataStreamSender (dst_id=17) BytesSent: 5320 InactiveTotalTime: 0 NetworkThroughput(*): 67 OverallThroughput: 42970453 PeakMemoryUsage: 28672 SerializeBatchTime: 41642 ThriftTransmitTime(*): 78295935000 TotalTime: 123806 UncompressedRowBatchSize: 7567 HDFS_SCAN_NODE (id=4) AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 0 BytesRead: 2720 BytesReadDataNodeCache: 0 BytesReadLocal: 2720 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 2720 DecompressionTime: 3973 InactiveTotalTime: 0 MaterializeTupleTime(*): 9315 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 59392 PerReadThreadRawHdfsThroughput: 93096484 RemoteScanRanges: 0 RowsRead: 25 RowsReturned: 25 RowsReturnedRate: 4500 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 1 ScannerThreadsSysTime: 0 ScannerThreadsTotalWallClockTime: 4836039 ScannerThreadsUserTime: 0 ScannerThreadsVoluntaryContextSwitches: 9 TotalRawHdfsReadTime(*): 29217 TotalReadThroughput: 0 TotalTime: 5555310 Averaged Fragment F04 completion times: min:22m1s max:22m23s mean: 22m6s stddev:7s556ms split sizes: min: 168.12 MB, max: 348.22 MB, avg: 200.15 MB, stddev: 66.37 MB execution rates: min:130.12 KB/sec max:265.46 KB/sec mean:154.22 KB/sec stddev:49.86 KB/sec num instances: 6 AverageThreadTokens: 4611676547112033652 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 18433597 PerHostPeakMemUsage: 870017397 PrepareTime: 206925 RowsProduced: 2500000 TotalCpuTime: 1510298616836 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1139889568379 TotalStorageWaitTime: 18138061 TotalTime: 1142349942951 DataStreamSender (dst_id=16) BytesSent: 259233504 InactiveTotalTime: 0 NetworkThroughput(*): 192890 OverallThroughput: 322261 PeakMemoryUsage: 38192 SerializeBatchTime: 466455620 ThriftTransmitTime(*): 1340662429569 TotalTime: 1140906520658 UncompressedRowBatchSize: 490068371 HDFS_SCAN_NODE (id=3) AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607166394787556708 BytesRead: 11812762 BytesReadDataNodeCache: 0 BytesReadLocal: 11812762 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 11812762 DecompressionTime: 63500583 InactiveTotalTime: 0 MaterializeTupleTime(*): 1323200763331 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 18378153 PerReadThreadRawHdfsThroughput: 2073695436 RemoteScanRanges: 0 RowsRead: 2500000 RowsReturned: 2500000 RowsReturnedRate: 2156820 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 1408 ScannerThreadsSysTime: 111982500 ScannerThreadsTotalWallClockTime: 1323690657948 ScannerThreadsUserTime: 752385166 ScannerThreadsVoluntaryContextSwitches: 2686 TotalRawHdfsReadTime(*): 5887162 TotalReadThroughput: 8978 TotalTime: 1177622122 Filter 0 InactiveTotalTime: 0 Rows processed: 19113 Rows rejected: 0 Rows total: 19114 TotalTime: 0 Averaged Fragment F02 completion times: min:23m26s max:23m45s mean: 23m36s stddev:7s146ms split sizes: min: 759.03 MB, max: 1012.08 MB, avg: 900.63 MB, stddev: 99.51 MB execution rates: min:552.49 KB/sec max:727.22 KB/sec mean:650.56 KB/sec stddev:68.73 KB/sec num instances: 7 AverageThreadTokens: 4611682332457717317 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68336397 PerHostPeakMemUsage: 1912524173 PrepareTime: 158653 RowsProduced: 21428571 TotalCpuTime: 1462609225284 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1369840112506 TotalStorageWaitTime: 64726458 TotalTime: 1400200951225 DataStreamSender (dst_id=15) BytesSent: 399034886 InactiveTotalTime: 0 NetworkThroughput(*): 68093 OverallThroughput: 285738 PeakMemoryUsage: 238896 SerializeBatchTime: 7303047348 ThriftTransmitTime(*): 6323999213311 TotalTime: 1394475553459 UncompressedRowBatchSize: 600125694 HDFS_SCAN_NODE (id=2) AverageHdfsReadThreadConcurrency: 4542991240145334483 AverageScannerThreadConcurrency: 4607177392064143125 BytesRead: 201494007 BytesReadDataNodeCache: 0 BytesReadLocal: 201494007 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 201494007 DecompressionTime: 1334989795 InactiveTotalTime: 0 MaterializeTupleTime(*): 1413581187468 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68150164 PerReadThreadRawHdfsThroughput: 1709806059 RemoteScanRanges: 0 RowsRead: 21428571 RowsReturned: 21428571 RowsReturnedRate: 3975114 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 8245 ScannerThreadsSysTime: 820303428 ScannerThreadsTotalWallClockTime: 1415662678356 ScannerThreadsUserTime: 3774711428 ScannerThreadsVoluntaryContextSwitches: 31002 TotalRawHdfsReadTime(*): 200785386 TotalReadThroughput: 143493 TotalTime: 5391404076 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Averaged Fragment F00 completion times: min:29m18s max:29m49s mean: 29m28s stddev:9s453ms split sizes: min: 2.86 GB, max: 3.22 GB, avg: 3.04 GB, stddev: 102.80 MB execution rates: min:1.67 MB/sec max:1.84 MB/sec mean:1.76 MB/sec stddev:50.57 KB/sec num instances: 7 AverageThreadTokens: 4611189702388467362 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306257286 PerHostPeakMemUsage: 2304047301 PrepareTime: 11099111895 RowsProduced: 26016468 TotalCpuTime: 1717975366477 TotalNetworkReceiveTime: 190120863406 TotalNetworkSendTime: 1424329930210 TotalStorageWaitTime: 399837711 TotalTime: 1758687899788 CodeGen CodegenTime: 0 CompileTime: 75792119 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 646553712 PrepareTime: 11020772501 TotalTime: 11767363038 DataStreamSender (dst_id=14) BytesSent: 1333876465 InactiveTotalTime: 0 NetworkThroughput(*): 271844 OverallThroughput: 876369 PeakMemoryUsage: 223552 SerializeBatchTime: 28077333660 ThriftTransmitTime(*): 5041949996498 TotalTime: 1521927238433 UncompressedRowBatchSize: 2550634187 HASH_JOIN_NODE (id=6) BuildPartitionTime: 292375515 BuildRows: 998976 BuildRowsPartitioned: 998976 BuildTime: 323753984 GetNewBlockTime: 4576436 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 38139233720 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179270182 PinTime: 0 ProbeRows: 26042963 ProbeRowsPartitioned: 0 ProbeTime: 25540437023 RowsReturned: 26016468 RowsReturnedRate: 110107 SpilledPartitions: 0 TotalTime: 236259747282 UnpinTime: 1474 EXCHANGE_NODE (id=13) BytesReceived: 11509865 ConvertRowBatchTime: 22944818 DeserializeRowBatchTimer: 1578358160 FirstBatchArrivalWaitTime: 434901864 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 998976 RowsReturnedRate: 5431 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 190145867033 HDFS_SCAN_NODE (id=1) AverageHdfsReadThreadConcurrency: 4556241610649139311 AverageScannerThreadConcurrency: 4607176652407939921 BytesRead: 1184027232 BytesReadDataNodeCache: 0 BytesReadLocal: 1184027232 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1184027232 DecompressionTime: 17890810374 InactiveTotalTime: 0 MaterializeTupleTime(*): 1545122884682 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128625605 PerReadThreadRawHdfsThroughput: 1590627678 RemoteScanRanges: 0 RowsRead: 85719700 RowsReturned: 26042963 RowsReturnedRate: 3312045 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 160143 ScannerThreadsSysTime: 8719673857 ScannerThreadsTotalWallClockTime: 1564229446794 ScannerThreadsUserTime: 35481891285 ScannerThreadsVoluntaryContextSwitches: 23566 TotalRawHdfsReadTime(*): 747891887 TotalReadThroughput: 675308 TotalTime: 7974646529 Filter 3 InactiveTotalTime: 0 Rows processed: 212753 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 225 Rows total: 212992 TotalTime: 0 Averaged Fragment F01 completion times: min:3m21s max:3m22s mean: 3m22s stddev:358.188ms split sizes: min: 10.40 MB, max: 11.93 MB, avg: 11.38 MB, stddev: 546.16 KB execution rates: min:52.81 KB/sec max:60.52 KB/sec mean:57.69 KB/sec stddev:2.65 KB/sec num instances: 7 AverageThreadTokens: 4607194435925582123 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 7720577 PerHostPeakMemUsage: 419809555 PrepareTime: 109389 RowsProduced: 142857 TotalCpuTime: 2670935286 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 199911119555 TotalStorageWaitTime: 6586960 TotalTime: 201083262382 DataStreamSender (dst_id=13) BytesSent: 11522062 InactiveTotalTime: 0 NetworkThroughput(*): 56631 OverallThroughput: 57621 PeakMemoryUsage: 38192 SerializeBatchTime: 19690567 ThriftTransmitTime(*): 203496150493 TotalTime: 199964785599 UncompressedRowBatchSize: 28003916 HDFS_SCAN_NODE (id=0) AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4568319722435255928 BytesRead: 845325 BytesReadDataNodeCache: 0 BytesReadLocal: 845325 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 845325 DecompressionTime: 1417538 InactiveTotalTime: 0 MaterializeTupleTime(*): 59149106 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7649617 PerReadThreadRawHdfsThroughput: 1263881938 RemoteScanRanges: 0 RowsRead: 142857 RowsReturned: 142857 RowsReturnedRate: 192916 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 165 ScannerThreadsSysTime: 2570714 ScannerThreadsTotalWallClockTime: 525160503 ScannerThreadsUserTime: 464786000 ScannerThreadsVoluntaryContextSwitches: 10 TotalRawHdfsReadTime(*): 694953 TotalReadThroughput: 4525 TotalTime: 910330551 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Fragment F07 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50debd (host=vc0714.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27568432 PerHostPeakMemUsage: 2232741352 PrepareTime: 169206920 RowsProduced: 1 TotalCpuTime: 428815894 TotalNetworkReceiveTime: 1861510869378 TotalNetworkSendTime: 143360 TotalStorageWaitTime: 0 TotalTime: 1861684224391 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 549 BlocksRecycled: 943 BufferedPins: 140 BytesWritten: 1845493760 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2055735296 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 34209679598 TotalTime: 0 CodeGen CodegenTime: 2167505 CompileTime: 30761203 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 222647114 PrepareTime: 165089338 TotalTime: 420004819 DataStreamSender (dst_id=21) BytesSent: 68 InactiveTotalTime: 0 NetworkThroughput(*): 556364 OverallThroughput: 1900237 PeakMemoryUsage: 2336 SerializeBatchTime: 17691 ThriftTransmitTime(*): 122222 TotalTime: 35785 UncompressedRowBatchSize: 77 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1223 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25182208 RowsReturned: 1 RowsReturnedRate: 0 SortDataSize: 69 TotalMergesPerformed: 0 TotalTime: 1861681552574 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 22506 GetNewBlockTime: 45516 GetResultsTime: 2141 HTResizeTime: 4333 HashBuckets: 1024 InactiveTotalTime: 0 LargestPartitionPercent: 16 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2392064 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 1 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861680969583 UnpinTime: 631 EXCHANGE_NODE (id=19) BytesReceived: 408 ConvertRowBatchTime: 12065 DeserializeRowBatchTimer: 51318 FirstBatchArrivalWaitTime: 1788944050916 InactiveTotalTime: 1861510832320 PeakMemoryUsage: 0 RowsReturned: 6 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861510912497 Instance c441d45ac6132d78:99a92025da50debf (host=vc0708.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27543840 PerHostPeakMemUsage: 2282205368 PrepareTime: 220365844 RowsProduced: 0 TotalCpuTime: 498974356 TotalNetworkReceiveTime: 1861445220606 TotalNetworkSendTime: 351 TotalStorageWaitTime: 0 TotalTime: 1861671360348 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 535 BlocksRecycled: 310 BufferedPins: 125 BytesWritten: 1635778560 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2148009984 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 34720904766 TotalTime: 0 CodeGen CodegenTime: 2357328 CompileTime: 25704947 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 245995417 PrepareTime: 216191633 TotalTime: 489249190 DataStreamSender (dst_id=21) BytesSent: 0 InactiveTotalTime: 0 NetworkThroughput(*): 0 OverallThroughput: 0 PeakMemoryUsage: 2336 SerializeBatchTime: 0 ThriftTransmitTime(*): 0 TotalTime: 21774 UncompressedRowBatchSize: 0 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1811 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25174016 RowsReturned: 0 RowsReturnedRate: 0 SortDataSize: 0 TotalMergesPerformed: 0 TotalTime: 1861668935574 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 6448 GetNewBlockTime: 50065 GetResultsTime: 0 HTResizeTime: 3230 HashBuckets: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2367488 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861668368089 UnpinTime: 757 EXCHANGE_NODE (id=19) BytesReceived: 0 ConvertRowBatchTime: 776 DeserializeRowBatchTimer: 0 FirstBatchArrivalWaitTime: 1861445218110 InactiveTotalTime: 1861445218793 PeakMemoryUsage: 0 RowsReturned: 0 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861445223617 Instance c441d45ac6132d78:99a92025da50dec2 (host=vc0336.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27543840 PerHostPeakMemUsage: 2198988040 PrepareTime: 180894648 RowsProduced: 0 TotalCpuTime: 460094581 TotalNetworkReceiveTime: 1861477686182 TotalNetworkSendTime: 345 TotalStorageWaitTime: 0 TotalTime: 1861662180831 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 550 BlocksRecycled: 1008 BufferedPins: 146 BytesWritten: 1853882368 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2047346688 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 50801362448 TotalTime: 0 CodeGen CodegenTime: 4217388 CompileTime: 23484879 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 249169916 PrepareTime: 174183335 TotalTime: 448588033 DataStreamSender (dst_id=21) BytesSent: 0 InactiveTotalTime: 0 NetworkThroughput(*): 0 OverallThroughput: 0 PeakMemoryUsage: 2336 SerializeBatchTime: 0 ThriftTransmitTime(*): 0 TotalTime: 12270 UncompressedRowBatchSize: 0 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1590 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25174016 RowsReturned: 0 RowsReturnedRate: 0 SortDataSize: 0 TotalMergesPerformed: 0 TotalTime: 1861659911859 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 7538 GetNewBlockTime: 87260 GetResultsTime: 0 HTResizeTime: 4280 HashBuckets: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2367488 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861658934987 UnpinTime: 1797 EXCHANGE_NODE (id=19) BytesReceived: 0 ConvertRowBatchTime: 702 DeserializeRowBatchTimer: 0 FirstBatchArrivalWaitTime: 1861477682623 InactiveTotalTime: 1861477683417 PeakMemoryUsage: 0 RowsReturned: 0 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861477689209 Instance c441d45ac6132d78:99a92025da50debe (host=vc0706.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27568432 PerHostPeakMemUsage: 2297960808 PrepareTime: 186896062 RowsProduced: 1 TotalCpuTime: 472637218 TotalNetworkReceiveTime: 1861465490668 TotalNetworkSendTime: 138383 TotalStorageWaitTime: 0 TotalTime: 1861656208811 CodeGen CodegenTime: 2344220 CompileTime: 29409300 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 244878625 PrepareTime: 182242937 TotalTime: 458286371 DataStreamSender (dst_id=21) BytesSent: 68 InactiveTotalTime: 0 NetworkThroughput(*): 590093 OverallThroughput: 1895311 PeakMemoryUsage: 2336 SerializeBatchTime: 16935 ThriftTransmitTime(*): 115236 TotalTime: 35878 UncompressedRowBatchSize: 77 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1256 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25182208 RowsReturned: 1 RowsReturnedRate: 0 SortDataSize: 69 TotalMergesPerformed: 0 TotalTime: 1861653482301 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 17039 GetNewBlockTime: 49397 GetResultsTime: 2146 HTResizeTime: 3211 HashBuckets: 1024 InactiveTotalTime: 0 LargestPartitionPercent: 16 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2392064 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 1 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861652799180 UnpinTime: 767 EXCHANGE_NODE (id=19) BytesReceived: 408 ConvertRowBatchTime: 11282 DeserializeRowBatchTimer: 97138 FirstBatchArrivalWaitTime: 1788898270575 InactiveTotalTime: 1861465462272 PeakMemoryUsage: 0 RowsReturned: 6 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861465522916 Instance c441d45ac6132d78:99a92025da50dec0 (host=vc0718.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27568432 PerHostPeakMemUsage: 2366311440 PrepareTime: 195639427 RowsProduced: 1 TotalCpuTime: 503483325 TotalNetworkReceiveTime: 1861442365508 TotalNetworkSendTime: 193910 TotalStorageWaitTime: 0 TotalTime: 1861653752014 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 575 BlocksRecycled: 1056 BufferedPins: 174 BytesWritten: 1811939328 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2206730240 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 35596417097 TotalTime: 0 CodeGen CodegenTime: 2510543 CompileTime: 35068550 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 253980148 PrepareTime: 191337998 TotalTime: 481612815 DataStreamSender (dst_id=21) BytesSent: 68 InactiveTotalTime: 0 NetworkThroughput(*): 407646 OverallThroughput: 981396 PeakMemoryUsage: 2336 SerializeBatchTime: 31760 ThriftTransmitTime(*): 166811 TotalTime: 69289 UncompressedRowBatchSize: 77 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1787 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25182208 RowsReturned: 1 RowsReturnedRate: 0 SortDataSize: 69 TotalMergesPerformed: 0 TotalTime: 1861651389619 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 45338 GetNewBlockTime: 50897 GetResultsTime: 1838 HTResizeTime: 6815 HashBuckets: 1024 InactiveTotalTime: 0 LargestPartitionPercent: 16 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2392064 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 1 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861639114131 UnpinTime: 760 EXCHANGE_NODE (id=19) BytesReceived: 407 ConvertRowBatchTime: 13655 DeserializeRowBatchTimer: 72082 FirstBatchArrivalWaitTime: 1788872928757 InactiveTotalTime: 1861442323125 PeakMemoryUsage: 0 RowsReturned: 6 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861442402509 Instance c441d45ac6132d78:99a92025da50dec1 (host=vc0712.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27568432 PerHostPeakMemUsage: 2394107736 PrepareTime: 311139212 RowsProduced: 1 TotalCpuTime: 782877959 TotalNetworkReceiveTime: 1861160766083 TotalNetworkSendTime: 142599 TotalStorageWaitTime: 0 TotalTime: 1861481909319 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 299 BlocksRecycled: 88 BufferedPins: 0 BytesWritten: 0 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2206730240 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 0 TotalTime: 0 CodeGen CodegenTime: 4595504 CompileTime: 39128409 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 419603566 PrepareTime: 297458687 TotalTime: 758400410 DataStreamSender (dst_id=21) BytesSent: 68 InactiveTotalTime: 0 NetworkThroughput(*): 555088 OverallThroughput: 991701 PeakMemoryUsage: 2336 SerializeBatchTime: 23427 ThriftTransmitTime(*): 122503 TotalTime: 68569 UncompressedRowBatchSize: 77 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 1157 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25182208 RowsReturned: 1 RowsReturnedRate: 0 SortDataSize: 69 TotalMergesPerformed: 0 TotalTime: 1861476812092 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 38379 GetNewBlockTime: 5040203 GetResultsTime: 3261 HTResizeTime: 4263 HashBuckets: 1024 InactiveTotalTime: 0 LargestPartitionPercent: 16 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2392064 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 1 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1861474633588 UnpinTime: 1548 EXCHANGE_NODE (id=19) BytesReceived: 408 ConvertRowBatchTime: 18063 DeserializeRowBatchTimer: 43645 FirstBatchArrivalWaitTime: 1788591265124 InactiveTotalTime: 1861160728164 PeakMemoryUsage: 0 RowsReturned: 6 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1861160807194 Instance c441d45ac6132d78:99a92025da50debc (host=vc0704.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 27543840 PerHostPeakMemUsage: 2356016368 PrepareTime: 77886240873 RowsProduced: 0 TotalCpuTime: 82024005980 TotalNetworkReceiveTime: 1779726701776 TotalNetworkSendTime: 223 TotalStorageWaitTime: 0 TotalTime: 1858106064283 BlockMgr BlockWritesOutstanding: 0 BlocksCreated: 473 BlocksRecycled: 822 BufferedPins: 135 BytesWritten: 1266679808 InactiveTotalTime: 0 MaxBlockSize: 8388608 MemoryLimit: 4899786240 PeakMemoryUsage: 2189950976 TotalBufferWaitTime: 0 TotalEncryptionTime: 0 TotalIntegrityCheckTime: 0 TotalReadBlockTime: 23064595622 TotalTime: 0 CodeGen CodegenTime: 4879570 CompileTime: 565045837 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 2936831873 PrepareTime: 76377524077 TotalTime: 81371446711 DataStreamSender (dst_id=21) BytesSent: 0 InactiveTotalTime: 0 NetworkThroughput(*): 0 OverallThroughput: 0 PeakMemoryUsage: 2336 SerializeBatchTime: 0 ThriftTransmitTime(*): 0 TotalTime: 15474 UncompressedRowBatchSize: 0 SORT_NODE (id=12) ExecOption: Codegen Enabled InMemorySortTime: 998 InactiveTotalTime: 0 InitialRunsCreated: 1 PeakMemoryUsage: 25174016 RowsReturned: 0 RowsReturnedRate: 0 SortDataSize: 0 TotalMergesPerformed: 0 TotalTime: 1857614418050 AGGREGATION_NODE (id=20) ExecOption: Codegen Enabled BuildTime: 5310 GetNewBlockTime: 74037 GetResultsTime: 0 HTResizeTime: 2851 HashBuckets: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2367488 PinTime: 0 RowsRepartitioned: 0 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1857613437400 UnpinTime: 932 EXCHANGE_NODE (id=19) BytesReceived: 0 ConvertRowBatchTime: 416 DeserializeRowBatchTimer: 0 FirstBatchArrivalWaitTime: 1779726699747 InactiveTotalTime: 1779726700179 PeakMemoryUsage: 0 RowsReturned: 0 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1779726703684 Fragment F03 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dec9 (host=vc0336.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1402507544 PerHostPeakMemUsage: 2198988040 PrepareTime: 209827097 RowsProduced: 4 TotalCpuTime: 1212246666729 TotalNetworkReceiveTime: 649686333046 TotalNetworkSendTime: 736691 TotalStorageWaitTime: 0 TotalTime: 1861341232392 CodeGen CodegenTime: 2877367 CompileTime: 215840962 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 368082483 PrepareTime: 193326727 TotalTime: 779931116 DataStreamSender (dst_id=19) BytesSent: 272 InactiveTotalTime: 0 NetworkThroughput(*): 434084 OverallThroughput: 7378071 PeakMemoryUsage: 32736 SerializeBatchTime: 48054 ThriftTransmitTime(*): 626606 TotalTime: 36866 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 30899 GetResultsTime: 5415 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 10498704 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 460778142 TotalTime: 1861333962215 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 29968093 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 17783 GetNewBlockTime: 45018 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2551724371 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2154752 PinTime: 0 ProbeRows: 26021808 ProbeRowsPartitioned: 0 ProbeTime: 2423107673 RowsReturned: 82955 RowsReturnedRate: 44 SpilledPartitions: 0 TotalTime: 1860664206496 UnpinTime: 810 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 1115 DeserializeRowBatchTimer: 12108 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 77842635915 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 77842646613 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 6206 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 9402 GetNewBlockTime: 54634 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 1603681765 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2146560 PinTime: 0 ProbeRows: 26021808 ProbeRowsPartitioned: 0 ProbeTime: 1527942143 RowsReturned: 26021808 RowsReturnedRate: 14616 SpilledPartitions: 0 TotalTime: 1780269835512 UnpinTime: 1083 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 1951 DeserializeRowBatchTimer: 7963 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 3212128 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 7783 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 1088410067890 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 2499471773 GetNewBlockTime: 4596028 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 1101498262033 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950050816 PinTime: 0 ProbeRows: 26021808 ProbeRowsPartitioned: 0 ProbeTime: 5649265083 RowsReturned: 26021808 RowsReturnedRate: 14629 SpilledPartitions: 0 TotalTime: 1778666145964 UnpinTime: 859 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 395620940 DeserializeRowBatchTimer: 1091486022637 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 172734281796 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 85177 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 176103513410 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Spilled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 7139118703 BuildRows: 21430224 BuildRowsPartitioned: 40181368 BuildTime: 3539261243 GetNewBlockTime: 4224262611 HashBuckets: 37748736 HashCollisions: 6371 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 82809800677 MaxPartitionLevel: 1 NumRepartitions: 15 PartitionsCreated: 240 PeakMemoryUsage: 429940736 PinTime: 50803580789 ProbeRows: 26021808 ProbeRowsPartitioned: 22867045 ProbeTime: 19612787734 RowsReturned: 26021808 RowsReturnedRate: 51933 SpilledPartitions: 15 TotalTime: 501064370521 UnpinTime: 96328270 EXCHANGE_NODE (id=15) BytesReceived: 399072583 ConvertRowBatchTime: 651494153 DeserializeRowBatchTimer: 16688948965 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 71950491109 PeakMemoryUsage: 0 RowsReturned: 21430224 RowsReturnedRate: 290840 SendersBlockedTimer: 1144277746995 SendersBlockedTotalTimer(*): 6866246365387 TotalTime: 73683805432 EXCHANGE_NODE (id=14) BytesReceived: 1334119657 ConvertRowBatchTime: 21084200643 DeserializeRowBatchTimer: 73835652802 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 318444797540 PeakMemoryUsage: 0 RowsReturned: 26021808 RowsReturnedRate: 75519 SendersBlockedTimer: 1220298556554 SendersBlockedTotalTimer(*): 3660895068486 TotalTime: 344570764412 Instance c441d45ac6132d78:99a92025da50dec7 (host=vc0718.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1318629656 PerHostPeakMemUsage: 2366311440 PrepareTime: 203508814 RowsProduced: 4 TotalCpuTime: 87066760406 TotalNetworkReceiveTime: 1758301287271 TotalNetworkSendTime: 90368638 TotalStorageWaitTime: 0 TotalTime: 1844702315175 CodeGen CodegenTime: 3027521 CompileTime: 198651950 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 413748493 PrepareTime: 187663454 TotalTime: 801554395 DataStreamSender (dst_id=19) BytesSent: 272 InactiveTotalTime: 0 NetworkThroughput(*): 3016 OverallThroughput: 3967327 PeakMemoryUsage: 32736 SerializeBatchTime: 60440 ThriftTransmitTime(*): 90175634 TotalTime: 68560 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 33394 GetResultsTime: 5138 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 13367312 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 340532843 TotalTime: 1844688890342 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 4762 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 5181 GetNewBlockTime: 55139 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2507672750 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 4747248 PinTime: 0 ProbeRows: 26025149 ProbeRowsPartitioned: 0 ProbeTime: 2414506829 RowsReturned: 83365 RowsReturnedRate: 45 SpilledPartitions: 0 TotalTime: 1844150404090 UnpinTime: 769 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 1287 DeserializeRowBatchTimer: 7385 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 4248810 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 5884 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 12711 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 20473 GetNewBlockTime: 26105 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 1602550874 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 3270256 PinTime: 0 ProbeRows: 26025149 ProbeRowsPartitioned: 0 ProbeTime: 1495379574 RowsReturned: 26025149 RowsReturnedRate: 14131 SpilledPartitions: 0 TotalTime: 1841642725456 UnpinTime: 617 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 950 DeserializeRowBatchTimer: 10130 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 78062009203 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 78062018266 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 6980486927 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 2339737821 GetNewBlockTime: 7471374 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 15766721849 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950840216 PinTime: 0 ProbeRows: 26025149 ProbeRowsPartitioned: 0 ProbeTime: 5738186734 RowsReturned: 26025149 RowsReturnedRate: 14770 SpilledPartitions: 0 TotalTime: 1761978156316 UnpinTime: 1039 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 476602545 DeserializeRowBatchTimer: 8747177872 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 1255361583392 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 11930 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1257258838106 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Spilled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 8121169122 BuildRows: 21433482 BuildRowsPartitioned: 41529301 BuildTime: 2962991516 GetNewBlockTime: 66458275 HashBuckets: 33554432 HashCollisions: 7214 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 63462708809 MaxPartitionLevel: 1 NumRepartitions: 15 PartitionsCreated: 256 PeakMemoryUsage: 346062848 PinTime: 35599066372 ProbeRows: 26025149 ProbeRowsPartitioned: 24399096 ProbeTime: 15145427851 RowsReturned: 26025149 RowsReturnedRate: 53226 SpilledPartitions: 15 TotalTime: 488952596361 UnpinTime: 122281876 EXCHANGE_NODE (id=15) BytesReceived: 399115919 ConvertRowBatchTime: 651495120 DeserializeRowBatchTimer: 16668933449 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 71246476409 PeakMemoryUsage: 0 RowsReturned: 21433482 RowsReturnedRate: 292218 SendersBlockedTimer: 1143849106793 SendersBlockedTotalTimer(*): 6863248417821 TotalTime: 73347380479 EXCHANGE_NODE (id=14) BytesReceived: 1334344982 ConvertRowBatchTime: 1002508494 DeserializeRowBatchTimer: 57843747556 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 345913907865 PeakMemoryUsage: 0 RowsReturned: 26025149 RowsReturnedRate: 73905 SendersBlockedTimer: 1219226742188 SendersBlockedTotalTimer(*): 2438447653571 TotalTime: 352142507073 Instance c441d45ac6132d78:99a92025da50dec4 (host=vc0714.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1402507544 PerHostPeakMemUsage: 2232741352 PrepareTime: 193620823 RowsProduced: 4 TotalCpuTime: 81359876203 TotalNetworkReceiveTime: 1760201401142 TotalNetworkSendTime: 10613055 TotalStorageWaitTime: 0 TotalTime: 1840944959231 CodeGen CodegenTime: 2675845 CompileTime: 194559541 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 382743625 PrepareTime: 179175833 TotalTime: 757760722 DataStreamSender (dst_id=19) BytesSent: 272 InactiveTotalTime: 0 NetworkThroughput(*): 25920 OverallThroughput: 7325415 PeakMemoryUsage: 32736 SerializeBatchTime: 38306 ThriftTransmitTime(*): 10493814 TotalTime: 37131 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 24744 GetResultsTime: 4646 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 10576592 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 289084056 TotalTime: 1840934205673 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 4726 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 5199 GetNewBlockTime: 32845 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2664242357 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2272744 PinTime: 0 ProbeRows: 26025222 ProbeRowsPartitioned: 0 ProbeTime: 2568734134 RowsReturned: 83536 RowsReturnedRate: 45 SpilledPartitions: 0 TotalTime: 1840455823040 UnpinTime: 700 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 1146 DeserializeRowBatchTimer: 13244 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 3870568 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 6459 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 4030 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 2816 GetNewBlockTime: 23286 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 1824365755 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2146560 PinTime: 0 ProbeRows: 26025222 ProbeRowsPartitioned: 0 ProbeTime: 1746424128 RowsReturned: 26025222 RowsReturnedRate: 14161 SpilledPartitions: 0 TotalTime: 1837791574224 UnpinTime: 565 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 1113 DeserializeRowBatchTimer: 10301 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 4980079 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 5020 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 4994361623 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 2018470598 GetNewBlockTime: 6258261 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 13044364812 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950050816 PinTime: 0 ProbeRows: 26025222 ProbeRowsPartitioned: 0 ProbeTime: 5408200094 RowsReturned: 26025222 RowsReturnedRate: 14175 SpilledPartitions: 0 TotalTime: 1835967203449 UnpinTime: 956 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 418929824 DeserializeRowBatchTimer: 7855106380 FirstBatchArrivalWaitTime: 239318445 InactiveTotalTime: 1335670531440 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 11215 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1337413389505 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Spilled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 6785169085 BuildRows: 21430425 BuildRowsPartitioned: 38841187 BuildTime: 4015810694 GetNewBlockTime: 1357014683 HashBuckets: 37748736 HashCollisions: 5580 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 60295609028 MaxPartitionLevel: 1 NumRepartitions: 14 PartitionsCreated: 224 PeakMemoryUsage: 429940736 PinTime: 34212089036 ProbeRows: 26025222 ProbeRowsPartitioned: 22774335 ProbeTime: 13707176250 RowsReturned: 26025222 RowsReturnedRate: 53603 SpilledPartitions: 14 TotalTime: 485509449132 UnpinTime: 96285764 EXCHANGE_NODE (id=15) BytesReceived: 399076011 ConvertRowBatchTime: 665773763 DeserializeRowBatchTimer: 14676648524 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 73003679910 PeakMemoryUsage: 0 RowsReturned: 21430425 RowsReturnedRate: 286591 SendersBlockedTimer: 1143485154242 SendersBlockedTotalTimer(*): 6861075787132 TotalTime: 74776967581 EXCHANGE_NODE (id=14) BytesReceived: 1334320360 ConvertRowBatchTime: 954006122 DeserializeRowBatchTimer: 53086009833 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 344778958816 PeakMemoryUsage: 0 RowsReturned: 26025222 RowsReturnedRate: 74265 SendersBlockedTimer: 1220420480230 SendersBlockedTotalTimer(*): 7322521284371 TotalTime: 350436872523 Instance c441d45ac6132d78:99a92025da50dec6 (host=vc0708.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1352184088 PerHostPeakMemUsage: 2282205368 PrepareTime: 222403376 RowsProduced: 4 TotalCpuTime: 79604704171 TotalNetworkReceiveTime: 1760187287557 TotalNetworkSendTime: 930908 TotalStorageWaitTime: 0 TotalTime: 1839234101593 CodeGen CodegenTime: 3575599 CompileTime: 196385707 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 357883280 PrepareTime: 206931256 TotalTime: 762799671 DataStreamSender (dst_id=19) BytesSent: 272 InactiveTotalTime: 0 NetworkThroughput(*): 318706 OverallThroughput: 6427069 PeakMemoryUsage: 32736 SerializeBatchTime: 46884 ThriftTransmitTime(*): 853450 TotalTime: 42321 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 34981 GetResultsTime: 9363 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 10484792 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 440699715 TotalTime: 1839222721451 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 5165 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 5739 GetNewBlockTime: 37728 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2564143015 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2154752 PinTime: 0 ProbeRows: 26026898 ProbeRowsPartitioned: 0 ProbeTime: 2470334075 RowsReturned: 83048 RowsReturnedRate: 45 SpilledPartitions: 0 TotalTime: 1838493544596 UnpinTime: 774 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 1045 DeserializeRowBatchTimer: 6927 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 3953194 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 6324 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 3875 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 3084 GetNewBlockTime: 24764 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 1699286037 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2146560 PinTime: 0 ProbeRows: 26026898 ProbeRowsPartitioned: 0 ProbeTime: 1636165996 RowsReturned: 26026898 RowsReturnedRate: 14176 SpilledPartitions: 0 TotalTime: 1835929395257 UnpinTime: 613 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 1127 DeserializeRowBatchTimer: 7908 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 5387931 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 4640 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 5015655233 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 1836059203 GetNewBlockTime: 4230213 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 12746136069 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950050816 PinTime: 0 ProbeRows: 26026898 ProbeRowsPartitioned: 0 ProbeTime: 5324306111 RowsReturned: 26026898 RowsReturnedRate: 14189 SpilledPartitions: 0 TotalTime: 1834230104580 UnpinTime: 654 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 436435839 DeserializeRowBatchTimer: 8264481736 FirstBatchArrivalWaitTime: 233367178 InactiveTotalTime: 1335289540050 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 11215 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1337394635529 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Spilled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 6313646035 BuildRows: 21436939 BuildRowsPartitioned: 25455985 BuildTime: 3964942934 GetNewBlockTime: 1260124357 HashBuckets: 33554432 HashCollisions: 1359 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 58965446460 MaxPartitionLevel: 1 NumRepartitions: 14 PartitionsCreated: 64 PeakMemoryUsage: 387968592 PinTime: 34722890650 ProbeRows: 26026898 ProbeRowsPartitioned: 22774606 ProbeTime: 12601427777 RowsReturned: 26026898 RowsReturnedRate: 53764 SpilledPartitions: 14 TotalTime: 484089332982 UnpinTime: 188845260 EXCHANGE_NODE (id=15) BytesReceived: 399182321 ConvertRowBatchTime: 638525510 DeserializeRowBatchTimer: 17007052602 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 72375823768 PeakMemoryUsage: 0 RowsReturned: 21436939 RowsReturnedRate: 288310 SendersBlockedTimer: 1143261718414 SendersBlockedTotalTimer(*): 6859544076952 TotalTime: 74353701541 EXCHANGE_NODE (id=14) BytesReceived: 1334343887 ConvertRowBatchTime: 930263867 DeserializeRowBatchTimer: 58391996655 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 344645584393 PeakMemoryUsage: 0 RowsReturned: 26026898 RowsReturnedRate: 74199 SendersBlockedTimer: 1219577362697 SendersBlockedTotalTimer(*): 7317436279255 TotalTime: 350770184981 Instance c441d45ac6132d78:99a92025da50dec5 (host=vc0706.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1301852440 PerHostPeakMemUsage: 2297960808 PrepareTime: 193751056 RowsProduced: 4 TotalCpuTime: 85426841206 TotalNetworkReceiveTime: 1752526731636 TotalNetworkSendTime: 795276 TotalStorageWaitTime: 0 TotalTime: 1837321671892 CodeGen CodegenTime: 2814395 CompileTime: 215867612 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 410889990 PrepareTime: 177582590 TotalTime: 806322685 DataStreamSender (dst_id=19) BytesSent: 271 InactiveTotalTime: 0 NetworkThroughput(*): 397042 OverallThroughput: 7178617 PeakMemoryUsage: 32736 SerializeBatchTime: 53726 ThriftTransmitTime(*): 682546 TotalTime: 37751 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 28090 GetResultsTime: 4774 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 11310992 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 426776257 TotalTime: 1837311523021 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 4605 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 16796 GetNewBlockTime: 41987 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2634812625 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 3714504 PinTime: 0 ProbeRows: 25994172 ProbeRowsPartitioned: 0 ProbeTime: 2548431044 RowsReturned: 83546 RowsReturnedRate: 45 SpilledPartitions: 0 TotalTime: 1836696090623 UnpinTime: 864 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 1635 DeserializeRowBatchTimer: 10437 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 3911750 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 6391 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 10966 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 12461 GetNewBlockTime: 22194 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 1749396974 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2512912 PinTime: 0 ProbeRows: 25994172 ProbeRowsPartitioned: 0 ProbeTime: 1681903906 RowsReturned: 25994172 RowsReturnedRate: 14173 SpilledPartitions: 0 TotalTime: 1834061271607 UnpinTime: 600 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 1166 DeserializeRowBatchTimer: 7152 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 77810304463 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 77810312584 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 5495245909 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 2545815069 GetNewBlockTime: 6434973 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 14051793766 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950840216 PinTime: 0 ProbeRows: 25994172 ProbeRowsPartitioned: 0 ProbeTime: 5300086269 RowsReturned: 25994172 RowsReturnedRate: 14815 SpilledPartitions: 0 TotalTime: 1754501562049 UnpinTime: 1170 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 443227759 DeserializeRowBatchTimer: 7065211290 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 1256947006136 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 11914 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1258985805949 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Spilled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 7656393591 BuildRows: 21423792 BuildRowsPartitioned: 34813449 BuildTime: 3452072185 GetNewBlockTime: 695177732 HashBuckets: 33554432 HashCollisions: 4503 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 55932378246 MaxPartitionLevel: 1 NumRepartitions: 15 PartitionsCreated: 176 PeakMemoryUsage: 337702480 PinTime: 29376206357 ProbeRows: 25994172 ProbeRowsPartitioned: 24368628 ProbeTime: 13929109101 RowsReturned: 25994172 RowsReturnedRate: 53989 SpilledPartitions: 15 TotalTime: 481463962334 UnpinTime: 113912619 EXCHANGE_NODE (id=15) BytesReceived: 398943538 ConvertRowBatchTime: 644317527 DeserializeRowBatchTimer: 16181361418 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 71096687170 PeakMemoryUsage: 0 RowsReturned: 21423792 RowsReturnedRate: 293010 SendersBlockedTimer: 1144035975749 SendersBlockedTotalTimer(*): 5721074113220 TotalTime: 73116069275 EXCHANGE_NODE (id=14) BytesReceived: 1332728848 ConvertRowBatchTime: 8379954452 DeserializeRowBatchTimer: 67820316965 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 339252110509 PeakMemoryUsage: 0 RowsReturned: 25994172 RowsReturnedRate: 73760 SendersBlockedTimer: 1219165685941 SendersBlockedTotalTimer(*): 2438330888186 TotalTime: 352415514813 Instance c441d45ac6132d78:99a92025da50dec3 (host=vc0704.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 1653647640 PerHostPeakMemUsage: 2356016368 PrepareTime: 77915395815 RowsProduced: 0 TotalCpuTime: 150811261220 TotalNetworkReceiveTime: 1673163128745 TotalNetworkSendTime: 1564 TotalStorageWaitTime: 0 TotalTime: 1816992865630 CodeGen CodegenTime: 5221791 CompileTime: 1819007814 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 4645558060 PrepareTime: 77754051792 TotalTime: 84220739093 DataStreamSender (dst_id=19) BytesSent: 0 InactiveTotalTime: 0 NetworkThroughput(*): 0 OverallThroughput: 0 PeakMemoryUsage: 16352 SerializeBatchTime: 0 ThriftTransmitTime(*): 0 TotalTime: 50424 UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 29857 GetResultsTime: 0 HTResizeTime: 0 HashBuckets: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 1359872 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 0 RowsReturnedRate: 0 StreamingTime: 1418 TotalTime: 1816721334409 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 768 BuildRows: 0 BuildRowsPartitioned: 0 BuildTime: 0 GetNewBlockTime: 151700 HashBuckets: 0 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 LocalTime: 546461993 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 8798680 PinTime: 0 ProbeRows: 0 ProbeRowsPartitioned: 0 ProbeTime: 624 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1739103268836 UnpinTime: 1196 EXCHANGE_NODE (id=18) BytesReceived: 0 ConvertRowBatchTime: 788 DeserializeRowBatchTimer: 0 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 0 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 4248 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 779 BuildRows: 0 BuildRowsPartitioned: 0 BuildTime: 0 GetNewBlockTime: 830628 HashBuckets: 0 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 0 LocalTime: 895156285 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2138112 PinTime: 0 ProbeRows: 26004950 ProbeRowsPartitioned: 0 ProbeTime: 783547741 RowsReturned: 0 RowsReturnedRate: 0 SpilledPartitions: 0 TotalTime: 1738556802595 UnpinTime: 1057 EXCHANGE_NODE (id=17) BytesReceived: 0 ConvertRowBatchTime: 609 DeserializeRowBatchTimer: 0 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 0 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 3392 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 5765623474 BuildRows: 14994880 BuildRowsPartitioned: 14994880 BuildTime: 2094688085 GetNewBlockTime: 4105662 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 14481297426 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950050816 PinTime: 0 ProbeRows: 26014206 ProbeRowsPartitioned: 0 ProbeTime: 5972207066 RowsReturned: 26004950 RowsReturnedRate: 14965 SpilledPartitions: 0 TotalTime: 1737661642918 UnpinTime: 1091 EXCHANGE_NODE (id=16) BytesReceived: 222127985 ConvertRowBatchTime: 445294306 DeserializeRowBatchTimer: 9088568351 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 1250351818711 PeakMemoryUsage: 0 RowsReturned: 14994880 RowsReturnedRate: 11978 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1251816213490 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High), Spilled BuildPartitionTime: 7015496949 BuildRows: 21419354 BuildRowsPartitioned: 36141706 BuildTime: 3156225297 GetNewBlockTime: 60806593 HashBuckets: 33554432 HashCollisions: 4689 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 47562297168 MaxPartitionLevel: 1 NumRepartitions: 11 PartitionsCreated: 192 PeakMemoryUsage: 681607168 PinTime: 23066577349 ProbeRows: 26019171 ProbeRowsPartitioned: 17875150 ProbeTime: 12640289451 RowsReturned: 26014206 RowsReturnedRate: 55189 SpilledPartitions: 11 TotalTime: 471364132002 UnpinTime: 157471131 EXCHANGE_NODE (id=15) BytesReceived: 398886081 ConvertRowBatchTime: 673360542 DeserializeRowBatchTimer: 15207043623 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 72605909609 PeakMemoryUsage: 0 RowsReturned: 21419354 RowsReturnedRate: 288065 SendersBlockedTimer: 1143255466941 SendersBlockedTotalTimer(*): 2286644980536 TotalTime: 74355752196 EXCHANGE_NODE (id=14) BytesReceived: 1334053540 ConvertRowBatchTime: 967846541 DeserializeRowBatchTimer: 52065789207 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 343308963625 PeakMemoryUsage: 0 RowsReturned: 26019171 RowsReturnedRate: 74458 SendersBlockedTimer: 1220534382608 SendersBlockedTotalTimer(*): 8543736771471 TotalTime: 349446082638 Instance c441d45ac6132d78:99a92025da50dec8 (host=vc0712.halxg.cloudera.com:22000) AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 3145728 InactiveTotalTime: 0 PeakMemoryUsage: 2056827160 PerHostPeakMemUsage: 2394107736 PrepareTime: 288238669 RowsProduced: 4 TotalCpuTime: 54525857069 TotalNetworkReceiveTime: 1734840323669 TotalNetworkSendTime: 926940 TotalStorageWaitTime: 0 TotalTime: 1788199916066 CodeGen CodegenTime: 4943334 CompileTime: 398474716 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 758073530 PrepareTime: 261821605 TotalTime: 1420524176 DataStreamSender (dst_id=19) BytesSent: 272 InactiveTotalTime: 0 NetworkThroughput(*): 351847 OverallThroughput: 3975736 PeakMemoryUsage: 32736 SerializeBatchTime: 51551 ThriftTransmitTime(*): 773063 TotalTime: 68415 UncompressedRowBatchSize: 308 AGGREGATION_NODE (id=11) ExecOption: Streaming Preaggregation, Codegen Enabled GetNewBlockTime: 2311728 GetResultsTime: 7990 HTResizeTime: 0 HashBuckets: 3072 InactiveTotalTime: 0 LargestPartitionPercent: 0 PartitionsCreated: 16 PeakMemoryUsage: 9842192 PinTime: 0 ReductionFactorEstimate: 0 ReductionFactorThresholdToExpand: 0 RowsPassedThrough: 0 RowsReturned: 4 RowsReturnedRate: 0 StreamingTime: 485839691 TotalTime: 1788177470069 UnpinTime: 0 HASH_JOIN_NODE (id=10) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 7621 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 10768 GetNewBlockTime: 74928 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 4666268697 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2154752 PinTime: 0 ProbeRows: 26002859 ProbeRowsPartitioned: 0 ProbeTime: 4350538804 RowsReturned: 83313 RowsReturnedRate: 46 SpilledPartitions: 0 TotalTime: 1787407565130 UnpinTime: 1372 EXCHANGE_NODE (id=18) BytesReceived: 754 ConvertRowBatchTime: 2189 DeserializeRowBatchTimer: 7733 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 0 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 1748374 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 14299 HASH_JOIN_NODE (id=9) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 9773 BuildRows: 25 BuildRowsPartitioned: 25 BuildTime: 11484 GetNewBlockTime: 53681 HashBuckets: 64 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 28 LocalTime: 2791200136 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 2146560 PinTime: 0 ProbeRows: 26002859 ProbeRowsPartitioned: 0 ProbeTime: 2605229702 RowsReturned: 26002859 RowsReturnedRate: 14585 SpilledPartitions: 0 TotalTime: 1782741282134 UnpinTime: 1359 EXCHANGE_NODE (id=17) BytesReceived: 760 ConvertRowBatchTime: 1531 DeserializeRowBatchTimer: 15887 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 77165510111 PeakMemoryUsage: 0 RowsReturned: 25 RowsReturnedRate: 0 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 77165520153 HASH_JOIN_NODE (id=8) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 4972564178 BuildRows: 15000000 BuildRowsPartitioned: 15000000 BuildTime: 2752413887 GetNewBlockTime: 6197526 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 17243960868 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 950050816 PinTime: 0 ProbeRows: 26002859 ProbeRowsPartitioned: 0 ProbeTime: 8668927291 RowsReturned: 26002859 RowsReturnedRate: 15270 SpilledPartitions: 0 TotalTime: 1702784561845 UnpinTime: 700 EXCHANGE_NODE (id=16) BytesReceived: 222200147 ConvertRowBatchTime: 567234767 DeserializeRowBatchTimer: 7962170020 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 1257849617363 PeakMemoryUsage: 0 RowsReturned: 15000000 RowsReturnedRate: 11908 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 1259566668291 HASH_JOIN_NODE (id=7) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Disabled (FP Rate Too High) BuildPartitionTime: 4855151954 BuildRows: 21421692 BuildRowsPartitioned: 21421692 BuildTime: 3730642696 GetNewBlockTime: 5596947 HashBuckets: 33554432 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 18192605099 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 1084260352 PinTime: 0 ProbeRows: 26002859 ProbeRowsPartitioned: 0 ProbeTime: 8664494191 RowsReturned: 26002859 RowsReturnedRate: 61043 SpilledPartitions: 0 TotalTime: 425973932686 UnpinTime: 781 EXCHANGE_NODE (id=15) BytesReceived: 398904714 ConvertRowBatchTime: 631597735 DeserializeRowBatchTimer: 15270599963 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 72697104613 PeakMemoryUsage: 0 RowsReturned: 21421692 RowsReturnedRate: 287669 SendersBlockedTimer: 1144307103854 SendersBlockedTotalTimer(*): 6866878478143 TotalTime: 74466407867 EXCHANGE_NODE (id=14) BytesReceived: 1333223986 ConvertRowBatchTime: 8091439740 DeserializeRowBatchTimer: 59860770235 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 315633513806 PeakMemoryUsage: 0 RowsReturned: 26002859 RowsReturnedRate: 78012 SendersBlockedTimer: 1223302354940 SendersBlockedTotalTimer(*): 1241025344010 TotalTime: 333314919720 Fragment F06 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50deca (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 8:1/2.18 KB AverageThreadTokens: 4607211104147962443 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 96256 PerHostPeakMemUsage: 140150776 PrepareTime: 135743 RowsProduced: 25 TotalCpuTime: 2862571324 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 75785587051 TotalStorageWaitTime: 9086543 TotalTime: 43672590 DataStreamSender (dst_id=18) BytesSent: 5278 InactiveTotalTime: 0 NetworkThroughput(*): 68 OverallThroughput: 58599518 PeakMemoryUsage: 28672 SerializeBatchTime: 27289 ThriftTransmitTime(*): 76758223283 TotalTime: 90069 UncompressedRowBatchSize: 7567 HDFS_SCAN_NODE (id=5) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 8:1/2.18 KB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607182418800017408 BytesRead: 2720 BytesReadDataNodeCache: 0 BytesReadLocal: 2720 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 2720 DecompressionTime: 4673 InactiveTotalTime: 0 MaterializeTupleTime(*): 10975 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 59392 PerReadThreadRawHdfsThroughput: 100729548 RemoteScanRanges: 0 RowsRead: 25 RowsReturned: 25 RowsReturnedRate: 1501 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 0 ScannerThreadsSysTime: 0 ScannerThreadsTotalWallClockTime: 10213293 ScannerThreadsUserTime: 0 ScannerThreadsVoluntaryContextSwitches: 6 TotalRawHdfsReadTime(*): 27003 TotalReadThroughput: 0 TotalTime: 16652318 Fragment F05 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50decb (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 8:1/2.18 KB AverageThreadTokens: 4607182418800017408 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 96256 PerHostPeakMemUsage: 140150776 PrepareTime: 132990 RowsProduced: 25 TotalCpuTime: 1588509495 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 77345305245 TotalStorageWaitTime: 4505614 TotalTime: 43324325 DataStreamSender (dst_id=17) BytesSent: 5320 InactiveTotalTime: 0 NetworkThroughput(*): 67 OverallThroughput: 42970453 PeakMemoryUsage: 28672 SerializeBatchTime: 41642 ThriftTransmitTime(*): 78295935000 TotalTime: 123806 UncompressedRowBatchSize: 7567 HDFS_SCAN_NODE (id=4) Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 8:1/2.18 KB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 0 BytesRead: 2720 BytesReadDataNodeCache: 0 BytesReadLocal: 2720 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 2720 DecompressionTime: 3973 InactiveTotalTime: 0 MaterializeTupleTime(*): 9315 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 59392 PerReadThreadRawHdfsThroughput: 93096484 RemoteScanRanges: 0 RowsRead: 25 RowsReturned: 25 RowsReturnedRate: 4500 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 1 ScannerThreadsSysTime: 0 ScannerThreadsTotalWallClockTime: 4836039 ScannerThreadsUserTime: 0 ScannerThreadsVoluntaryContextSwitches: 9 TotalRawHdfsReadTime(*): 29217 TotalReadThroughput: 0 TotalTime: 5555310 Fragment F04 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50decf (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/180.12 MB 11:1/168.11 MB AverageThreadTokens: 4611677619323271212 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 19051872 PerHostPeakMemUsage: 895855760 PrepareTime: 135393 RowsProduced: 4350000 TotalCpuTime: 1350044482826 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1334630624995 TotalStorageWaitTime: 18300656 TotalTime: 1338050238424 DataStreamSender (dst_id=16) BytesSent: 460217261 InactiveTotalTime: 0 NetworkThroughput(*): 337835 OverallThroughput: 344353 PeakMemoryUsage: 38192 SerializeBatchTime: 926660165 ThriftTransmitTime(*): 1362253359012 TotalTime: 1336466096355 UncompressedRowBatchSize: 852718972 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Runtime filters: Only following filters arrived: , waited 964ms File Formats: PARQUET/SNAPPY:4 Hdfs split stats (:<# splits>/): 2:1/180.12 MB 11:1/168.11 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607172332350683991 BytesRead: 20548435 BytesReadDataNodeCache: 0 BytesReadLocal: 20548435 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 20548435 DecompressionTime: 116285170 InactiveTotalTime: 0 MaterializeTupleTime(*): 1340852788641 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 2 NumRowGroups: 2 NumScannerThreadsStarted: 1 PeakMemoryUsage: 19005488 PerReadThreadRawHdfsThroughput: 1941188284 RemoteScanRanges: 0 RowsRead: 4350000 RowsReturned: 4350000 RowsReturnedRate: 2860843 ScanRangesComplete: 2 ScannerThreadsInvoluntaryContextSwitches: 2129 ScannerThreadsSysTime: 191970000 ScannerThreadsTotalWallClockTime: 1341458995385 ScannerThreadsUserTime: 1091834000 ScannerThreadsVoluntaryContextSwitches: 4805 TotalRawHdfsReadTime(*): 10585493 TotalReadThroughput: 15334 TotalTime: 1520530719 Filter 0 InactiveTotalTime: 0 Rows processed: 32766 Rows rejected: 0 Rows total: 32768 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded0 (host=vc0708.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/180.08 MB AverageThreadTokens: 4611677505006542213 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 19049592 PerHostPeakMemUsage: 882168616 PrepareTime: 126985 RowsProduced: 2250000 TotalCpuTime: 1328955115000 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1319417587915 TotalStorageWaitTime: 9079278 TotalTime: 1321855689560 DataStreamSender (dst_id=16) BytesSent: 231795340 InactiveTotalTime: 0 NetworkThroughput(*): 173078 OverallThroughput: 175536 PeakMemoryUsage: 38192 SerializeBatchTime: 428875599 ThriftTransmitTime(*): 1339247860854 TotalTime: 1320497263899 UncompressedRowBatchSize: 441061544 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 2:1/180.08 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607165391958326026 BytesRead: 10622703 BytesReadDataNodeCache: 0 BytesReadLocal: 10622703 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 10622703 DecompressionTime: 65693218 InactiveTotalTime: 0 MaterializeTupleTime(*): 1322426418375 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 19003208 PerReadThreadRawHdfsThroughput: 1665006472 RemoteScanRanges: 0 RowsRead: 2250000 RowsReturned: 2250000 RowsReturnedRate: 1705465 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 2251 ScannerThreadsSysTime: 135979000 ScannerThreadsTotalWallClockTime: 1322974906979 ScannerThreadsUserTime: 763883000 ScannerThreadsVoluntaryContextSwitches: 2368 TotalRawHdfsReadTime(*): 6379977 TotalReadThroughput: 8032 TotalTime: 1319288026 Filter 0 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dece (host=vc0714.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/168.12 MB AverageThreadTokens: 4611677488882639096 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 18124616 PerHostPeakMemUsage: 853143776 PrepareTime: 122931 RowsProduced: 2100000 TotalCpuTime: 1324986124315 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1318198421319 TotalStorageWaitTime: 5998181 TotalTime: 1320207610253 DataStreamSender (dst_id=16) BytesSent: 215551651 InactiveTotalTime: 0 NetworkThroughput(*): 161203 OverallThroughput: 163422 PeakMemoryUsage: 38192 SerializeBatchTime: 374809369 ThriftTransmitTime(*): 1337142307764 TotalTime: 1318982919579 UncompressedRowBatchSize: 411657428 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 2:1/168.12 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607165359710519792 BytesRead: 9926511 BytesReadDataNodeCache: 0 BytesReadLocal: 9926511 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 9926511 DecompressionTime: 50106499 InactiveTotalTime: 0 MaterializeTupleTime(*): 1319629385598 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 18065056 PerReadThreadRawHdfsThroughput: 2365391241 RemoteScanRanges: 0 RowsRead: 2100000 RowsReturned: 2100000 RowsReturnedRate: 1808921 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 1691 ScannerThreadsSysTime: 119981000 ScannerThreadsTotalWallClockTime: 1320161806509 ScannerThreadsUserTime: 767883000 ScannerThreadsVoluntaryContextSwitches: 2196 TotalRawHdfsReadTime(*): 4196562 TotalReadThroughput: 7520 TotalTime: 1160912584 Filter 0 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded1 (host=vc0718.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:1/168.16 MB AverageThreadTokens: 4611675779095154398 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 18126032 PerHostPeakMemUsage: 840344224 PrepareTime: 137341 RowsProduced: 2100000 TotalCpuTime: 1325019980890 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1317247463307 TotalStorageWaitTime: 8375234 TotalTime: 1319460991067 DataStreamSender (dst_id=16) BytesSent: 214731937 InactiveTotalTime: 0 NetworkThroughput(*): 160902 OverallThroughput: 162901 PeakMemoryUsage: 38192 SerializeBatchTime: 379213638 ThriftTransmitTime(*): 1334547443250 TotalTime: 1318171336165 UncompressedRowBatchSize: 411657428 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 4:1/168.16 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607161940135550396 BytesRead: 9926013 BytesReadDataNodeCache: 0 BytesReadLocal: 9926013 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 9926013 DecompressionTime: 43198918 InactiveTotalTime: 0 MaterializeTupleTime(*): 1319071856417 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 18065056 PerReadThreadRawHdfsThroughput: 1757421137 RemoteScanRanges: 0 RowsRead: 2100000 RowsReturned: 2100000 RowsReturnedRate: 1661946 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 781 ScannerThreadsSysTime: 84987000 ScannerThreadsTotalWallClockTime: 1319667510169 ScannerThreadsUserTime: 835872000 ScannerThreadsVoluntaryContextSwitches: 2248 TotalRawHdfsReadTime(*): 5648056 TotalReadThroughput: 7522 TotalTime: 1263578348 Filter 0 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50decd (host=vc0704.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 11:1/168.16 MB AverageThreadTokens: 4611673398252291189 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 18123728 PerHostPeakMemUsage: 868170376 PrepareTime: 570237 RowsProduced: 2100000 TotalCpuTime: 1323041631495 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1316210512063 TotalStorageWaitTime: 61106713 TotalTime: 1319030066970 DataStreamSender (dst_id=16) BytesSent: 216846903 InactiveTotalTime: 0 NetworkThroughput(*): 162461 OverallThroughput: 164658 PeakMemoryUsage: 38192 SerializeBatchTime: 358170562 ThriftTransmitTime(*): 1334754996487 TotalTime: 1316946867131 UncompressedRowBatchSize: 411657428 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 0 File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 11:1/168.16 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607167978400410609 BytesRead: 9926791 BytesReadDataNodeCache: 0 BytesReadLocal: 9926791 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 9926791 DecompressionTime: 43921416 InactiveTotalTime: 0 MaterializeTupleTime(*): 1317399542525 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 18065056 PerReadThreadRawHdfsThroughput: 2116429075 RemoteScanRanges: 0 RowsRead: 2100000 RowsReturned: 2100000 RowsReturnedRate: 2995166 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 810 ScannerThreadsSysTime: 74988000 ScannerThreadsTotalWallClockTime: 1317519539741 ScannerThreadsUserTime: 311952000 ScannerThreadsVoluntaryContextSwitches: 2258 TotalRawHdfsReadTime(*): 4690349 TotalReadThroughput: 7947 TotalTime: 701129722 Filter 0 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50decc (host=vc0336.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/168.13 MB AverageThreadTokens: 4611677492112303901 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 18125744 PerHostPeakMemUsage: 880421632 PrepareTime: 148665 RowsProduced: 2100000 TotalCpuTime: 2409744366490 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 233632800676 TotalStorageWaitTime: 5968304 TotalTime: 235495061432 DataStreamSender (dst_id=16) BytesSent: 216257937 InactiveTotalTime: 0 NetworkThroughput(*): 161866 OverallThroughput: 922701 PeakMemoryUsage: 38192 SerializeBatchTime: 331004389 ThriftTransmitTime(*): 1336028610052 TotalTime: 234374640819 UncompressedRowBatchSize: 411657428 HDFS_SCAN_NODE (id=3) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 2:1/168.13 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607165366169849402 BytesRead: 9926121 BytesReadDataNodeCache: 0 BytesReadLocal: 9926121 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 9926121 DecompressionTime: 61798279 InactiveTotalTime: 0 MaterializeTupleTime(*): 1319824588433 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 18065056 PerReadThreadRawHdfsThroughput: 2596736408 RemoteScanRanges: 0 RowsRead: 2100000 RowsReturned: 2100000 RowsReturnedRate: 1908581 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 789 ScannerThreadsSysTime: 63990000 ScannerThreadsTotalWallClockTime: 1320361188906 ScannerThreadsUserTime: 742887000 ScannerThreadsVoluntaryContextSwitches: 2243 TotalRawHdfsReadTime(*): 3822537 TotalReadThroughput: 7516 TotalTime: 1100293333 Filter 0 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Fragment F02 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded3 (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 10:1/252.99 MB 2:1/252.99 MB 6:1/253.02 MB 3:1/253.01 MB AverageThreadTokens: 4611681271133332348 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68302992 PerHostPeakMemUsage: 1891987008 PrepareTime: 183025 RowsProduced: 24083108 TotalCpuTime: 1461670538870 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1389250783110 TotalStorageWaitTime: 53146503 TotalTime: 1424533310949 DataStreamSender (dst_id=15) BytesSent: 449092387 InactiveTotalTime: 0 NetworkThroughput(*): 120778 OverallThroughput: 316646 PeakMemoryUsage: 238896 SerializeBatchTime: 8251029863 ThriftTransmitTime(*): 3718323279731 TotalTime: 1418276273078 UncompressedRowBatchSize: 674468288 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 4 Runtime filters: Only following filters arrived: , waited 984ms File Formats: PARQUET/SNAPPY:8 Hdfs split stats (:<# splits>/): 10:1/252.99 MB 2:1/252.99 MB 6:1/253.02 MB 3:1/253.01 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176086849750455 BytesRead: 226326651 BytesReadDataNodeCache: 0 BytesReadLocal: 226326651 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 226326651 DecompressionTime: 1545970979 InactiveTotalTime: 0 MaterializeTupleTime(*): 1422790384802 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68129632 PerReadThreadRawHdfsThroughput: 2016390037 RemoteScanRanges: 0 RowsRead: 24083108 RowsReturned: 24083108 RowsReturnedRate: 3972517 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 7297 ScannerThreadsSysTime: 764883000 ScannerThreadsTotalWallClockTime: 1424999128035 ScannerThreadsUserTime: 4181364000 ScannerThreadsVoluntaryContextSwitches: 35812 TotalRawHdfsReadTime(*): 112243488 TotalReadThroughput: 159048 TotalTime: 6062429512 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded6 (host=vc0708.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:1/253.02 MB 4:1/253.03 MB 3:1/253.02 MB 10:1/253.01 MB AverageThreadTokens: 4611682851339042355 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68333896 PerHostPeakMemUsage: 1984466488 PrepareTime: 174716 RowsProduced: 24083819 TotalCpuTime: 1460782979053 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1388455237035 TotalStorageWaitTime: 46650712 TotalTime: 1423925169435 DataStreamSender (dst_id=15) BytesSent: 449347078 InactiveTotalTime: 0 NetworkThroughput(*): 54202 OverallThroughput: 316927 PeakMemoryUsage: 238896 SerializeBatchTime: 8063252460 ThriftTransmitTime(*): 8290176316025 TotalTime: 1417824743172 UncompressedRowBatchSize: 674488200 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 4 Runtime filters: Only following filters arrived: , waited 985ms File Formats: PARQUET/SNAPPY:8 Hdfs split stats (:<# splits>/): 1:1/253.02 MB 4:1/253.03 MB 3:1/253.02 MB 10:1/253.01 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176084623326310 BytesRead: 226331703 BytesReadDataNodeCache: 0 BytesReadLocal: 226331703 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 226331703 DecompressionTime: 1417784767 InactiveTotalTime: 0 MaterializeTupleTime(*): 1422148280740 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68127768 PerReadThreadRawHdfsThroughput: 2200930553 RemoteScanRanges: 0 RowsRead: 24083819 RowsReturned: 24083819 RowsReturnedRate: 4036775 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 11532 ScannerThreadsSysTime: 931858000 ScannerThreadsTotalWallClockTime: 1424171047274 ScannerThreadsUserTime: 4097377000 ScannerThreadsVoluntaryContextSwitches: 35025 TotalRawHdfsReadTime(*): 102834550 TotalReadThroughput: 159164 TotalTime: 5966103232 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded4 (host=vc0714.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/253.02 MB 5:1/156.16 MB 11:1/253.00 MB 4:1/169.40 MB 2:1/152.67 MB AverageThreadTokens: 4611682843524583977 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68322600 PerHostPeakMemUsage: 1897901776 PrepareTime: 168034 RowsProduced: 23412032 TotalCpuTime: 1453602729435 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1388542732072 TotalStorageWaitTime: 45525614 TotalTime: 1420085191804 DataStreamSender (dst_id=15) BytesSent: 436584418 InactiveTotalTime: 0 NetworkThroughput(*): 61080 OverallThroughput: 308779 PeakMemoryUsage: 238896 SerializeBatchTime: 8140144508 ThriftTransmitTime(*): 7147689004842 TotalTime: 1413901998176 UncompressedRowBatchSize: 655674224 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 5 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:10 Hdfs split stats (:<# splits>/): 0:1/253.02 MB 5:1/156.16 MB 11:1/253.00 MB 4:1/169.40 MB 2:1/152.67 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176068994409554 BytesRead: 220305297 BytesReadDataNodeCache: 0 BytesReadLocal: 220305297 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 220305297 DecompressionTime: 1350371509 InactiveTotalTime: 0 MaterializeTupleTime(*): 1418614635807 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 5 NumRowGroups: 5 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68157432 PerReadThreadRawHdfsThroughput: 1952270474 RemoteScanRanges: 0 RowsRead: 23412032 RowsReturned: 23412032 RowsReturnedRate: 3928246 ScanRangesComplete: 5 ScannerThreadsInvoluntaryContextSwitches: 7765 ScannerThreadsSysTime: 902862000 ScannerThreadsTotalWallClockTime: 1420577750578 ScannerThreadsUserTime: 4117374000 ScannerThreadsVoluntaryContextSwitches: 34053 TotalRawHdfsReadTime(*): 112845684 TotalReadThroughput: 155308 TotalTime: 5959918873 Filter 2 InactiveTotalTime: 0 Rows processed: 81915 Rows rejected: 0 Rows total: 81920 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded2 (host=vc0704.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/123.56 MB 1:1/253.01 MB 5:1/253.01 MB 7:1/253.00 MB AverageThreadTokens: 4611679304152878220 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68317000 PerHostPeakMemUsage: 1896026240 PrepareTime: 110184 RowsProduced: 20998196 TotalCpuTime: 1444195020199 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1382807558911 TotalStorageWaitTime: 163769359 TotalTime: 1412456298633 DataStreamSender (dst_id=15) BytesSent: 390731365 InactiveTotalTime: 0 NetworkThroughput(*): 80537 OverallThroughput: 277908 PeakMemoryUsage: 238896 SerializeBatchTime: 7258098529 ThriftTransmitTime(*): 4851517847636 TotalTime: 1405971195415 UncompressedRowBatchSize: 588072664 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:99.96% 1:0.03731% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 4 Runtime filters: Only following filters arrived: , waited 0 File Formats: PARQUET/SNAPPY:8 Hdfs split stats (:<# splits>/): 2:1/123.56 MB 1:1/253.01 MB 5:1/253.01 MB 7:1/253.00 MB AverageHdfsReadThreadConcurrency: 4555518737104540345 AverageScannerThreadConcurrency: 4607179057904773102 BytesRead: 197471242 BytesReadDataNodeCache: 0 BytesReadLocal: 197471242 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 197471242 DecompressionTime: 1301038889 InactiveTotalTime: 0 MaterializeTupleTime(*): 1409883022999 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68127256 PerReadThreadRawHdfsThroughput: 252463361 RemoteScanRanges: 0 RowsRead: 20998196 RowsReturned: 20998196 RowsReturnedRate: 4170263 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 7389 ScannerThreadsSysTime: 775882000 ScannerThreadsTotalWallClockTime: 1412394047533 ScannerThreadsUserTime: 3312496000 ScannerThreadsVoluntaryContextSwitches: 30045 TotalRawHdfsReadTime(*): 782177820 TotalReadThroughput: 147201 TotalTime: 5035220332 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded8 (host=vc0336.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/253.02 MB 9:1/253.00 MB 6:1/124.53 MB 3:1/253.03 MB AverageThreadTokens: 4611682831166505122 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68448504 PerHostPeakMemUsage: 1900139320 PrepareTime: 145538 RowsProduced: 21022383 TotalCpuTime: 1448382294374 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1381491231660 TotalStorageWaitTime: 47563752 TotalTime: 1410034438130 DataStreamSender (dst_id=15) BytesSent: 391145511 InactiveTotalTime: 0 NetworkThroughput(*): 65224 OverallThroughput: 278411 PeakMemoryUsage: 238896 SerializeBatchTime: 7299220888 ThriftTransmitTime(*): 5996947676581 TotalTime: 1404917261241 UncompressedRowBatchSize: 588750036 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 4 Runtime filters: Only following filters arrived: , waited 1s005ms File Formats: PARQUET/SNAPPY:8 Hdfs split stats (:<# splits>/): 0:1/253.02 MB 9:1/253.00 MB 6:1/124.53 MB 3:1/253.03 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607179230410900686 BytesRead: 197687122 BytesReadDataNodeCache: 0 BytesReadLocal: 197687122 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 197687122 DecompressionTime: 1352115418 InactiveTotalTime: 0 MaterializeTupleTime(*): 1412334401806 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68291528 PerReadThreadRawHdfsThroughput: 2037629479 RemoteScanRanges: 0 RowsRead: 21022383 RowsReturned: 21022383 RowsReturnedRate: 4205049 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 8357 ScannerThreadsSysTime: 844871000 ScannerThreadsTotalWallClockTime: 1414304771738 ScannerThreadsUserTime: 3765427000 ScannerThreadsVoluntaryContextSwitches: 29887 TotalRawHdfsReadTime(*): 97018189 TotalReadThroughput: 139954 TotalTime: 4999319239 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded5 (host=vc0718.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/253.01 MB 10:1/125.74 MB 11:1/139.13 MB 4:1/253.01 MB AverageThreadTokens: 4611684415152333660 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68319856 PerHostPeakMemUsage: 1933707584 PrepareTime: 116828 RowsProduced: 18337722 TotalCpuTime: 1436005544160 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1379236185355 TotalStorageWaitTime: 57975370 TotalTime: 1406799593634 DataStreamSender (dst_id=15) BytesSent: 340622028 InactiveTotalTime: 0 NetworkThroughput(*): 47765 OverallThroughput: 243031 PeakMemoryUsage: 238896 SerializeBatchTime: 6144031993 ThriftTransmitTime(*): 7131164385383 TotalTime: 1401555143902 UncompressedRowBatchSize: 513563780 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 4 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:8 Hdfs split stats (:<# splits>/): 2:1/253.01 MB 10:1/125.74 MB 11:1/139.13 MB 4:1/253.01 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607179212249908921 BytesRead: 172585108 BytesReadDataNodeCache: 0 BytesReadLocal: 172585108 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 172585108 DecompressionTime: 1164602616 InactiveTotalTime: 0 MaterializeTupleTime(*): 1405376154697 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 4 NumRowGroups: 4 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68097344 PerReadThreadRawHdfsThroughput: 1536708550 RemoteScanRanges: 0 RowsRead: 18337722 RowsReturned: 18337722 RowsReturnedRate: 3572897 ScanRangesComplete: 4 ScannerThreadsInvoluntaryContextSwitches: 8024 ScannerThreadsSysTime: 820875000 ScannerThreadsTotalWallClockTime: 1407217906603 ScannerThreadsUserTime: 3389484000 ScannerThreadsVoluntaryContextSwitches: 25644 TotalRawHdfsReadTime(*): 112308289 TotalReadThroughput: 122873 TotalTime: 5132450949 Filter 2 InactiveTotalTime: 0 Rows processed: 65532 Rows rejected: 0 Rows total: 65536 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded7 (host=vc0712.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:1/252.99 MB 1:1/253.02 MB 2:1/253.02 MB AverageThreadTokens: 4611682810735345617 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 68309936 PerHostPeakMemUsage: 1883440800 PrepareTime: 212250 RowsProduced: 18062740 TotalCpuTime: 1533625470901 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 1279097059403 TotalStorageWaitTime: 38453898 TotalTime: 1303572655993 DataStreamSender (dst_id=15) BytesSent: 335721420 InactiveTotalTime: 0 NetworkThroughput(*): 47071 OverallThroughput: 258469 PeakMemoryUsage: 238896 SerializeBatchTime: 5965553196 ThriftTransmitTime(*): 7132175982985 TotalTime: 1298882259235 UncompressedRowBatchSize: 505862668 HDFS_SCAN_NODE (id=2) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Runtime filters: Only following filters arrived: , waited 983ms File Formats: PARQUET/SNAPPY:6 Hdfs split stats (:<# splits>/): 7:1/252.99 MB 1:1/253.02 MB 2:1/253.02 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176003415932835 BytesRead: 169750927 BytesReadDataNodeCache: 0 BytesReadLocal: 169750927 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 169750927 DecompressionTime: 1213044388 InactiveTotalTime: 0 MaterializeTupleTime(*): 1403921431431 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 3 NumRowGroups: 3 NumScannerThreadsStarted: 1 PeakMemoryUsage: 68120192 PerReadThreadRawHdfsThroughput: 1972249961 RemoteScanRanges: 0 RowsRead: 18062740 RowsReturned: 18062740 RowsReturnedRate: 3940056 ScanRangesComplete: 3 ScannerThreadsInvoluntaryContextSwitches: 7354 ScannerThreadsSysTime: 700893000 ScannerThreadsTotalWallClockTime: 1405974096736 ScannerThreadsUserTime: 3559458000 ScannerThreadsVoluntaryContextSwitches: 26551 TotalRawHdfsReadTime(*): 86069682 TotalReadThroughput: 120905 TotalTime: 4584386398 Filter 2 InactiveTotalTime: 0 Rows processed: 49149 Rows rejected: 0 Rows total: 49152 TotalTime: 0 Fragment F00 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dedb (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:1/253.30 MB 2:1/253.28 MB 4:2/506.56 MB 6:3/759.82 MB 9:1/253.28 MB 3:2/506.58 MB 0:2/506.59 MB 11:1/253.29 MB Filter 4 arrival: 3m23s AverageThreadTokens: 4611171465459600964 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306248856 PerHostPeakMemUsage: 2297960808 PrepareTime: 192123946 RowsProduced: 27590351 TotalCpuTime: 1754414294046 TotalNetworkReceiveTime: 202066995462 TotalNetworkSendTime: 1417423635243 TotalStorageWaitTime: 394642471 TotalTime: 1771097624218 CodeGen CodegenTime: 0 CompileTime: 24204618 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 227737634 PrepareTime: 188193962 TotalTime: 441421210 DataStreamSender (dst_id=14) BytesSent: 1408252990 InactiveTotalTime: 0 NetworkThroughput(*): 351972 OverallThroughput: 921159 PeakMemoryUsage: 223552 SerializeBatchTime: 30157098678 ThriftTransmitTime(*): 4001036268949 TotalTime: 1528783686240 UncompressedRowBatchSize: 2704936406 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 209366466 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 485444051 GetNewBlockTime: 1765681 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 29389259213 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179268456 PinTime: 0 ProbeRows: 27590351 ProbeRowsPartitioned: 0 ProbeTime: 28009937744 RowsReturned: 27590351 RowsReturnedRate: 114013 SpilledPartitions: 0 TotalTime: 241991117833 UnpinTime: 1616 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 24206517 DeserializeRowBatchTimer: 666557107 FirstBatchArrivalWaitTime: 554466090 InactiveTotalTime: 202001779079 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4948 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 202093012505 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:99.97% 1:0.0316% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:65 Hdfs split stats (:<# splits>/): 1:1/253.30 MB 2:1/253.28 MB 4:2/506.56 MB 6:3/759.82 MB 9:1/253.28 MB 3:2/506.58 MB 0:2/506.59 MB 11:1/253.29 MB AverageHdfsReadThreadConcurrency: 4554463978801771118 AverageScannerThreadConcurrency: 4607176727046933843 BytesRead: 1254276775 BytesReadDataNodeCache: 0 BytesReadLocal: 1254276775 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1254276775 DecompressionTime: 26255734033 InactiveTotalTime: 0 MaterializeTupleTime(*): 1557420790363 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 8 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128684880 PerReadThreadRawHdfsThroughput: 1538418975 RemoteScanRanges: 0 RowsRead: 90828115 RowsReturned: 27590351 RowsReturnedRate: 2625440 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 172603 ScannerThreadsSysTime: 9911493000 ScannerThreadsTotalWallClockTime: 1584956604906 ScannerThreadsUserTime: 36685422000 ScannerThreadsVoluntaryContextSwitches: 26728 TotalRawHdfsReadTime(*): 815302460 TotalReadThroughput: 702670 TotalTime: 10508846115 Filter 3 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50deda (host=vc0714.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 11:1/253.29 MB 9:3/759.85 MB 10:1/253.30 MB 5:2/506.55 MB 2:1/253.28 MB 8:1/253.28 MB 3:1/43.63 MB 7:1/253.29 MB 4:3/594.25 MB Filter 4 arrival: 3m22s AverageThreadTokens: 4611167499318946662 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306295968 PerHostPeakMemUsage: 2232741352 PrepareTime: 187987665 RowsProduced: 26578377 TotalCpuTime: 1702570054479 TotalNetworkReceiveTime: 201886829553 TotalNetworkSendTime: 1433939093729 TotalStorageWaitTime: 421031437 TotalTime: 1768084478110 CodeGen CodegenTime: 0 CompileTime: 23342098 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 218471092 PrepareTime: 183950220 TotalTime: 427085839 DataStreamSender (dst_id=14) BytesSent: 1365799409 InactiveTotalTime: 0 NetworkThroughput(*): 261351 OverallThroughput: 891959 PeakMemoryUsage: 223552 SerializeBatchTime: 28799827506 ThriftTransmitTime(*): 5225914921305 TotalTime: 1531234817522 UncompressedRowBatchSize: 2605723258 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 313712417 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 275784300 GetNewBlockTime: 8087995 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 26914207081 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179269160 PinTime: 0 ProbeRows: 26578377 ProbeRowsPartitioned: 0 ProbeTime: 25682774804 RowsReturned: 26578377 RowsReturnedRate: 112350 SpilledPartitions: 0 TotalTime: 236567108802 UnpinTime: 1598 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 23431378 DeserializeRowBatchTimer: 1311908872 FirstBatchArrivalWaitTime: 571802615 InactiveTotalTime: 201676389277 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4952 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 201912139067 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:70 Hdfs split stats (:<# splits>/): 11:1/253.29 MB 9:3/759.85 MB 10:1/253.30 MB 5:2/506.55 MB 2:1/253.28 MB 8:1/253.28 MB 3:1/43.63 MB 7:1/253.29 MB 4:3/594.25 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176663401132589 BytesRead: 1208146576 BytesReadDataNodeCache: 0 BytesReadLocal: 1208146576 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1208146576 DecompressionTime: 16493874488 InactiveTotalTime: 0 MaterializeTupleTime(*): 1549627310536 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 14 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128625488 PerReadThreadRawHdfsThroughput: 1722413632 RemoteScanRanges: 0 RowsRead: 87444064 RowsReturned: 26578377 RowsReturnedRate: 3433560 ScanRangesComplete: 14 ScannerThreadsInvoluntaryContextSwitches: 158441 ScannerThreadsSysTime: 8087770000 ScannerThreadsTotalWallClockTime: 1567332409408 ScannerThreadsUserTime: 37465304000 ScannerThreadsVoluntaryContextSwitches: 23075 TotalRawHdfsReadTime(*): 701426506 TotalReadThroughput: 683722 TotalTime: 7740762654 Filter 3 InactiveTotalTime: 0 Rows processed: 229362 Rows rejected: 0 Rows total: 229376 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 229362 Rows rejected: 0 Rows total: 229376 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dedd (host=vc0718.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:1/253.28 MB 11:1/84.08 MB 1:2/506.60 MB 4:1/253.28 MB 8:1/253.30 MB 5:3/759.83 MB 6:1/253.27 MB 9:2/506.57 MB 0:1/253.27 MB Filter 4 arrival: 3m23s AverageThreadTokens: 4611167058900677884 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306241032 PerHostPeakMemUsage: 2366311440 PrepareTime: 196078976 RowsProduced: 26173921 TotalCpuTime: 1705518808541 TotalNetworkReceiveTime: 201949707955 TotalNetworkSendTime: 1428631963348 TotalStorageWaitTime: 442936309 TotalTime: 1766293053590 CodeGen CodegenTime: 0 CompileTime: 29643598 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 224557383 PrepareTime: 192141482 TotalTime: 447681745 DataStreamSender (dst_id=14) BytesSent: 1344039198 InactiveTotalTime: 0 NetworkThroughput(*): 257526 OverallThroughput: 879492 PeakMemoryUsage: 223552 SerializeBatchTime: 28505346332 ThriftTransmitTime(*): 5219036170840 TotalTime: 1528199194712 UncompressedRowBatchSize: 2566070714 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 327550250 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 290226530 GetNewBlockTime: 1470046 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 28306530029 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179270360 PinTime: 0 ProbeRows: 26173921 ProbeRowsPartitioned: 0 ProbeTime: 27005815401 RowsReturned: 26173921 RowsReturnedRate: 110069 SpilledPartitions: 0 TotalTime: 237795116103 UnpinTime: 2408 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 23578222 DeserializeRowBatchTimer: 1275749974 FirstBatchArrivalWaitTime: 549145374 InactiveTotalTime: 201772743215 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4951 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 201975302823 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:99.97% 1:0.03198% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:65 Hdfs split stats (:<# splits>/): 7:1/253.28 MB 11:1/84.08 MB 1:2/506.60 MB 4:1/253.28 MB 8:1/253.30 MB 5:3/759.83 MB 6:1/253.27 MB 9:2/506.57 MB 0:1/253.27 MB AverageHdfsReadThreadConcurrency: 4554534806270906925 AverageScannerThreadConcurrency: 4607176657879483515 BytesRead: 1189965824 BytesReadDataNodeCache: 0 BytesReadLocal: 1189965824 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1189965824 DecompressionTime: 16929210669 InactiveTotalTime: 0 MaterializeTupleTime(*): 1547943156575 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128629008 PerReadThreadRawHdfsThroughput: 1503188912 RemoteScanRanges: 0 RowsRead: 86152093 RowsReturned: 26173921 RowsReturnedRate: 3483686 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 143270 ScannerThreadsSysTime: 8752669000 ScannerThreadsTotalWallClockTime: 1566152786372 ScannerThreadsUserTime: 35398618000 ScannerThreadsVoluntaryContextSwitches: 23948 TotalRawHdfsReadTime(*): 791627595 TotalReadThroughput: 673786 TotalTime: 7513283251 Filter 3 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50ded9 (host=vc0704.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 9:1/253.29 MB 5:1/253.27 MB 10:1/253.30 MB 1:2/313.37 MB 0:1/253.29 MB 7:2/506.58 MB 2:1/253.29 MB 8:2/506.58 MB 11:2/506.57 MB Filter 4 arrival: 3m22s AverageThreadTokens: 4611330365927977102 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306378640 PerHostPeakMemUsage: 2356016368 PrepareTime: 76429130733 RowsProduced: 25782447 TotalCpuTime: 1772887986324 TotalNetworkReceiveTime: 119555865707 TotalNetworkSendTime: 1431167765653 TotalStorageWaitTime: 363044200 TotalTime: 1757776277288 CodeGen CodegenTime: 0 CompileTime: 357970524 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 3016216623 PrepareTime: 75907166233 TotalTime: 79441078065 DataStreamSender (dst_id=14) BytesSent: 1324335285 InactiveTotalTime: 0 NetworkThroughput(*): 253612 OverallThroughput: 868117 PeakMemoryUsage: 223552 SerializeBatchTime: 28545287586 ThriftTransmitTime(*): 5221894311831 TotalTime: 1525524957168 UncompressedRowBatchSize: 2527690910 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 214885088 BuildRows: 992832 BuildRowsPartitioned: 992832 BuildTime: 257224403 GetNewBlockTime: 3515378 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 102805914583 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179273832 PinTime: 0 ProbeRows: 25967912 ProbeRowsPartitioned: 0 ProbeTime: 24853652832 RowsReturned: 25782447 RowsReturnedRate: 111900 SpilledPartitions: 0 TotalTime: 230405555764 UnpinTime: 1108 EXCHANGE_NODE (id=13) BytesReceived: 11436684 ConvertRowBatchTime: 21462544 DeserializeRowBatchTimer: 2124602924 FirstBatchArrivalWaitTime: 0 InactiveTotalTime: 119127600869 PeakMemoryUsage: 0 RowsReturned: 992832 RowsReturnedRate: 8302 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 119580725621 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:65 Hdfs split stats (:<# splits>/): 9:1/253.29 MB 5:1/253.27 MB 10:1/253.30 MB 1:2/313.37 MB 0:1/253.29 MB 7:2/506.58 MB 2:1/253.29 MB 8:2/506.58 MB 11:2/506.57 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4607176637542472645 BytesRead: 1180843855 BytesReadDataNodeCache: 0 BytesReadLocal: 1180843855 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1180843855 DecompressionTime: 16210737894 InactiveTotalTime: 0 MaterializeTupleTime(*): 1542457794360 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128757312 PerReadThreadRawHdfsThroughput: 1611178802 RemoteScanRanges: 0 RowsRead: 85489075 RowsReturned: 25967912 RowsReturnedRate: 3238332 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 150051 ScannerThreadsSysTime: 8309736000 ScannerThreadsTotalWallClockTime: 1559765834771 ScannerThreadsUserTime: 35164654000 ScannerThreadsVoluntaryContextSwitches: 22988 TotalRawHdfsReadTime(*): 732906772 TotalReadThroughput: 701211 TotalTime: 8018915560 Filter 3 InactiveTotalTime: 0 Rows processed: 211402 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 1577 Rows total: 212992 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dedc (host=vc0708.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/253.29 MB 11:2/506.58 MB 3:1/253.29 MB 6:1/253.27 MB 0:1/253.26 MB 5:1/253.25 MB 1:1/253.26 MB 4:1/253.29 MB 9:1/68.43 MB 7:2/331.34 MB 8:1/253.28 MB Filter 4 arrival: 3m23s AverageThreadTokens: 4611162523086086718 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 305951088 PerHostPeakMemUsage: 2282205368 PrepareTime: 213238940 RowsProduced: 24570751 TotalCpuTime: 1686378285305 TotalNetworkReceiveTime: 201947644974 TotalNetworkSendTime: 1424284209734 TotalStorageWaitTime: 436269787 TotalTime: 1755614490245 CodeGen CodegenTime: 0 CompileTime: 26714616 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 226467704 PrepareTime: 209277433 TotalTime: 463776117 DataStreamSender (dst_id=14) BytesSent: 1261349613 InactiveTotalTime: 0 NetworkThroughput(*): 242090 OverallThroughput: 829718 PeakMemoryUsage: 223552 SerializeBatchTime: 26489529795 ThriftTransmitTime(*): 5210229707303 TotalTime: 1520213849539 UncompressedRowBatchSize: 2408897182 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 220074433 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 371185705 GetNewBlockTime: 14414999 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 25145940751 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179266736 PinTime: 0 ProbeRows: 24570751 ProbeRowsPartitioned: 0 ProbeTime: 23922029218 RowsReturned: 24570751 RowsReturnedRate: 104482 SpilledPartitions: 0 TotalTime: 235166823987 UnpinTime: 1593 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 22922198 DeserializeRowBatchTimer: 1080700647 FirstBatchArrivalWaitTime: 532583346 InactiveTotalTime: 201844886647 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4951 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 201972214998 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:99.94% 1:0.06443% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:65 Hdfs split stats (:<# splits>/): 2:1/253.29 MB 11:2/506.58 MB 3:1/253.29 MB 6:1/253.27 MB 0:1/253.26 MB 5:1/253.25 MB 1:1/253.26 MB 4:1/253.29 MB 9:1/68.43 MB 7:2/331.34 MB 8:1/253.28 MB AverageHdfsReadThreadConcurrency: 4559082117625214997 AverageScannerThreadConcurrency: 4607176615192250178 BytesRead: 1117441370 BytesReadDataNodeCache: 0 BytesReadLocal: 1117441370 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1117441370 DecompressionTime: 16418569153 InactiveTotalTime: 0 MaterializeTupleTime(*): 1536666212366 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 11 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128297136 PerReadThreadRawHdfsThroughput: 1532416855 RemoteScanRanges: 0 RowsRead: 80876909 RowsReturned: 24570751 RowsReturnedRate: 3052772 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 155534 ScannerThreadsSysTime: 8560698000 ScannerThreadsTotalWallClockTime: 1554267825384 ScannerThreadsUserTime: 33689878000 ScannerThreadsVoluntaryContextSwitches: 22509 TotalRawHdfsReadTime(*): 729201957 TotalReadThroughput: 636897 TotalTime: 8048668238 Filter 3 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dede (host=vc0712.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/253.29 MB 5:1/253.29 MB 9:1/253.28 MB 7:1/253.29 MB 4:3/759.85 MB 11:1/253.27 MB 0:1/57.12 MB 1:1/253.30 MB 6:3/759.88 MB Filter 4 arrival: 3m23s AverageThreadTokens: 4611164306715869686 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306372088 PerHostPeakMemUsage: 2394107736 PrepareTime: 283429526 RowsProduced: 25948838 TotalCpuTime: 1697754952633 TotalNetworkReceiveTime: 201732963050 TotalNetworkSendTime: 1424539678785 TotalStorageWaitTime: 398377526 TotalTime: 1753392399961 CodeGen CodegenTime: 0 CompileTime: 44647618 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 396212788 PrepareTime: 278135063 TotalTime: 720918128 DataStreamSender (dst_id=14) BytesSent: 1333928783 InactiveTotalTime: 0 NetworkThroughput(*): 334019 OverallThroughput: 878666 PeakMemoryUsage: 223552 SerializeBatchTime: 27321589097 ThriftTransmitTime(*): 3993571078809 TotalTime: 1518128975884 UncompressedRowBatchSize: 2544003748 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 227478295 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 267886886 GetNewBlockTime: 1565145 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 26146079260 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179270072 PinTime: 0 ProbeRows: 25948838 ProbeRowsPartitioned: 0 ProbeTime: 24904027192 RowsReturned: 25948838 RowsReturnedRate: 110415 SpilledPartitions: 0 TotalTime: 235010206562 UnpinTime: 1054 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 24164929 DeserializeRowBatchTimer: 1188173808 FirstBatchArrivalWaitTime: 263957632 InactiveTotalTime: 201318717125 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4956 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 201759017101 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:99.94% 1:0.06418% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:65 Hdfs split stats (:<# splits>/): 2:1/253.29 MB 5:1/253.29 MB 9:1/253.28 MB 7:1/253.29 MB 4:3/759.85 MB 11:1/253.27 MB 0:1/57.12 MB 1:1/253.30 MB 6:3/759.88 MB AverageHdfsReadThreadConcurrency: 4559059230997408924 AverageScannerThreadConcurrency: 4607176637542472645 BytesRead: 1179728051 BytesReadDataNodeCache: 0 BytesReadLocal: 1179728051 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1179728051 DecompressionTime: 16200628344 InactiveTotalTime: 0 MaterializeTupleTime(*): 1542324867785 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 13 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128693408 PerReadThreadRawHdfsThroughput: 1789420604 RemoteScanRanges: 0 RowsRead: 85406461 RowsReturned: 25948838 RowsReturnedRate: 3652137 ScanRangesComplete: 13 ScannerThreadsInvoluntaryContextSwitches: 157357 ScannerThreadsSysTime: 7966788000 ScannerThreadsTotalWallClockTime: 1559870649910 ScannerThreadsUserTime: 34849702000 ScannerThreadsVoluntaryContextSwitches: 22980 TotalRawHdfsReadTime(*): 659279349 TotalReadThroughput: 670293 TotalTime: 7105110201 Filter 3 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 212979 Rows rejected: 0 Rows total: 212992 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dedf (host=vc0336.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/253.30 MB 9:1/253.28 MB 5:1/253.29 MB 1:2/506.60 MB 11:1/253.28 MB 10:2/506.56 MB 3:1/253.30 MB 6:1/253.30 MB 2:2/506.57 MB Filter 4 arrival: 3m23s AverageThreadTokens: 4611164697310112650 BloomFilterBytes: 2097152 InactiveTotalTime: 0 PeakMemoryUsage: 306313336 PerHostPeakMemUsage: 2198988040 PrepareTime: 191793484 RowsProduced: 25470594 TotalCpuTime: 1706303184012 TotalNetworkReceiveTime: 201706037147 TotalNetworkSendTime: 1410323164979 TotalStorageWaitTime: 342562247 TotalTime: 1738556975108 CodeGen CodegenTime: 0 CompileTime: 24021761 InactiveTotalTime: 0 LoadTime: 0 ModuleBitcodeSize: 1939944 OptimizationTime: 216212762 PrepareTime: 186543119 TotalTime: 429580164 DataStreamSender (dst_id=14) BytesSent: 1299429982 InactiveTotalTime: 0 NetworkThroughput(*): 202341 OverallThroughput: 865475 PeakMemoryUsage: 223552 SerializeBatchTime: 26722656626 ThriftTransmitTime(*): 6421967516453 TotalTime: 1501405187972 UncompressedRowBatchSize: 2497117092 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced BuildPartitionTime: 533561656 BuildRows: 1000000 BuildRowsPartitioned: 1000000 BuildTime: 318526017 GetNewBlockTime: 1215811 HashBuckets: 2097152 HashCollisions: 0 InactiveTotalTime: 0 LargestPartitionPercent: 6 LocalTime: 28266705124 MaxPartitionLevel: 0 NumRepartitions: 0 PartitionsCreated: 16 PeakMemoryUsage: 179272664 PinTime: 0 ProbeRows: 25470594 ProbeRowsPartitioned: 0 ProbeTime: 24404821970 RowsReturned: 25470594 RowsReturnedRate: 107524 SpilledPartitions: 0 TotalTime: 236882301927 UnpinTime: 943 EXCHANGE_NODE (id=13) BytesReceived: 11522062 ConvertRowBatchTime: 20847941 DeserializeRowBatchTimer: 3400813792 FirstBatchArrivalWaitTime: 572357992 InactiveTotalTime: 200041881174 PeakMemoryUsage: 0 RowsReturned: 1000000 RowsReturnedRate: 4957 SendersBlockedTimer: 0 SendersBlockedTotalTimer(*): 0 TotalTime: 201728657117 HDFS_SCAN_NODE (id=1) Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.09643% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 12 Runtime filters: Only following filters arrived: 4, waited 0 File Formats: PARQUET/SNAPPY:60 Hdfs split stats (:<# splits>/): 0:1/253.30 MB 9:1/253.28 MB 5:1/253.29 MB 1:2/506.60 MB 11:1/253.28 MB 10:2/506.56 MB 3:1/253.30 MB 6:1/253.30 MB 2:2/506.57 MB AverageHdfsReadThreadConcurrency: 4562033506817236621 AverageScannerThreadConcurrency: 4607176628250834032 BytesRead: 1157788178 BytesReadDataNodeCache: 0 BytesReadLocal: 1157788178 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 1157788178 DecompressionTime: 16726918039 InactiveTotalTime: 0 MaterializeTupleTime(*): 1539420060794 MaxCompressedTextFileLength: 0 NumColumns: 5 NumDisksAccessed: 9 NumRowGroups: 12 NumScannerThreadsStarted: 1 PeakMemoryUsage: 128692008 PerReadThreadRawHdfsThroughput: 1437355969 RemoteScanRanges: 0 RowsRead: 83841185 RowsReturned: 25470594 RowsReturnedRate: 3698390 ScanRangesComplete: 12 ScannerThreadsInvoluntaryContextSwitches: 183751 ScannerThreadsSysTime: 9448563000 ScannerThreadsTotalWallClockTime: 1557260016813 ScannerThreadsUserTime: 35119661000 ScannerThreadsVoluntaryContextSwitches: 22737 TotalRawHdfsReadTime(*): 805498570 TotalReadThroughput: 658577 TotalTime: 6886939686 Filter 3 InactiveTotalTime: 0 Rows processed: 196596 Rows rejected: 0 Rows total: 196608 TotalTime: 0 Filter 4 InactiveTotalTime: 0 Rows processed: 196596 Rows rejected: 0 Rows total: 196608 TotalTime: 0 Fragment F01 InactiveTotalTime: 0 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee5 (host=vc0706.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:1/11.93 MB AverageThreadTokens: 4607193566323847533 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 8016264 PerHostPeakMemUsage: 430677304 PrepareTime: 106830 RowsProduced: 150000 TotalCpuTime: 1917667136 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 200765352190 TotalStorageWaitTime: 23815821 TotalTime: 201845843223 DataStreamSender (dst_id=13) BytesSent: 11595773 InactiveTotalTime: 0 NetworkThroughput(*): 57027 OverallThroughput: 57748 PeakMemoryUsage: 38192 SerializeBatchTime: 16149305 ThriftTransmitTime(*): 203337873592 TotalTime: 200796855803 UncompressedRowBatchSize: 29404116 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 983ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 6:1/11.93 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567882350409928602 BytesRead: 878415 BytesReadDataNodeCache: 0 BytesReadLocal: 878415 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 878415 DecompressionTime: 1671977 InactiveTotalTime: 0 MaterializeTupleTime(*): 15375373 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7945304 PerReadThreadRawHdfsThroughput: 1085847753 RemoteScanRanges: 0 RowsRead: 150000 RowsReturned: 150000 RowsReturnedRate: 147853 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 182 ScannerThreadsSysTime: 2999000 ScannerThreadsTotalWallClockTime: 522969018 ScannerThreadsUserTime: 492925000 ScannerThreadsVoluntaryContextSwitches: 13 TotalRawHdfsReadTime(*): 808967 TotalReadThroughput: 4359 TotalTime: 1014517097 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee6 (host=vc0714.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:1/11.16 MB AverageThreadTokens: 4607193566323847533 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 7602304 PerHostPeakMemUsage: 409130872 PrepareTime: 115570 RowsProduced: 140000 TotalCpuTime: 2176697671 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 200594301254 TotalStorageWaitTime: 4242322 TotalTime: 201766605689 DataStreamSender (dst_id=13) BytesSent: 10839703 InactiveTotalTime: 0 NetworkThroughput(*): 52814 OverallThroughput: 53999 PeakMemoryUsage: 38192 SerializeBatchTime: 35520383 ThriftTransmitTime(*): 205239476426 TotalTime: 200738154853 UncompressedRowBatchSize: 27443836 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s005ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 1:1/11.16 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567868117338257098 BytesRead: 832112 BytesReadDataNodeCache: 0 BytesReadLocal: 832112 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 832112 DecompressionTime: 1384273 InactiveTotalTime: 0 MaterializeTupleTime(*): 9265956 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7531344 PerReadThreadRawHdfsThroughput: 1015147078 RemoteScanRanges: 0 RowsRead: 140000 RowsReturned: 140000 RowsReturnedRate: 137754 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 147 ScannerThreadsSysTime: 1999000 ScannerThreadsTotalWallClockTime: 496414257 ScannerThreadsUserTime: 487925000 ScannerThreadsVoluntaryContextSwitches: 7 TotalRawHdfsReadTime(*): 819696 TotalReadThroughput: 4129 TotalTime: 1016298595 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee0 (host=vc0712.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:1/11.17 MB AverageThreadTokens: 4607193593985196987 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 7602304 PerHostPeakMemUsage: 409383272 PrepareTime: 113407 RowsProduced: 140000 TotalCpuTime: 1891649002 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 200566825021 TotalStorageWaitTime: 3926284 TotalTime: 201605003729 DataStreamSender (dst_id=13) BytesSent: 13527206 InactiveTotalTime: 0 NetworkThroughput(*): 66438 OverallThroughput: 67436 PeakMemoryUsage: 38192 SerializeBatchTime: 17389672 ThriftTransmitTime(*): 203604889162 TotalTime: 200591875102 UncompressedRowBatchSize: 27443836 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 983ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 6:1/11.17 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567868117338257098 BytesRead: 832078 BytesReadDataNodeCache: 0 BytesReadLocal: 832078 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 832078 DecompressionTime: 1393320 InactiveTotalTime: 0 MaterializeTupleTime(*): 15713737 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7531344 PerReadThreadRawHdfsThroughput: 1008903465 RemoteScanRanges: 0 RowsRead: 140000 RowsReturned: 140000 RowsReturnedRate: 140996 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 310 ScannerThreadsSysTime: 0 ScannerThreadsTotalWallClockTime: 759816172 ScannerThreadsUserTime: 744886000 ScannerThreadsVoluntaryContextSwitches: 13 TotalRawHdfsReadTime(*): 824735 TotalReadThroughput: 4129 TotalTime: 992934182 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee4 (host=vc0708.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/11.17 MB AverageThreadTokens: 4607193593985196987 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 7602304 PerHostPeakMemUsage: 429061376 PrepareTime: 103717 RowsProduced: 140000 TotalCpuTime: 1959190946 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 200525857728 TotalStorageWaitTime: 2144158 TotalTime: 201591863252 DataStreamSender (dst_id=13) BytesSent: 11014591 InactiveTotalTime: 0 NetworkThroughput(*): 53827 OverallThroughput: 54921 PeakMemoryUsage: 38192 SerializeBatchTime: 15598080 ThriftTransmitTime(*): 204627124673 TotalTime: 200553016567 UncompressedRowBatchSize: 27443836 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 983ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 0:1/11.17 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567868117338257098 BytesRead: 832075 BytesReadDataNodeCache: 0 BytesReadLocal: 832075 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 832075 DecompressionTime: 1480965 InactiveTotalTime: 0 MaterializeTupleTime(*): 11543620 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7531344 PerReadThreadRawHdfsThroughput: 1270925614 RemoteScanRanges: 0 RowsRead: 140000 RowsReturned: 140000 RowsReturnedRate: 137383 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 196 ScannerThreadsSysTime: 2999000 ScannerThreadsTotalWallClockTime: 479188025 ScannerThreadsUserTime: 470928000 ScannerThreadsVoluntaryContextSwitches: 11 TotalRawHdfsReadTime(*): 654700 TotalReadThroughput: 4129 TotalTime: 1019043959 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee2 (host=vc0704.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/11.93 MB AverageThreadTokens: 4607199542752973189 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 8016264 PerHostPeakMemUsage: 429043000 PrepareTime: 86244 RowsProduced: 150000 TotalCpuTime: 2711369347 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 199512213665 TotalStorageWaitTime: 4853616 TotalTime: 201186444369 DataStreamSender (dst_id=13) BytesSent: 12071773 InactiveTotalTime: 0 NetworkThroughput(*): 59433 OverallThroughput: 60496 PeakMemoryUsage: 38192 SerializeBatchTime: 15924228 ThriftTransmitTime(*): 203112637685 TotalTime: 199545387062 UncompressedRowBatchSize: 29404116 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 0 File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 0:1/11.93 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4571015049484826656 BytesRead: 878483 BytesReadDataNodeCache: 0 BytesReadLocal: 878483 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 878483 DecompressionTime: 1505456 InactiveTotalTime: 0 MaterializeTupleTime(*): 344516001 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7945304 PerReadThreadRawHdfsThroughput: 1893612893 RemoteScanRanges: 0 RowsRead: 150000 RowsReturned: 150000 RowsReturnedRate: 511459 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 5 ScannerThreadsSysTime: 1000000 ScannerThreadsTotalWallClockTime: 358067714 ScannerThreadsUserTime: 15997000 ScannerThreadsVoluntaryContextSwitches: 13 TotalRawHdfsReadTime(*): 463919 TotalReadThroughput: 6680 TotalTime: 293278082 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee3 (host=vc0718.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:1/10.40 MB AverageThreadTokens: 4607193621784165096 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 7188336 PerHostPeakMemUsage: 397620216 PrepareTime: 129031 RowsProduced: 130000 TotalCpuTime: 2213704654 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 199986816914 TotalStorageWaitTime: 3364060 TotalTime: 201071924324 DataStreamSender (dst_id=13) BytesSent: 10032463 InactiveTotalTime: 0 NetworkThroughput(*): 49187 OverallThroughput: 50150 PeakMemoryUsage: 38192 SerializeBatchTime: 17167862 ThriftTransmitTime(*): 203964564881 TotalTime: 200045502829 UncompressedRowBatchSize: 25483556 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s004ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 2:1/10.40 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567882350409928602 BytesRead: 785650 BytesReadDataNodeCache: 0 BytesReadLocal: 785650 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 785650 DecompressionTime: 1055398 InactiveTotalTime: 0 MaterializeTupleTime(*): 7905723 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7117376 PerReadThreadRawHdfsThroughput: 1253008320 RemoteScanRanges: 0 RowsRead: 130000 RowsReturned: 130000 RowsReturnedRate: 128010 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 152 ScannerThreadsSysTime: 4999000 ScannerThreadsTotalWallClockTime: 563532113 ScannerThreadsUserTime: 554915000 ScannerThreadsVoluntaryContextSwitches: 7 TotalRawHdfsReadTime(*): 627011 TotalReadThroughput: 3907 TotalTime: 1015540658 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0 Instance c441d45ac6132d78:99a92025da50dee1 (host=vc0336.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:1/11.92 MB AverageThreadTokens: 4607193566323847533 BloomFilterBytes: 0 InactiveTotalTime: 0 PeakMemoryUsage: 8016264 PerHostPeakMemUsage: 433750848 PrepareTime: 110928 RowsProduced: 150000 TotalCpuTime: 5826268246 TotalNetworkReceiveTime: 0 TotalNetworkSendTime: 197426470118 TotalStorageWaitTime: 3762464 TotalTime: 198515152091 DataStreamSender (dst_id=13) BytesSent: 11572925 InactiveTotalTime: 0 NetworkThroughput(*): 57695 OverallThroughput: 58602 PeakMemoryUsage: 38192 SerializeBatchTime: 20084442 ThriftTransmitTime(*): 200586487035 TotalTime: 197482706980 UncompressedRowBatchSize: 29404116 HDFS_SCAN_NODE (id=0) Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Runtime filters: Only following filters arrived: , waited 1s008ms File Formats: PARQUET/SNAPPY:2 Hdfs split stats (:<# splits>/): 1:1/11.92 MB AverageHdfsReadThreadConcurrency: 0 AverageScannerThreadConcurrency: 4567853954727336443 BytesRead: 878468 BytesReadDataNodeCache: 0 BytesReadLocal: 878468 BytesReadRemoteUnexpected: 0 BytesReadShortCircuit: 878468 DecompressionTime: 1431383 InactiveTotalTime: 0 MaterializeTupleTime(*): 9723332 MaxCompressedTextFileLength: 0 NumColumns: 2 NumDisksAccessed: 1 NumRowGroups: 1 NumScannerThreadsStarted: 1 PeakMemoryUsage: 7945304 PerReadThreadRawHdfsThroughput: 1319728443 RemoteScanRanges: 0 RowsRead: 150000 RowsReturned: 150000 RowsReturnedRate: 146957 ScanRangesComplete: 1 ScannerThreadsInvoluntaryContextSwitches: 163 ScannerThreadsSysTime: 3999000 ScannerThreadsTotalWallClockTime: 496136226 ScannerThreadsUserTime: 485926000 ScannerThreadsVoluntaryContextSwitches: 9 TotalRawHdfsReadTime(*): 665643 TotalReadThroughput: 4348 TotalTime: 1020701290 Filter 1 InactiveTotalTime: 0 Rows processed: 16383 Rows rejected: 0 Rows total: 16384 TotalTime: 0