Query (id=e743f6c0eaa908e0:f107a9c66d3751a1): Summary: Session ID: d04377a57abfda29:502a0a9f21989287 Session Type: BEESWAX Start Time: 2014-03-19 16:55:45.724323000 End Time: 2014-03-19 16:56:38.338559000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded Impala Version: impalad version 1.3.0-INTERNAL RELEASE (build af37dd6fac1c08af7ec68370d0f077fb48ee1549) User: jenkins Network Address: 10.20.90.10:37087 Default Db: tpcds1000gb_parquet Sql Statement: SELECT c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt FROM (SELECT ss_ticket_number, ss_customer_sk, COUNT(*) AS cnt FROM store_sales ss JOIN date_dim d ON (ss.ss_sold_date_sk = d.d_date_sk) JOIN household_demographics hd ON (ss.ss_hdemo_sk = hd.hd_demo_sk) JOIN store s ON (ss.ss_store_sk = s.s_store_sk) WHERE d.d_dom BETWEEN 1 AND 2 AND (hd.hd_buy_potential = '>10000' OR hd.hd_buy_potential = 'unknown') AND hd.hd_vehicle_count > 0 AND CASE WHEN hd.hd_vehicle_count > 0 THEN hd.hd_dep_count / hd.hd_vehicle_count ELSE NULL END > 1 AND d.d_year IN (1999, 1999 + 1, 1999 + 2) AND s.s_county IN ('Williamson County', 'Ziebach County', 'Ziebach County', 'Ziebach County') GROUP BY ss_ticket_number, ss_customer_sk ) dj JOIN customer c ON (dj.ss_customer_sk = c.c_customer_sk) WHERE cnt BETWEEN 1 AND 5 ORDER BY cnt DESC LIMIT 100 Plan: ---------------- Estimated Per-Host Requirements: Memory=170.75GB VCores=4 F06:PLAN FRAGMENT [PARTITION=UNPARTITIONED] 18:TOP-N [LIMIT=100] | order by: cnt DESC | hosts=10 per-host-mem=unavailable | tuple-ids=4,6 row-size=108B cardinality=100 | 17:EXCHANGE [PARTITION=UNPARTITIONED] hosts=10 per-host-mem=unavailable tuple-ids=4,6 row-size=108B cardinality=100 F04:PLAN FRAGMENT [PARTITION=HASH(ss_ticket_number,ss_customer_sk)] DATASTREAM SINK [FRAGMENT=F06, EXCHANGE=17, PARTITION=UNPARTITIONED] 10:TOP-N [LIMIT=100] | order by: cnt DESC | hosts=10 per-host-mem=10.51KB | tuple-ids=4,6 row-size=108B cardinality=100 | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_customer_sk = c.c_customer_sk | hosts=10 per-host-mem=2.69GB | tuple-ids=4,6 row-size=108B cardinality=8251124389 | |--16:EXCHANGE [BROADCAST] | hosts=10 per-host-mem=0B | tuple-ids=6 row-size=88B cardinality=30000000 | 15:AGGREGATE [MERGE FINALIZE] | output: sum(count(*)) | group by: ss_ticket_number, ss_customer_sk | having: count(*) >= 1, count(*) <= 5 | hosts=10 per-host-mem=1.69GB | tuple-ids=4 row-size=20B cardinality=8251124389 | 14:EXCHANGE [PARTITION=HASH(ss_ticket_number,ss_customer_sk)] hosts=10 per-host-mem=0B tuple-ids=4 row-size=20B cardinality=8251124389 F05:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F04, EXCHANGE=16, BROADCAST] 08:SCAN HDFS [tpcds1000gb_parquet.customer c, PARTITION=RANDOM] partitions=1/1 size=1.75GB table stats: 30000000 rows total column stats: all hosts=10 per-host-mem=440.00MB tuple-ids=6 row-size=88B cardinality=30000000 F00:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F04, EXCHANGE=14, PARTITION=HASH(ss_ticket_number,ss_customer_sk)] 07:AGGREGATE | output: count(*) | group by: ss_ticket_number, ss_customer_sk | hosts=10 per-host-mem=169.06GB | tuple-ids=4 row-size=20B cardinality=8251124389 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss.ss_store_sk = s.s_store_sk | hosts=10 per-host-mem=5.00KB | tuple-ids=0,1,2,3 row-size=129B cardinality=8251124389 | |--13:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=3 row-size=38B cardinality=123 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss.ss_hdemo_sk = hd.hd_demo_sk | hosts=10 per-host-mem=956B | tuple-ids=0,1,2 row-size=92B cardinality=8251124389 | |--12:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=2 row-size=40B cardinality=22 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss.ss_sold_date_sk = d.d_date_sk | hosts=10 per-host-mem=176B | tuple-ids=0,1 row-size=52B cardinality=8251124389 | |--11:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=1 row-size=16B cardinality=10 | 00:SCAN HDFS [tpcds1000gb_parquet.store_sales ss, PARTITION=RANDOM] partitions=1823/1823 size=558.06GB table stats: 8251124389 rows total column stats: all hosts=10 per-host-mem=440.00MB tuple-ids=0 row-size=36B cardinality=8251124389 F03:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=13, BROADCAST] 03:SCAN HDFS [tpcds1000gb_parquet.store s, PARTITION=RANDOM] partitions=1/1 size=121.03KB predicates: s.s_county IN ('Williamson County', 'Ziebach County', 'Ziebach County', 'Ziebach County') table stats: 1350 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=3 row-size=38B cardinality=123 F02:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=12, BROADCAST] 02:SCAN HDFS [tpcds1000gb_parquet.household_demographics hd, PARTITION=RANDOM] partitions=1/1 size=33.93KB predicates: (hd.hd_buy_potential = '>10000' OR hd.hd_buy_potential = 'unknown'), hd.hd_vehicle_count > 0, CASE WHEN hd.hd_vehicle_count > 0 THEN hd.hd_dep_count / hd.hd_vehicle_count ELSE NULL END > 1.0 table stats: 7200 rows total column stats: all hosts=3 per-host-mem=64.00MB tuple-ids=2 row-size=40B cardinality=22 F01:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=11, BROADCAST] 01:SCAN HDFS [tpcds1000gb_parquet.date_dim d, PARTITION=RANDOM] partitions=1/1 size=2.03MB predicates: d.d_dom >= 1, d.d_dom <= 2, d.d_year IN (1999, 1999 + 1, 1999 + 2) table stats: 73049 rows total column stats: all hosts=3 per-host-mem=48.00MB tuple-ids=1 row-size=16B cardinality=10 ---------------- Estimated Per-Host Mem: 183339978060 Estimated Per-Host VCores: 4 Admission result: Admitted immediately Request Pool: default-pool Query Timeline: 52s636ms - Start execution: 2.645ms (2.645ms) - Planning finished: 107.596ms (104.951ms) - Submit for admission: 111.635ms (4.39ms) - Completed admission: 111.762ms (126.265us) - Rows available: 52s587ms (52s475ms) - First row fetched: 52s614ms (26.841ms) - Unregister query: 52s614ms (126.722us) ImpalaServer: - ClientFetchWaitTimer: 26.917ms - RowMaterializationTimer: 0ns Execution Profile e743f6c0eaa908e0:f107a9c66d3751a1:(Active: 52s465ms, % non-child: 0.00%) Per Node Peak Memory Usage: c2310.halxg.cloudera.com:22000(20.39 GB) c2304.halxg.cloudera.com:22000(7.51 GB) c2332.halxg.cloudera.com:22000(29.20 GB) c2302.halxg.cloudera.com:22000(29.03 GB) c2306.halxg.cloudera.com:22000(16.44 GB) c2330.halxg.cloudera.com:22000(10.23 GB) c2308.halxg.cloudera.com:22000(23.06 GB) c2338.halxg.cloudera.com:22000(15.17 GB) c2334.halxg.cloudera.com:22000(10.95 GB) c2336.halxg.cloudera.com:22000(13.12 GB) - FinalizationTimer: 0ns Coordinator Fragment:(Active: 47s636ms, % non-child: 0.00%) MemoryUsage(1s000ms): 16.00 KB, 16.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 24.00 KB, 16.00 KB, 16.00 KB ThreadUsage(500.0ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 32.00 KB - PrepareTime: 66.503us - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 47s636ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 114.134ms, % non-child: 0.24%) - CodegenTime: 0ns - CompileTime: 97.762ms - LoadTime: 14.983ms - ModuleFileSize: 108.78 KB SORT_NODE (id=18):(Active: 47s636ms, % non-child: 0.00%) - PeakMemoryUsage: 16.00 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=17):(Active: 47s636ms, % non-child: 100.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 - BytesReceived: 0.00 - ConvertRowBatchTime: 577ns - DataArrivalWaitTime: 47s636ms - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 47s636ms - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 1: split sizes: min: 0.00 , max: 0.00 , avg: 0.00 , stddev: 0.00 completion times: min:51s674ms max:52s072ms mean: 52s017ms stddev:114.823ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 10 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.34 GB - PrepareTime: 13.687ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m27s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 256.765ms, % non-child: 100.00%) - CodegenTime: 3.626ms - CompileTime: 209.110ms - LoadTime: 35.448ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 25.129us, % non-child: 100.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): - BuildBuckets: 16.78M (16777216) - BuildRows: 26.75M (26752000) - BuildTime: 7s536ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.34 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 40s624ms, % non-child: 100.00%) - BytesReceived: 1.41 GB - ConvertRowBatchTime: 691.110ms - DataArrivalWaitTime: 30s175ms - DeserializeRowBatchTimer: 18s805ms - FirstBatchArrivalWaitTime: 832.606ms - PeakMemoryUsage: 18.59 MB - RowsReturned: 26.75M (26752414) - RowsReturnedRate: 658.83 K/sec - SendersBlockedTimer: 4s836ms - SendersBlockedTotalTimer(*): 29s096ms AGGREGATION_NODE (id=15):(Active: 3.561ms, % non-child: 0.00%) - BuildBuckets: 8.19K (8192) - BuildTime: 4.340ms - GetResultsTime: 0ns - LoadFactor: 0.68 - PeakMemoryUsage: 695.49 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 47s371ms, % non-child: 100.00%) - BytesReceived: 161.26 KB - ConvertRowBatchTime: 270.217us - DataArrivalWaitTime: 47s373ms - DeserializeRowBatchTimer: 1.978ms - FirstBatchArrivalWaitTime: 41s155ms - PeakMemoryUsage: 30.19 KB - RowsReturned: 9.87K (9872) - RowsReturnedRate: 206.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 2:(Active: 38s869ms, % non-child: 0.00%) split sizes: min: 117.94 MB, max: 294.06 MB, avg: 199.28 MB, stddev: 51.60 MB completion times: min:31s830ms max:51s516ms mean: 45s633ms stddev:6s603ms execution rates: min:3.71 MB/sec max:5.72 MB/sec mean:4.31 MB/sec stddev:612.90 KB/sec num instances: 9 - AverageThreadTokens: 2.10 - PeakMemoryUsage: 43.42 MB - PrepareTime: 78.413us - RowsProduced: 2.97M (2968106) - TotalCpuTime: 26s857ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 39s755ms - TotalStorageWaitTime: 483.311ms CodeGen:(Active: 98.568ms, % non-child: 0.25%) - CodegenTime: 0ns - CompileTime: 89.724ms - LoadTime: 7.982ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 43s245ms, % non-child: 100.00%) - BytesSent: 160.30 MB - NetworkThroughput(*): 1.61 MB/sec - OverallThroughput: 3.69 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s237ms - ThriftTransmitTime(*): 1m39s - UncompressedRowBatchSize: 282.06 MB HDFS_SCAN_NODE (id=8):(Active: 463.992ms, % non-child: 1.19%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.10 - BytesRead: 24.76 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 12.60 MB - BytesReadShortCircuit: 12.60 MB - DecompressionTime: 193.829ms - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 43.35 MB - PerReadThreadRawHdfsThroughput: 114.98 MB/sec - RowsRead: 3.01M (3014698) - RowsReturned: 2.97M (2968106) - RowsReturnedRate: 6.55 M/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 43 - ScannerThreadsTotalWallClockTime: 24s719ms - MaterializeTupleTime(*): 24s357ms - ScannerThreadsSysTime: 15.747ms - ScannerThreadsUserTime: 624.904ms - ScannerThreadsVoluntaryContextSwitches: 1.65K (1654) - TotalRawHdfsReadTime(*): 227.722ms - TotalReadThroughput: 557.23 KB/sec Averaged Fragment 3:(Active: 31s167ms, % non-child: 0.00%) split sizes: min: 55.57 GB, max: 55.97 GB, avg: 55.81 GB, stddev: 120.81 MB completion times: min:40s076ms max:51s019ms mean: 46s963ms stddev:4s300ms execution rates: min:1.09 GB/sec max:1.39 GB/sec mean:1.20 GB/sec stddev:115.75 MB/sec num instances: 10 - AverageThreadTokens: 15.85 - PeakMemoryUsage: 17.51 GB - PrepareTime: 14.107ms - RowsProduced: 11.90K (11900) - TotalCpuTime: 7m46s - TotalNetworkReceiveTime: 2s118ms - TotalNetworkSendTime: 3.117ms - TotalStorageWaitTime: 1m19s CodeGen:(Active: 432.410ms, % non-child: 1.39%) - CodegenTime: 2.498ms - CompileTime: 423.625ms - LoadTime: 7.939ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 3.563ms, % non-child: 0.01%) - BytesSent: 191.48 KB - NetworkThroughput(*): 13.51 MB/sec - OverallThroughput: 36.18 MB/sec - PeakMemoryUsage: 249.28 KB - SerializeBatchTime: 1.932ms - ThriftTransmitTime(*): 10.28ms - UncompressedRowBatchSize: 320.58 KB AGGREGATION_NODE (id=7):(Active: 31s166ms, % non-child: 0.00%) - BuildBuckets: 15.15K (15155) - BuildTime: 881.755ms - GetResultsTime: 828.671us - LoadFactor: 0.62 - PeakMemoryUsage: 14.79 GB - RowsReturned: 11.90K (11900) - RowsReturnedRate: 272.00 /sec HASH_JOIN_NODE (id=6):(Active: 38s518ms, % non-child: 0.00%) - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 10.886us - LeftChildRows: 2.10M (2100337) - LeftChildTime: 157.242ms - LoadFactor: 0.07 - PeakMemoryUsage: 14.62 GB - RowsReturned: 144.63K (144629) - RowsReturnedRate: 3.83 K/sec EXCHANGE_NODE (id=13):(Active: 800.168ms, % non-child: 2.57%) - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.887us - DataArrivalWaitTime: 800.152ms - DeserializeRowBatchTimer: 20.722us - FirstBatchArrivalWaitTime: 798.369ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 92.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 40s627ms, % non-child: 1.71%) - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 34.993us - LeftChildRows: 29.80M (29796612) - LeftChildTime: 939.982ms - LoadFactor: 0.43 - PeakMemoryUsage: 16.82 GB - RowsReturned: 2.10M (2100453) - RowsReturnedRate: 53.30 K/sec EXCHANGE_NODE (id=12):(Active: 439.317ms, % non-child: 1.41%) - BytesReceived: 8.72 KB - ConvertRowBatchTime: 14.57us - DataArrivalWaitTime: 439.289ms - DeserializeRowBatchTimer: 90.357us - FirstBatchArrivalWaitTime: 436.389ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.20 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 39s654ms, % non-child: 63.60%) - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.609us - LeftChildRows: 768.37M (768366282) - LeftChildTime: 21s529ms - LoadFactor: 0.07 - PeakMemoryUsage: 440.19 KB - RowsReturned: 29.80M (29796716) - RowsReturnedRate: 779.23 K/sec EXCHANGE_NODE (id=11):(Active: 878.708ms, % non-child: 2.82%) - BytesReceived: 1.00 KB - ConvertRowBatchTime: 3.964us - DataArrivalWaitTime: 878.692ms - DeserializeRowBatchTimer: 20.758us - FirstBatchArrivalWaitTime: 876.111ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 81.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 18s954ms, % non-child: 60.82%) - AverageHdfsReadThreadConcurrency: 0.93 - AverageScannerThreadConcurrency: 14.96 - BytesRead: 4.02 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 2.97 GB - BytesReadShortCircuit: 2.97 GB - DecompressionTime: 1m59s - NumColumns: 0 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 18 - PeakMemoryUsage: 676.54 MB - PerReadThreadRawHdfsThroughput: 101.17 MB/sec - RowsRead: 768.41M (768407344) - RowsReturned: 768.37M (768366589) - RowsReturnedRate: 45.66 M/sec - ScanRangesComplete: 167 - ScannerThreadsInvoluntaryContextSwitches: 45.35K (45350) - ScannerThreadsTotalWallClockTime: 7m44s - MaterializeTupleTime(*): 7m43s - ScannerThreadsSysTime: 7s154ms - ScannerThreadsUserTime: 2m26s - ScannerThreadsVoluntaryContextSwitches: 730.69K (730686) - TotalRawHdfsReadTime(*): 41s205ms - TotalReadThroughput: 90.06 MB/sec Averaged Fragment 4:(Active: 583.745ms, % non-child: 0.00%) split sizes: min: 121.03 KB, max: 121.03 KB, avg: 121.03 KB, stddev: 0.00 completion times: min:587.909ms max:587.909ms mean: 587.909ms stddev:0ns execution rates: min:205.86 KB/sec max:205.86 KB/sec mean:205.86 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 244.55 KB - PrepareTime: 634.179us - RowsProduced: 74 - TotalCpuTime: 925.310ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 390.379us - TotalStorageWaitTime: 368.548ms CodeGen:(Active: 117.382ms, % non-child: 20.11%) - CodegenTime: 500.416us - CompileTime: 108.103ms - LoadTime: 8.275ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=13):(Active: 490.163us, % non-child: 0.08%) - BytesSent: 1.43 KB - NetworkThroughput(*): 371.64 KB/sec - OverallThroughput: 2.84 MB/sec - PeakMemoryUsage: 40.00 KB - SerializeBatchTime: 33.581us - ThriftTransmitTime(*): 3.836ms - UncompressedRowBatchSize: 3.71 KB HDFS_SCAN_NODE (id=3):(Active: 582.999ms, % non-child: 99.87%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 107.58 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 107.58 KB - BytesReadShortCircuit: 107.58 KB - DecompressionTime: 39.641us - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 196.55 KB - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RowsRead: 1.35K (1350) - RowsReturned: 74 - RowsReturnedRate: 126.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 583.15ms - MaterializeTupleTime(*): 161.434us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 76.165us - TotalReadThroughput: 0.00 /sec Averaged Fragment 5:(Active: 29.570ms, % non-child: 0.00%) split sizes: min: 33.93 KB, max: 33.93 KB, avg: 33.93 KB, stddev: 0.00 completion times: min:178.701ms max:178.701ms mean: 178.701ms stddev:0ns execution rates: min:189.85 KB/sec max:189.85 KB/sec mean:189.85 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 309.48 KB - PrepareTime: 33.616ms - RowsProduced: 520 - TotalCpuTime: 200.869ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.27ms - TotalStorageWaitTime: 26.456ms CodeGen:(Active: 126.850ms, % non-child: 100.00%) - CodegenTime: 926.24us - CompileTime: 117.856ms - LoadTime: 8.86ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=12):(Active: 1.189ms, % non-child: 4.02%) - BytesSent: 8.72 KB - NetworkThroughput(*): 792.40 KB/sec - OverallThroughput: 7.16 MB/sec - PeakMemoryUsage: 31.95 KB - SerializeBatchTime: 143.978us - ThriftTransmitTime(*): 11.6ms - UncompressedRowBatchSize: 25.40 KB HDFS_SCAN_NODE (id=2):(Active: 27.901ms, % non-child: 94.36%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 65.76 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 65.76 KB - BytesReadShortCircuit: 65.76 KB - DecompressionTime: 194.716us - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 269.52 KB - PerReadThreadRawHdfsThroughput: 7.74 MB/sec - RowsRead: 7.20K (7200) - RowsReturned: 520 - RowsReturnedRate: 18.64 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 28.6ms - MaterializeTupleTime(*): 965.642us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 11 - TotalRawHdfsReadTime(*): 8.298ms - TotalReadThroughput: 0.00 /sec Averaged Fragment 6:(Active: 290.784ms, % non-child: 0.00%) split sizes: min: 2.03 MB, max: 2.03 MB, avg: 2.03 MB, stddev: 0.00 completion times: min:296.549ms max:296.549ms mean: 296.549ms stddev:0ns execution rates: min:6.86 MB/sec max:6.86 MB/sec mean:6.86 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 1.74 MB - PrepareTime: 1.480ms - RowsProduced: 72 - TotalCpuTime: 565.416ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 533.898us - TotalStorageWaitTime: 165.826ms CodeGen:(Active: 134.454ms, % non-child: 46.24%) - CodegenTime: 1.314ms - CompileTime: 113.766ms - LoadTime: 17.956ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=11):(Active: 708.705us, % non-child: 0.24%) - BytesSent: 1.01 KB - NetworkThroughput(*): 177.94 KB/sec - OverallThroughput: 1.39 MB/sec - PeakMemoryUsage: 53.28 KB - SerializeBatchTime: 30.570us - ThriftTransmitTime(*): 5.658ms - UncompressedRowBatchSize: 1.98 KB HDFS_SCAN_NODE (id=1):(Active: 289.644ms, % non-child: 99.61%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 415.33 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 415.33 KB - BytesReadShortCircuit: 415.33 KB - DecompressionTime: 2.134ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.68 MB - PerReadThreadRawHdfsThroughput: 2.58 GB/sec - RowsRead: 73.05K (73049) - RowsReturned: 72 - RowsReturnedRate: 248.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 289.712ms - MaterializeTupleTime(*): 10.156ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 11.998ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 153.356us - TotalReadThroughput: 0.00 /sec Fragment 1: Instance e743f6c0eaa908e0:f107a9c66d3751a3 (host=c2310.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 114.45 KB, 126.04 MB, 295.48 MB, 358.55 MB, 437.10 MB, 493.39 MB, 537.27 MB, 574.92 MB, 649.02 MB, 723.13 MB, 778.75 MB, 851.50 MB, 892.47 MB, 988.67 MB, 1.06 GB, 1.12 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.40 GB, 1.53 GB, 1.58 GB, 1.60 GB, 1.65 GB, 1.70 GB, 1.76 GB, 1.81 GB, 1.86 GB, 1.92 GB, 1.97 GB, 2.02 GB, 2.27 GB, 2.32 GB, 2.38 GB, 2.42 GB, 2.47 GB, 2.51 GB, 2.56 GB, 2.60 GB, 2.65 GB, 2.71 GB, 2.75 GB, 2.79 GB, 2.84 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 2.90 GB - PrepareTime: 6.180ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m20s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 227.519ms, % non-child: 0.00%) - CodegenTime: 2.640ms - CompileTime: 206.599ms - LoadTime: 20.11ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 25.269us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 24.63M (24633344) - BuildTime: 6s963ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 2.90 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 37s990ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 53.31 MB, 127.15 MB, 156.91 MB, 182.38 MB, 204.35 MB, 230.43 MB, 252.80 MB, 279.42 MB, 306.12 MB, 339.11 MB, 363.22 MB, 387.73 MB, 418.93 MB, 450.41 MB, 488.09 MB, 521.42 MB, 544.28 MB, 566.42 MB, 591.97 MB, 618.01 MB, 640.35 MB, 651.94 MB, 663.83 MB, 692.95 MB, 723.04 MB, 759.35 MB, 791.09 MB, 822.16 MB, 854.25 MB, 885.20 MB, 918.50 MB, 950.21 MB, 984.68 MB, 1017.63 MB, 1.02 GB, 1.05 GB, 1.07 GB, 1.10 GB, 1.13 GB, 1.16 GB, 1.19 GB, 1.21 GB, 1.24 GB, 1.27 GB - BytesReceived: 1.30 GB - ConvertRowBatchTime: 630.98ms - DataArrivalWaitTime: 33s060ms - DeserializeRowBatchTimer: 14s211ms - FirstBatchArrivalWaitTime: 878.873ms - PeakMemoryUsage: 18.42 MB - RowsReturned: 24.63M (24634368) - RowsReturnedRate: 648.44 K/sec - SendersBlockedTimer: 1s395ms - SendersBlockedTotalTimer(*): 9s446ms AGGREGATION_NODE (id=15):(Active: 2.427ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 2.108ms - GetResultsTime: 0ns - LoadFactor: 0.53 - PeakMemoryUsage: 526.23 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 43s569ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 22.11 KB, 66.96 KB, 85.04 KB, 103.12 KB - BytesReceived: 103.12 KB - ConvertRowBatchTime: 184.304us - DataArrivalWaitTime: 43s568ms - DeserializeRowBatchTimer: 435.341us - FirstBatchArrivalWaitTime: 41s201ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 6.31K (6312) - RowsReturnedRate: 144.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a8 (host=c2308.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 114.45 KB, 98.45 MB, 276.22 MB, 353.04 MB, 406.76 MB, 469.18 MB, 532.47 MB, 570.29 MB, 643.04 MB, 716.84 MB, 775.12 MB, 832.06 MB, 885.24 MB, 984.43 MB, 1.05 GB, 1.11 GB, 1.17 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.33 GB, 1.53 GB, 1.58 GB, 1.60 GB, 1.65 GB, 1.69 GB, 1.75 GB, 1.81 GB, 1.86 GB, 1.91 GB, 1.96 GB, 2.02 GB, 2.16 GB, 2.32 GB, 2.37 GB, 2.42 GB, 2.46 GB, 2.51 GB, 2.55 GB, 2.60 GB, 2.64 GB, 2.70 GB, 2.75 GB, 2.79 GB, 2.83 GB, 2.95 GB, 3.31 GB, 3.38 GB, 3.40 GB, 3.40 GB, 3.40 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.127ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m31s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 215.38ms, % non-child: 0.00%) - CodegenTime: 2.634ms - CompileTime: 205.909ms - LoadTime: 8.251ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.559us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.07M (27066368) - BuildTime: 7s183ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 42s238ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 42.79 MB, 122.83 MB, 153.20 MB, 180.45 MB, 200.96 MB, 227.60 MB, 250.03 MB, 275.81 MB, 302.09 MB, 336.41 MB, 360.90 MB, 383.12 MB, 416.35 MB, 446.36 MB, 483.14 MB, 518.59 MB, 541.40 MB, 563.72 MB, 588.81 MB, 614.65 MB, 637.51 MB, 651.98 MB, 660.68 MB, 689.70 MB, 719.32 MB, 754.89 MB, 787.66 MB, 818.17 MB, 850.67 MB, 881.41 MB, 914.19 MB, 946.14 MB, 980.19 MB, 1014.05 MB, 1.02 GB, 1.04 GB, 1.07 GB, 1.10 GB, 1.12 GB, 1.15 GB, 1.18 GB, 1.21 GB, 1.24 GB, 1.26 GB, 1.33 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.43 GB, 1.43 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 725.449ms - DataArrivalWaitTime: 24s502ms - DeserializeRowBatchTimer: 25s208ms - FirstBatchArrivalWaitTime: 892.595ms - PeakMemoryUsage: 18.73 MB - RowsReturned: 27.07M (27066706) - RowsReturnedRate: 640.81 K/sec - SendersBlockedTimer: 9s611ms - SendersBlockedTotalTimer(*): 1m1s AGGREGATION_NODE (id=15):(Active: 2.404ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 3.581ms - GetResultsTime: 0ns - LoadFactor: 0.75 - PeakMemoryUsage: 873.36 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 49s824ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 21.64 KB, 54.16 KB, 84.14 KB, 103.23 KB, 103.23 KB, 103.23 KB, 154.13 KB, 154.13 KB, 165.94 KB, 188.89 KB - BytesReceived: 188.89 KB - ConvertRowBatchTime: 325.74us - DataArrivalWaitTime: 49s823ms - DeserializeRowBatchTimer: 1.95ms - FirstBatchArrivalWaitTime: 41s215ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 11.56K (11561) - RowsReturnedRate: 232.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a5 (host=c2306.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 106.45 KB, 68.29 MB, 274.96 MB, 347.16 MB, 422.14 MB, 482.08 MB, 527.70 MB, 565.91 MB, 637.87 MB, 710.66 MB, 767.05 MB, 827.96 MB, 877.52 MB, 977.55 MB, 1.05 GB, 1.11 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.32 GB, 1.49 GB, 1.58 GB, 1.59 GB, 1.64 GB, 1.69 GB, 1.75 GB, 1.80 GB, 1.85 GB, 1.90 GB, 1.95 GB, 2.01 GB, 2.25 GB, 2.31 GB, 2.37 GB, 2.41 GB, 2.46 GB, 2.50 GB, 2.55 GB, 2.59 GB, 2.64 GB, 2.69 GB, 2.74 GB, 2.78 GB, 2.83 GB, 2.93 GB, 3.31 GB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - PeakMemoryUsage: 3.38 GB - PrepareTime: 6.158ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m25s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 228.60ms, % non-child: 0.00%) - CodegenTime: 2.657ms - CompileTime: 208.202ms - LoadTime: 18.764ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.80us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 26.76M (26759168) - BuildTime: 7s546ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.38 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 39s354ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 29.75 MB, 114.69 MB, 150.15 MB, 178.34 MB, 197.65 MB, 224.79 MB, 247.42 MB, 272.81 MB, 298.69 MB, 332.13 MB, 358.74 MB, 378.85 MB, 412.28 MB, 442.69 MB, 478.69 MB, 515.30 MB, 538.70 MB, 560.85 MB, 585.47 MB, 611.24 MB, 634.31 MB, 651.97 MB, 658.24 MB, 686.17 MB, 715.57 MB, 750.85 MB, 785.33 MB, 814.69 MB, 846.91 MB, 877.97 MB, 910.30 MB, 942.12 MB, 975.72 MB, 1010.56 MB, 1.02 GB, 1.04 GB, 1.07 GB, 1.09 GB, 1.12 GB, 1.15 GB, 1.18 GB, 1.21 GB, 1.23 GB, 1.26 GB, 1.32 GB, 1.38 GB - BytesReceived: 1.41 GB - ConvertRowBatchTime: 704.607ms - DataArrivalWaitTime: 28s801ms - DeserializeRowBatchTimer: 19s255ms - FirstBatchArrivalWaitTime: 878.911ms - PeakMemoryUsage: 18.63 MB - RowsReturned: 26.76M (26759506) - RowsReturnedRate: 679.97 K/sec - SendersBlockedTimer: 3s328ms - SendersBlockedTotalTimer(*): 14s934ms AGGREGATION_NODE (id=15):(Active: 2.430ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 9.875ms - GetResultsTime: 0ns - LoadFactor: 0.67 - PeakMemoryUsage: 621.66 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 46s747ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 21.81 KB, 54.33 KB, 65.04 KB, 103.16 KB, 103.16 KB, 103.16 KB - BytesReceived: 154.61 KB - ConvertRowBatchTime: 318.198us - DataArrivalWaitTime: 46s747ms - DeserializeRowBatchTimer: 5.782ms - FirstBatchArrivalWaitTime: 41s201ms - PeakMemoryUsage: 42.62 KB - RowsReturned: 9.47K (9473) - RowsReturnedRate: 202.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751aa (host=c2334.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 114.45 KB, 129.64 MB, 298.17 MB, 360.37 MB, 438.36 MB, 495.62 MB, 538.77 MB, 576.60 MB, 650.89 MB, 725.79 MB, 779.46 MB, 852.81 MB, 895.32 MB, 990.68 MB, 1.06 GB, 1.13 GB, 1.18 GB, 1.22 GB, 1.25 GB, 1.29 GB, 1.40 GB, 1.53 GB, 1.58 GB, 1.60 GB, 1.65 GB, 1.70 GB, 1.76 GB, 1.81 GB, 1.87 GB, 1.92 GB, 1.97 GB, 2.02 GB, 2.27 GB, 2.33 GB, 2.38 GB, 2.43 GB, 2.47 GB, 2.51 GB, 2.56 GB, 2.60 GB, 2.65 GB, 2.71 GB, 2.75 GB, 2.80 GB, 2.84 GB, 2.97 GB, 3.33 GB, 3.38 GB, 3.40 GB, 3.40 GB, 3.40 GB, 3.40 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.24ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m31s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 229.574ms, % non-child: 0.00%) - CodegenTime: 2.558ms - CompileTime: 206.78ms - LoadTime: 22.620ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.22us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.07M (27067392) - BuildTime: 7s110ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 42s298ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 55.63 MB, 128.77 MB, 157.98 MB, 183.10 MB, 205.70 MB, 231.32 MB, 253.83 MB, 280.53 MB, 307.71 MB, 339.53 MB, 363.93 MB, 389.39 MB, 420.13 MB, 451.99 MB, 490.01 MB, 522.44 MB, 545.19 MB, 567.41 MB, 592.90 MB, 619.00 MB, 641.33 MB, 651.97 MB, 665.15 MB, 694.19 MB, 724.56 MB, 761.14 MB, 792.27 MB, 823.80 MB, 855.61 MB, 886.70 MB, 920.23 MB, 951.08 MB, 986.18 MB, 1018.81 MB, 1.02 GB, 1.05 GB, 1.07 GB, 1.10 GB, 1.13 GB, 1.16 GB, 1.19 GB, 1.22 GB, 1.24 GB, 1.27 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.43 GB, 1.43 GB, 1.43 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 688.569ms - DataArrivalWaitTime: 37s981ms - DeserializeRowBatchTimer: 13s001ms - FirstBatchArrivalWaitTime: 875.19ms - PeakMemoryUsage: 18.52 MB - RowsReturned: 27.07M (27067730) - RowsReturnedRate: 639.92 K/sec - SendersBlockedTimer: 1s402ms - SendersBlockedTotalTimer(*): 8s317ms AGGREGATION_NODE (id=15):(Active: 2.335ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 3.257ms - GetResultsTime: 0ns - LoadFactor: 0.75 - PeakMemoryUsage: 873.36 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 49s806ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 44.70 KB, 66.27 KB, 84.79 KB, 103.32 KB, 103.32 KB, 111.95 KB, 155.84 KB, 155.84 KB, 167.44 KB, 190.20 KB, 190.20 KB - BytesReceived: 190.20 KB - ConvertRowBatchTime: 300.284us - DataArrivalWaitTime: 49s806ms - DeserializeRowBatchTimer: 880.838us - FirstBatchArrivalWaitTime: 41s197ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 11.65K (11647) - RowsReturnedRate: 233.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a7 (host=c2332.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 114.45 KB, 125.23 MB, 293.68 MB, 357.34 MB, 436.43 MB, 492.14 MB, 536.44 MB, 574.08 MB, 618.71 MB, 721.16 MB, 777.96 MB, 850.82 MB, 890.61 MB, 987.64 MB, 1.06 GB, 1.12 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.33 GB, 1.50 GB, 1.58 GB, 1.60 GB, 1.65 GB, 1.70 GB, 1.76 GB, 1.81 GB, 1.86 GB, 1.92 GB, 1.97 GB, 2.02 GB, 2.27 GB, 2.32 GB, 2.38 GB, 2.42 GB, 2.47 GB, 2.51 GB, 2.56 GB, 2.60 GB, 2.65 GB, 2.71 GB, 2.75 GB, 2.79 GB, 2.84 GB, 2.96 GB, 3.32 GB, 3.38 GB, 3.40 GB, 3.40 GB, 3.40 GB, 3.40 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.569ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m30s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 248.65ms, % non-child: 0.00%) - CodegenTime: 2.784ms - CompileTime: 223.1ms - LoadTime: 24.56ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 22.961us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.07M (27066368) - BuildTime: 8s379ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 41s004ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 52.77 MB, 126.11 MB, 156.20 MB, 182.02 MB, 203.22 MB, 229.43 MB, 251.83 MB, 278.19 MB, 304.95 MB, 338.63 MB, 362.57 MB, 386.62 MB, 418.31 MB, 449.45 MB, 487.09 MB, 520.42 MB, 543.29 MB, 565.49 MB, 591.03 MB, 616.83 MB, 639.39 MB, 652.02 MB, 662.58 MB, 691.88 MB, 721.91 MB, 757.82 MB, 789.92 MB, 821.01 MB, 853.31 MB, 884.04 MB, 917.49 MB, 949.41 MB, 983.60 MB, 1016.69 MB, 1.02 GB, 1.05 GB, 1.07 GB, 1.10 GB, 1.13 GB, 1.15 GB, 1.19 GB, 1.21 GB, 1.24 GB, 1.26 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.43 GB, 1.43 GB, 1.43 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 694.732ms - DataArrivalWaitTime: 17s729ms - DeserializeRowBatchTimer: 29s817ms - FirstBatchArrivalWaitTime: 849.53ms - PeakMemoryUsage: 18.73 MB - RowsReturned: 27.07M (27066706) - RowsReturnedRate: 660.09 K/sec - SendersBlockedTimer: 15s861ms - SendersBlockedTotalTimer(*): 1m41s AGGREGATION_NODE (id=15):(Active: 2.559ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 7.409ms - GetResultsTime: 0ns - LoadFactor: 0.75 - PeakMemoryUsage: 873.36 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 49s777ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 21.96 KB, 55.13 KB, 85.53 KB, 104.72 KB, 104.72 KB, 104.72 KB, 155.19 KB, 155.19 KB, 166.72 KB, 189.39 KB, 189.39 KB - BytesReceived: 189.39 KB - ConvertRowBatchTime: 288.886us - DataArrivalWaitTime: 49s777ms - DeserializeRowBatchTimer: 5.889ms - FirstBatchArrivalWaitTime: 41s171ms - PeakMemoryUsage: 42.62 KB - RowsReturned: 11.60K (11596) - RowsReturnedRate: 232.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751ac (host=c2336.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 106.45 KB, 57.92 MB, 268.98 MB, 345.19 MB, 401.06 MB, 479.74 MB, 525.88 MB, 564.14 MB, 636.00 MB, 708.46 MB, 764.18 MB, 826.88 MB, 874.83 MB, 932.08 MB, 1.05 GB, 1.10 GB, 1.16 GB, 1.20 GB, 1.24 GB, 1.28 GB, 1.32 GB, 1.49 GB, 1.58 GB, 1.59 GB, 1.64 GB, 1.69 GB, 1.74 GB, 1.80 GB, 1.85 GB, 1.90 GB, 1.95 GB, 2.01 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.41 GB, 2.46 GB, 2.50 GB, 2.54 GB, 2.59 GB, 2.63 GB, 2.69 GB, 2.74 GB, 2.78 GB, 2.82 GB, 2.92 GB, 3.31 GB, 3.37 GB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.114ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m26s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 228.100ms, % non-child: 0.00%) - CodegenTime: 2.636ms - CompileTime: 206.169ms - LoadTime: 21.6ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.402us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.02M (27019264) - BuildTime: 7s767ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 40s182ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 24.68 MB, 111.31 MB, 148.95 MB, 177.07 MB, 196.27 MB, 223.72 MB, 246.39 MB, 271.71 MB, 297.38 MB, 330.46 MB, 358.07 MB, 376.96 MB, 410.70 MB, 440.76 MB, 476.91 MB, 513.77 MB, 537.66 MB, 559.99 MB, 584.20 MB, 610.35 MB, 633.20 MB, 651.81 MB, 657.54 MB, 685.03 MB, 714.08 MB, 749.40 MB, 784.04 MB, 813.28 MB, 845.31 MB, 876.72 MB, 908.72 MB, 940.56 MB, 974.16 MB, 1009.09 MB, 1.01 GB, 1.04 GB, 1.07 GB, 1.09 GB, 1.12 GB, 1.15 GB, 1.18 GB, 1.21 GB, 1.23 GB, 1.26 GB, 1.31 GB, 1.38 GB, 1.41 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 719.382ms - DataArrivalWaitTime: 31s262ms - DeserializeRowBatchTimer: 18s333ms - FirstBatchArrivalWaitTime: 877.961ms - PeakMemoryUsage: 18.63 MB - RowsReturned: 27.02M (27019602) - RowsReturnedRate: 672.42 K/sec - SendersBlockedTimer: 3s797ms - SendersBlockedTotalTimer(*): 24s776ms AGGREGATION_NODE (id=15):(Active: 2.402ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 3.325ms - GetResultsTime: 0ns - LoadFactor: 0.68 - PeakMemoryUsage: 620.55 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 46s752ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 22.50 KB, 55.92 KB, 66.83 KB, 104.23 KB, 104.23 KB, 104.23 KB, 156.94 KB - BytesReceived: 156.94 KB - ConvertRowBatchTime: 264.190us - DataArrivalWaitTime: 46s763ms - DeserializeRowBatchTimer: 721.817us - FirstBatchArrivalWaitTime: 41s200ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 9.60K (9601) - RowsReturnedRate: 205.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a6 (host=c2302.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 4.76 MB, 176.25 MB, 322.78 MB, 369.25 MB, 446.21 MB, 505.12 MB, 546.06 MB, 585.33 MB, 658.17 MB, 738.60 MB, 790.43 MB, 857.31 MB, 906.99 MB, 1.02 GB, 1.07 GB, 1.14 GB, 1.19 GB, 1.22 GB, 1.26 GB, 1.30 GB, 1.41 GB, 1.54 GB, 1.58 GB, 1.61 GB, 1.66 GB, 1.71 GB, 1.78 GB, 1.83 GB, 1.88 GB, 1.93 GB, 1.98 GB, 2.13 GB, 2.28 GB, 2.34 GB, 2.39 GB, 2.44 GB, 2.48 GB, 2.52 GB, 2.57 GB, 2.61 GB, 2.67 GB, 2.72 GB, 2.76 GB, 2.80 GB, 2.86 GB, 3.14 GB, 3.34 GB, 3.38 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.40 GB - PrepareTime: 73.867ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m25s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 470.648ms, % non-child: 0.00%) - CodegenTime: 11.511ms - CompileTime: 211.708ms - LoadTime: 156.583ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 31.961us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.02M (27024384) - BuildTime: 8s133ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 39s442ms, % non-child: 0.00%) BytesReceived(1s000ms): 1.88 MB, 74.79 MB, 135.56 MB, 163.32 MB, 187.48 MB, 211.38 MB, 235.65 MB, 258.97 MB, 284.45 MB, 314.59 MB, 345.60 MB, 366.36 MB, 395.96 MB, 426.56 MB, 458.88 MB, 498.09 MB, 526.99 MB, 549.40 MB, 572.17 MB, 597.86 MB, 622.35 MB, 646.03 MB, 652.11 MB, 671.12 MB, 699.75 MB, 731.84 MB, 768.62 MB, 799.15 MB, 829.95 MB, 862.06 MB, 892.98 MB, 926.71 MB, 956.51 MB, 993.29 MB, 1.00 GB, 1.03 GB, 1.05 GB, 1.08 GB, 1.11 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.22 GB, 1.25 GB, 1.28 GB, 1.36 GB, 1.39 GB, 1.42 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 687.268ms - DataArrivalWaitTime: 25s726ms - DeserializeRowBatchTimer: 22s502ms - FirstBatchArrivalWaitTime: 494.784ms - PeakMemoryUsage: 18.62 MB - RowsReturned: 27.02M (27024722) - RowsReturnedRate: 685.17 K/sec - SendersBlockedTimer: 4s020ms - SendersBlockedTotalTimer(*): 18s580ms AGGREGATION_NODE (id=15):(Active: 12.735ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 3.565ms - GetResultsTime: 0ns - LoadFactor: 0.67 - PeakMemoryUsage: 620.77 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 46s369ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 44.11 KB, 66.54 KB, 84.77 KB, 103.00 KB, 103.00 KB, 128.41 KB, 153.82 KB - BytesReceived: 153.82 KB - ConvertRowBatchTime: 231.928us - DataArrivalWaitTime: 46s372ms - DeserializeRowBatchTimer: 873.394us - FirstBatchArrivalWaitTime: 40s817ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 9.42K (9421) - RowsReturnedRate: 203.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a9 (host=c2330.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 106.45 KB, 83.89 MB, 279.39 MB, 348.65 MB, 423.58 MB, 483.80 MB, 529.48 MB, 567.49 MB, 639.73 MB, 712.77 MB, 769.83 MB, 845.55 MB, 880.58 MB, 980.61 MB, 1.05 GB, 1.11 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.33 GB, 1.52 GB, 1.58 GB, 1.59 GB, 1.64 GB, 1.69 GB, 1.75 GB, 1.80 GB, 1.85 GB, 1.91 GB, 1.96 GB, 2.01 GB, 2.26 GB, 2.31 GB, 2.37 GB, 2.42 GB, 2.46 GB, 2.50 GB, 2.55 GB, 2.59 GB, 2.64 GB, 2.70 GB, 2.74 GB, 2.79 GB, 2.83 GB, 2.93 GB, 3.31 GB, 3.38 GB, 3.40 GB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.54ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m27s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 232.461ms, % non-child: 0.00%) - CodegenTime: 2.608ms - CompileTime: 207.668ms - LoadTime: 23.883ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.667us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.07M (27065344) - BuildTime: 7s569ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 41s354ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 34.56 MB, 117.51 MB, 151.04 MB, 179.28 MB, 198.68 MB, 225.84 MB, 248.36 MB, 273.89 MB, 299.93 MB, 333.84 MB, 359.67 MB, 380.38 MB, 413.53 MB, 443.90 MB, 480.24 MB, 516.46 MB, 539.67 MB, 561.93 MB, 586.67 MB, 612.36 MB, 635.51 MB, 651.85 MB, 658.94 MB, 687.24 MB, 717.12 MB, 752.31 MB, 785.99 MB, 816.00 MB, 848.42 MB, 879.15 MB, 911.64 MB, 943.23 MB, 977.42 MB, 1011.75 MB, 1.02 GB, 1.04 GB, 1.07 GB, 1.09 GB, 1.12 GB, 1.15 GB, 1.18 GB, 1.21 GB, 1.24 GB, 1.26 GB, 1.32 GB, 1.38 GB, 1.41 GB, 1.43 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 687.177ms - DataArrivalWaitTime: 34s796ms - DeserializeRowBatchTimer: 14s506ms - FirstBatchArrivalWaitTime: 873.287ms - PeakMemoryUsage: 18.52 MB - RowsReturned: 27.07M (27065682) - RowsReturnedRate: 654.48 K/sec - SendersBlockedTimer: 2s718ms - SendersBlockedTotalTimer(*): 17s461ms AGGREGATION_NODE (id=15):(Active: 2.377ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 3.397ms - GetResultsTime: 0ns - LoadFactor: 0.68 - PeakMemoryUsage: 629.34 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 46s748ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 23.08 KB, 57.07 KB, 68.00 KB, 106.67 KB, 106.67 KB, 106.67 KB, 157.04 KB, 157.04 KB - BytesReceived: 157.04 KB - ConvertRowBatchTime: 274.200us - DataArrivalWaitTime: 46s755ms - DeserializeRowBatchTimer: 1.468ms - FirstBatchArrivalWaitTime: 41s195ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 9.62K (9623) - RowsReturnedRate: 205.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751a4 (host=c2304.halxg.cloudera.com:22000): MemoryUsage(1s000ms): 114.45 KB, 127.53 MB, 297.08 MB, 359.76 MB, 437.85 MB, 494.69 MB, 538.11 MB, 575.81 MB, 650.25 MB, 724.77 MB, 779.35 MB, 852.31 MB, 894.17 MB, 989.56 MB, 1.06 GB, 1.12 GB, 1.18 GB, 1.22 GB, 1.25 GB, 1.29 GB, 1.40 GB, 1.53 GB, 1.58 GB, 1.60 GB, 1.65 GB, 1.70 GB, 1.76 GB, 1.81 GB, 1.86 GB, 1.92 GB, 1.97 GB, 2.02 GB, 2.27 GB, 2.32 GB, 2.38 GB, 2.43 GB, 2.47 GB, 2.51 GB, 2.56 GB, 2.60 GB, 2.65 GB, 2.71 GB, 2.75 GB, 2.80 GB, 2.84 GB, 2.97 GB, 3.33 GB, 3.38 GB, 3.40 GB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 3.40 GB - PrepareTime: 6.90ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1m27s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Active: 231.417ms, % non-child: 0.00%) - CodegenTime: 2.605ms - CompileTime: 206.653ms - LoadTime: 23.857ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=17):(Active: 24.244us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.45 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=10): - PeakMemoryUsage: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=9): ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 16.78M (16777216) - BuildRows: 27.07M (27066368) - BuildTime: 7s171ms - LeftChildRows: 0 - LeftChildTime: 0ns - LoadFactor: 0.50 - PeakMemoryUsage: 3.40 GB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=16):(Active: 41s756ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 54.49 MB, 128.13 MB, 157.64 MB, 182.81 MB, 205.13 MB, 230.92 MB, 253.35 MB, 280.16 MB, 307.10 MB, 339.48 MB, 363.66 MB, 388.71 MB, 419.45 MB, 451.35 MB, 489.28 MB, 522.02 MB, 544.78 MB, 566.98 MB, 592.48 MB, 618.54 MB, 640.89 MB, 651.88 MB, 664.54 MB, 693.67 MB, 723.94 MB, 760.37 MB, 791.73 MB, 823.18 MB, 855.15 MB, 886.23 MB, 919.48 MB, 950.72 MB, 985.63 MB, 1018.33 MB, 1.02 GB, 1.05 GB, 1.07 GB, 1.10 GB, 1.13 GB, 1.16 GB, 1.19 GB, 1.21 GB, 1.24 GB, 1.27 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB - BytesReceived: 1.43 GB - ConvertRowBatchTime: 682.710ms - DataArrivalWaitTime: 37s714ms - DeserializeRowBatchTimer: 12s408ms - FirstBatchArrivalWaitTime: 872.972ms - PeakMemoryUsage: 18.52 MB - RowsReturned: 27.07M (27066706) - RowsReturnedRate: 648.20 K/sec - SendersBlockedTimer: 1s396ms - SendersBlockedTotalTimer(*): 5s909ms AGGREGATION_NODE (id=15):(Active: 2.379ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 2.540ms - GetResultsTime: 0ns - LoadFactor: 0.67 - PeakMemoryUsage: 620.74 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=14):(Active: 46s748ms, % non-child: 0.00%) BytesReceived(1s000ms): 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 0.00 , 45.46 KB, 68.15 KB, 87.09 KB, 106.03 KB, 106.03 KB, 114.20 KB, 157.31 KB, 157.31 KB - BytesReceived: 157.31 KB - ConvertRowBatchTime: 244.894us - DataArrivalWaitTime: 46s749ms - DeserializeRowBatchTimer: 663.196us - FirstBatchArrivalWaitTime: 41s195ms - PeakMemoryUsage: 26.64 KB - RowsReturned: 9.62K (9618) - RowsReturnedRate: 205.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance e743f6c0eaa908e0:f107a9c66d3751ab (host=c2338.halxg.cloudera.com:22000): Fragment 2: Instance e743f6c0eaa908e0:f107a9c66d3751af (host=c2306.halxg.cloudera.com:22000):(Active: 48s896ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/235.17 MB MemoryUsage(1s000ms): 23.57 MB, 47.17 MB, 47.15 MB, 47.18 MB, 47.18 MB, 47.15 MB, 47.18 MB, 47.15 MB, 47.15 MB, 47.18 MB, 47.15 MB, 47.14 MB, 47.15 MB, 47.15 MB, 47.14 MB, 47.15 MB, 47.18 MB, 47.15 MB, 47.18 MB, 47.18 MB, 47.13 MB, 47.18 MB, 47.18 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.22 MB, 47.14 MB, 47.15 MB, 47.15 MB, 47.22 MB, 43.17 MB, 39.22 MB, 39.22 MB, 39.18 MB, 39.21 MB, 39.19 MB, 39.18 MB, 39.18 MB, 39.19 MB, 39.20 MB, 39.18 MB, 39.18 MB, 39.24 MB, 39.21 MB, 39.22 MB, 39.22 MB, 39.18 MB, 39.17 MB, 39.17 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - PeakMemoryUsage: 47.25 MB - PrepareTime: 84.367us - RowsProduced: 3.48M (3476480) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 44s253ms - TotalStorageWaitTime: 342.915ms CodeGen:(Active: 98.800ms, % non-child: 0.20%) - CodegenTime: 0ns - CompileTime: 89.756ms - LoadTime: 8.173ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 48s448ms, % non-child: 99.08%) - BytesSent: 190.85 MB - NetworkThroughput(*): 1.74 MB/sec - OverallThroughput: 3.94 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s895ms - ThriftTransmitTime(*): 1m49s - UncompressedRowBatchSize: 330.37 MB HDFS_SCAN_NODE (id=8):(Active: 428.482ms, % non-child: 0.88%) Hdfs split stats (:<# splits>/): 3:1/235.17 MB BytesRead(1s000ms): 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB, 29.85 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 29.85 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 251.582ms - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 47.20 MB - PerReadThreadRawHdfsThroughput: 140.42 MB/sec - RowsRead: 3.60M (3600384) - RowsReturned: 3.48M (3476480) - RowsReturnedRate: 8.11 M/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 212.565ms - TotalReadThroughput: 599.33 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751ae (host=c2304.halxg.cloudera.com:22000):(Active: 48s356ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/236.11 MB MemoryUsage(1s000ms): 27.68 MB, 47.15 MB, 47.20 MB, 47.15 MB, 47.18 MB, 47.15 MB, 47.15 MB, 47.18 MB, 47.14 MB, 47.14 MB, 47.18 MB, 47.15 MB, 47.18 MB, 47.14 MB, 47.18 MB, 47.15 MB, 47.15 MB, 47.17 MB, 47.14 MB, 47.15 MB, 47.18 MB, 47.14 MB, 47.18 MB, 47.15 MB, 47.15 MB, 47.14 MB, 47.14 MB, 47.18 MB, 47.15 MB, 47.13 MB, 47.17 MB, 47.15 MB, 39.19 MB, 39.21 MB, 39.21 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.21 MB, 39.18 MB, 39.21 MB, 39.19 MB, 39.24 MB, 39.21 MB, 39.21 MB, 39.17 MB, 39.18 MB, 39.18 MB, 39.17 MB, 39.17 MB, 39.17 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 47.24 MB - PrepareTime: 69.907us - RowsProduced: 3.54M (3542016) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 43s753ms - TotalStorageWaitTime: 530.333ms CodeGen:(Active: 96.142ms, % non-child: 0.20%) - CodegenTime: 0ns - CompileTime: 87.202ms - LoadTime: 8.47ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 47s760ms, % non-child: 98.77%) - BytesSent: 191.18 MB - NetworkThroughput(*): 1.75 MB/sec - OverallThroughput: 4.00 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s751ms - ThriftTransmitTime(*): 1m49s - UncompressedRowBatchSize: 336.60 MB HDFS_SCAN_NODE (id=8):(Active: 575.760ms, % non-child: 1.19%) Hdfs split stats (:<# splits>/): 5:1/236.11 MB BytesRead(1s000ms): 15.03 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB, 29.97 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 29.97 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 129.729ms - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 47.20 MB - PerReadThreadRawHdfsThroughput: 81.73 MB/sec - RowsRead: 3.67M (3665920) - RowsReturned: 3.54M (3542016) - RowsReturnedRate: 6.15 M/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 366.678ms - TotalReadThroughput: 601.69 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b1 (host=c2302.halxg.cloudera.com:22000):(Active: 48s345ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/176.12 MB 9:1/117.94 MB MemoryUsage(1s000ms): 30.76 MB, 61.01 MB, 61.04 MB, 61.01 MB, 60.99 MB, 60.98 MB, 61.01 MB, 60.99 MB, 60.98 MB, 61.04 MB, 61.01 MB, 61.01 MB, 60.95 MB, 61.01 MB, 60.98 MB, 60.99 MB, 60.97 MB, 61.05 MB, 60.95 MB, 61.04 MB, 60.92 MB, 60.97 MB, 60.97 MB, 61.05 MB, 61.01 MB, 61.02 MB, 61.01 MB, 61.05 MB, 60.99 MB, 61.00 MB, 60.94 MB, 60.98 MB, 61.02 MB, 61.02 MB, 60.95 MB, 61.02 MB, 61.05 MB, 61.05 MB, 60.97 MB, 60.91 MB, 61.02 MB, 61.00 MB, 60.98 MB, 61.00 MB, 60.94 MB, 60.96 MB, 61.03 MB, 61.03 MB, 61.04 MB, 61.04 MB, 61.04 MB ThreadUsage(1s000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - PeakMemoryUsage: 61.16 MB - PrepareTime: 101.538us - RowsProduced: 3.46M (3464192) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 43s575ms - TotalStorageWaitTime: 1s173ms CodeGen:(Active: 99.354ms, % non-child: 0.21%) - CodegenTime: 0ns - CompileTime: 90.657ms - LoadTime: 7.859ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 47s635ms, % non-child: 98.53%) - BytesSent: 180.15 MB - NetworkThroughput(*): 1.58 MB/sec - OverallThroughput: 3.78 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s718ms - ThriftTransmitTime(*): 1m53s - UncompressedRowBatchSize: 329.21 MB HDFS_SCAN_NODE (id=8):(Active: 678.455ms, % non-child: 1.40%) Hdfs split stats (:<# splits>/): 1:1/176.12 MB 9:1/117.94 MB BytesRead(1s000ms): 18.70 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 37.40 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 258.760ms - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 61.04 MB - PerReadThreadRawHdfsThroughput: 138.88 MB/sec - RowsRead: 3.59M (3589120) - RowsReturned: 3.46M (3464192) - RowsReturnedRate: 5.11 M/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 269.303ms - TotalReadThroughput: 750.95 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b0 (host=c2332.halxg.cloudera.com:22000):(Active: 46s088ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/176.57 MB MemoryUsage(1s000ms): 25.69 MB, 43.18 MB, 43.15 MB, 43.17 MB, 43.21 MB, 43.17 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.18 MB, 43.18 MB, 43.18 MB, 43.18 MB, 43.15 MB, 43.14 MB, 43.18 MB, 43.17 MB, 43.21 MB, 43.15 MB, 43.21 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.18 MB, 43.15 MB, 43.18 MB, 43.15 MB, 43.17 MB, 43.18 MB, 43.18 MB, 43.15 MB, 43.14 MB, 43.15 MB, 43.15 MB, 43.14 MB, 43.15 MB, 39.20 MB, 35.18 MB, 35.24 MB, 35.19 MB, 35.21 MB, 35.18 MB, 35.22 MB, 35.22 MB, 35.22 MB, 7.28 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - PeakMemoryUsage: 43.25 MB - PrepareTime: 62.662us - RowsProduced: 2.95M (2953031) - TotalCpuTime: 48s738ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 42s098ms - TotalStorageWaitTime: 417.377ms CodeGen:(Active: 98.596ms, % non-child: 0.21%) - CodegenTime: 0ns - CompileTime: 89.672ms - LoadTime: 8.56ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 45s592ms, % non-child: 98.92%) - BytesSent: 162.41 MB - NetworkThroughput(*): 1.58 MB/sec - OverallThroughput: 3.56 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s228ms - ThriftTransmitTime(*): 1m43s - UncompressedRowBatchSize: 280.62 MB HDFS_SCAN_NODE (id=8):(Active: 479.730ms, % non-child: 1.04%) Hdfs split stats (:<# splits>/): 7:1/176.57 MB Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:1.075% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:5 ExecOption: Codegen enabled: 0 out of 1 BytesRead(1s000ms): 11.27 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB, 22.43 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 22.43 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 22.43 MB - BytesReadShortCircuit: 22.43 MB - DecompressionTime: 333.837ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 43.20 MB - PerReadThreadRawHdfsThroughput: 101.92 MB/sec - RowsRead: 2.95M (2953031) - RowsReturned: 2.95M (2953031) - RowsReturnedRate: 6.16 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 32 - ScannerThreadsTotalWallClockTime: 45s027ms - MaterializeTupleTime(*): 44s253ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 1s117ms - ScannerThreadsVoluntaryContextSwitches: 3.11K (3109) - TotalRawHdfsReadTime(*): 220.119ms - TotalReadThroughput: 494.04 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b4 (host=c2338.halxg.cloudera.com:22000):(Active: 44s615ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/176.55 MB MemoryUsage(1s000ms): 26.73 MB, 43.18 MB, 43.15 MB, 43.15 MB, 43.18 MB, 43.14 MB, 43.15 MB, 43.17 MB, 43.15 MB, 43.13 MB, 43.21 MB, 43.17 MB, 43.14 MB, 43.17 MB, 43.15 MB, 43.18 MB, 43.14 MB, 43.14 MB, 43.10 MB, 43.15 MB, 43.15 MB, 43.14 MB, 43.17 MB, 43.21 MB, 43.17 MB, 43.15 MB, 43.15 MB, 43.18 MB, 43.18 MB, 43.18 MB, 39.17 MB, 35.19 MB, 35.19 MB, 35.18 MB, 35.22 MB, 35.21 MB, 35.22 MB, 35.19 MB, 35.19 MB, 35.18 MB, 35.18 MB, 35.25 MB, 35.19 MB, 35.22 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - PeakMemoryUsage: 43.25 MB - PrepareTime: 74.34us - RowsProduced: 2.95M (2953370) - TotalCpuTime: 47s824ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 40s789ms - TotalStorageWaitTime: 303.87ms CodeGen:(Active: 98.119ms, % non-child: 0.22%) - CodegenTime: 0ns - CompileTime: 89.270ms - LoadTime: 7.986ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 44s261ms, % non-child: 99.21%) - BytesSent: 159.82 MB - NetworkThroughput(*): 1.66 MB/sec - OverallThroughput: 3.61 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s216ms - ThriftTransmitTime(*): 1m36s - UncompressedRowBatchSize: 280.65 MB HDFS_SCAN_NODE (id=8):(Active: 335.602ms, % non-child: 0.75%) Hdfs split stats (:<# splits>/): 4:1/176.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:5 ExecOption: Codegen enabled: 0 out of 1 BytesRead(1s000ms): 15.27 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB, 22.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 22.44 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 22.44 MB - BytesReadShortCircuit: 22.44 MB - DecompressionTime: 226.396ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 43.13 MB - PerReadThreadRawHdfsThroughput: 139.84 MB/sec - RowsRead: 2.95M (2953370) - RowsReturned: 2.95M (2953370) - RowsReturnedRate: 8.80 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 57 - ScannerThreadsTotalWallClockTime: 44s127ms - MaterializeTupleTime(*): 43s571ms - ScannerThreadsSysTime: 29.995ms - ScannerThreadsUserTime: 1s120ms - ScannerThreadsVoluntaryContextSwitches: 2.92K (2920) - TotalRawHdfsReadTime(*): 160.435ms - TotalReadThroughput: 516.28 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b3 (host=c2334.halxg.cloudera.com:22000):(Active: 43s978ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/176.16 MB MemoryUsage(1s000ms): 25.69 MB, 43.14 MB, 43.18 MB, 43.15 MB, 43.18 MB, 43.17 MB, 43.15 MB, 43.15 MB, 43.18 MB, 43.14 MB, 43.18 MB, 43.15 MB, 43.18 MB, 43.18 MB, 43.15 MB, 43.14 MB, 43.15 MB, 43.18 MB, 43.20 MB, 43.15 MB, 43.14 MB, 43.17 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.15 MB, 43.14 MB, 43.18 MB, 43.15 MB, 43.18 MB, 43.18 MB, 39.20 MB, 35.25 MB, 35.19 MB, 35.19 MB, 35.19 MB, 35.19 MB, 35.19 MB, 35.18 MB, 35.18 MB, 35.19 MB, 35.22 MB, 35.19 MB, 9.73 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - PeakMemoryUsage: 43.25 MB - PrepareTime: 71.165us - RowsProduced: 2.95M (2946722) - TotalCpuTime: 47s040ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 40s019ms - TotalStorageWaitTime: 390.999ms CodeGen:(Active: 98.446ms, % non-child: 0.22%) - CodegenTime: 0ns - CompileTime: 89.724ms - LoadTime: 7.904ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 43s513ms, % non-child: 98.94%) - BytesSent: 158.65 MB - NetworkThroughput(*): 1.57 MB/sec - OverallThroughput: 3.65 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 3s240ms - ThriftTransmitTime(*): 1m40s - UncompressedRowBatchSize: 280.02 MB HDFS_SCAN_NODE (id=8):(Active: 446.599ms, % non-child: 1.02%) Hdfs split stats (:<# splits>/): 0:1/176.16 MB Hdfs Read Thread Concurrency Bucket: 0:98.88% 1:1.124% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:5 ExecOption: Codegen enabled: 0 out of 1 BytesRead(1s000ms): 11.24 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB, 22.39 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 22.39 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 22.39 MB - BytesReadShortCircuit: 22.39 MB - DecompressionTime: 112.285ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 43.20 MB - PerReadThreadRawHdfsThroughput: 75.87 MB/sec - RowsRead: 2.95M (2946722) - RowsReturned: 2.95M (2946722) - RowsReturnedRate: 6.60 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 168 - ScannerThreadsTotalWallClockTime: 42s955ms - MaterializeTupleTime(*): 42s427ms - ScannerThreadsSysTime: 33.994ms - ScannerThreadsUserTime: 1s117ms - ScannerThreadsVoluntaryContextSwitches: 2.90K (2899) - TotalRawHdfsReadTime(*): 295.56ms - TotalReadThroughput: 515.11 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751ad (host=c2310.halxg.cloudera.com:22000):(Active: 37s742ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/145.80 MB MemoryUsage(1s000ms): 20.19 MB, 32.15 MB, 32.18 MB, 32.15 MB, 32.17 MB, 32.15 MB, 32.18 MB, 32.18 MB, 32.15 MB, 32.18 MB, 32.14 MB, 32.15 MB, 32.15 MB, 32.18 MB, 32.17 MB, 32.18 MB, 32.13 MB, 32.15 MB, 32.15 MB, 32.14 MB, 32.14 MB, 32.14 MB, 32.15 MB, 32.15 MB, 32.15 MB, 32.17 MB, 32.18 MB, 32.21 MB, 32.14 MB, 32.15 MB, 32.17 MB, 24.23 MB, 24.18 MB, 24.19 MB, 24.19 MB, 24.21 MB, 8.85 MB, 2.47 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.95 - PeakMemoryUsage: 32.25 MB - PrepareTime: 87.81us - RowsProduced: 2.44M (2437723) - TotalCpuTime: 39s006ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 34s446ms - TotalStorageWaitTime: 366.13ms CodeGen:(Active: 100.97ms, % non-child: 0.27%) - CodegenTime: 0ns - CompileTime: 91.231ms - LoadTime: 7.969ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 37s330ms, % non-child: 98.91%) - BytesSent: 132.29 MB - NetworkThroughput(*): 1.52 MB/sec - OverallThroughput: 3.54 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 2s678ms - ThriftTransmitTime(*): 1m27s - UncompressedRowBatchSize: 231.65 MB HDFS_SCAN_NODE (id=8):(Active: 396.299ms, % non-child: 1.05%) Hdfs split stats (:<# splits>/): 10:1/145.80 MB Hdfs Read Thread Concurrency Bucket: 0:98.68% 1:1.316% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:5 ExecOption: Codegen enabled: 0 out of 1 BytesRead(1s000ms): 9.32 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB, 18.54 MB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.95 - BytesRead: 18.54 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 18.54 MB - BytesReadShortCircuit: 18.54 MB - DecompressionTime: 130.583ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 32.13 MB - PerReadThreadRawHdfsThroughput: 157.70 MB/sec - RowsRead: 2.44M (2437723) - RowsReturned: 2.44M (2437723) - RowsReturnedRate: 6.15 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 47 - ScannerThreadsTotalWallClockTime: 35s909ms - MaterializeTupleTime(*): 35s390ms - ScannerThreadsSysTime: 16.997ms - ScannerThreadsUserTime: 912.861ms - ScannerThreadsVoluntaryContextSwitches: 2.39K (2394) - TotalRawHdfsReadTime(*): 117.592ms - TotalReadThroughput: 499.71 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b2 (host=c2330.halxg.cloudera.com:22000):(Active: 31s803ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/117.94 MB MemoryUsage(1s000ms): 14.83 MB, 29.65 MB, 29.67 MB, 29.65 MB, 29.64 MB, 29.68 MB, 29.65 MB, 29.68 MB, 29.71 MB, 29.71 MB, 29.65 MB, 29.65 MB, 29.65 MB, 29.64 MB, 29.65 MB, 29.65 MB, 29.68 MB, 29.65 MB, 29.65 MB, 29.64 MB, 29.68 MB, 29.65 MB, 29.65 MB, 29.65 MB, 29.68 MB, 29.65 MB, 29.65 MB, 29.68 MB, 29.67 MB, 29.64 MB, 9.45 MB, 3.35 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.92 - PeakMemoryUsage: 29.72 MB - PrepareTime: 76.555us - RowsProduced: 1.97M (1971316) - TotalCpuTime: 32s247ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 29s102ms - TotalStorageWaitTime: 342.341ms CodeGen:(Active: 98.989ms, % non-child: 0.31%) - CodegenTime: 0ns - CompileTime: 90.281ms - LoadTime: 7.864ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=16):(Active: 31s420ms, % non-child: 98.80%) - BytesSent: 107.04 MB - NetworkThroughput(*): 1.48 MB/sec - OverallThroughput: 3.41 MB/sec - PeakMemoryUsage: 15.94 KB - SerializeBatchTime: 2s170ms - ThriftTransmitTime(*): 1m12s - UncompressedRowBatchSize: 187.33 MB HDFS_SCAN_NODE (id=8):(Active: 371.8ms, % non-child: 1.17%) Hdfs split stats (:<# splits>/): 5:1/117.94 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:5 ExecOption: Codegen enabled: 0 out of 1 BytesRead(1s000ms): 7.51 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB, 15.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 15.02 MB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 15.02 MB - BytesReadShortCircuit: 15.02 MB - DecompressionTime: 107.459ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 29.70 MB - PerReadThreadRawHdfsThroughput: 83.45 MB/sec - RowsRead: 1.97M (1971316) - RowsReturned: 1.97M (1971316) - RowsReturnedRate: 5.31 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 46 - ScannerThreadsTotalWallClockTime: 29s737ms - MaterializeTupleTime(*): 29s216ms - ScannerThreadsSysTime: 23.996ms - ScannerThreadsUserTime: 729.889ms - ScannerThreadsVoluntaryContextSwitches: 1.91K (1913) - TotalRawHdfsReadTime(*): 180.29ms - TotalReadThroughput: 480.75 KB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b5 (host=c2336.halxg.cloudera.com:22000): Fragment 3: Instance e743f6c0eaa908e0:f107a9c66d3751be (host=c2338.halxg.cloudera.com:22000):(Active: 48s632ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:11/3.28 GB 1:19/5.33 GB 2:17/4.56 GB 3:17/5.85 GB 4:24/6.71 GB 5:13/4.93 GB 6:15/4.85 GB 7:16/5.45 GB 8:18/5.82 GB 9:18/4.50 GB 10:15/4.59 GB MemoryUsage(1s000ms): 18.52 MB, 438.50 MB, 678.71 MB, 717.18 MB, 839.51 MB, 1.32 GB, 2.21 GB, 3.33 GB, 5.10 GB, 7.05 GB, 8.89 GB, 10.61 GB, 614.40 MB, 523.96 MB, 527.27 MB, 501.89 MB, 573.52 MB, 1.45 GB, 2.14 GB, 2.72 GB, 3.24 GB, 3.85 GB, 4.63 GB, 5.49 GB, 7.10 GB, 8.96 GB, 10.69 GB, 12.41 GB, 14.25 GB, 723.95 MB, 726.96 MB, 2.07 GB, 3.36 GB, 4.04 GB, 4.56 GB, 5.04 GB, 5.51 GB, 5.98 GB, 6.48 GB, 7.01 GB, 7.54 GB, 8.07 GB, 4.50 GB, 656.47 MB, 1.56 GB, 3.25 GB, 4.86 GB, 6.02 GB, 6.72 GB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 20, 24, 18, 7, 3 - AverageThreadTokens: 15.55 - PeakMemoryUsage: 15.17 GB - PrepareTime: 13.851ms - RowsProduced: 9.37K (9365) - TotalCpuTime: 11m57s - TotalNetworkReceiveTime: 1s914ms - TotalNetworkSendTime: 923.713us - TotalStorageWaitTime: 1m33s CodeGen:(Active: 500.585ms, % non-child: 1.03%) - CodegenTime: 2.342ms - CompileTime: 491.921ms - LoadTime: 7.793ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 2.657ms, % non-child: 0.01%) - BytesSent: 123.66 KB - NetworkThroughput(*): 25.47 MB/sec - OverallThroughput: 45.44 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 1.121ms - ThriftTransmitTime(*): 4.740ms - UncompressedRowBatchSize: 207.04 KB AGGREGATION_NODE (id=7):(Active: 48s631ms, % non-child: 1.99%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 966.550ms - GetResultsTime: 580.165us - LoadFactor: 0.68 - PeakMemoryUsage: 14.60 GB - RowsReturned: 9.37K (9365) - RowsReturnedRate: 192.00 /sec HASH_JOIN_NODE (id=6):(Active: 47s661ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.52us - LeftChildRows: 1.42M (1424999) - LeftChildTime: 129.27ms - LoadFactor: 0.07 - PeakMemoryUsage: 14.41 GB - RowsReturned: 97.40K (97396) - RowsReturnedRate: 2.04 K/sec EXCHANGE_NODE (id=13):(Active: 731.548ms, % non-child: 1.50%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.545us - DataArrivalWaitTime: 731.530ms - DeserializeRowBatchTimer: 21.122us - FirstBatchArrivalWaitTime: 731.159ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 101.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 47s528ms, % non-child: 0.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 40.56us - LeftChildRows: 20.20M (20200748) - LeftChildTime: 676.320ms - LoadFactor: 0.43 - PeakMemoryUsage: 14.39 GB - RowsReturned: 1.42M (1424999) - RowsReturnedRate: 29.98 K/sec EXCHANGE_NODE (id=12):(Active: 372.3ms, % non-child: 0.76%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 11.601us - DataArrivalWaitTime: 371.976ms - DeserializeRowBatchTimer: 65.944us - FirstBatchArrivalWaitTime: 368.990ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.40 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 46s829ms, % non-child: 51.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.715us - LeftChildRows: 825.54M (825536259) - LeftChildTime: 24s205ms - LoadFactor: 0.07 - PeakMemoryUsage: 453.06 KB - RowsReturned: 20.20M (20200748) - RowsReturnedRate: 431.37 K/sec EXCHANGE_NODE (id=11):(Active: 811.107ms, % non-child: 1.67%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.183us - DataArrivalWaitTime: 811.91ms - DeserializeRowBatchTimer: 11.276us - FirstBatchArrivalWaitTime: 808.905ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 88.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 21s019ms, % non-child: 43.22%) Hdfs split stats (:<# splits>/): 0:11/3.28 GB 1:19/5.33 GB 2:17/4.56 GB 3:17/5.85 GB 4:24/6.71 GB 5:13/4.93 GB 6:15/4.85 GB 7:16/5.45 GB 8:18/5.82 GB 9:18/4.50 GB 10:15/4.59 GB Hdfs Read Thread Concurrency Bucket: 0:48.45% 1:29.9% 2:9.278% 3:6.186% 4:4.124% 5:2.062% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:915 ExecOption: Codegen enabled: 0 out of 183 BytesRead(1s000ms): 2.95 MB, 273.12 MB, 472.88 MB, 613.52 MB, 647.67 MB, 694.06 MB, 713.40 MB, 713.40 MB, 920.90 MB, 1.12 GB, 1.20 GB, 1.29 GB, 1.45 GB, 1.53 GB, 1.62 GB, 1.76 GB, 1.91 GB, 2.05 GB, 2.06 GB, 2.07 GB, 2.08 GB, 2.13 GB, 2.22 GB, 2.29 GB, 2.51 GB, 2.61 GB, 2.70 GB, 2.80 GB, 3.00 GB, 3.18 GB, 3.21 GB, 3.33 GB, 3.40 GB, 3.50 GB, 3.54 GB, 3.56 GB, 3.59 GB, 3.61 GB, 3.63 GB, 3.69 GB, 3.76 GB, 3.78 GB, 3.82 GB, 3.87 GB, 4.00 GB, 4.13 GB, 4.18 GB, 4.21 GB, 4.25 GB - AverageHdfsReadThreadConcurrency: 0.94 - AverageScannerThreadConcurrency: 14.79 - BytesRead: 4.26 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.26 GB - BytesReadShortCircuit: 4.26 GB - DecompressionTime: 2m - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 23 - PeakMemoryUsage: 693.50 MB - PerReadThreadRawHdfsThroughput: 99.63 MB/sec - RowsRead: 825.54M (825536259) - RowsReturned: 825.54M (825536259) - RowsReturnedRate: 39.27 M/sec - ScanRangesComplete: 183 - ScannerThreadsInvoluntaryContextSwitches: 70.29K (70286) - ScannerThreadsTotalWallClockTime: 11m56s - MaterializeTupleTime(*): 8m10s - ScannerThreadsSysTime: 13s006ms - ScannerThreadsUserTime: 3m34s - ScannerThreadsVoluntaryContextSwitches: 1.15M (1152603) - TotalRawHdfsReadTime(*): 43s772ms - TotalReadThroughput: 89.00 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b8 (host=c2306.halxg.cloudera.com:22000):(Active: 48s209ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/4.77 GB 1:22/7.41 GB 2:13/3.59 GB 3:21/5.70 GB 4:19/6.89 GB 5:18/4.92 GB 6:16/4.80 GB 7:16/5.89 GB 8:13/5.14 GB 9:18/4.05 GB 10:9/2.67 GB MemoryUsage(1s000ms): 100.36 MB, 468.20 MB, 631.02 MB, 564.15 MB, 720.95 MB, 841.26 MB, 1.48 GB, 2.06 GB, 2.67 GB, 3.31 GB, 4.14 GB, 4.90 GB, 5.64 GB, 6.40 GB, 3.87 GB, 711.15 MB, 830.01 MB, 688.51 MB, 619.00 MB, 552.36 MB, 579.24 MB, 549.96 MB, 543.82 MB, 861.76 MB, 2.40 GB, 3.21 GB, 3.90 GB, 4.67 GB, 5.45 GB, 6.35 GB, 7.38 GB, 8.50 GB, 9.91 GB, 11.71 GB, 13.48 GB, 15.22 GB, 8.35 GB, 508.41 MB, 1.46 GB, 3.28 GB, 4.80 GB, 5.52 GB, 6.03 GB, 6.50 GB, 449.69 MB, 512.43 MB, 1.18 GB, 3.07 GB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 8 - AverageThreadTokens: 15.56 - PeakMemoryUsage: 16.44 GB - PrepareTime: 13.545ms - RowsProduced: 14.38K (14385) - TotalCpuTime: 11m46s - TotalNetworkReceiveTime: 1s982ms - TotalNetworkSendTime: 2.897ms - TotalStorageWaitTime: 1m11s CodeGen:(Active: 480.787ms, % non-child: 1.00%) - CodegenTime: 2.332ms - CompileTime: 471.850ms - LoadTime: 8.70ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 4.731ms, % non-child: 0.01%) - BytesSent: 235.42 KB - NetworkThroughput(*): 19.52 MB/sec - OverallThroughput: 48.59 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 2.438ms - ThriftTransmitTime(*): 11.779ms - UncompressedRowBatchSize: 393.46 KB AGGREGATION_NODE (id=7):(Active: 48s206ms, % non-child: 2.17%) ExecOption: Codegen Enabled - BuildBuckets: 16.38K (16384) - BuildTime: 1s040ms - GetResultsTime: 1.39ms - LoadFactor: 0.59 - PeakMemoryUsage: 15.92 GB - RowsReturned: 14.38K (14385) - RowsReturnedRate: 298.00 /sec HASH_JOIN_NODE (id=6):(Active: 47s162ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 18.979us - LeftChildRows: 2.15M (2152122) - LeftChildTime: 183.302ms - LoadFactor: 0.07 - PeakMemoryUsage: 15.77 GB - RowsReturned: 149.40K (149396) - RowsReturnedRate: 3.17 K/sec EXCHANGE_NODE (id=13):(Active: 754.537ms, % non-child: 1.57%) BytesReceived(500.0ms): 0.00 , 0.00 , 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 4.85us - DataArrivalWaitTime: 754.521ms - DeserializeRowBatchTimer: 25.22us - FirstBatchArrivalWaitTime: 752.258ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 98.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 46s974ms, % non-child: 1.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 28.601us - LeftChildRows: 30.66M (30660260) - LeftChildTime: 1s033ms - LoadFactor: 0.43 - PeakMemoryUsage: 15.76 GB - RowsReturned: 2.15M (2152122) - RowsReturnedRate: 45.81 K/sec EXCHANGE_NODE (id=12):(Active: 394.560ms, % non-child: 0.82%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 13.443us - DataArrivalWaitTime: 394.535ms - DeserializeRowBatchTimer: 71.439us - FirstBatchArrivalWaitTime: 390.396ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.32 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 45s905ms, % non-child: 52.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.307us - LeftChildRows: 825.84M (825835832) - LeftChildTime: 24s496ms - LoadFactor: 0.07 - PeakMemoryUsage: 436.34 KB - RowsReturned: 30.66M (30660260) - RowsReturnedRate: 667.90 K/sec EXCHANGE_NODE (id=11):(Active: 833.157ms, % non-child: 1.73%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 3.287us - DataArrivalWaitTime: 833.142ms - DeserializeRowBatchTimer: 35.577us - FirstBatchArrivalWaitTime: 830.146ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 86.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 19s772ms, % non-child: 41.01%) Hdfs split stats (:<# splits>/): 0:17/4.77 GB 1:22/7.41 GB 2:13/3.59 GB 3:21/5.70 GB 4:19/6.89 GB 5:18/4.92 GB 6:16/4.80 GB 7:16/5.89 GB 8:13/5.14 GB 9:18/4.05 GB 10:9/2.67 GB Hdfs Read Thread Concurrency Bucket: 0:50% 1:26.04% 2:13.54% 3:9.375% 4:1.042% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:910 ExecOption: Codegen enabled: 0 out of 182 BytesRead(1s000ms): 56.14 MB, 365.43 MB, 396.92 MB, 496.91 MB, 636.98 MB, 681.33 MB, 750.30 MB, 750.30 MB, 750.30 MB, 752.61 MB, 979.45 MB, 1018.72 MB, 1018.72 MB, 1022.72 MB, 1.12 GB, 1.23 GB, 1.39 GB, 1.49 GB, 1.63 GB, 1.68 GB, 1.77 GB, 1.82 GB, 1.97 GB, 2.03 GB, 2.25 GB, 2.31 GB, 2.35 GB, 2.48 GB, 2.51 GB, 2.53 GB, 2.64 GB, 2.75 GB, 2.86 GB, 2.99 GB, 3.09 GB, 3.17 GB, 3.27 GB, 3.37 GB, 3.52 GB, 3.64 GB, 3.75 GB, 3.79 GB, 3.80 GB, 3.83 GB, 3.90 GB, 4.01 GB, 4.13 GB, 4.22 GB - AverageHdfsReadThreadConcurrency: 0.86 - AverageScannerThreadConcurrency: 14.67 - BytesRead: 4.23 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.23 GB - BytesReadShortCircuit: 4.23 GB - DecompressionTime: 2m6s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 637.08 MB - PerReadThreadRawHdfsThroughput: 109.90 MB/sec - RowsRead: 825.84M (825835832) - RowsReturned: 825.84M (825835832) - RowsReturnedRate: 41.77 M/sec - ScanRangesComplete: 182 - ScannerThreadsInvoluntaryContextSwitches: 69.11K (69106) - ScannerThreadsTotalWallClockTime: 11m44s - MaterializeTupleTime(*): 8m20s - ScannerThreadsSysTime: 9s072ms - ScannerThreadsUserTime: 3m36s - ScannerThreadsVoluntaryContextSwitches: 1.04M (1035305) - TotalRawHdfsReadTime(*): 39s378ms - TotalReadThroughput: 89.23 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b6 (host=c2310.halxg.cloudera.com:22000):(Active: 45s642ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:24/8.82 GB 1:15/4.20 GB 2:18/5.36 GB 3:16/4.13 GB 4:17/5.02 GB 5:13/3.63 GB 6:15/5.09 GB 7:11/3.48 GB 8:18/5.55 GB 9:17/5.20 GB 10:16/5.49 GB MemoryUsage(1s000ms): 7.96 MB, 484.41 MB, 1.29 GB, 1.91 GB, 2.57 GB, 3.26 GB, 2.26 GB, 635.39 MB, 648.11 MB, 556.66 MB, 645.27 MB, 805.39 MB, 595.27 MB, 572.89 MB, 571.76 MB, 514.53 MB, 485.25 MB, 873.28 MB, 1.93 GB, 2.76 GB, 3.50 GB, 618.41 MB, 1.19 GB, 2.62 GB, 3.49 GB, 4.26 GB, 5.17 GB, 6.05 GB, 6.95 GB, 7.97 GB, 9.24 GB, 10.56 GB, 12.28 GB, 14.00 GB, 15.79 GB, 17.50 GB, 19.19 GB, 10.42 GB, 712.58 MB, 689.39 MB, 725.54 MB, 855.03 MB, 747.05 MB, 547.20 MB, 466.06 MB, 171.05 MB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 24, 24, 24, 24, 24, 24, 13, 4 - AverageThreadTokens: 16.41 - PeakMemoryUsage: 20.39 GB - PrepareTime: 13.759ms - RowsProduced: 21.33K (21329) - TotalCpuTime: 11m55s - TotalNetworkReceiveTime: 2s122ms - TotalNetworkSendTime: 4.667ms - TotalStorageWaitTime: 1m34s CodeGen:(Active: 437.525ms, % non-child: 0.96%) - CodegenTime: 2.268ms - CompileTime: 428.779ms - LoadTime: 7.934ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 6.447ms, % non-child: 0.01%) - BytesSent: 348.37 KB - NetworkThroughput(*): 17.38 MB/sec - OverallThroughput: 52.77 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 3.837ms - ThriftTransmitTime(*): 19.569ms - UncompressedRowBatchSize: 583.37 KB AGGREGATION_NODE (id=7):(Active: 45s638ms, % non-child: 2.10%) ExecOption: Codegen Enabled - BuildBuckets: 16.38K (16384) - BuildTime: 955.306ms - GetResultsTime: 1.636ms - LoadFactor: 0.73 - PeakMemoryUsage: 19.95 GB - RowsReturned: 21.33K (21329) - RowsReturnedRate: 467.00 /sec HASH_JOIN_NODE (id=6):(Active: 44s677ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.521us - LeftChildRows: 3.21M (3212742) - LeftChildTime: 209.624ms - LoadFactor: 0.07 - PeakMemoryUsage: 19.77 GB - RowsReturned: 220.85K (220851) - RowsReturnedRate: 4.94 K/sec EXCHANGE_NODE (id=13):(Active: 800.918ms, % non-child: 1.75%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.550us - DataArrivalWaitTime: 800.904ms - DeserializeRowBatchTimer: 16.877us - FirstBatchArrivalWaitTime: 799.426ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 92.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 44s460ms, % non-child: 2.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 50.608us - LeftChildRows: 45.55M (45554248) - LeftChildTime: 1s469ms - LoadFactor: 0.43 - PeakMemoryUsage: 19.76 GB - RowsReturned: 3.21M (3212742) - RowsReturnedRate: 72.26 K/sec EXCHANGE_NODE (id=12):(Active: 441.305ms, % non-child: 0.97%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 11.263us - DataArrivalWaitTime: 441.281ms - DeserializeRowBatchTimer: 88.562us - FirstBatchArrivalWaitTime: 437.567ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.18 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 42s940ms, % non-child: 58.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 8.472us - LeftChildRows: 827.77M (827772030) - LeftChildTime: 25s906ms - LoadFactor: 0.07 - PeakMemoryUsage: 441.28 KB - RowsReturned: 45.55M (45554248) - RowsReturnedRate: 1.06 M/sec EXCHANGE_NODE (id=11):(Active: 880.457ms, % non-child: 1.93%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 3.72us - DataArrivalWaitTime: 880.443ms - DeserializeRowBatchTimer: 11.539us - FirstBatchArrivalWaitTime: 877.154ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 81.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 15s354ms, % non-child: 33.64%) Hdfs split stats (:<# splits>/): 0:24/8.82 GB 1:15/4.20 GB 2:18/5.36 GB 3:16/4.13 GB 4:17/5.02 GB 5:13/3.63 GB 6:15/5.09 GB 7:11/3.48 GB 8:18/5.55 GB 9:17/5.20 GB 10:16/5.49 GB Hdfs Read Thread Concurrency Bucket: 0:47.83% 1:27.17% 2:11.96% 3:6.522% 4:4.348% 5:2.174% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:900 ExecOption: Codegen enabled: 0 out of 180 BytesRead(1s000ms): 887.15 KB, 271.90 MB, 464.73 MB, 464.73 MB, 464.73 MB, 515.32 MB, 597.66 MB, 597.76 MB, 712.47 MB, 768.90 MB, 1000.65 MB, 1.04 GB, 1.21 GB, 1.28 GB, 1.37 GB, 1.48 GB, 1.59 GB, 1.69 GB, 1.84 GB, 1.89 GB, 1.92 GB, 2.07 GB, 2.15 GB, 2.29 GB, 2.32 GB, 2.37 GB, 2.54 GB, 2.63 GB, 2.64 GB, 2.68 GB, 2.77 GB, 2.78 GB, 2.93 GB, 3.10 GB, 3.22 GB, 3.34 GB, 3.41 GB, 3.58 GB, 3.81 GB, 3.90 GB, 4.02 GB, 4.09 GB, 4.14 GB, 4.18 GB, 4.22 GB, 4.24 GB - AverageHdfsReadThreadConcurrency: 0.99 - AverageScannerThreadConcurrency: 15.52 - BytesRead: 4.24 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.24 GB - BytesReadShortCircuit: 4.24 GB - DecompressionTime: 1m45s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 23 - PeakMemoryUsage: 736.31 MB - PerReadThreadRawHdfsThroughput: 92.31 MB/sec - RowsRead: 827.77M (827772030) - RowsReturned: 827.77M (827772030) - RowsReturnedRate: 53.91 M/sec - ScanRangesComplete: 180 - ScannerThreadsInvoluntaryContextSwitches: 66.03K (66025) - ScannerThreadsTotalWallClockTime: 11m53s - MaterializeTupleTime(*): 8m18s - ScannerThreadsSysTime: 17s502ms - ScannerThreadsUserTime: 3m30s - ScannerThreadsVoluntaryContextSwitches: 1.16M (1161243) - TotalRawHdfsReadTime(*): 47s040ms - TotalReadThroughput: 93.38 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751bf (host=c2336.halxg.cloudera.com:22000):(Active: 45s589ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:15/3.96 GB 1:20/5.95 GB 2:14/4.91 GB 3:13/3.86 GB 4:19/4.90 GB 5:20/7.69 GB 6:15/4.87 GB 7:22/6.77 GB 8:17/4.34 GB 9:14/4.70 GB 10:13/3.63 GB MemoryUsage(1s000ms): 68.78 MB, 690.27 MB, 1.61 GB, 2.47 GB, 3.49 GB, 4.77 GB, 5.93 GB, 7.33 GB, 9.23 GB, 549.69 MB, 625.31 MB, 1.84 GB, 2.50 GB, 3.11 GB, 3.68 GB, 4.28 GB, 4.93 GB, 5.60 GB, 6.35 GB, 7.49 GB, 8.77 GB, 10.52 GB, 12.30 GB, 521.27 MB, 729.08 MB, 2.44 GB, 2.16 GB, 582.70 MB, 1.24 GB, 3.10 GB, 4.58 GB, 5.45 GB, 6.15 GB, 6.93 GB, 7.78 GB, 8.92 GB, 5.40 GB, 560.41 MB, 536.12 MB, 694.34 MB, 2.28 GB, 4.10 GB, 5.90 GB, 3.70 GB, 526.61 MB, 271.46 MB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 14, 7 - AverageThreadTokens: 15.61 - PeakMemoryUsage: 13.12 GB - PrepareTime: 13.699ms - RowsProduced: 10.12K (10118) - TotalCpuTime: 11m12s - TotalNetworkReceiveTime: 2s093ms - TotalNetworkSendTime: 4.770ms - TotalStorageWaitTime: 1m17s CodeGen:(Active: 440.754ms, % non-child: 0.97%) - CodegenTime: 2.338ms - CompileTime: 432.90ms - LoadTime: 7.828ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 3.562ms, % non-child: 0.01%) - BytesSent: 165.57 KB - NetworkThroughput(*): 18.26 MB/sec - OverallThroughput: 45.39 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 2.98ms - ThriftTransmitTime(*): 8.856ms - UncompressedRowBatchSize: 276.74 KB AGGREGATION_NODE (id=7):(Active: 45s588ms, % non-child: 2.12%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 961.756ms - GetResultsTime: 799.557us - LoadFactor: 0.71 - PeakMemoryUsage: 12.72 GB - RowsReturned: 10.12K (10118) - RowsReturnedRate: 221.00 /sec HASH_JOIN_NODE (id=6):(Active: 44s622ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.285us - LeftChildRows: 1.53M (1527971) - LeftChildTime: 190.899ms - LoadFactor: 0.07 - PeakMemoryUsage: 12.57 GB - RowsReturned: 104.63K (104626) - RowsReturnedRate: 2.34 K/sec EXCHANGE_NODE (id=13):(Active: 791.448ms, % non-child: 1.74%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.668us - DataArrivalWaitTime: 791.431ms - DeserializeRowBatchTimer: 16.64us - FirstBatchArrivalWaitTime: 790.597ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 93.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 44s428ms, % non-child: 0.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 22.218us - LeftChildRows: 21.62M (21624584) - LeftChildTime: 676.374ms - LoadFactor: 0.43 - PeakMemoryUsage: 12.56 GB - RowsReturned: 1.53M (1527971) - RowsReturnedRate: 34.39 K/sec EXCHANGE_NODE (id=12):(Active: 429.801ms, % non-child: 0.94%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 11.263us - DataArrivalWaitTime: 429.775ms - DeserializeRowBatchTimer: 264.370us - FirstBatchArrivalWaitTime: 428.936ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.21 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 43s725ms, % non-child: 54.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.370us - LeftChildRows: 820.53M (820532933) - LeftChildTime: 23s923ms - LoadFactor: 0.07 - PeakMemoryUsage: 430.24 KB - RowsReturned: 21.62M (21624584) - RowsReturnedRate: 494.55 K/sec EXCHANGE_NODE (id=11):(Active: 872.637ms, % non-child: 1.91%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.117us - DataArrivalWaitTime: 872.620ms - DeserializeRowBatchTimer: 31.265us - FirstBatchArrivalWaitTime: 868.314ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 82.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 18s162ms, % non-child: 39.84%) Hdfs split stats (:<# splits>/): 0:15/3.96 GB 1:20/5.95 GB 2:14/4.91 GB 3:13/3.86 GB 4:19/4.90 GB 5:20/7.69 GB 6:15/4.87 GB 7:22/6.77 GB 8:17/4.34 GB 9:14/4.70 GB 10:13/3.63 GB Hdfs Read Thread Concurrency Bucket: 0:51.65% 1:23.08% 2:14.29% 3:6.593% 4:1.099% 5:0% 6:1.099% 7:0% 8:1.099% 9:1.099% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:910 ExecOption: Codegen enabled: 0 out of 182 BytesRead(1s000ms): 33.21 MB, 381.80 MB, 490.76 MB, 490.76 MB, 534.58 MB, 676.00 MB, 676.05 MB, 731.01 MB, 810.81 MB, 1.02 GB, 1.06 GB, 1.16 GB, 1.16 GB, 1.22 GB, 1.33 GB, 1.49 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.68 GB, 1.71 GB, 1.81 GB, 1.90 GB, 2.09 GB, 2.21 GB, 2.40 GB, 2.46 GB, 2.52 GB, 2.68 GB, 2.79 GB, 2.96 GB, 3.02 GB, 3.10 GB, 3.20 GB, 3.20 GB, 3.21 GB, 3.38 GB, 3.46 GB, 3.60 GB, 3.68 GB, 3.87 GB, 4.01 GB, 4.11 GB, 4.19 GB, 4.25 GB, 4.26 GB - AverageHdfsReadThreadConcurrency: 1.01 - AverageScannerThreadConcurrency: 14.71 - BytesRead: 4.26 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.26 GB - BytesReadShortCircuit: 4.26 GB - DecompressionTime: 2m5s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 712.90 MB - PerReadThreadRawHdfsThroughput: 106.04 MB/sec - RowsRead: 820.53M (820532933) - RowsReturned: 820.53M (820532933) - RowsReturnedRate: 45.18 M/sec - ScanRangesComplete: 182 - ScannerThreadsInvoluntaryContextSwitches: 66.35K (66354) - ScannerThreadsTotalWallClockTime: 11m10s - MaterializeTupleTime(*): 7m43s - ScannerThreadsSysTime: 8s224ms - ScannerThreadsUserTime: 3m37s - ScannerThreadsVoluntaryContextSwitches: 1.01M (1011112) - TotalRawHdfsReadTime(*): 41s091ms - TotalReadThroughput: 94.72 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b7 (host=c2304.halxg.cloudera.com:22000):(Active: 42s413ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:14/4.48 GB 1:17/4.78 GB 2:25/7.69 GB 3:18/4.10 GB 4:15/4.00 GB 5:19/5.32 GB 6:22/5.20 GB 7:21/6.13 GB 8:13/4.50 GB 9:16/5.00 GB 10:15/4.62 GB MemoryUsage(1s000ms): 2.09 MB, 460.11 MB, 591.13 MB, 570.65 MB, 680.73 MB, 576.69 MB, 459.45 MB, 542.44 MB, 1.44 GB, 2.48 GB, 3.96 GB, 5.82 GB, 606.95 MB, 482.08 MB, 557.53 MB, 773.37 MB, 456.69 MB, 796.47 MB, 1.91 GB, 2.80 GB, 2.03 GB, 640.07 MB, 534.92 MB, 626.92 MB, 669.50 MB, 845.69 MB, 2.13 GB, 3.29 GB, 5.01 GB, 6.84 GB, 537.37 MB, 503.56 MB, 510.92 MB, 594.32 MB, 2.03 GB, 3.19 GB, 4.20 GB, 5.76 GB, 439.30 MB, 1.12 GB, 749.20 MB, 734.65 MB, 1.27 GB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 12, 7, 3 - AverageThreadTokens: 15.23 - PeakMemoryUsage: 7.51 GB - PrepareTime: 13.496ms - RowsProduced: 23.06K (23061) - TotalCpuTime: 10m9s - TotalNetworkReceiveTime: 1s993ms - TotalNetworkSendTime: 3.980ms - TotalStorageWaitTime: 1m28s CodeGen:(Active: 458.876ms, % non-child: 1.08%) - CodegenTime: 2.276ms - CompileTime: 450.111ms - LoadTime: 7.916ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 6.566ms, % non-child: 0.02%) - BytesSent: 376.56 KB - NetworkThroughput(*): 21.10 MB/sec - OverallThroughput: 56.00 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 3.502ms - ThriftTransmitTime(*): 17.432ms - UncompressedRowBatchSize: 630.73 KB AGGREGATION_NODE (id=7):(Active: 42s409ms, % non-child: 2.48%) ExecOption: Codegen Enabled - BuildBuckets: 32.77K (32768) - BuildTime: 1s045ms - GetResultsTime: 1.607ms - LoadFactor: 0.50 - PeakMemoryUsage: 7.01 GB - RowsReturned: 23.06K (23061) - RowsReturnedRate: 543.00 /sec HASH_JOIN_NODE (id=6):(Active: 41s358ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 10.902us - LeftChildRows: 3.47M (3469720) - LeftChildTime: 234.168ms - LoadFactor: 0.07 - PeakMemoryUsage: 6.83 GB - RowsReturned: 238.57K (238573) - RowsReturnedRate: 5.77 K/sec EXCHANGE_NODE (id=13):(Active: 759.957ms, % non-child: 1.79%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.764us - DataArrivalWaitTime: 759.940ms - DeserializeRowBatchTimer: 17.423us - FirstBatchArrivalWaitTime: 757.434ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 97.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 41s116ms, % non-child: 2.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 25.910us - LeftChildRows: 49.35M (49349065) - LeftChildTime: 1s517ms - LoadFactor: 0.43 - PeakMemoryUsage: 6.82 GB - RowsReturned: 3.47M (3469720) - RowsReturnedRate: 84.39 K/sec EXCHANGE_NODE (id=12):(Active: 397.616ms, % non-child: 0.94%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 17.887us - DataArrivalWaitTime: 397.585ms - DeserializeRowBatchTimer: 47.894us - FirstBatchArrivalWaitTime: 395.293ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.31 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 39s543ms, % non-child: 59.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 10.90us - LeftChildRows: 825.16M (825161371) - LeftChildTime: 24s485ms - LoadFactor: 0.07 - PeakMemoryUsage: 430.20 KB - RowsReturned: 49.35M (49349065) - RowsReturnedRate: 1.25 M/sec EXCHANGE_NODE (id=11):(Active: 836.105ms, % non-child: 1.97%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 3.827us - DataArrivalWaitTime: 836.89ms - DeserializeRowBatchTimer: 17.782us - FirstBatchArrivalWaitTime: 835.13ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 86.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 13s477ms, % non-child: 31.78%) Hdfs split stats (:<# splits>/): 0:14/4.48 GB 1:17/4.78 GB 2:25/7.69 GB 3:18/4.10 GB 4:15/4.00 GB 5:19/5.32 GB 6:22/5.20 GB 7:21/6.13 GB 8:13/4.50 GB 9:16/5.00 GB 10:15/4.62 GB Hdfs Read Thread Concurrency Bucket: 0:56.47% 1:17.65% 2:12.94% 3:7.059% 4:2.353% 5:1.176% 6:2.353% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:975 ExecOption: Codegen enabled: 0 out of 195 BytesRead(1s000ms): 250.00 KB, 286.76 MB, 426.29 MB, 492.62 MB, 593.02 MB, 636.63 MB, 682.67 MB, 812.24 MB, 1.00 GB, 1.02 GB, 1.13 GB, 1.20 GB, 1.38 GB, 1.39 GB, 1.55 GB, 1.61 GB, 1.78 GB, 1.86 GB, 2.03 GB, 2.04 GB, 2.14 GB, 2.26 GB, 2.38 GB, 2.63 GB, 2.72 GB, 2.77 GB, 2.90 GB, 2.97 GB, 3.07 GB, 3.22 GB, 3.37 GB, 3.40 GB, 3.51 GB, 3.58 GB, 3.78 GB, 3.85 GB, 3.93 GB, 4.06 GB, 4.12 GB, 4.12 GB, 4.16 GB, 4.20 GB, 4.23 GB - AverageHdfsReadThreadConcurrency: 0.94 - AverageScannerThreadConcurrency: 14.34 - BytesRead: 4.24 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.24 GB - BytesReadShortCircuit: 4.24 GB - DecompressionTime: 1m20s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 606.93 MB - PerReadThreadRawHdfsThroughput: 115.09 MB/sec - RowsRead: 825.16M (825161371) - RowsReturned: 825.16M (825161371) - RowsReturnedRate: 61.23 M/sec - ScanRangesComplete: 195 - ScannerThreadsInvoluntaryContextSwitches: 63.33K (63327) - ScannerThreadsTotalWallClockTime: 10m7s - MaterializeTupleTime(*): 6m59s - ScannerThreadsSysTime: 9s419ms - ScannerThreadsUserTime: 3m21s - ScannerThreadsVoluntaryContextSwitches: 990.33K (990329) - TotalRawHdfsReadTime(*): 37s730ms - TotalReadThroughput: 100.98 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751bc (host=c2330.halxg.cloudera.com:22000):(Active: 41s122ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/4.79 GB 1:18/5.17 GB 2:17/5.42 GB 3:18/4.94 GB 4:18/5.60 GB 5:16/5.22 GB 6:15/5.49 GB 7:17/6.27 GB 8:15/3.76 GB 9:13/3.85 GB 10:18/5.16 GB MemoryUsage(1s000ms): 109.14 MB, 705.13 MB, 1.81 GB, 3.00 GB, 5.10 GB, 6.86 GB, 8.69 GB, 5.35 GB, 693.92 MB, 717.94 MB, 509.14 MB, 1.53 GB, 2.15 GB, 2.71 GB, 3.29 GB, 2.22 GB, 557.07 MB, 492.11 MB, 617.07 MB, 589.43 MB, 707.08 MB, 2.32 GB, 3.66 GB, 4.52 GB, 5.56 GB, 7.17 GB, 8.96 GB, 614.04 MB, 670.13 MB, 644.25 MB, 666.72 MB, 701.92 MB, 1.75 GB, 3.49 GB, 905.95 MB, 998.91 MB, 1.20 GB, 1001.33 MB, 985.23 MB, 2.28 GB, 3.31 GB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 20, 24, 24, 24, 24, 24, 24, 24, 12, 4 - AverageThreadTokens: 16.70 - PeakMemoryUsage: 10.23 GB - PrepareTime: 14.696ms - RowsProduced: 13.54K (13535) - TotalCpuTime: 10m54s - TotalNetworkReceiveTime: 2s317ms - TotalNetworkSendTime: 7.695ms - TotalStorageWaitTime: 1m22s CodeGen:(Active: 369.83ms, % non-child: 0.90%) - CodegenTime: 2.683ms - CompileTime: 359.973ms - LoadTime: 8.242ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 3.674ms, % non-child: 0.01%) - BytesSent: 220.84 KB - NetworkThroughput(*): 13.02 MB/sec - OverallThroughput: 58.70 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 2.243ms - ThriftTransmitTime(*): 16.562ms - UncompressedRowBatchSize: 370.19 KB AGGREGATION_NODE (id=7):(Active: 41s121ms, % non-child: 3.24%) ExecOption: Codegen Enabled - BuildBuckets: 16.38K (16384) - BuildTime: 1s328ms - GetResultsTime: 939.357us - LoadFactor: 0.56 - PeakMemoryUsage: 9.72 GB - RowsReturned: 13.54K (13535) - RowsReturnedRate: 329.00 /sec HASH_JOIN_NODE (id=6):(Active: 39s789ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.31us - LeftChildRows: 2.06M (2062480) - LeftChildTime: 168.878ms - LoadFactor: 0.07 - PeakMemoryUsage: 9.57 GB - RowsReturned: 140.26K (140263) - RowsReturnedRate: 3.52 K/sec EXCHANGE_NODE (id=13):(Active: 866.657ms, % non-child: 2.11%) BytesReceived(500.0ms): 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 4.198us - DataArrivalWaitTime: 866.642ms - DeserializeRowBatchTimer: 39.250us - FirstBatchArrivalWaitTime: 863.754ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 85.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 39s614ms, % non-child: 1.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 26.974us - LeftChildRows: 29.16M (29158883) - LeftChildTime: 958.737ms - LoadFactor: 0.43 - PeakMemoryUsage: 9.56 GB - RowsReturned: 2.06M (2062480) - RowsReturnedRate: 52.06 K/sec EXCHANGE_NODE (id=12):(Active: 506.462ms, % non-child: 1.23%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 16.448us - DataArrivalWaitTime: 506.432ms - DeserializeRowBatchTimer: 78.559us - FirstBatchArrivalWaitTime: 501.958ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.03 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 38s621ms, % non-child: 60.85%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 10.325us - LeftChildRows: 823.75M (823749973) - LeftChildTime: 24s237ms - LoadFactor: 0.07 - PeakMemoryUsage: 453.41 KB - RowsReturned: 29.16M (29158883) - RowsReturnedRate: 754.98 K/sec EXCHANGE_NODE (id=11):(Active: 944.150ms, % non-child: 2.30%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.79us - DataArrivalWaitTime: 944.132ms - DeserializeRowBatchTimer: 12.163us - FirstBatchArrivalWaitTime: 941.750ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 76.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 12s653ms, % non-child: 30.77%) Hdfs split stats (:<# splits>/): 0:17/4.79 GB 1:18/5.17 GB 2:17/5.42 GB 3:18/4.94 GB 4:18/5.60 GB 5:16/5.22 GB 6:15/5.49 GB 7:17/6.27 GB 8:15/3.76 GB 9:13/3.85 GB 10:18/5.16 GB Hdfs Read Thread Concurrency Bucket: 0:44.44% 1:25.93% 2:14.81% 3:9.877% 4:2.469% 5:2.469% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:910 ExecOption: Codegen enabled: 0 out of 182 BytesRead(1s000ms): 63.71 MB, 331.46 MB, 416.49 MB, 428.43 MB, 639.78 MB, 729.50 MB, 768.24 MB, 1.01 GB, 1.07 GB, 1.22 GB, 1.24 GB, 1.39 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.57 GB, 1.62 GB, 1.79 GB, 1.89 GB, 2.05 GB, 2.10 GB, 2.28 GB, 2.35 GB, 2.42 GB, 2.48 GB, 2.58 GB, 2.74 GB, 2.94 GB, 3.05 GB, 3.13 GB, 3.20 GB, 3.32 GB, 3.59 GB, 3.68 GB, 3.86 GB, 3.94 GB, 4.02 GB, 4.12 GB, 4.15 GB, 4.20 GB, 4.21 GB - AverageHdfsReadThreadConcurrency: 1.07 - AverageScannerThreadConcurrency: 16.04 - BytesRead: 4.21 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.21 GB - BytesReadShortCircuit: 4.21 GB - DecompressionTime: 1m23s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 23 - PeakMemoryUsage: 808.14 MB - PerReadThreadRawHdfsThroughput: 89.02 MB/sec - RowsRead: 823.75M (823749973) - RowsReturned: 823.75M (823749973) - RowsReturnedRate: 65.10 M/sec - ScanRangesComplete: 182 - ScannerThreadsInvoluntaryContextSwitches: 61.86K (61860) - ScannerThreadsTotalWallClockTime: 10m51s - MaterializeTupleTime(*): 8m1s - ScannerThreadsSysTime: 7s603ms - ScannerThreadsUserTime: 3m23s - ScannerThreadsVoluntaryContextSwitches: 1.01M (1013151) - TotalRawHdfsReadTime(*): 48s437ms - TotalReadThroughput: 105.17 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751bd (host=c2334.halxg.cloudera.com:22000):(Active: 40s063ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/5.01 GB 1:16/6.55 GB 2:18/5.17 GB 3:11/3.72 GB 4:22/6.36 GB 5:17/6.31 GB 6:16/3.50 GB 7:15/4.42 GB 8:11/3.51 GB 9:14/4.86 GB 10:22/6.30 GB MemoryUsage(1s000ms): 23.84 MB, 595.06 MB, 1.95 GB, 3.77 GB, 655.47 MB, 595.97 MB, 591.67 MB, 564.56 MB, 577.40 MB, 571.29 MB, 626.19 MB, 532.07 MB, 1014.39 MB, 2.24 GB, 4.01 GB, 547.32 MB, 604.32 MB, 536.87 MB, 751.72 MB, 2.03 GB, 1.80 GB, 573.61 MB, 657.67 MB, 652.33 MB, 2.10 GB, 3.73 GB, 5.46 GB, 7.30 GB, 9.06 GB, 5.49 GB, 574.70 MB, 1.28 GB, 2.86 GB, 3.75 GB, 4.45 GB, 5.19 GB, 6.16 GB, 7.51 GB, 9.38 GB, 181.22 MB ThreadUsage(1s000ms): 8, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 14, 8 - AverageThreadTokens: 15.43 - PeakMemoryUsage: 10.95 GB - PrepareTime: 13.366ms - RowsProduced: 27.21K (27211) - TotalCpuTime: 9m42s - TotalNetworkReceiveTime: 2s028ms - TotalNetworkSendTime: 6.238ms - TotalStorageWaitTime: 1m34s CodeGen:(Active: 464.385ms, % non-child: 1.16%) - CodegenTime: 2.379ms - CompileTime: 456.186ms - LoadTime: 7.412ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 7.901ms, % non-child: 0.02%) - BytesSent: 444.40 KB - NetworkThroughput(*): 20.33 MB/sec - OverallThroughput: 54.92 MB/sec - PeakMemoryUsage: 333.28 KB - SerializeBatchTime: 4.77ms - ThriftTransmitTime(*): 21.343ms - UncompressedRowBatchSize: 744.22 KB AGGREGATION_NODE (id=7):(Active: 40s058ms, % non-child: 3.31%) ExecOption: Codegen Enabled - BuildBuckets: 32.77K (32768) - BuildTime: 1s322ms - GetResultsTime: 1.683ms - LoadFactor: 0.56 - PeakMemoryUsage: 10.47 GB - RowsReturned: 27.21K (27211) - RowsReturnedRate: 679.00 /sec HASH_JOIN_NODE (id=6):(Active: 38s730ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 11.352us - LeftChildRows: 4.07M (4072120) - LeftChildTime: 213.907ms - LoadFactor: 0.07 - PeakMemoryUsage: 10.28 GB - RowsReturned: 282.79K (282789) - RowsReturnedRate: 7.30 K/sec EXCHANGE_NODE (id=13):(Active: 770.281ms, % non-child: 1.92%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.958us - DataArrivalWaitTime: 770.266ms - DeserializeRowBatchTimer: 19.407us - FirstBatchArrivalWaitTime: 769.639ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 96.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 38s509ms, % non-child: 3.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 44.612us - LeftChildRows: 57.71M (57714020) - LeftChildTime: 1s658ms - LoadFactor: 0.43 - PeakMemoryUsage: 10.26 GB - RowsReturned: 4.07M (4072120) - RowsReturnedRate: 105.74 K/sec EXCHANGE_NODE (id=12):(Active: 409.281ms, % non-child: 1.02%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 13.890us - DataArrivalWaitTime: 409.254ms - DeserializeRowBatchTimer: 87.532us - FirstBatchArrivalWaitTime: 407.666ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.27 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 36s794ms, % non-child: 62.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.398us - LeftChildRows: 822.54M (822535857) - LeftChildTime: 24s341ms - LoadFactor: 0.07 - PeakMemoryUsage: 452.72 KB - RowsReturned: 57.71M (57714020) - RowsReturnedRate: 1.57 M/sec EXCHANGE_NODE (id=11):(Active: 848.924ms, % non-child: 2.12%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.40us - DataArrivalWaitTime: 848.910ms - DeserializeRowBatchTimer: 25.95us - FirstBatchArrivalWaitTime: 847.417ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 84.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 10s863ms, % non-child: 27.12%) Hdfs split stats (:<# splits>/): 0:17/5.01 GB 1:16/6.55 GB 2:18/5.17 GB 3:11/3.72 GB 4:22/6.36 GB 5:17/6.31 GB 6:16/3.50 GB 7:15/4.42 GB 8:11/3.51 GB 9:14/4.86 GB 10:22/6.30 GB Hdfs Read Thread Concurrency Bucket: 0:30% 1:33.75% 2:25% 3:3.75% 4:6.25% 5:1.25% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:895 ExecOption: Codegen enabled: 0 out of 179 BytesRead(1s000ms): 3.82 MB, 304.67 MB, 432.96 MB, 500.87 MB, 545.11 MB, 714.75 MB, 914.48 MB, 987.27 MB, 1021.00 MB, 1.08 GB, 1.17 GB, 1.22 GB, 1.34 GB, 1.42 GB, 1.60 GB, 1.75 GB, 1.83 GB, 1.93 GB, 2.03 GB, 2.16 GB, 2.28 GB, 2.41 GB, 2.55 GB, 2.70 GB, 2.85 GB, 2.96 GB, 3.00 GB, 3.22 GB, 3.28 GB, 3.41 GB, 3.51 GB, 3.60 GB, 3.79 GB, 3.91 GB, 3.93 GB, 3.94 GB, 4.06 GB, 4.11 GB, 4.17 GB, 4.24 GB - AverageHdfsReadThreadConcurrency: 1.26 - AverageScannerThreadConcurrency: 14.55 - BytesRead: 4.27 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 4.27 GB - BytesReadShortCircuit: 4.27 GB - DecompressionTime: 1m16s - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 613.76 MB - PerReadThreadRawHdfsThroughput: 88.75 MB/sec - RowsRead: 822.54M (822535857) - RowsReturned: 822.54M (822535857) - RowsReturnedRate: 75.72 M/sec - ScanRangesComplete: 179 - ScannerThreadsInvoluntaryContextSwitches: 56.55K (56547) - ScannerThreadsTotalWallClockTime: 9m40s - MaterializeTupleTime(*): 6m45s - ScannerThreadsSysTime: 6s711ms - ScannerThreadsUserTime: 3m21s - ScannerThreadsVoluntaryContextSwitches: 943.12K (943125) - TotalRawHdfsReadTime(*): 49s319ms - TotalReadThroughput: 108.01 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751ba (host=c2332.halxg.cloudera.com:22000): Hdfs split stats (:<# splits>/): 0:12/4.51 GB 1:17/6.28 GB 2:15/4.63 GB 3:19/6.64 GB 4:20/5.76 GB 5:23/7.57 GB 6:15/3.99 GB 7:15/4.86 GB 8:13/3.40 GB 9:13/4.50 GB 10:14/3.82 GB MemoryUsage(1s000ms): 221.77 MB, 1.23 GB, 2.98 GB, 4.67 GB, 5.50 GB, 5.98 GB, 6.38 GB, 6.78 GB, 532.82 MB, 558.46 MB, 580.55 MB, 956.90 MB, 2.61 GB, 4.30 GB, 5.78 GB, 6.50 GB, 6.89 GB, 7.28 GB, 7.62 GB, 7.99 GB, 8.41 GB, 8.83 GB, 9.27 GB, 9.73 GB, 10.19 GB, 10.78 GB, 11.35 GB, 11.86 GB, 12.35 GB, 12.89 GB, 13.38 GB, 14.03 GB, 14.57 GB, 15.14 GB, 15.70 GB, 16.34 GB, 16.93 GB, 17.71 GB, 18.39 GB, 19.12 GB, 19.94 GB, 20.83 GB, 21.83 GB, 23.15 GB, 24.75 GB, 26.29 GB, 28.06 GB ThreadUsage(1s000ms): 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 24 - AverageThreadTokens: 16.17 - PeakMemoryUsage: 29.20 GB - PrepareTime: 17.248ms - RowsProduced: 0 - TotalCpuTime: 2s251ms - TotalNetworkReceiveTime: 2s251ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 48s890ms CodeGen:(Active: 382.63ms, % non-child: 0.00%) - CodegenTime: 3.690ms - CompileTime: 372.826ms - LoadTime: 8.310ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 40.557us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.28 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 AGGREGATION_NODE (id=7):(Active: 3.359ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 4.10K (4096) - BuildTime: 187.746ms - GetResultsTime: 0ns - LoadFactor: 0.62 - PeakMemoryUsage: 6.48 GB - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=6):(Active: 10s979ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.285us - LeftChildRows: 604.16K (604160) - LeftChildTime: 51.651ms - LoadFactor: 0.07 - PeakMemoryUsage: 6.29 GB - RowsReturned: 41.62K (41619) - RowsReturnedRate: 3.79 K/sec EXCHANGE_NODE (id=13):(Active: 844.269ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 4.122us - DataArrivalWaitTime: 844.252ms - DeserializeRowBatchTimer: 16.357us - FirstBatchArrivalWaitTime: 842.557ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 87.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 11s020ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 36.229us - LeftChildRows: 8.56M (8561664) - LeftChildTime: 278.935ms - LoadFactor: 0.43 - PeakMemoryUsage: 28.45 GB - RowsReturned: 604.72K (604722) - RowsReturnedRate: 54.87 K/sec EXCHANGE_NODE (id=12):(Active: 483.520ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 17.206us - DataArrivalWaitTime: 483.491ms - DeserializeRowBatchTimer: 51.791us - FirstBatchArrivalWaitTime: 480.263ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.07 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 10s734ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.475us - LeftChildRows: 564.78M (564780392) - LeftChildTime: 4s855ms - LoadFactor: 0.07 - PeakMemoryUsage: 430.19 KB - RowsReturned: 8.56M (8562472) - RowsReturnedRate: 797.65 K/sec EXCHANGE_NODE (id=11):(Active: 924.30ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.462us - DataArrivalWaitTime: 924.12ms - DeserializeRowBatchTimer: 15.560us - FirstBatchArrivalWaitTime: 920.301ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 77.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 28s810ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:12/4.51 GB 1:17/6.28 GB 2:15/4.63 GB 3:19/6.64 GB 4:20/5.76 GB 5:23/7.57 GB 6:15/3.99 GB 7:15/4.86 GB 8:13/3.40 GB 9:13/4.50 GB 10:14/3.82 GB BytesRead(1s000ms): 160.92 MB, 487.04 MB, 529.44 MB, 624.90 MB, 641.69 MB, 641.69 MB, 657.19 MB, 735.49 MB, 775.15 MB, 779.12 MB, 1.01 GB, 1.12 GB, 1.24 GB, 1.29 GB, 1.40 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.49 GB, 1.57 GB, 1.60 GB, 1.60 GB, 1.60 GB, 1.64 GB, 1.67 GB, 1.85 GB, 1.94 GB, 1.94 GB, 1.95 GB, 1.99 GB, 2.02 GB, 2.14 GB, 2.16 GB, 2.16 GB, 2.16 GB, 2.23 GB, 2.24 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.49 GB, 2.53 GB, 2.54 GB, 2.68 GB, 2.76 GB, 2.90 GB, 3.13 GB - AverageHdfsReadThreadConcurrency: 0.57 - AverageScannerThreadConcurrency: 15.12 - BytesRead: 3.17 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 2m47s - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 23 - PeakMemoryUsage: 681.25 MB - PerReadThreadRawHdfsThroughput: 117.05 MB/sec - RowsRead: 564.92M (564919656) - RowsReturned: 564.78M (564782440) - RowsReturnedRate: 19.60 M/sec - ScanRangesComplete: 109 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 7m46s - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 27s710ms - TotalReadThroughput: 68.67 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751bb (host=c2308.halxg.cloudera.com:22000): Hdfs split stats (:<# splits>/): 0:17/5.67 GB 1:23/7.14 GB 2:16/4.82 GB 3:16/4.79 GB 4:14/4.43 GB 5:13/3.37 GB 6:18/4.50 GB 7:17/4.56 GB 8:15/4.60 GB 9:16/5.43 GB 10:18/6.45 GB MemoryUsage(1s000ms): 129.68 MB, 768.06 MB, 1.34 GB, 1.80 GB, 2.27 GB, 2.73 GB, 3.22 GB, 3.86 GB, 4.36 GB, 4.87 GB, 5.42 GB, 5.97 GB, 6.49 GB, 7.02 GB, 7.61 GB, 8.21 GB, 8.90 GB, 9.67 GB, 10.52 GB, 11.37 GB, 6.24 GB, 570.42 MB, 463.58 MB, 940.30 MB, 2.55 GB, 4.22 GB, 4.99 GB, 5.69 GB, 6.27 GB, 6.81 GB, 7.39 GB, 7.98 GB, 8.57 GB, 9.24 GB, 9.97 GB, 10.92 GB, 11.99 GB, 13.35 GB, 15.23 GB, 17.01 GB, 18.78 GB, 20.49 GB, 22.15 GB, 11.88 GB, 561.96 MB, 534.94 MB, 676.80 MB, 483.68 MB ThreadUsage(1s000ms): 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16 - AverageThreadTokens: 16.00 - PeakMemoryUsage: 23.06 GB - PrepareTime: 13.713ms - RowsProduced: 0 - TotalCpuTime: 2s343ms - TotalNetworkReceiveTime: 2s343ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1m9s CodeGen:(Active: 358.423ms, % non-child: 0.00%) - CodegenTime: 2.334ms - CompileTime: 349.308ms - LoadTime: 8.277ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 24.867us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.28 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 AGGREGATION_NODE (id=7):(Active: 2.77ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 653.863ms - GetResultsTime: 0ns - LoadFactor: 0.64 - PeakMemoryUsage: 22.48 GB - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=6):(Active: 47s306ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 12.7us - LeftChildRows: 1.27M (1274880) - LeftChildTime: 103.625ms - LoadFactor: 0.07 - PeakMemoryUsage: 22.26 GB - RowsReturned: 88.89K (88890) - RowsReturnedRate: 1.88 K/sec EXCHANGE_NODE (id=13):(Active: 876.333ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 , 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB, 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 4.577us - DataArrivalWaitTime: 876.311ms - DeserializeRowBatchTimer: 18.822us - FirstBatchArrivalWaitTime: 872.959ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 84.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 47s254ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 52.232us - LeftChildRows: 18.03M (18034688) - LeftChildTime: 566.669ms - LoadFactor: 0.43 - PeakMemoryUsage: 22.25 GB - RowsReturned: 1.28M (1275480) - RowsReturnedRate: 26.99 K/sec EXCHANGE_NODE (id=12):(Active: 516.83ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 16.881us - DataArrivalWaitTime: 516.47ms - DeserializeRowBatchTimer: 80.260us - FirstBatchArrivalWaitTime: 511.125ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.01 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 46s669ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 10.572us - LeftChildRows: 657.09M (657087187) - LeftChildTime: 18s888ms - LoadFactor: 0.07 - PeakMemoryUsage: 441.57 KB - RowsReturned: 18.03M (18034918) - RowsReturnedRate: 386.44 K/sec EXCHANGE_NODE (id=11):(Active: 951.373ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 4.696us - DataArrivalWaitTime: 951.353ms - DeserializeRowBatchTimer: 34.801us - FirstBatchArrivalWaitTime: 950.562ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 75.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 26s169ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/5.67 GB 1:23/7.14 GB 2:16/4.82 GB 3:16/4.79 GB 4:14/4.43 GB 5:13/3.37 GB 6:18/4.50 GB 7:17/4.56 GB 8:15/4.60 GB 9:16/5.43 GB 10:18/6.45 GB BytesRead(1s000ms): 91.38 MB, 380.54 MB, 456.13 MB, 456.13 MB, 456.13 MB, 456.13 MB, 507.58 MB, 652.32 MB, 652.85 MB, 652.85 MB, 652.85 MB, 658.67 MB, 692.74 MB, 716.91 MB, 716.91 MB, 716.91 MB, 745.17 MB, 875.19 MB, 995.81 MB, 1004.12 MB, 1.03 GB, 1.17 GB, 1.24 GB, 1.45 GB, 1.54 GB, 1.64 GB, 1.67 GB, 1.85 GB, 1.88 GB, 1.88 GB, 1.92 GB, 1.95 GB, 1.99 GB, 2.04 GB, 2.04 GB, 2.10 GB, 2.20 GB, 2.24 GB, 2.47 GB, 2.61 GB, 2.78 GB, 2.85 GB, 2.95 GB, 3.12 GB, 3.16 GB, 3.27 GB, 3.38 GB, 3.42 GB - AverageHdfsReadThreadConcurrency: 0.68 - AverageScannerThreadConcurrency: 14.95 - BytesRead: 3.51 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 2m39s - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 659.31 MB - PerReadThreadRawHdfsThroughput: 104.56 MB/sec - RowsRead: 657.22M (657222355) - RowsReturned: 657.09M (657088211) - RowsReturnedRate: 25.11 M/sec - ScanRangesComplete: 133 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 7m38s - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34s368ms - TotalReadThroughput: 73.45 MB/sec Instance e743f6c0eaa908e0:f107a9c66d3751b9 (host=c2302.halxg.cloudera.com:22000): Hdfs split stats (:<# splits>/): 0:18/5.15 GB 1:11/3.95 GB 2:20/6.82 GB 3:14/3.58 GB 4:19/5.33 GB 5:16/4.82 GB 6:16/3.71 GB 7:15/4.61 GB 8:14/4.86 GB 9:17/6.29 GB 10:21/6.76 GB MemoryUsage(1s000ms): 67.68 MB, 466.22 MB, 759.75 MB, 621.50 MB, 644.92 MB, 857.36 MB, 1.40 GB, 1.85 GB, 2.33 GB, 2.85 GB, 3.34 GB, 3.92 GB, 4.49 GB, 5.18 GB, 5.77 GB, 6.40 GB, 7.08 GB, 7.78 GB, 8.50 GB, 9.26 GB, 5.20 GB, 471.70 MB, 514.20 MB, 535.13 MB, 1.82 GB, 3.41 GB, 4.25 GB, 4.86 GB, 5.48 GB, 6.15 GB, 6.80 GB, 7.47 GB, 8.26 GB, 9.14 GB, 10.17 GB, 11.14 GB, 12.32 GB, 13.95 GB, 15.80 GB, 17.58 GB, 19.39 GB, 21.13 GB, 22.93 GB, 24.72 GB, 26.31 GB, 27.82 GB, 29.01 GB, 29.02 GB, 29.02 GB ThreadUsage(1s000ms): 8, 15, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16 - AverageThreadTokens: 15.83 - PeakMemoryUsage: 29.03 GB - PrepareTime: 13.699ms - RowsProduced: 0 - TotalCpuTime: 2s133ms - TotalNetworkReceiveTime: 2s133ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1m14s CodeGen:(Active: 431.619ms, % non-child: 0.00%) - CodegenTime: 2.340ms - CompileTime: 423.202ms - LoadTime: 7.603ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=14):(Active: 31.779us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.28 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 AGGREGATION_NODE (id=7):(Active: 2.89ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 8.19K (8192) - BuildTime: 356.38ms - GetResultsTime: 0ns - LoadFactor: 0.61 - PeakMemoryUsage: 28.58 GB - RowsReturned: 0 - RowsReturnedRate: 0 HASH_JOIN_NODE (id=6):(Active: 22s898ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 74 - BuildTime: 9.454us - LeftChildRows: 1.20M (1202176) - LeftChildTime: 87.335ms - LoadFactor: 0.07 - PeakMemoryUsage: 28.43 GB - RowsReturned: 81.89K (81890) - RowsReturnedRate: 3.58 K/sec EXCHANGE_NODE (id=13):(Active: 805.734ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 , 1.42 KB - BytesReceived: 1.42 KB - ConvertRowBatchTime: 3.411us - DataArrivalWaitTime: 805.718ms - DeserializeRowBatchTimer: 16.884us - FirstBatchArrivalWaitTime: 803.912ms - PeakMemoryUsage: 4.58 KB - RowsReturned: 74 - RowsReturnedRate: 91.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Active: 45s366ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 520 - BuildTime: 22.493us - LeftChildRows: 17.11M (17107968) - LeftChildTime: 562.981ms - LoadFactor: 0.43 - PeakMemoryUsage: 28.42 GB - RowsReturned: 1.20M (1202176) - RowsReturnedRate: 26.50 K/sec EXCHANGE_NODE (id=12):(Active: 442.538ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 , 8.72 KB - BytesReceived: 8.72 KB - ConvertRowBatchTime: 10.688us - DataArrivalWaitTime: 442.518ms - DeserializeRowBatchTimer: 67.225us - FirstBatchArrivalWaitTime: 441.701ms - PeakMemoryUsage: 27.42 KB - RowsReturned: 520 - RowsReturnedRate: 1.18 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=4):(Active: 44s783ms, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildBuckets: 1.02K (1024) - BuildRows: 72 - BuildTime: 9.367us - LeftChildRows: 690.67M (690670989) - LeftChildTime: 19s953ms - LoadFactor: 0.07 - PeakMemoryUsage: 432.88 KB - RowsReturned: 17.11M (17107968) - RowsReturnedRate: 382.01 K/sec EXCHANGE_NODE (id=11):(Active: 885.146ms, % non-child: 0.00%) BytesReceived(500.0ms): 0.00 , 0.00 , 0.00 - BytesReceived: 1.00 KB - ConvertRowBatchTime: 3.879us - DataArrivalWaitTime: 885.128ms - DeserializeRowBatchTimer: 12.527us - FirstBatchArrivalWaitTime: 881.551ms - PeakMemoryUsage: 4.56 KB - RowsReturned: 72 - RowsReturnedRate: 81.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Active: 23s263ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/5.15 GB 1:11/3.95 GB 2:20/6.82 GB 3:14/3.58 GB 4:19/5.33 GB 5:16/4.82 GB 6:16/3.71 GB 7:15/4.61 GB 8:14/4.86 GB 9:17/6.29 GB 10:21/6.76 GB BytesRead(1s000ms): 36.05 MB, 338.18 MB, 482.61 MB, 531.15 MB, 581.82 MB, 654.88 MB, 761.08 MB, 761.08 MB, 761.08 MB, 761.08 MB, 761.18 MB, 849.83 MB, 932.55 MB, 1.04 GB, 1.04 GB, 1.06 GB, 1.15 GB, 1.21 GB, 1.23 GB, 1.24 GB, 1.31 GB, 1.37 GB, 1.47 GB, 1.60 GB, 1.71 GB, 1.81 GB, 1.90 GB, 1.94 GB, 2.00 GB, 2.10 GB, 2.16 GB, 2.18 GB, 2.24 GB, 2.31 GB, 2.44 GB, 2.48 GB, 2.58 GB, 2.64 GB, 2.79 GB, 2.92 GB, 3.07 GB, 3.18 GB, 3.31 GB, 3.41 GB, 3.51 GB, 3.60 GB, 3.75 GB, 3.76 GB, 3.76 GB - AverageHdfsReadThreadConcurrency: 0.94 - AverageScannerThreadConcurrency: 14.94 - BytesRead: 3.77 GB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 0.00 - BytesReadShortCircuit: 0.00 - DecompressionTime: 2m25s - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 15 - PeakMemoryUsage: 616.25 MB - PerReadThreadRawHdfsThroughput: 89.30 MB/sec - RowsRead: 690.81M (690807181) - RowsReturned: 690.67M (690670989) - RowsReturnedRate: 29.69 M/sec - ScanRangesComplete: 148 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 7m31s - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 43s206ms - TotalReadThroughput: 77.95 MB/sec Fragment 4: Instance e743f6c0eaa908e0:f107a9c66d3751c0 (host=c2302.halxg.cloudera.com:22000):(Active: 583.745ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/121.03 KB MemoryUsage(500.0ms): 48.00 KB ThreadUsage(500.0ms): 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 244.55 KB - PrepareTime: 634.179us - RowsProduced: 74 - TotalCpuTime: 925.310ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 390.379us - TotalStorageWaitTime: 368.548ms CodeGen:(Active: 117.382ms, % non-child: 20.11%) - CodegenTime: 500.416us - CompileTime: 108.103ms - LoadTime: 8.275ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=13):(Active: 490.163us, % non-child: 0.08%) - BytesSent: 1.43 KB - NetworkThroughput(*): 371.64 KB/sec - OverallThroughput: 2.84 MB/sec - PeakMemoryUsage: 40.00 KB - SerializeBatchTime: 33.581us - ThriftTransmitTime(*): 3.836ms - UncompressedRowBatchSize: 3.71 KB HDFS_SCAN_NODE (id=3):(Active: 582.999ms, % non-child: 99.87%) Hdfs split stats (:<# splits>/): 7:1/121.03 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0.00 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 107.58 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 107.58 KB - BytesReadShortCircuit: 107.58 KB - DecompressionTime: 39.641us - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 196.55 KB - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RowsRead: 1.35K (1350) - RowsReturned: 74 - RowsReturnedRate: 126.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 583.15ms - MaterializeTupleTime(*): 161.434us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 76.165us - TotalReadThroughput: 0.00 /sec Fragment 5: Instance e743f6c0eaa908e0:f107a9c66d3751c1 (host=c2302.halxg.cloudera.com:22000):(Active: 29.570ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/33.93 KB MemoryUsage(500.0ms): 39.95 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 309.48 KB - PrepareTime: 33.616ms - RowsProduced: 520 - TotalCpuTime: 200.869ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.27ms - TotalStorageWaitTime: 26.456ms CodeGen:(Active: 126.850ms, % non-child: 100.00%) - CodegenTime: 926.24us - CompileTime: 117.856ms - LoadTime: 8.86ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=12):(Active: 1.189ms, % non-child: 4.02%) - BytesSent: 8.72 KB - NetworkThroughput(*): 792.40 KB/sec - OverallThroughput: 7.16 MB/sec - PeakMemoryUsage: 31.95 KB - SerializeBatchTime: 143.978us - ThriftTransmitTime(*): 11.6ms - UncompressedRowBatchSize: 25.40 KB HDFS_SCAN_NODE (id=2):(Active: 27.901ms, % non-child: 94.36%) Hdfs split stats (:<# splits>/): 2:1/33.93 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0.00 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 65.76 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 65.76 KB - BytesReadShortCircuit: 65.76 KB - DecompressionTime: 194.716us - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 269.52 KB - PerReadThreadRawHdfsThroughput: 7.74 MB/sec - RowsRead: 7.20K (7200) - RowsReturned: 520 - RowsReturnedRate: 18.64 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 28.6ms - MaterializeTupleTime(*): 965.642us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 11 - TotalRawHdfsReadTime(*): 8.298ms - TotalReadThroughput: 0.00 /sec Fragment 6: Instance e743f6c0eaa908e0:f107a9c66d3751c2 (host=c2304.halxg.cloudera.com:22000):(Active: 290.784ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/2.03 MB MemoryUsage(500.0ms): 61.28 KB ThreadUsage(500.0ms): 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 1.74 MB - PrepareTime: 1.480ms - RowsProduced: 72 - TotalCpuTime: 565.416ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 533.898us - TotalStorageWaitTime: 165.826ms CodeGen:(Active: 134.454ms, % non-child: 46.24%) - CodegenTime: 1.314ms - CompileTime: 113.766ms - LoadTime: 17.956ms - ModuleFileSize: 108.78 KB DataStreamSender (dst_id=11):(Active: 708.705us, % non-child: 0.24%) - BytesSent: 1.01 KB - NetworkThroughput(*): 177.94 KB/sec - OverallThroughput: 1.39 MB/sec - PeakMemoryUsage: 53.28 KB - SerializeBatchTime: 30.570us - ThriftTransmitTime(*): 5.658ms - UncompressedRowBatchSize: 1.98 KB HDFS_SCAN_NODE (id=1):(Active: 289.644ms, % non-child: 99.61%) Hdfs split stats (:<# splits>/): 9:1/2.03 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0.00 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 415.33 KB - BytesReadDataNodeCache: 0.00 - BytesReadLocal: 415.33 KB - BytesReadShortCircuit: 415.33 KB - DecompressionTime: 2.134ms - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.68 MB - PerReadThreadRawHdfsThroughput: 2.58 GB/sec - RowsRead: 73.05K (73049) - RowsReturned: 72 - RowsReturnedRate: 248.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 289.712ms - MaterializeTupleTime(*): 10.156ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 11.998ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 153.356us - TotalReadThroughput: 0.00 /sec