Coordinator: d2402.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=24,RUNTIME_FILTER_MODE=2,RUNTIME_FILTER_WAIT_TIME_MS=20000 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.94GB VCores=6 20:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC | limit: 100 | hosts=20 per-host-mem=unavailable | tuple-ids=7 row-size=83B cardinality=100 | 12:TOP-N [LIMIT=100] | order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC | hosts=20 per-host-mem=8.15KB | tuple-ids=7 row-size=83B cardinality=100 | 19:AGGREGATE [FINALIZE] | output: sum:merge(ss_ext_sales_price) | group by: i_brand, i_brand_id, i_manufact_id, i_manufact | hosts=20 per-host-mem=328.11MB | tuple-ids=6 row-size=83B cardinality=25193874 | 18:EXCHANGE [HASH(i_brand,i_brand_id,i_manufact_id,i_manufact)] | hosts=20 per-host-mem=0B | tuple-ids=6 row-size=83B cardinality=25193874 | 11:AGGREGATE [STREAMING] | output: sum(ss_ext_sales_price) | group by: i_brand, i_brand_id, i_manufact_id, i_manufact | hosts=20 per-host-mem=2.15GB | tuple-ids=6 row-size=83B cardinality=25193874 | 10:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | other predicates: substr(ca_zip, 1, 5) != substr(s_zip, 1, 5) | runtime filters: RF000 <- s_store_sk | hosts=20 per-host-mem=1.93KB | tuple-ids=1,2,0,3,4,5 row-size=205B cardinality=25193874 | |--17:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=5 row-size=29B cardinality=62 | | | 05:SCAN HDFS [tpcds_15000_decimal_parquet.store, RANDOM] | partitions=1/1 files=1 size=11.92KB | table stats: 62 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=5 row-size=29B cardinality=62 | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: c_current_addr_sk = ca_address_sk | runtime filters: RF001 <- ca_address_sk | hosts=20 per-host-mem=58.26MB | tuple-ids=1,2,0,3,4 row-size=176B cardinality=25193874 | |--16:EXCHANGE [BROADCAST] | | hosts=19 per-host-mem=0B | | tuple-ids=4 row-size=29B cardinality=1925000 | | | 04:SCAN HDFS [tpcds_15000_decimal_parquet.customer_address, RANDOM] | partitions=1/1 files=20 size=40.15MB | table stats: 1925000 rows total | column stats: all | hosts=19 per-host-mem=32.00MB | tuple-ids=4 row-size=29B cardinality=1925000 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_customer_sk = c_customer_sk | runtime filters: RF002 <- c_customer_sk | hosts=20 per-host-mem=64.62MB | tuple-ids=1,2,0,3 row-size=147B cardinality=25193874 | |--15:EXCHANGE [BROADCAST] | | hosts=20 per-host-mem=0B | | tuple-ids=3 row-size=16B cardinality=3850000 | | | 03:SCAN HDFS [tpcds_15000_decimal_parquet.customer, RANDOM] | partitions=1/1 files=20 size=213.69MB | runtime filters: RF001 -> c_current_addr_sk | table stats: 3850000 rows total | column stats: all | hosts=20 per-host-mem=48.00MB | tuple-ids=3 row-size=16B cardinality=3850000 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF003 <- d_date_sk | hosts=20 per-host-mem=1.86KB | tuple-ids=1,2,0 row-size=131B cardinality=25193874 | |--14:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=16B cardinality=108 | | | 00:SCAN HDFS [tpcds_15000_decimal_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_moy = 11, d_year = 1999 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=0 row-size=16B cardinality=108 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF004 <- i_item_sk | hosts=20 per-host-mem=27.56KB | tuple-ids=1,2 row-size=115B cardinality=436074693 | |--13:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=79B cardinality=323 | | | 02:SCAN HDFS [tpcds_15000_decimal_parquet.item, RANDOM] | partitions=1/1 files=1 size=3.14MB | predicates: i_manager_id = 7 | table stats: 32000 rows total | column stats: all | hosts=1 per-host-mem=96.00MB | tuple-ids=2 row-size=79B cardinality=323 | 01:SCAN HDFS [tpcds_15000_decimal_parquet.store_sales, RANDOM] partitions=1824/1824 files=6922 size=1.52TB runtime filters: RF000 -> ss_store_sk, RF002 -> ss_customer_sk, RF003 -> ss_sold_date_sk, RF004 -> ss_item_sk table stats: 43202446268 rows total column stats: all hosts=20 per-host-mem=352.00MB tuple-ids=1 row-size=36B cardinality=43202446268 ---------------- Estimated Per-Host Mem: 3154149519 Estimated Per-Host VCores: 6 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 20:MERGING-EXCHANGE 1 294.392us 294.392us 301 100 0 -1.00 B UNPARTITIONED 12:TOP-N 20 489.576us 685.858us 301 100 12.00 KB 8.15 KB 19:AGGREGATE 20 186.865ms 254.407ms 301 25.19M 2.34 MB 328.11 MB FINALIZE 18:EXCHANGE 20 290.751us 447.656us 6.02K 25.19M 0 0 HASH(i_brand,i_brand_id,i_m... 11:AGGREGATE 20 419.267ms 563.879ms 6.02K 25.19M 8.40 MB 2.15 GB STREAMING 10:HASH JOIN 20 181.768ms 278.321ms 23.29M 25.19M 7.39 MB 1.93 KB INNER JOIN, BROADCAST |--17:EXCHANGE 20 13.458us 35.402us 62 62 0 0 BROADCAST | 05:SCAN HDFS 1 4.188ms 4.188ms 62 62 70.00 KB 32.00 MB tpcds_15000_decimal_parquet... 09:HASH JOIN 20 356.278ms 525.141ms 23.55M 25.19M 207.05 MB 58.26 MB INNER JOIN, BROADCAST |--16:EXCHANGE 20 60.429ms 73.593ms 1.93M 1.93M 0 0 BROADCAST | 04:SCAN HDFS 18 7.925ms 14.612ms 1.93M 1.93M 11.98 MB 32.00 MB tpcds_15000_decimal_parquet... 08:HASH JOIN 20 319.778ms 609.357ms 23.55M 25.19M 270.57 MB 64.62 MB INNER JOIN, BROADCAST |--15:EXCHANGE 20 132.751ms 220.477ms 3.85M 3.85M 0 0 BROADCAST | 03:SCAN HDFS 17 1s549ms 1s555ms 3.85M 3.85M 18.91 MB 48.00 MB tpcds_15000_decimal_parquet... 07:HASH JOIN 20 70.136ms 116.020ms 24.09M 25.19M 4.51 MB 1.86 KB INNER JOIN, BROADCAST |--14:EXCHANGE 20 21.054us 271.842us 30 108 0 0 BROADCAST | 00:SCAN HDFS 1 13.422ms 13.422ms 30 108 1.79 MB 48.00 MB tpcds_15000_decimal_parquet... 06:HASH JOIN 20 104.192ms 167.928ms 24.09M 436.07M 3.06 MB 27.56 KB INNER JOIN, BROADCAST |--13:EXCHANGE 20 20.171us 32.357us 591 323 0 0 BROADCAST | 02:SCAN HDFS 1 16.679ms 16.679ms 591 323 1.73 MB 96.00 MB tpcds_15000_decimal_parquet... 01:SCAN HDFS 20 19s979ms 20s622ms 24.09M 43.20B 849.66 MB 352.00 MB tpcds_15000_decimal_parquet... Planner Timeline: 38.764ms - Analysis finished: 5.403ms (5.403ms) - Equivalence classes computed: 5.800ms (396.609us) - Single node plan created: 20.777ms (14.977ms) - Runtime filters computed: 21.193ms (415.988us) - Distributed plan created: 27.868ms (6.675ms) - Lineage info computed: 28.904ms (1.035ms) - Planning finished: 38.764ms (9.859ms) Query Timeline: 23s340ms - Start execution: 69.703us (69.703us) - Planning finished: 95.959ms (95.889ms) - Ready to start 78 remote fragments: 126.659ms (30.699ms) - All 78 remote fragments started: 306.333ms (179.674ms) - First dynamic filter received: 1s764ms (1s458ms) - Rows available: 22s873ms (21s108ms) - First row fetched: 23s265ms (391.144ms) - Unregister query: 23s310ms (45.594ms) ImpalaServer: - ClientFetchWaitTimer: 422.182ms - RowMaterializationTimer: 260.135us Execution Profile 3045db9f916d3ae1:2b6258aae4211ead:(Total: 22s756ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 5 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 4 6 1 20 LOCAL false 1 (20) N/A N/A 3 7 1 20 LOCAL true 1 (20) N/A N/A 2 8 1 20 LOCAL false 1 (20) N/A N/A 1 9 3 17 GLOBAL (Broadcast) false 1 (3) N/A N/A 0 10 1 20 LOCAL false 1 (20) N/A N/A Fragment start latencies: Count: 78, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 18ms, 90th %-ile: 22ms, 95th %-ile: 23ms, 99.9th %-ile: 32ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 4 6 1 20 LOCAL false 1 (20) N/A N/A 3 7 1 20 LOCAL true 1 (20) N/A N/A 2 8 1 20 LOCAL false 1 (20) N/A N/A 1 9 3 17 GLOBAL (Broadcast) false 0 (3) 1s764ms 1s764ms 0 10 1 20 LOCAL false 1 (20) N/A N/A Per Node Peak Memory Usage: d2413.halxg.cloudera.com:22000(879.32 MB) d2406.halxg.cloudera.com:22000(914.84 MB) d2420.halxg.cloudera.com:22000(969.93 MB) d2410.halxg.cloudera.com:22000(1.01 GB) d2404.halxg.cloudera.com:22000(1.02 GB) d2403.halxg.cloudera.com:22000(962.65 MB) d2408.halxg.cloudera.com:22000(909.19 MB) d2421.halxg.cloudera.com:22000(1.12 GB) d2415.halxg.cloudera.com:22000(1.03 GB) d2419.halxg.cloudera.com:22000(1.08 GB) d2409.halxg.cloudera.com:22000(998.57 MB) d2407.halxg.cloudera.com:22000(908.11 MB) d2416.halxg.cloudera.com:22000(1.30 GB) d2414.halxg.cloudera.com:22000(819.42 MB) d2405.halxg.cloudera.com:22000(915.11 MB) d2418.halxg.cloudera.com:22000(961.21 MB) d2411.halxg.cloudera.com:22000(810.96 MB) d2412.halxg.cloudera.com:22000(910.49 MB) d2417.halxg.cloudera.com:22000(819.52 MB) d2402.halxg.cloudera.com:22000(955.75 MB) - FiltersReceived: 1 (1) - FinalizationTimer: 0.000ns Coordinator Fragment F07:(Total: 22s559ms, non-child: 971.310us, % non-child: 0.00%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 90.35 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 90.35 KB (92520) - PerHostPeakMemUsage: 0 - PrepareTime: 118.633us - RowsProduced: 100 (100) - TotalCpuTime: 23s140ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 22s558ms, non-child: 294.392us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.27 KB - BytesReceived: 18.27 KB (18712) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 183.012us - FirstBatchArrivalWaitTime: 22s558ms - MergeGetNext: 190.727us - MergeGetNextBatch: 53.747us - PeakMemoryUsage: 0 - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 22s423ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:22s738ms max:22s748ms mean: 22s741ms stddev:2.314ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 20 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463984) - PerHostPeakMemUsage: 972.60 MB (1019843463) - PrepareTime: 186.217ms - RowsProduced: 15 (15) - TotalCpuTime: 504.970ms - TotalNetworkReceiveTime: 22s234ms - TotalNetworkSendTime: 337.857us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 79 (79) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 495.479ms, non-child: 495.479ms, % non-child: 100.00%) - CodegenTime: 3.110ms - CompileTime: 39.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 273.513ms - PrepareTime: 181.200ms DataStreamSender (dst_id=20):(Total: 44.171us, non-child: 44.171us, % non-child: 100.00%) - BytesSent: 935.00 B (935) - NetworkThroughput(*): 4.40 MB/sec - OverallThroughput: 20.54 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 21.603us - ThriftTransmitTime(*): 224.052us - UncompressedRowBatchSize: 1.41 KB (1440) SORT_NODE (id=12):(Total: 22s422ms, non-child: 489.577us, % non-child: 0.00%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 15 (15) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s421ms, non-child: 186.865ms, % non-child: 0.83%) - BuildTime: 79.128us - GetNewBlockTime: 131.429us - GetResultsTime: 18.511us - HTResizeTime: 4.865us - HashBuckets: 9.88K (9881) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.321us EXCHANGE_NODE (id=18):(Total: 22s234ms, non-child: 22s234ms, % non-child: 100.00%) - BytesReceived: 17.73 KB (18156) - ConvertRowBatchTime: 66.057us - DeserializeRowBatchTimer: 190.281us - FirstBatchArrivalWaitTime: 21s058ms - PeakMemoryUsage: 0 - RowsReturned: 301 (301) - RowsReturnedRate: 12.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 21s442ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 77.58 GB, max: 78.14 GB, avg: 77.94 GB, stddev: 133.93 MB completion times: min:21s477ms max:22s587ms mean: 21s986ms stddev:283.290ms execution rates: min:3.43 GB/sec max:3.64 GB/sec mean:3.55 GB/sec stddev:48.61 MB/sec num instances: 20 - AverageThreadTokens: 22.80 - BloomFilterBytes: 7.15 MB (7497318) - PeakMemoryUsage: 963.18 MB (1009972103) - PerHostPeakMemUsage: 972.60 MB (1019843463) - PrepareTime: 192.111ms - RowsProduced: 301 (301) - TotalCpuTime: 8m22s - TotalNetworkReceiveTime: 1s217ms - TotalNetworkSendTime: 5.394ms - TotalStorageWaitTime: 381.522ms CodeGen:(Total: 709.943ms, non-child: 709.943ms, % non-child: 100.00%) - CodegenTime: 2.476ms - CompileTime: 144.829ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 390.764ms - PrepareTime: 172.861ms DataStreamSender (dst_id=18):(Total: 321.269us, non-child: 321.269us, % non-child: 100.00%) - BytesSent: 17.73 KB (18156) - NetworkThroughput(*): 4.48 MB/sec - OverallThroughput: 95.00 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 434.230us - ThriftTransmitTime(*): 4.501ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s428ms, non-child: 419.267ms, % non-child: 1.96%) - GetNewBlockTime: 68.020us - GetResultsTime: 127.232us - HTResizeTime: 360.161us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.37 MB (6680561) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 244.631ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s009ms, non-child: 181.768ms, % non-child: 0.87%) - BuildPartitionTime: 7.247us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 12.686us - GetNewBlockTime: 228.885us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.91 MB (5146543) - PinTime: 0.000ns - ProbeRows: 1.18M (1177465) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 168.426ms - RowsReturned: 1.16M (1164458) - RowsReturnedRate: 55.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.347us EXCHANGE_NODE (id=17):(Total: 13.458us, non-child: 13.458us, % non-child: 100.00%) - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 3.682us - DeserializeRowBatchTimer: 9.981us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s827ms, non-child: 356.278ms, % non-child: 1.71%) - BuildPartitionTime: 149.807ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 179.784ms - GetNewBlockTime: 775.456us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.58 MB (214516481) - PinTime: 0.000ns - ProbeRows: 1.18M (1177465) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 347.217ms - RowsReturned: 1.18M (1177465) - RowsReturnedRate: 56.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.392us EXCHANGE_NODE (id=16):(Total: 270.890ms, non-child: 270.890ms, % non-child: 100.00%) - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.853ms - DeserializeRowBatchTimer: 127.371ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 7.93 M/sec - SendersBlockedTimer: 395.297ms - SendersBlockedTotalTimer(*): 6s144ms HASH_JOIN_NODE (id=8):(Total: 20s472ms, non-child: 319.778ms, % non-child: 1.56%) - BuildPartitionTime: 187.316ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 345.559ms - GetNewBlockTime: 471.012us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.29 MB (281325884) - PinTime: 0.000ns - ProbeRows: 1.20M (1204329) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 309.773ms - RowsReturned: 1.18M (1177465) - RowsReturnedRate: 57.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.179us EXCHANGE_NODE (id=15):(Total: 1s056ms, non-child: 1s056ms, % non-child: 100.00%) - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 69.479ms - DeserializeRowBatchTimer: 141.077ms - FirstBatchArrivalWaitTime: 789.048ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.66 M/sec - SendersBlockedTimer: 15.630ms - SendersBlockedTotalTimer(*): 212.486ms HASH_JOIN_NODE (id=7):(Total: 20s154ms, non-child: 70.136ms, % non-child: 0.35%) - BuildPartitionTime: 14.798us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.473us - GetNewBlockTime: 156.485us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.26 MB (3415464) - PinTime: 0.000ns - ProbeRows: 1.20M (1204329) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 62.984ms - RowsReturned: 1.20M (1204329) - RowsReturnedRate: 59.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.104us EXCHANGE_NODE (id=14):(Total: 21.054us, non-child: 21.054us, % non-child: 100.00%) - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.556us - DeserializeRowBatchTimer: 6.363us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s083ms, non-child: 104.192ms, % non-child: 0.52%) - BuildPartitionTime: 72.044us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 91.472us - GetNewBlockTime: 160.889us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.91 MB (3047836) - PinTime: 0.000ns - ProbeRows: 1.20M (1204329) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.312ms - RowsReturned: 1.20M (1204329) - RowsReturnedRate: 60.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.132us EXCHANGE_NODE (id=13):(Total: 20.171us, non-child: 20.171us, % non-child: 100.00%) - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 13.408us - DeserializeRowBatchTimer: 84.986us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 30.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s979ms, non-child: 19s979ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.59 - BytesRead: 396.99 MB (416278340) - BytesReadDataNodeCache: 0 - BytesReadLocal: 396.99 MB (416278340) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 396.99 MB (416278340) - DecompressionTime: 804.809ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 489.10 MB (512857020) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 65.51M (65507746) - RowsReturned: 1.20M (1204329) - RowsReturnedRate: 60.41 K/sec - ScanRangesComplete: 346 (346) - ScannerThreadsInvoluntaryContextSwitches: 6.09K (6087) - ScannerThreadsTotalWallClockTime: 7m59s - MaterializeTupleTime(*): 14s960ms - ScannerThreadsSysTime: 23s669ms - ScannerThreadsUserTime: 18s969ms - ScannerThreadsVoluntaryContextSwitches: 424.34K (424342) - TotalRawHdfsReadTime(*): 288.601ms - TotalReadThroughput: 18.21 MB/sec Filter 0: - Rows processed: 173.66K (173659) - Rows rejected: 4.14K (4142) - Rows total: 173.67K (173670) Filter 2: - Rows processed: 173.66K (173659) - Rows rejected: 0 (0) - Rows total: 173.67K (173670) Filter 3: - Files processed: 346 (346) - Files rejected: 335 (335) - Files total: 346 (346) - RowGroups processed: 470.21K (470210) - RowGroups rejected: 0 (0) - RowGroups total: 470.21K (470210) - Rows processed: 173.66K (173659) - Rows rejected: 0 (0) - Rows total: 173.67K (173670) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 65.50M (65503604) - Rows rejected: 64.30M (64299274) - Rows total: 65.50M (65503604) Averaged Fragment F05:(Total: 301.774ms, non-child: 297.445ms, % non-child: 98.57%) split sizes: min: 11.92 KB, max: 11.92 KB, avg: 11.92 KB, stddev: 0 completion times: min:304.571ms max:304.571ms mean: 304.571ms stddev:0.000ns execution rates: min:39.14 KB/sec max:39.14 KB/sec mean:39.14 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 158.00 KB (161792) - PerHostPeakMemUsage: 12.41 MB (13015384) - PrepareTime: 84.746us - RowsProduced: 62 (62) - TotalCpuTime: 13.010ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 291.487ms - TotalStorageWaitTime: 3.642ms DataStreamSender (dst_id=17):(Total: 139.784us, non-child: 139.784us, % non-child: 100.00%) - BytesSent: 21.43 KB (21940) - NetworkThroughput(*): 5.35 KB/sec - OverallThroughput: 149.69 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 26.430us - ThriftTransmitTime(*): 4s005ms - UncompressedRowBatchSize: 49.63 KB (50820) HDFS_SCAN_NODE (id=5):(Total: 4.188ms, non-child: 4.188ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.59 KB (12892) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.59 KB (12892) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.59 KB (12892) - DecompressionTime: 3.030us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 70.00 KB (71680) - PerReadThreadRawHdfsThroughput: 655.37 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62 (62) - RowsReturned: 62 (62) - RowsReturnedRate: 14.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.956ms - MaterializeTupleTime(*): 9.824us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 18.760us - TotalReadThroughput: 0.00 /sec Averaged Fragment F04:(Total: 1s128ms, non-child: 6.414ms, % non-child: 0.57%) split sizes: min: 2.00 MB, max: 4.02 MB, avg: 2.23 MB, stddev: 646.12 KB completion times: min:1s099ms max:1s174ms mean: 1s130ms stddev:17.108ms execution rates: min:1.77 MB/sec max:3.43 MB/sec mean:1.97 MB/sec stddev:527.77 KB/sec num instances: 18 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.71 MB (7031109) - PerHostPeakMemUsage: 172.25 MB (180619526) - PrepareTime: 107.519us - RowsProduced: 106.94K (106944) - TotalCpuTime: 57.503ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s087ms - TotalStorageWaitTime: 5.184ms DataStreamSender (dst_id=16):(Total: 1s113ms, non-child: 1s113ms, % non-child: 100.00%) - BytesSent: 34.60 MB (36278682) - NetworkThroughput(*): 3.07 MB/sec - OverallThroughput: 30.95 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 18.657ms - ThriftTransmitTime(*): 11s452ms - UncompressedRowBatchSize: 83.33 MB (87378630) HDFS_SCAN_NODE (id=4):(Total: 7.925ms, non-child: 7.925ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 806.23 KB (825575) - BytesReadDataNodeCache: 0 - BytesReadLocal: 806.23 KB (825575) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 806.23 KB (825575) - DecompressionTime: 1.385ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.59 MB (6908229) - PerReadThreadRawHdfsThroughput: 2.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 106.94K (106944) - RowsReturned: 106.94K (106944) - RowsReturnedRate: 14.02 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 19.838ms - MaterializeTupleTime(*): 10.606ms - ScannerThreadsSysTime: 2.276ms - ScannerThreadsUserTime: 11.053ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 353.030us - TotalReadThroughput: 725.60 KB/sec Averaged Fragment F03:(Total: 1s919ms, non-child: 5.665ms, % non-child: 0.30%) split sizes: min: 10.67 MB, max: 21.37 MB, avg: 12.57 MB, stddev: 4.07 MB completion times: min:1s855ms max:1s995ms mean: 1s923ms stddev:34.908ms execution rates: min:5.55 MB/sec max:10.76 MB/sec mean:6.50 MB/sec stddev:1.96 MB/sec num instances: 17 - AverageThreadTokens: 1.45 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 12.28 MB (12873760) - PerHostPeakMemUsage: 372.81 MB (390921365) - PrepareTime: 108.142us - RowsProduced: 226.47K (226470) - TotalCpuTime: 2s559ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.056ms - TotalStorageWaitTime: 3.327ms DataStreamSender (dst_id=15):(Total: 364.921ms, non-child: 364.921ms, % non-child: 100.00%) - BytesSent: 64.53 MB (67661755) - NetworkThroughput(*): 42.64 MB/sec - OverallThroughput: 173.73 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 25.095ms - ThriftTransmitTime(*): 1s489ms - UncompressedRowBatchSize: 120.97 MB (126841242) HDFS_SCAN_NODE (id=3):(Total: 1s549ms, non-child: 1s549ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.45 - BytesRead: 2.24 MB (2347072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.24 MB (2347072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.24 MB (2347072) - DecompressionTime: 6.852ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 12.14 MB (12730857) - PerReadThreadRawHdfsThroughput: 2.57 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 226.47K (226470) - RowsReturned: 226.47K (226470) - RowsReturnedRate: 146.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 965.472ms - MaterializeTupleTime(*): 64.953ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 25.407ms - ScannerThreadsVoluntaryContextSwitches: 66 (66) - TotalRawHdfsReadTime(*): 864.322us - TotalReadThroughput: 1.01 MB/sec Filter 1: - Rows processed: 19.27K (19274) - Rows rejected: 0 (0) - Rows total: 19.27K (19275) Averaged Fragment F02:(Total: 281.553ms, non-child: 267.968ms, % non-child: 95.17%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:283.335ms max:283.335ms mean: 283.335ms stddev:0.000ns execution rates: min:7.65 MB/sec max:7.65 MB/sec mean:7.65 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.90 MB (1996824) - PerHostPeakMemUsage: 10.40 MB (10905152) - PrepareTime: 93.484us - RowsProduced: 30 (30) - TotalCpuTime: 30.365ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 263.235ms - TotalStorageWaitTime: 2.911ms DataStreamSender (dst_id=14):(Total: 163.030us, non-child: 163.030us, % non-child: 100.00%) - BytesSent: 5.86 KB (6000) - NetworkThroughput(*): 1.68 KB/sec - OverallThroughput: 35.10 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 18.568us - ThriftTransmitTime(*): 3s477ms - UncompressedRowBatchSize: 16.48 KB (16880) HDFS_SCAN_NODE (id=0):(Total: 13.422ms, non-child: 13.422ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.93 KB (477115) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.93 KB (477115) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.93 KB (477115) - DecompressionTime: 580.560us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.79 MB (1879512) - PerReadThreadRawHdfsThroughput: 841.42 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 30 (30) - RowsReturnedRate: 2.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 13.200ms - MaterializeTupleTime(*): 8.250ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 540.770us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 279.753ms, non-child: 262.653ms, % non-child: 93.89%) split sizes: min: 3.14 MB, max: 3.14 MB, avg: 3.14 MB, stddev: 0 completion times: min:282.720ms max:282.720ms mean: 282.720ms stddev:0.000ns execution rates: min:11.10 MB/sec max:11.10 MB/sec mean:11.10 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.79 MB (1873344) - PerHostPeakMemUsage: 10.38 MB (10887432) - PrepareTime: 160.228us - RowsProduced: 591 (591) - TotalCpuTime: 34.255ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.247ms - TotalStorageWaitTime: 7.063ms DataStreamSender (dst_id=13):(Total: 419.654us, non-child: 419.654us, % non-child: 100.00%) - BytesSent: 513.44 KB (525760) - NetworkThroughput(*): 152.75 KB/sec - OverallThroughput: 1.17 GB/sec - PeakMemoryUsage: 45.62 KB (46720) - SerializeBatchTime: 301.684us - ThriftTransmitTime(*): 3s361ms - UncompressedRowBatchSize: 1008.61 KB (1032820) HDFS_SCAN_NODE (id=2):(Total: 16.679ms, non-child: 16.679ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 487.70 KB (499409) - BytesReadDataNodeCache: 0 - BytesReadLocal: 487.70 KB (499409) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 487.70 KB (499409) - DecompressionTime: 98.346us - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.73 MB (1818432) - PerReadThreadRawHdfsThroughput: 315.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.00K (32000) - RowsReturned: 591 (591) - RowsReturnedRate: 35.43 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.320ms - MaterializeTupleTime(*): 7.669ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 1.508ms - TotalReadThroughput: 0.00 /sec Fragment F06: Instance 3045db9f916d3ae1:2b6258aae4211ec2 (host=d2417.halxg.cloudera.com:22000):(Total: 22s444ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463920) - PerHostPeakMemUsage: 819.52 MB (859332000) - PrepareTime: 179.167ms - RowsProduced: 11 (11) - TotalCpuTime: 480.444ms - TotalNetworkReceiveTime: 22s262ms - TotalNetworkSendTime: 192.656us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 474.090ms, non-child: 474.090ms, % non-child: 100.00%) - CodegenTime: 2.841ms - CompileTime: 38.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 259.917ms - PrepareTime: 174.457ms DataStreamSender (dst_id=20):(Total: 30.468us, non-child: 30.468us, % non-child: 100.00%) - BytesSent: 701.00 B (701) - NetworkThroughput(*): 4.44 MB/sec - OverallThroughput: 21.94 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 12.340us - ThriftTransmitTime(*): 150.498us - UncompressedRowBatchSize: 1.03 KB (1058) SORT_NODE (id=12):(Total: 22s442ms, non-child: 436.812us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 11 (11) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s442ms, non-child: 179.644ms, % non-child: 0.80%) ExecOption: Codegen Enabled - BuildTime: 64.238us - GetNewBlockTime: 150.348us - GetResultsTime: 10.872us - HTResizeTime: 2.830us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 11 (11) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.226us EXCHANGE_NODE (id=18):(Total: 22s262ms, non-child: 239.868us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 680.00 B, 8.61 KB, 12.58 KB - BytesReceived: 13.24 KB (13553) - ConvertRowBatchTime: 41.164us - DeserializeRowBatchTimer: 187.132us - FirstBatchArrivalWaitTime: 21s085ms - PeakMemoryUsage: 0 - RowsReturned: 220 (220) - RowsReturnedRate: 9.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ebf (host=d2406.halxg.cloudera.com:22000):(Total: 22s439ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.31 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464128) - PerHostPeakMemUsage: 914.84 MB (959283200) - PrepareTime: 177.446ms - RowsProduced: 24 (24) - TotalCpuTime: 484.400ms - TotalNetworkReceiveTime: 22s257ms - TotalNetworkSendTime: 421.386us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 476.527ms, non-child: 476.527ms, % non-child: 100.00%) - CodegenTime: 2.915ms - CompileTime: 38.798ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 263.599ms - PrepareTime: 172.598ms DataStreamSender (dst_id=20):(Total: 41.814us, non-child: 41.814us, % non-child: 100.00%) - BytesSent: 1.39 KB (1424) - NetworkThroughput(*): 4.09 MB/sec - OverallThroughput: 32.48 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 22.706us - ThriftTransmitTime(*): 331.946us - UncompressedRowBatchSize: 2.23 KB (2286) SORT_NODE (id=12):(Total: 22s436ms, non-child: 468.964us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 24 (24) - RowsReturnedRate: 1.00 /sec AGGREGATION_NODE (id=19):(Total: 22s436ms, non-child: 178.119ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 85.532us - GetNewBlockTime: 128.750us - GetResultsTime: 27.264us - HTResizeTime: 2.554us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 24 (24) - RowsReturnedRate: 1.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.164us EXCHANGE_NODE (id=18):(Total: 22s257ms, non-child: 424.528us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.24 KB, 23.82 KB - BytesReceived: 26.48 KB (27115) - ConvertRowBatchTime: 87.080us - DeserializeRowBatchTimer: 199.378us - FirstBatchArrivalWaitTime: 21s081ms - PeakMemoryUsage: 0 - RowsReturned: 480 (480) - RowsReturnedRate: 21.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eaf (host=d2412.halxg.cloudera.com:22000):(Total: 22s438ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.29 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464000) - PerHostPeakMemUsage: 910.49 MB (954721368) - PrepareTime: 177.737ms - RowsProduced: 16 (16) - TotalCpuTime: 478.955ms - TotalNetworkReceiveTime: 22s258ms - TotalNetworkSendTime: 567.624us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.341ms, non-child: 472.341ms, % non-child: 100.00%) - CodegenTime: 3.005ms - CompileTime: 36.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 261.897ms - PrepareTime: 172.975ms DataStreamSender (dst_id=20):(Total: 35.347us, non-child: 35.347us, % non-child: 100.00%) - BytesSent: 1011.00 B (1011) - NetworkThroughput(*): 4.22 MB/sec - OverallThroughput: 27.28 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 16.496us - ThriftTransmitTime(*): 228.558us - UncompressedRowBatchSize: 1.49 KB (1527) SORT_NODE (id=12):(Total: 22s436ms, non-child: 460.247us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 16 (16) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s436ms, non-child: 178.120ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 78.751us - GetNewBlockTime: 130.564us - GetResultsTime: 32.292us - HTResizeTime: 3.213us - HashBuckets: 10.24K (10240) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 16 (16) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.189us EXCHANGE_NODE (id=18):(Total: 22s258ms, non-child: 283.700us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.70 KB, 16.03 KB - BytesReceived: 18.85 KB (19307) - ConvertRowBatchTime: 84.317us - DeserializeRowBatchTimer: 173.562us - FirstBatchArrivalWaitTime: 21s083ms - PeakMemoryUsage: 0 - RowsReturned: 320 (320) - RowsReturnedRate: 14.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ebb (host=d2421.halxg.cloudera.com:22000):(Total: 22s437ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.30 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463904) - PerHostPeakMemUsage: 1.12 GB (1197392536) - PrepareTime: 173.796ms - RowsProduced: 10 (10) - TotalCpuTime: 478.240ms - TotalNetworkReceiveTime: 22s261ms - TotalNetworkSendTime: 245.016us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 471.714ms, non-child: 471.714ms, % non-child: 100.00%) - CodegenTime: 2.887ms - CompileTime: 38.451ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 262.764ms - PrepareTime: 168.975ms DataStreamSender (dst_id=20):(Total: 42.076us, non-child: 42.076us, % non-child: 100.00%) - BytesSent: 653.00 B (653) - NetworkThroughput(*): 3.88 MB/sec - OverallThroughput: 14.80 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 21.672us - ThriftTransmitTime(*): 160.620us - UncompressedRowBatchSize: 950.00 B (950) SORT_NODE (id=12):(Total: 22s436ms, non-child: 434.368us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s436ms, non-child: 174.421ms, % non-child: 0.78%) ExecOption: Codegen Enabled - BuildTime: 68.840us - GetNewBlockTime: 113.766us - GetResultsTime: 14.056us - HTResizeTime: 1.706us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.772us EXCHANGE_NODE (id=18):(Total: 22s261ms, non-child: 212.174us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.33 KB, 10.48 KB - BytesReceived: 12.34 KB (12635) - ConvertRowBatchTime: 38.928us - DeserializeRowBatchTimer: 206.376us - FirstBatchArrivalWaitTime: 21s086ms - PeakMemoryUsage: 0 - RowsReturned: 200 (200) - RowsReturnedRate: 8.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb0 (host=d2411.halxg.cloudera.com:22000):(Total: 22s435ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.31 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463968) - PerHostPeakMemUsage: 810.96 MB (850358344) - PrepareTime: 180.140ms - RowsProduced: 14 (14) - TotalCpuTime: 484.771ms - TotalNetworkReceiveTime: 22s252ms - TotalNetworkSendTime: 278.942us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 478.086ms, non-child: 478.086ms, % non-child: 100.00%) - CodegenTime: 3.011ms - CompileTime: 38.984ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 262.354ms - PrepareTime: 175.244ms DataStreamSender (dst_id=20):(Total: 36.372us, non-child: 36.372us, % non-child: 100.00%) - BytesSent: 892.00 B (892) - NetworkThroughput(*): 3.77 MB/sec - OverallThroughput: 23.39 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 17.816us - ThriftTransmitTime(*): 225.430us - UncompressedRowBatchSize: 1.31 KB (1338) SORT_NODE (id=12):(Total: 22s433ms, non-child: 466.784us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 14 (14) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s433ms, non-child: 180.743ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 67.616us - GetNewBlockTime: 128.086us - GetResultsTime: 16.244us - HTResizeTime: 3.210us - HashBuckets: 10.24K (10240) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 14 (14) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.384us EXCHANGE_NODE (id=18):(Total: 22s252ms, non-child: 193.748us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.54 KB, 15.36 KB - BytesReceived: 17.08 KB (17492) - ConvertRowBatchTime: 40.164us - DeserializeRowBatchTimer: 210.768us - FirstBatchArrivalWaitTime: 21s077ms - PeakMemoryUsage: 0 - RowsReturned: 280 (280) - RowsReturnedRate: 12.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb4 (host=d2416.halxg.cloudera.com:22000):(Total: 22s433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463872) - PerHostPeakMemUsage: 1.30 GB (1398468888) - PrepareTime: 180.141ms - RowsProduced: 8 (8) - TotalCpuTime: 488.122ms - TotalNetworkReceiveTime: 22s250ms - TotalNetworkSendTime: 726.856us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.206ms, non-child: 481.206ms, % non-child: 100.00%) - CodegenTime: 3.030ms - CompileTime: 39.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 264.880ms - PrepareTime: 175.255ms DataStreamSender (dst_id=20):(Total: 34.780us, non-child: 34.780us, % non-child: 100.00%) - BytesSent: 539.00 B (539) - NetworkThroughput(*): 1.41 MB/sec - OverallThroughput: 14.78 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 16.116us - ThriftTransmitTime(*): 363.546us - UncompressedRowBatchSize: 758.00 B (758) SORT_NODE (id=12):(Total: 22s432ms, non-child: 460.804us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 8 (8) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s431ms, non-child: 180.889ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 47.366us - GetNewBlockTime: 122.306us - GetResultsTime: 9.334us - HTResizeTime: 2.258us - HashBuckets: 6.14K (6144) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 8 (8) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.198us EXCHANGE_NODE (id=18):(Total: 22s250ms, non-child: 263.406us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 516.00 B, 6.61 KB, 9.66 KB - BytesReceived: 10.17 KB (10419) - ConvertRowBatchTime: 60.594us - DeserializeRowBatchTimer: 206.846us - FirstBatchArrivalWaitTime: 21s075ms - PeakMemoryUsage: 0 - RowsReturned: 160 (160) - RowsReturnedRate: 7.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb8 (host=d2415.halxg.cloudera.com:22000):(Total: 22s433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463968) - PerHostPeakMemUsage: 1.03 GB (1110429560) - PrepareTime: 181.463ms - RowsProduced: 14 (14) - TotalCpuTime: 489.431ms - TotalNetworkReceiveTime: 22s249ms - TotalNetworkSendTime: 307.952us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 482.579ms, non-child: 482.579ms, % non-child: 100.00%) - CodegenTime: 3.126ms - CompileTime: 38.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 266.078ms - PrepareTime: 176.444ms DataStreamSender (dst_id=20):(Total: 37.910us, non-child: 37.910us, % non-child: 100.00%) - BytesSent: 878.00 B (878) - NetworkThroughput(*): 3.43 MB/sec - OverallThroughput: 22.09 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 16.556us - ThriftTransmitTime(*): 244.368us - UncompressedRowBatchSize: 1.33 KB (1362) SORT_NODE (id=12):(Total: 22s432ms, non-child: 540.738us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 14 (14) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s431ms, non-child: 182.007ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 73.924us - GetNewBlockTime: 148.286us - GetResultsTime: 14.678us - HTResizeTime: 13.740us - HashBuckets: 9.22K (9216) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 14 (14) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.420us EXCHANGE_NODE (id=18):(Total: 22s249ms, non-child: 326.464us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 863.00 B, 10.97 KB, 16.05 KB - BytesReceived: 16.91 KB (17312) - ConvertRowBatchTime: 78.396us - DeserializeRowBatchTimer: 178.196us - FirstBatchArrivalWaitTime: 21s074ms - PeakMemoryUsage: 0 - RowsReturned: 280 (280) - RowsReturnedRate: 12.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb3 (host=d2405.halxg.cloudera.com:22000):(Total: 22s433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.30 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464080) - PerHostPeakMemUsage: 915.11 MB (959562976) - PrepareTime: 180.887ms - RowsProduced: 21 (21) - TotalCpuTime: 488.327ms - TotalNetworkReceiveTime: 22s250ms - TotalNetworkSendTime: 345.414us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.250ms, non-child: 481.250ms, % non-child: 100.00%) - CodegenTime: 3.069ms - CompileTime: 37.523ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 266.346ms - PrepareTime: 175.774ms DataStreamSender (dst_id=20):(Total: 56.890us, non-child: 56.890us, % non-child: 100.00%) - BytesSent: 1.21 KB (1244) - NetworkThroughput(*): 4.86 MB/sec - OverallThroughput: 20.85 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 37.618us - ThriftTransmitTime(*): 244.274us - UncompressedRowBatchSize: 1.97 KB (2017) SORT_NODE (id=12):(Total: 22s432ms, non-child: 470.788us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 21 (21) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s431ms, non-child: 181.541ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 77.624us - GetNewBlockTime: 145.028us - GetResultsTime: 19.106us - HTResizeTime: 2.236us - HashBuckets: 11.26K (11264) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21 (21) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.204us EXCHANGE_NODE (id=18):(Total: 22s250ms, non-child: 430.956us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.12 KB, 20.19 KB - BytesReceived: 23.78 KB (24355) - ConvertRowBatchTime: 120.790us - DeserializeRowBatchTimer: 214.152us - FirstBatchArrivalWaitTime: 21s074ms - PeakMemoryUsage: 0 - RowsReturned: 420 (420) - RowsReturnedRate: 18.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb6 (host=d2419.halxg.cloudera.com:22000):(Total: 22s433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463984) - PerHostPeakMemUsage: 1.08 GB (1156130496) - PrepareTime: 175.738ms - RowsProduced: 15 (15) - TotalCpuTime: 483.622ms - TotalNetworkReceiveTime: 22s255ms - TotalNetworkSendTime: 328.650us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.195ms, non-child: 477.195ms, % non-child: 100.00%) - CodegenTime: 3.044ms - CompileTime: 38.948ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 265.876ms - PrepareTime: 171.031ms DataStreamSender (dst_id=20):(Total: 34.720us, non-child: 34.720us, % non-child: 100.00%) - BytesSent: 957.00 B (957) - NetworkThroughput(*): 3.83 MB/sec - OverallThroughput: 26.29 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 15.687us - ThriftTransmitTime(*): 238.574us - UncompressedRowBatchSize: 1.39 KB (1425) SORT_NODE (id=12):(Total: 22s432ms, non-child: 482.424us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 15 (15) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s431ms, non-child: 176.249ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 61.756us - GetNewBlockTime: 102.942us - GetResultsTime: 14.418us - HTResizeTime: 1.799us - HashBuckets: 9.22K (9216) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.269us EXCHANGE_NODE (id=18):(Total: 22s255ms, non-child: 182.870us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 908.00 B, 11.38 KB, 16.64 KB - BytesReceived: 17.51 KB (17933) - ConvertRowBatchTime: 35.926us - DeserializeRowBatchTimer: 209.972us - FirstBatchArrivalWaitTime: 21s079ms - PeakMemoryUsage: 0 - RowsReturned: 300 (300) - RowsReturnedRate: 13.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb7 (host=d2409.halxg.cloudera.com:22000):(Total: 22s431ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.29 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464000) - PerHostPeakMemUsage: 998.57 MB (1047078152) - PrepareTime: 177.390ms - RowsProduced: 16 (16) - TotalCpuTime: 487.845ms - TotalNetworkReceiveTime: 22s251ms - TotalNetworkSendTime: 301.544us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.000ms, non-child: 481.000ms, % non-child: 100.00%) - CodegenTime: 3.045ms - CompileTime: 38.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 268.272ms - PrepareTime: 172.408ms DataStreamSender (dst_id=20):(Total: 48.752us, non-child: 48.752us, % non-child: 100.00%) - BytesSent: 1009.00 B (1009) - NetworkThroughput(*): 3.96 MB/sec - OverallThroughput: 19.74 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 20.656us - ThriftTransmitTime(*): 242.920us - UncompressedRowBatchSize: 1.50 KB (1536) SORT_NODE (id=12):(Total: 22s430ms, non-child: 485.386us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 16 (16) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s430ms, non-child: 178.083ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 67.198us - GetNewBlockTime: 129.996us - GetResultsTime: 18.756us - HTResizeTime: 2.386us - HashBuckets: 11.26K (11264) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 16 (16) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.394us EXCHANGE_NODE (id=18):(Total: 22s251ms, non-child: 273.132us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.77 KB, 14.17 KB - BytesReceived: 18.91 KB (19367) - ConvertRowBatchTime: 56.342us - DeserializeRowBatchTimer: 189.900us - FirstBatchArrivalWaitTime: 21s076ms - PeakMemoryUsage: 0 - RowsReturned: 320 (320) - RowsReturnedRate: 14.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb2 (host=d2414.halxg.cloudera.com:22000):(Total: 22s429ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463920) - PerHostPeakMemUsage: 819.42 MB (859222968) - PrepareTime: 182.631ms - RowsProduced: 11 (11) - TotalCpuTime: 494.047ms - TotalNetworkReceiveTime: 22s244ms - TotalNetworkSendTime: 336.544us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 487.090ms, non-child: 487.090ms, % non-child: 100.00%) - CodegenTime: 3.105ms - CompileTime: 39.088ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 268.832ms - PrepareTime: 177.635ms DataStreamSender (dst_id=20):(Total: 41.098us, non-child: 41.098us, % non-child: 100.00%) - BytesSent: 706.00 B (706) - NetworkThroughput(*): 2.63 MB/sec - OverallThroughput: 16.38 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 19.684us - ThriftTransmitTime(*): 255.626us - UncompressedRowBatchSize: 1.04 KB (1063) SORT_NODE (id=12):(Total: 22s427ms, non-child: 462.472us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 11 (11) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s427ms, non-child: 183.280ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 63.436us - GetNewBlockTime: 122.334us - GetResultsTime: 12.152us - HTResizeTime: 3.274us - HashBuckets: 7.17K (7168) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 11 (11) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.136us EXCHANGE_NODE (id=18):(Total: 22s244ms, non-child: 333.058us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.04 KB, 9.55 KB - BytesReceived: 13.66 KB (13990) - ConvertRowBatchTime: 94.990us - DeserializeRowBatchTimer: 149.328us - FirstBatchArrivalWaitTime: 21s068ms - PeakMemoryUsage: 0 - RowsReturned: 220 (220) - RowsReturnedRate: 9.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb5 (host=d2407.halxg.cloudera.com:22000):(Total: 22s429ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 12.00 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463984) - PerHostPeakMemUsage: 908.11 MB (952224736) - PrepareTime: 180.239ms - RowsProduced: 15 (15) - TotalCpuTime: 492.465ms - TotalNetworkReceiveTime: 22s246ms - TotalNetworkSendTime: 327.248us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 485.515ms, non-child: 485.515ms, % non-child: 100.00%) - CodegenTime: 3.011ms - CompileTime: 40.265ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 268.420ms - PrepareTime: 175.352ms DataStreamSender (dst_id=20):(Total: 38.292us, non-child: 38.292us, % non-child: 100.00%) - BytesSent: 921.00 B (921) - NetworkThroughput(*): 3.30 MB/sec - OverallThroughput: 22.94 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 20.292us - ThriftTransmitTime(*): 266.164us - UncompressedRowBatchSize: 1.39 KB (1421) SORT_NODE (id=12):(Total: 22s428ms, non-child: 462.952us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 15 (15) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s427ms, non-child: 180.846ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 69.676us - GetNewBlockTime: 123.782us - GetResultsTime: 19.094us - HTResizeTime: 15.008us - HashBuckets: 11.26K (11264) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.226us EXCHANGE_NODE (id=18):(Total: 22s246ms, non-child: 350.302us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 914.00 B, 11.57 KB - BytesReceived: 17.82 KB (18244) - ConvertRowBatchTime: 45.792us - DeserializeRowBatchTimer: 184.284us - FirstBatchArrivalWaitTime: 21s071ms - PeakMemoryUsage: 0 - RowsReturned: 300 (300) - RowsReturnedRate: 13.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ec0 (host=d2413.halxg.cloudera.com:22000):(Total: 22s428ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.31 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463984) - PerHostPeakMemUsage: 879.32 MB (922038720) - PrepareTime: 178.504ms - RowsProduced: 15 (15) - TotalCpuTime: 495.052ms - TotalNetworkReceiveTime: 22s247ms - TotalNetworkSendTime: 272.588us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 482.710ms, non-child: 482.710ms, % non-child: 100.00%) - CodegenTime: 2.943ms - CompileTime: 40.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 267.267ms - PrepareTime: 173.601ms DataStreamSender (dst_id=20):(Total: 43.446us, non-child: 43.446us, % non-child: 100.00%) - BytesSent: 950.00 B (950) - NetworkThroughput(*): 5.40 MB/sec - OverallThroughput: 20.85 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 21.864us - ThriftTransmitTime(*): 167.870us - UncompressedRowBatchSize: 1.42 KB (1454) SORT_NODE (id=12):(Total: 22s427ms, non-child: 469.052us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 15 (15) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s426ms, non-child: 179.244ms, % non-child: 0.80%) ExecOption: Codegen Enabled - BuildTime: 87.628us - GetNewBlockTime: 127.110us - GetResultsTime: 27.046us - HTResizeTime: 14.816us - HashBuckets: 10.24K (10240) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 15 (15) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.298us EXCHANGE_NODE (id=18):(Total: 22s247ms, non-child: 337.156us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 KB, 16.08 KB - BytesReceived: 17.88 KB (18314) - ConvertRowBatchTime: 88.364us - DeserializeRowBatchTimer: 177.034us - FirstBatchArrivalWaitTime: 21s070ms - PeakMemoryUsage: 0 - RowsReturned: 300 (300) - RowsReturnedRate: 13.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb1 (host=d2418.halxg.cloudera.com:22000):(Total: 22s428ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463920) - PerHostPeakMemUsage: 961.21 MB (1007900288) - PrepareTime: 179.796ms - RowsProduced: 11 (11) - TotalCpuTime: 491.636ms - TotalNetworkReceiveTime: 22s246ms - TotalNetworkSendTime: 306.970us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 484.894ms, non-child: 484.894ms, % non-child: 100.00%) - CodegenTime: 3.104ms - CompileTime: 43.284ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 265.316ms - PrepareTime: 174.779ms DataStreamSender (dst_id=20):(Total: 41.068us, non-child: 41.068us, % non-child: 100.00%) - BytesSent: 688.00 B (688) - NetworkThroughput(*): 2.64 MB/sec - OverallThroughput: 15.98 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 22.736us - ThriftTransmitTime(*): 248.964us - UncompressedRowBatchSize: 1.02 KB (1045) SORT_NODE (id=12):(Total: 22s426ms, non-child: 466.798us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 11 (11) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s426ms, non-child: 180.358ms, % non-child: 0.80%) ExecOption: Codegen Enabled - BuildTime: 71.432us - GetNewBlockTime: 124.866us - GetResultsTime: 10.792us - HTResizeTime: 14.238us - HashBuckets: 9.22K (9216) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 11 (11) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.520us EXCHANGE_NODE (id=18):(Total: 22s246ms, non-child: 266.722us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.02 KB, 9.38 KB - BytesReceived: 13.41 KB (13732) - ConvertRowBatchTime: 50.876us - DeserializeRowBatchTimer: 168.440us - FirstBatchArrivalWaitTime: 21s070ms - PeakMemoryUsage: 0 - RowsReturned: 220 (220) - RowsReturnedRate: 9.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eb9 (host=d2403.halxg.cloudera.com:22000):(Total: 22s428ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464032) - PerHostPeakMemUsage: 962.65 MB (1009409720) - PrepareTime: 186.020ms - RowsProduced: 18 (18) - TotalCpuTime: 501.009ms - TotalNetworkReceiveTime: 22s239ms - TotalNetworkSendTime: 273.594us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.026ms, non-child: 494.026ms, % non-child: 100.00%) - CodegenTime: 3.119ms - CompileTime: 39.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 271.996ms - PrepareTime: 181.017ms DataStreamSender (dst_id=20):(Total: 53.262us, non-child: 53.262us, % non-child: 100.00%) - BytesSent: 1.07 KB (1100) - NetworkThroughput(*): 4.84 MB/sec - OverallThroughput: 19.70 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 31.868us - ThriftTransmitTime(*): 216.672us - UncompressedRowBatchSize: 1.68 KB (1716) SORT_NODE (id=12):(Total: 22s426ms, non-child: 498.822us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 18 (18) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s426ms, non-child: 186.647ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 70.750us - GetNewBlockTime: 110.326us - GetResultsTime: 17.850us - HTResizeTime: 1.882us - HashBuckets: 9.22K (9216) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 18 (18) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.140us EXCHANGE_NODE (id=18):(Total: 22s239ms, non-child: 447.656us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.04 KB, 13.43 KB, 19.63 KB - BytesReceived: 20.68 KB (21172) - ConvertRowBatchTime: 131.800us - DeserializeRowBatchTimer: 170.644us - FirstBatchArrivalWaitTime: 21s063ms - PeakMemoryUsage: 0 - RowsReturned: 360 (360) - RowsReturnedRate: 16.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211eba (host=d2408.halxg.cloudera.com:22000):(Total: 22s425ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.31 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463936) - PerHostPeakMemUsage: 909.19 MB (953356056) - PrepareTime: 180.407ms - RowsProduced: 12 (12) - TotalCpuTime: 497.692ms - TotalNetworkReceiveTime: 22s242ms - TotalNetworkSendTime: 331.960us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.735ms, non-child: 490.735ms, % non-child: 100.00%) - CodegenTime: 3.073ms - CompileTime: 39.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 274.170ms - PrepareTime: 175.413ms DataStreamSender (dst_id=20):(Total: 37.940us, non-child: 37.940us, % non-child: 100.00%) - BytesSent: 756.00 B (756) - NetworkThroughput(*): 2.80 MB/sec - OverallThroughput: 19.00 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 18.510us - ThriftTransmitTime(*): 257.212us - UncompressedRowBatchSize: 1.12 KB (1151) SORT_NODE (id=12):(Total: 22s424ms, non-child: 486.416us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 12 (12) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s423ms, non-child: 181.177ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 61.064us - GetNewBlockTime: 134.676us - GetResultsTime: 14.060us - HTResizeTime: 2.230us - HashBuckets: 10.24K (10240) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 12 (12) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.352us EXCHANGE_NODE (id=18):(Total: 22s242ms, non-child: 254.356us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 732.00 B, 7.94 KB, 13.74 KB - BytesReceived: 14.46 KB (14802) - ConvertRowBatchTime: 51.994us - DeserializeRowBatchTimer: 166.704us - FirstBatchArrivalWaitTime: 21s066ms - PeakMemoryUsage: 0 - RowsReturned: 240 (240) - RowsReturnedRate: 10.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ec1 (host=d2402.halxg.cloudera.com:22000):(Total: 22s407ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.29 MB, 2.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464064) - PerHostPeakMemUsage: 955.75 MB (1002173584) - PrepareTime: 253.694ms - RowsProduced: 20 (20) - TotalCpuTime: 587.640ms - TotalNetworkReceiveTime: 22s151ms - TotalNetworkSendTime: 121.646us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 578.893ms, non-child: 578.893ms, % non-child: 100.00%) - CodegenTime: 3.332ms - CompileTime: 39.221ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 289.774ms - PrepareTime: 248.283ms DataStreamSender (dst_id=20):(Total: 66.115us, non-child: 66.115us, % non-child: 100.00%) - BytesSent: 1.18 KB (1211) - NetworkThroughput(*): 12.16 MB/sec - OverallThroughput: 17.47 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 22.499us - ThriftTransmitTime(*): 94.986us - UncompressedRowBatchSize: 1.86 KB (1900) SORT_NODE (id=12):(Total: 22s406ms, non-child: 556.535us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 20 (20) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s405ms, non-child: 254.407ms, % non-child: 1.14%) ExecOption: Codegen Enabled - BuildTime: 212.787us - GetNewBlockTime: 146.862us - GetResultsTime: 31.197us - HTResizeTime: 2.489us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 20 (20) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.405us EXCHANGE_NODE (id=18):(Total: 22s151ms, non-child: 311.756us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.59 KB, 19.02 KB - BytesReceived: 22.37 KB (22908) - ConvertRowBatchTime: 48.753us - DeserializeRowBatchTimer: 169.341us - FirstBatchArrivalWaitTime: 20s974ms - PeakMemoryUsage: 0 - RowsReturned: 400 (400) - RowsReturnedRate: 18.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ebc (host=d2410.halxg.cloudera.com:22000):(Total: 22s398ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.31 MB, 2.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463952) - PerHostPeakMemUsage: 1.01 GB (1080228920) - PrepareTime: 177.338ms - RowsProduced: 13 (13) - TotalCpuTime: 521.415ms - TotalNetworkReceiveTime: 22s218ms - TotalNetworkSendTime: 284.112us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.948ms, non-child: 472.948ms, % non-child: 100.00%) - CodegenTime: 3.038ms - CompileTime: 36.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 262.800ms - PrepareTime: 172.544ms DataStreamSender (dst_id=20):(Total: 34.980us, non-child: 34.980us, % non-child: 100.00%) - BytesSent: 802.00 B (802) - NetworkThroughput(*): 3.88 MB/sec - OverallThroughput: 21.87 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 16.308us - ThriftTransmitTime(*): 197.010us - UncompressedRowBatchSize: 1.22 KB (1248) SORT_NODE (id=12):(Total: 22s397ms, non-child: 514.960us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 13 (13) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s396ms, non-child: 177.849ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 60.200us - GetNewBlockTime: 127.312us - GetResultsTime: 14.320us - HTResizeTime: 1.800us - HashBuckets: 9.22K (9216) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 13 (13) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.210us EXCHANGE_NODE (id=18):(Total: 22s218ms, non-child: 204.408us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 821.00 B, 7.97 KB, 15.14 KB - BytesReceived: 15.94 KB (16325) - ConvertRowBatchTime: 48.676us - DeserializeRowBatchTimer: 169.208us - FirstBatchArrivalWaitTime: 21s042ms - PeakMemoryUsage: 0 - RowsReturned: 260 (260) - RowsReturnedRate: 11.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ebd (host=d2404.halxg.cloudera.com:22000):(Total: 22s381ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.28 MB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2463936) - PerHostPeakMemUsage: 1.02 GB (1100508792) - PrepareTime: 179.404ms - RowsProduced: 12 (12) - TotalCpuTime: 541.857ms - TotalNetworkReceiveTime: 22s199ms - TotalNetworkSendTime: 493.142us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 534.413ms, non-child: 534.413ms, % non-child: 100.00%) - CodegenTime: 3.748ms - CompileTime: 37.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 321.508ms - PrepareTime: 173.902ms DataStreamSender (dst_id=20):(Total: 51.948us, non-child: 51.948us, % non-child: 100.00%) - BytesSent: 779.00 B (779) - NetworkThroughput(*): 4.43 MB/sec - OverallThroughput: 14.30 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 13.276us - ThriftTransmitTime(*): 167.730us - UncompressedRowBatchSize: 1.14 KB (1166) SORT_NODE (id=12):(Total: 22s379ms, non-child: 480.346us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 12 (12) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 22s379ms, non-child: 180.336ms, % non-child: 0.81%) ExecOption: Codegen Enabled - BuildTime: 46.552us - GetNewBlockTime: 136.548us - GetResultsTime: 10.484us - HTResizeTime: 2.012us - HashBuckets: 6.14K (6144) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 12 (12) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.206us EXCHANGE_NODE (id=18):(Total: 22s199ms, non-child: 198.618us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 749.00 B, 9.56 KB - BytesReceived: 14.73 KB (15087) - ConvertRowBatchTime: 46.496us - DeserializeRowBatchTimer: 208.814us - FirstBatchArrivalWaitTime: 21s023ms - PeakMemoryUsage: 0 - RowsReturned: 240 (240) - RowsReturnedRate: 10.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3045db9f916d3ae1:2b6258aae4211ebe (host=d2420.halxg.cloudera.com:22000):(Total: 22s356ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.29 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.35 MB (2464144) - PerHostPeakMemUsage: 969.93 MB (1017047968) - PrepareTime: 242.397ms - RowsProduced: 25 (25) - TotalCpuTime: 632.434ms - TotalNetworkReceiveTime: 22s109ms - TotalNetworkSendTime: 293.300us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 448.79 MB (470585408) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 622.376ms, non-child: 622.376ms, % non-child: 100.00%) - CodegenTime: 3.762ms - CompileTime: 46.094ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 338.197ms - PrepareTime: 236.313ms DataStreamSender (dst_id=20):(Total: 76.146us, non-child: 76.146us, % non-child: 100.00%) - BytesSent: 1.46 KB (1491) - NetworkThroughput(*): 7.98 MB/sec - OverallThroughput: 18.67 MB/sec - PeakMemoryUsage: 2.00 KB (2048) - SerializeBatchTime: 47.376us - ThriftTransmitTime(*): 178.080us - UncompressedRowBatchSize: 2.32 KB (2379) SORT_NODE (id=12):(Total: 22s353ms, non-child: 685.858us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 1.00 /sec AGGREGATION_NODE (id=19):(Total: 22s353ms, non-child: 243.339ms, % non-child: 1.09%) ExecOption: Codegen Enabled - BuildTime: 146.196us - GetNewBlockTime: 174.710us - GetResultsTime: 36.206us - HTResizeTime: 3.634us - HashBuckets: 11.26K (11264) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2449408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 1.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.712us EXCHANGE_NODE (id=18):(Total: 22s109ms, non-child: 280.160us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.67 KB, 22.66 KB - BytesReceived: 28.38 KB (29059) - ConvertRowBatchTime: 69.700us - DeserializeRowBatchTimer: 265.554us - FirstBatchArrivalWaitTime: 20s933ms - PeakMemoryUsage: 0 - RowsReturned: 500 (500) - RowsReturnedRate: 22.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 3045db9f916d3ae1:2b6258aae4211ed1 (host=d2404.halxg.cloudera.com:22000):(Total: 22s064ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:26/6.12 GB 8:32/7.03 GB 5:33/7.30 GB 9:39/9.15 GB 7:38/8.91 GB 3:29/6.42 GB 4:30/7.06 GB 0:24/5.51 GB 10:23/5.16 GB 1:32/7.47 GB 2:33/7.46 GB Filter 3 arrival: 718ms Filter 0 arrival: 718ms Filter 4 arrival: 718ms MemoryUsage(500.000ms): 0, 27.85 MB, 141.50 MB, 349.73 MB, 382.46 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 914.33 MB, 1.01 GB, 905.35 MB, 649.91 MB, 537.47 MB, 24.00 KB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1 - AverageThreadTokens: 22.50 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 1.02 GB (1090795128) - PerHostPeakMemUsage: 1.02 GB (1100508792) - PrepareTime: 196.708ms - RowsProduced: 301 (301) - TotalCpuTime: 8m36s - TotalNetworkReceiveTime: 1s195ms - TotalNetworkSendTime: 4.577ms - TotalStorageWaitTime: 385.645ms CodeGen:(Total: 693.237ms, non-child: 693.237ms, % non-child: 100.00%) - CodegenTime: 2.183ms - CompileTime: 143.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 369.811ms - PrepareTime: 178.527ms DataStreamSender (dst_id=18):(Total: 160.630us, non-child: 160.630us, % non-child: 100.00%) - BytesSent: 17.78 KB (18211) - NetworkThroughput(*): 4.65 MB/sec - OverallThroughput: 108.12 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 534.648us - ThriftTransmitTime(*): 3.737ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 22s051ms, non-child: 469.774ms, % non-child: 2.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.544us - GetResultsTime: 97.326us - HTResizeTime: 231.660us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.64 MB (5911608) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 292.847ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s581ms, non-child: 215.942ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.970us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 17.616us - GetNewBlockTime: 193.402us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.63 MB (4856888) - PinTime: 0.000ns - ProbeRows: 1.30M (1303269) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 202.969ms - RowsReturned: 1.29M (1290443) - RowsReturnedRate: 59.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.414us EXCHANGE_NODE (id=17):(Total: 10.086us, non-child: 10.086us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.436us - DeserializeRowBatchTimer: 10.860us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 6.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 21s365ms, non-child: 457.892ms, % non-child: 2.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 140.558ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 160.766ms - GetNewBlockTime: 730.268us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.56 MB (214501856) - PinTime: 0.000ns - ProbeRows: 1.30M (1303269) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 449.512ms - RowsReturned: 1.30M (1303269) - RowsReturnedRate: 61.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.506us EXCHANGE_NODE (id=16):(Total: 255.772ms, non-child: 61.410ms, % non-child: 24.01%) BytesReceived(500.000ms): 10.23 MB, 28.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.756ms - DeserializeRowBatchTimer: 127.544ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 7.53 M/sec - SendersBlockedTimer: 407.768ms - SendersBlockedTotalTimer(*): 5s732ms HASH_JOIN_NODE (id=8):(Total: 20s908ms, non-child: 404.165ms, % non-child: 1.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 172.541ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 353.704ms - GetNewBlockTime: 381.278us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.56 MB (281602528) - PinTime: 0.000ns - ProbeRows: 1.33M (1334739) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 394.099ms - RowsReturned: 1.30M (1303269) - RowsReturnedRate: 62.33 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.268us EXCHANGE_NODE (id=15):(Total: 1s047ms, non-child: 135.738ms, % non-child: 12.96%) BytesReceived(500.000ms): 0, 0, 14.23 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 67.335ms - DeserializeRowBatchTimer: 143.994ms - FirstBatchArrivalWaitTime: 766.708ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s505ms, non-child: 78.397ms, % non-child: 0.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.232us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.268us - GetNewBlockTime: 80.730us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.05 MB (4247072) - PinTime: 0.000ns - ProbeRows: 1.33M (1334739) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 71.060ms - RowsReturned: 1.33M (1334739) - RowsReturnedRate: 65.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.058us EXCHANGE_NODE (id=14):(Total: 7.780us, non-child: 7.780us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.800us - DeserializeRowBatchTimer: 5.328us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s427ms, non-child: 111.081ms, % non-child: 0.54%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 66.230us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 58.724us - GetNewBlockTime: 89.298us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.93 MB (3071792) - PinTime: 0.000ns - ProbeRows: 1.33M (1334739) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 98.302ms - RowsReturned: 1.33M (1334739) - RowsReturnedRate: 65.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.058us EXCHANGE_NODE (id=13):(Total: 16.219us, non-child: 16.219us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 10.436us - DeserializeRowBatchTimer: 76.904us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 36.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s316ms, non-child: 20s316ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 12 Hdfs split stats (:<# splits>/): 6:26/6.12 GB 8:32/7.03 GB 5:33/7.30 GB 9:39/9.15 GB 7:38/8.91 GB 3:29/6.42 GB 4:30/7.06 GB 0:24/5.51 GB 10:23/5.16 GB 1:32/7.47 GB 2:33/7.46 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s297ms Hdfs Read Thread Concurrency Bucket: 0:97.67% 1:0% 2:2.326% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:327 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 357.42 MB, 441.67 MB, 441.67 MB, 441.67 MB, 441.67 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 22.91 - BytesRead: 441.67 MB (463123340) - BytesReadDataNodeCache: 0 - BytesReadLocal: 441.67 MB (463123340) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 441.67 MB (463123340) - DecompressionTime: 1s001ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 565.91 MB (593399008) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 72.76M (72756382) - RowsReturned: 1.33M (1334739) - RowsReturnedRate: 65.70 K/sec - ScanRangesComplete: 339 (339) - ScannerThreadsInvoluntaryContextSwitches: 10.44K (10438) - ScannerThreadsTotalWallClockTime: 8m12s - MaterializeTupleTime(*): 18s305ms - ScannerThreadsSysTime: 30s820ms - ScannerThreadsUserTime: 23s456ms - ScannerThreadsVoluntaryContextSwitches: 585.89K (585894) - TotalRawHdfsReadTime(*): 292.779ms - TotalReadThroughput: 20.08 MB/sec Filter 0: - Rows processed: 196.60K (196596) - Rows rejected: 4.71K (4714) - Rows total: 196.61K (196608) Filter 2: - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) Filter 3: - Files processed: 339 (339) - Files rejected: 327 (327) - Files total: 339 (339) - RowGroups processed: 520.00K (520003) - RowGroups rejected: 0 (0) - RowGroups total: 520.00K (520003) - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 4: - Rows processed: 72.75M (72751668) - Rows rejected: 71.42M (71416929) - Rows total: 72.75M (72751668) Instance 3045db9f916d3ae1:2b6258aae4211ec8 (host=d2416.halxg.cloudera.com:22000):(Total: 21s962ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:27/6.39 GB 2:28/6.01 GB 6:38/8.78 GB 7:24/5.31 GB 10:40/8.81 GB 5:29/6.62 GB 3:40/8.60 GB 8:35/7.94 GB 9:34/7.38 GB 4:28/6.23 GB 0:29/5.94 GB Filter 3 arrival: 739ms Filter 0 arrival: 739ms Filter 4 arrival: 740ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.51 MB, 351.09 MB, 374.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 1.16 GB, 1.29 GB, 1.22 GB, 1.03 GB, 554.34 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.51 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 1.29 GB (1388755224) - PerHostPeakMemUsage: 1.30 GB (1398468888) - PrepareTime: 196.602ms - RowsProduced: 301 (301) - TotalCpuTime: 8m32s - TotalNetworkReceiveTime: 1s269ms - TotalNetworkSendTime: 3.984ms - TotalStorageWaitTime: 786.256ms CodeGen:(Total: 714.681ms, non-child: 714.681ms, % non-child: 100.00%) - CodegenTime: 2.295ms - CompileTime: 143.759ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 391.236ms - PrepareTime: 178.324ms DataStreamSender (dst_id=18):(Total: 169.588us, non-child: 169.588us, % non-child: 100.00%) - BytesSent: 17.85 KB (18274) - NetworkThroughput(*): 4.94 MB/sec - OverallThroughput: 102.76 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 286.152us - ThriftTransmitTime(*): 3.525ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s950ms, non-child: 563.879ms, % non-child: 2.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 73.106us - GetResultsTime: 98.220us - HTResizeTime: 259.434us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.75 MB (4983816) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 385.822ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s386ms, non-child: 275.818ms, % non-child: 1.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.494us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.834us - GetNewBlockTime: 377.026us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.75 MB (3929096) - PinTime: 0.000ns - ProbeRows: 1.96M (1956180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 259.777ms - RowsReturned: 1.94M (1936626) - RowsReturnedRate: 90.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.106us EXCHANGE_NODE (id=17):(Total: 9.124us, non-child: 9.124us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.374us - DeserializeRowBatchTimer: 15.098us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 6.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 21s110ms, non-child: 525.141ms, % non-child: 2.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 147.279ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 159.174ms - GetNewBlockTime: 941.384us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 203.83 MB (213730568) - PinTime: 0.000ns - ProbeRows: 1.96M (1956180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 514.273ms - RowsReturned: 1.96M (1956180) - RowsReturnedRate: 92.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.124us EXCHANGE_NODE (id=16):(Total: 297.760ms, non-child: 59.008ms, % non-child: 19.82%) BytesReceived(500.000ms): 10.21 MB, 27.15 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.079ms - DeserializeRowBatchTimer: 122.709ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.46 M/sec - SendersBlockedTimer: 358.532ms - SendersBlockedTotalTimer(*): 4s656ms HASH_JOIN_NODE (id=8):(Total: 20s586ms, non-child: 609.357ms, % non-child: 2.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 189.995ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 348.508ms - GetNewBlockTime: 476.572us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.71 MB (280718256) - PinTime: 0.000ns - ProbeRows: 2.00M (2002386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 597.180ms - RowsReturned: 1.96M (1956180) - RowsReturnedRate: 95.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.036us EXCHANGE_NODE (id=15):(Total: 1s078ms, non-child: 127.213ms, % non-child: 11.80%) BytesReceived(500.000ms): 0, 0, 12.57 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 66.519ms - DeserializeRowBatchTimer: 140.410ms - FirstBatchArrivalWaitTime: 815.537ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s978ms, non-child: 116.020ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 2.816us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.878us - GetNewBlockTime: 100.626us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.21 MB (3362800) - PinTime: 0.000ns - ProbeRows: 2.00M (2002386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.029ms - RowsReturned: 2.00M (2002386) - RowsReturnedRate: 100.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 906.000ns EXCHANGE_NODE (id=14):(Total: 7.110us, non-child: 7.110us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.520us - DeserializeRowBatchTimer: 6.394us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s862ms, non-child: 167.928ms, % non-child: 0.85%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 65.822us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 59.786us - GetNewBlockTime: 104.274us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.94 MB (3087984) - PinTime: 0.000ns - ProbeRows: 2.00M (2002386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 153.313ms - RowsReturned: 2.00M (2002386) - RowsReturnedRate: 100.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.238us EXCHANGE_NODE (id=13):(Total: 19.594us, non-child: 19.594us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.352us - DeserializeRowBatchTimer: 82.528us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 30.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s694ms, non-child: 19s694ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:27/6.39 GB 2:28/6.01 GB 6:38/8.78 GB 7:24/5.31 GB 10:40/8.81 GB 5:29/6.62 GB 3:40/8.60 GB 8:35/7.94 GB 9:34/7.38 GB 4:28/6.23 GB 0:29/5.94 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s272ms Hdfs Read Thread Concurrency Bucket: 0:97.67% 1:0% 2:2.326% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:335 PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 583.79 MB, 662.08 MB, 662.08 MB, 662.08 MB, 662.08 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 22.42 - BytesRead: 662.08 MB (694244326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 662.08 MB (694244326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 662.08 MB (694244326) - DecompressionTime: 1s471ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 849.66 MB (890934264) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 109.84M (109837343) - RowsReturned: 2.00M (2002386) - RowsReturnedRate: 101.67 K/sec - ScanRangesComplete: 352 (352) - ScannerThreadsInvoluntaryContextSwitches: 7.66K (7655) - ScannerThreadsTotalWallClockTime: 8m9s - MaterializeTupleTime(*): 29s249ms - ScannerThreadsSysTime: 19s211ms - ScannerThreadsUserTime: 34s589ms - ScannerThreadsVoluntaryContextSwitches: 487.81K (487811) - TotalRawHdfsReadTime(*): 490.751ms - TotalReadThroughput: 30.09 MB/sec Filter 0: - Rows processed: 278.51K (278511) - Rows rejected: 6.29K (6294) - Rows total: 278.53K (278528) Filter 2: - Rows processed: 278.51K (278511) - Rows rejected: 0 (0) - Rows total: 278.53K (278528) Filter 3: - Files processed: 352 (352) - Files rejected: 335 (335) - Files total: 352 (352) - RowGroups processed: 784.99K (784989) - RowGroups rejected: 0 (0) - RowGroups total: 784.99K (784989) - Rows processed: 278.51K (278511) - Rows rejected: 0 (0) - Rows total: 278.53K (278528) - Splits processed: 17 (17) - Splits rejected: 0 (0) - Splits total: 17 (17) Filter 4: - Rows processed: 109.83M (109831049) - Rows rejected: 107.83M (107828663) - Rows total: 109.83M (109831049) Instance 3045db9f916d3ae1:2b6258aae4211ecf (host=d2421.halxg.cloudera.com:22000):(Total: 21s772ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:32/6.99 GB 6:35/7.82 GB 0:23/5.36 GB 8:25/5.74 GB 7:36/8.11 GB 9:34/7.42 GB 2:27/6.27 GB 10:30/6.86 GB 4:33/7.06 GB 3:37/8.05 GB 1:38/8.17 GB Filter 3 arrival: 710ms Filter 0 arrival: 710ms Filter 4 arrival: 710ms MemoryUsage(500.000ms): 14.42 MB, 141.51 MB, 173.48 MB, 342.53 MB, 438.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 1.08 GB, 1.04 GB, 962.38 MB, 513.63 MB, 76.00 KB ThreadUsage(500.000ms): 1, 3, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1 - AverageThreadTokens: 22.04 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 1.11 GB (1186630296) - PerHostPeakMemUsage: 1.12 GB (1197392536) - PrepareTime: 185.594ms - RowsProduced: 301 (301) - TotalCpuTime: 8m20s - TotalNetworkReceiveTime: 1s236ms - TotalNetworkSendTime: 9.092ms - TotalStorageWaitTime: 535.800ms CodeGen:(Total: 683.686ms, non-child: 683.686ms, % non-child: 100.00%) - CodegenTime: 2.419ms - CompileTime: 140.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 374.157ms - PrepareTime: 167.494ms DataStreamSender (dst_id=18):(Total: 203.560us, non-child: 203.560us, % non-child: 100.00%) - BytesSent: 17.81 KB (18239) - NetworkThroughput(*): 2.06 MB/sec - OverallThroughput: 85.45 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 307.636us - ThriftTransmitTime(*): 8.437ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s755ms, non-child: 473.143ms, % non-child: 2.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 97.240us - GetResultsTime: 119.212us - HTResizeTime: 388.072us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.61 MB (6929504) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 306.814ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s282ms, non-child: 233.365ms, % non-child: 1.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 7.158us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.566us - GetNewBlockTime: 161.246us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.71 MB (4936144) - PinTime: 0.000ns - ProbeRows: 1.51M (1511849) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 219.752ms - RowsReturned: 1.49M (1492819) - RowsReturnedRate: 70.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.148us EXCHANGE_NODE (id=17):(Total: 35.402us, non-child: 35.402us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 22.980us - DeserializeRowBatchTimer: 8.218us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 1.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 21s048ms, non-child: 520.289ms, % non-child: 2.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 137.328ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 259.492ms - GetNewBlockTime: 499.016us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.53 MB (214460800) - PinTime: 0.000ns - ProbeRows: 1.51M (1511849) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 511.329ms - RowsReturned: 1.51M (1511849) - RowsReturnedRate: 71.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 836.000ns EXCHANGE_NODE (id=16):(Total: 268.778ms, non-child: 56.474ms, % non-child: 21.01%) BytesReceived(500.000ms): 4.93 MB, 10.43 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 32.516ms - DeserializeRowBatchTimer: 122.424ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 7.16 M/sec - SendersBlockedTimer: 398.215ms - SendersBlockedTotalTimer(*): 5s988ms HASH_JOIN_NODE (id=8):(Total: 20s529ms, non-child: 467.424ms, % non-child: 2.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 166.076ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 351.531ms - GetNewBlockTime: 394.648us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.69 MB (280689040) - PinTime: 0.000ns - ProbeRows: 1.55M (1548461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 457.164ms - RowsReturned: 1.51M (1511849) - RowsReturnedRate: 73.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us EXCHANGE_NODE (id=15):(Total: 1s069ms, non-child: 117.012ms, % non-child: 10.94%) BytesReceived(500.000ms): 0, 0, 0, 37.57 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 63.041ms - DeserializeRowBatchTimer: 130.621ms - FirstBatchArrivalWaitTime: 782.169ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s063ms, non-child: 86.889ms, % non-child: 0.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.980us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.896us - GetNewBlockTime: 119.832us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.13 MB (3281912) - PinTime: 0.000ns - ProbeRows: 1.55M (1548461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 79.256ms - RowsReturned: 1.55M (1548461) - RowsReturnedRate: 77.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.044us EXCHANGE_NODE (id=14):(Total: 9.176us, non-child: 9.176us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.730us - DeserializeRowBatchTimer: 6.636us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s976ms, non-child: 143.027ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 66.096us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 54.584us - GetNewBlockTime: 77.896us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 MB (3161528) - PinTime: 0.000ns - ProbeRows: 1.55M (1548461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.550ms - RowsReturned: 1.55M (1548461) - RowsReturnedRate: 77.51 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 812.000ns EXCHANGE_NODE (id=13):(Total: 17.756us, non-child: 17.756us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.228us - DeserializeRowBatchTimer: 110.016us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 33.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s833ms, non-child: 19s833ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 5:32/6.99 GB 6:35/7.82 GB 0:23/5.36 GB 8:25/5.74 GB 7:36/8.11 GB 9:34/7.42 GB 2:27/6.27 GB 10:30/6.86 GB 4:33/7.06 GB 3:37/8.05 GB 1:38/8.17 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s294ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:337 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 512.70 MB, 512.70 MB, 512.70 MB, 512.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 21.88 - BytesRead: 512.70 MB (537601448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 512.70 MB (537601448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 512.70 MB (537601448) - DecompressionTime: 1s127ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 657.08 MB (688998160) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 84.95M (84947562) - RowsReturned: 1.55M (1548461) - RowsReturnedRate: 78.07 K/sec - ScanRangesComplete: 350 (350) - ScannerThreadsInvoluntaryContextSwitches: 7.02K (7016) - ScannerThreadsTotalWallClockTime: 7m57s - MaterializeTupleTime(*): 18s696ms - ScannerThreadsSysTime: 25s682ms - ScannerThreadsUserTime: 23s547ms - ScannerThreadsVoluntaryContextSwitches: 466.55K (466551) - TotalRawHdfsReadTime(*): 368.471ms - TotalReadThroughput: 23.30 MB/sec Filter 0: - Rows processed: 212.98K (212979) - Rows rejected: 5.23K (5232) - Rows total: 212.99K (212992) Filter 2: - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) Filter 3: - Files processed: 350 (350) - Files rejected: 337 (337) - Files total: 350 (350) - RowGroups processed: 608.83K (608825) - RowGroups rejected: 0 (0) - RowGroups total: 608.83K (608825) - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 4: - Rows processed: 84.94M (84942330) - Rows rejected: 83.39M (83393869) - Rows total: 84.94M (84942330) Instance 3045db9f916d3ae1:2b6258aae4211ec4 (host=d2411.halxg.cloudera.com:22000):(Total: 21s718ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:31/7.08 GB 9:34/7.44 GB 3:39/8.66 GB 7:22/5.22 GB 4:20/4.60 GB 1:34/7.94 GB 10:33/7.58 GB 0:32/7.72 GB 2:29/6.56 GB 6:33/7.30 GB 5:35/8.05 GB Filter 0 arrival: 716ms Filter 3 arrival: 716ms Filter 4 arrival: 717ms MemoryUsage(500.000ms): 27.85 MB, 141.50 MB, 201.46 MB, 342.54 MB, 454.46 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 799.11 MB, 752.17 MB, 632.64 MB, 505.89 MB ThreadUsage(500.000ms): 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.00 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 801.70 MB (840644680) - PerHostPeakMemUsage: 810.96 MB (850358344) - PrepareTime: 192.073ms - RowsProduced: 301 (301) - TotalCpuTime: 8m26s - TotalNetworkReceiveTime: 1s322ms - TotalNetworkSendTime: 3.380ms - TotalStorageWaitTime: 220.156ms CodeGen:(Total: 691.484ms, non-child: 691.484ms, % non-child: 100.00%) - CodegenTime: 2.393ms - CompileTime: 143.521ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 372.961ms - PrepareTime: 173.587ms DataStreamSender (dst_id=18):(Total: 166.918us, non-child: 166.918us, % non-child: 100.00%) - BytesSent: 17.68 KB (18105) - NetworkThroughput(*): 5.81 MB/sec - OverallThroughput: 103.44 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 291.682us - ThriftTransmitTime(*): 2.972ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s707ms, non-child: 341.583ms, % non-child: 1.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 58.688us - GetResultsTime: 84.856us - HTResizeTime: 276.068us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.97 MB (6259640) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 171.147ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s365ms, non-child: 123.923ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.476us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.212us - GetNewBlockTime: 303.690us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.96 MB (5204920) - PinTime: 0.000ns - ProbeRows: 791.51K (791513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 112.320ms - RowsReturned: 782.99K (782987) - RowsReturnedRate: 36.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.350us EXCHANGE_NODE (id=17):(Total: 10.996us, non-child: 10.996us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.520us - DeserializeRowBatchTimer: 6.452us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 21s241ms, non-child: 271.763ms, % non-child: 1.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 138.678ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 160.424ms - GetNewBlockTime: 813.714us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.62 MB (214563104) - PinTime: 0.000ns - ProbeRows: 791.51K (791513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.190ms - RowsReturned: 791.51K (791513) - RowsReturnedRate: 37.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.652us EXCHANGE_NODE (id=16):(Total: 331.476ms, non-child: 62.423ms, % non-child: 18.83%) BytesReceived(500.000ms): 10.21 MB, 10.40 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.085ms - DeserializeRowBatchTimer: 127.599ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 5.81 M/sec - SendersBlockedTimer: 333.696ms - SendersBlockedTotalTimer(*): 4s320ms HASH_JOIN_NODE (id=8):(Total: 20s970ms, non-child: 233.386ms, % non-child: 1.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 191.788ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 336.021ms - GetNewBlockTime: 474.848us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.94 MB (280959520) - PinTime: 0.000ns - ProbeRows: 806.88K (806883) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 224.846ms - RowsReturned: 791.51K (791513) - RowsReturnedRate: 37.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.212us EXCHANGE_NODE (id=15):(Total: 1s102ms, non-child: 129.778ms, % non-child: 11.78%) BytesReceived(500.000ms): 0, 0, 0, 44.34 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 71.857ms - DeserializeRowBatchTimer: 134.440ms - FirstBatchArrivalWaitTime: 842.443ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s739ms, non-child: 46.157ms, % non-child: 0.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 2.952us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 5.762us - GetNewBlockTime: 141.178us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.86 MB (2995016) - PinTime: 0.000ns - ProbeRows: 806.88K (806883) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.272ms - RowsReturned: 806.88K (806883) - RowsReturnedRate: 38.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.240us EXCHANGE_NODE (id=14):(Total: 7.104us, non-child: 7.104us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.432us - DeserializeRowBatchTimer: 4.388us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s693ms, non-child: 70.867ms, % non-child: 0.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 63.480us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 60.252us - GetNewBlockTime: 103.074us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.68 MB (2809112) - PinTime: 0.000ns - ProbeRows: 806.88K (806883) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59.081ms - RowsReturned: 806.88K (806883) - RowsReturnedRate: 38.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.132us EXCHANGE_NODE (id=13):(Total: 17.848us, non-child: 17.848us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.052us - DeserializeRowBatchTimer: 95.892us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 33.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s622ms, non-child: 20s622ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 8:31/7.08 GB 9:34/7.44 GB 3:39/8.66 GB 7:22/5.22 GB 4:20/4.60 GB 1:34/7.94 GB 10:33/7.58 GB 0:32/7.72 GB 2:29/6.56 GB 6:33/7.30 GB 5:35/8.05 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s292ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:335 PARQUET/SNAPPY:28 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 268.40 MB, 268.40 MB, 268.40 MB, 268.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.37 - BytesRead: 268.40 MB (281436173) - BytesReadDataNodeCache: 0 - BytesReadLocal: 268.40 MB (281436173) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 268.40 MB (281436173) - DecompressionTime: 522.437ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 327.13 MB (343020952) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 44.82M (44822239) - RowsReturned: 806.88K (806883) - RowsReturnedRate: 39.13 K/sec - ScanRangesComplete: 342 (342) - ScannerThreadsInvoluntaryContextSwitches: 6.69K (6688) - ScannerThreadsTotalWallClockTime: 8m3s - MaterializeTupleTime(*): 9s960ms - ScannerThreadsSysTime: 34s598ms - ScannerThreadsUserTime: 14s060ms - ScannerThreadsVoluntaryContextSwitches: 494.00K (494003) - TotalRawHdfsReadTime(*): 181.836ms - TotalReadThroughput: 12.20 MB/sec Filter 0: - Rows processed: 114.68K (114681) - Rows rejected: 2.84K (2839) - Rows total: 114.69K (114688) Filter 2: - Rows processed: 114.68K (114681) - Rows rejected: 0 (0) - Rows total: 114.69K (114688) Filter 3: - Files processed: 342 (342) - Files rejected: 335 (335) - Files total: 342 (342) - RowGroups processed: 322.34K (322343) - RowGroups rejected: 0 (0) - RowGroups total: 322.34K (322343) - Rows processed: 114.68K (114681) - Rows rejected: 0 (0) - Rows total: 114.69K (114688) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Filter 4: - Rows processed: 44.82M (44819400) - Rows rejected: 44.01M (44012517) - Rows total: 44.82M (44819400) Instance 3045db9f916d3ae1:2b6258aae4211eca (host=d2419.halxg.cloudera.com:22000):(Total: 21s660ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:28/6.04 GB 3:38/8.76 GB 2:35/7.50 GB 4:22/4.82 GB 1:31/7.14 GB 6:25/5.49 GB 0:42/9.68 GB 10:34/8.07 GB 7:25/5.99 GB 9:28/6.72 GB 5:36/7.66 GB Filter 0 arrival: 727ms Filter 4 arrival: 728ms Filter 3 arrival: 728ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.55 MB, 350.55 MB, 382.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 1.06 GB, 1020.82 MB, 912.32 MB, 561.44 MB, 497.94 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.51 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 1.07 GB (1146416832) - PerHostPeakMemUsage: 1.08 GB (1156130496) - PrepareTime: 186.463ms - RowsProduced: 301 (301) - TotalCpuTime: 8m25s - TotalNetworkReceiveTime: 1s296ms - TotalNetworkSendTime: 4.523ms - TotalStorageWaitTime: 471.284ms CodeGen:(Total: 702.907ms, non-child: 702.907ms, % non-child: 100.00%) - CodegenTime: 2.364ms - CompileTime: 143.023ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 390.682ms - PrepareTime: 167.737ms DataStreamSender (dst_id=18):(Total: 170.911us, non-child: 170.911us, % non-child: 100.00%) - BytesSent: 17.73 KB (18151) - NetworkThroughput(*): 5.25 MB/sec - OverallThroughput: 101.28 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 1.203ms - ThriftTransmitTime(*): 3.299ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s643ms, non-child: 472.882ms, % non-child: 2.18%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 63.873us - GetResultsTime: 95.123us - HTResizeTime: 264.885us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.14 MB (5389720) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 305.684ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s171ms, non-child: 218.421ms, % non-child: 1.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 7.388us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 10.817us - GetNewBlockTime: 266.194us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.13 MB (4335000) - PinTime: 0.000ns - ProbeRows: 1.50M (1496255) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 204.375ms - RowsReturned: 1.48M (1476633) - RowsReturnedRate: 69.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.267us EXCHANGE_NODE (id=17):(Total: 10.483us, non-child: 10.483us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.616us - DeserializeRowBatchTimer: 6.576us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s952ms, non-child: 446.642ms, % non-child: 2.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 152.995ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 161.403ms - GetNewBlockTime: 587.492us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 203.86 MB (213760016) - PinTime: 0.000ns - ProbeRows: 1.50M (1496255) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 436.738ms - RowsReturned: 1.50M (1496255) - RowsReturnedRate: 71.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.158us EXCHANGE_NODE (id=16):(Total: 304.249ms, non-child: 59.053ms, % non-child: 19.41%) BytesReceived(500.000ms): 10.26 MB, 27.12 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 35.292ms - DeserializeRowBatchTimer: 118.863ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.33 M/sec - SendersBlockedTimer: 346.785ms - SendersBlockedTotalTimer(*): 5s515ms HASH_JOIN_NODE (id=8):(Total: 20s507ms, non-child: 297.811ms, % non-child: 1.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 177.736ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 316.817ms - GetNewBlockTime: 464.006us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.85 MB (280860688) - PinTime: 0.000ns - ProbeRows: 1.53M (1528117) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 287.441ms - RowsReturned: 1.50M (1496255) - RowsReturnedRate: 72.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.218us EXCHANGE_NODE (id=15):(Total: 1s101ms, non-child: 130.491ms, % non-child: 11.85%) BytesReceived(500.000ms): 0, 0, 12.41 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 67.935ms - DeserializeRowBatchTimer: 139.169ms - FirstBatchArrivalWaitTime: 826.772ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s211ms, non-child: 85.120ms, % non-child: 0.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 218.883us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.810us - GetNewBlockTime: 91.116us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.17 MB (3325944) - PinTime: 0.000ns - ProbeRows: 1.53M (1528117) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 77.616ms - RowsReturned: 1.53M (1528117) - RowsReturnedRate: 75.61 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 905.000ns EXCHANGE_NODE (id=14):(Total: 271.842us, non-child: 271.842us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.318us - DeserializeRowBatchTimer: 4.414us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 110.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s125ms, non-child: 139.463ms, % non-child: 0.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 66.473us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 58.613us - GetNewBlockTime: 103.409us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.88 MB (3022800) - PinTime: 0.000ns - ProbeRows: 1.53M (1528117) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.848ms - RowsReturned: 1.53M (1528117) - RowsReturnedRate: 75.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 904.000ns EXCHANGE_NODE (id=13):(Total: 17.244us, non-child: 17.244us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.104us - DeserializeRowBatchTimer: 92.745us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 34.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s986ms, non-child: 19s986ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 8:28/6.04 GB 3:38/8.76 GB 2:35/7.50 GB 4:22/4.82 GB 1:31/7.14 GB 6:25/5.49 GB 0:42/9.68 GB 10:34/8.07 GB 7:25/5.99 GB 9:28/6.72 GB 5:36/7.66 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s273ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:331 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 502.48 MB, 502.48 MB, 502.48 MB, 502.48 MB, 502.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.42 - BytesRead: 502.48 MB (526886623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 502.48 MB (526886623) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 502.48 MB (526886623) - DecompressionTime: 979.163ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 619.41 MB (649501936) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 82.98M (82976771) - RowsReturned: 1.53M (1528117) - RowsReturnedRate: 76.46 K/sec - ScanRangesComplete: 344 (344) - ScannerThreadsInvoluntaryContextSwitches: 6.36K (6358) - ScannerThreadsTotalWallClockTime: 8m2s - MaterializeTupleTime(*): 18s720ms - ScannerThreadsSysTime: 24s561ms - ScannerThreadsUserTime: 23s296ms - ScannerThreadsVoluntaryContextSwitches: 467.74K (467735) - TotalRawHdfsReadTime(*): 434.142ms - TotalReadThroughput: 22.84 MB/sec Filter 0: - Rows processed: 212.98K (212979) - Rows rejected: 5.11K (5106) - Rows total: 212.99K (212992) Filter 2: - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) Filter 3: - Files processed: 344 (344) - Files rejected: 331 (331) - Files total: 344 (344) - RowGroups processed: 598.54K (598545) - RowGroups rejected: 0 (0) - RowGroups total: 598.54K (598545) - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 4: - Rows processed: 82.97M (82971665) - Rows rejected: 81.44M (81443548) - Rows total: 82.97M (82971665) Instance 3045db9f916d3ae1:2b6258aae4211ed6 (host=d2417.halxg.cloudera.com:22000):(Total: 21s652ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:29/6.62 GB 2:33/7.63 GB 1:28/6.44 GB 10:27/6.23 GB 6:31/6.99 GB 8:27/6.21 GB 4:31/7.30 GB 5:31/6.94 GB 3:31/7.08 GB 7:29/6.33 GB 0:44/10.06 GB Filter 0 arrival: 725ms Filter 3 arrival: 727ms Filter 4 arrival: 728ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.51 MB, 350.77 MB, 382.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 742.70 MB, 808.79 MB, 753.54 MB, 610.01 MB, 497.47 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.51 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 810.26 MB (849618336) - PerHostPeakMemUsage: 819.52 MB (859332000) - PrepareTime: 186.843ms - RowsProduced: 301 (301) - TotalCpuTime: 8m25s - TotalNetworkReceiveTime: 1s150ms - TotalNetworkSendTime: 8.510ms - TotalStorageWaitTime: 262.247ms CodeGen:(Total: 702.407ms, non-child: 702.407ms, % non-child: 100.00%) - CodegenTime: 2.332ms - CompileTime: 141.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 391.752ms - PrepareTime: 167.939ms DataStreamSender (dst_id=18):(Total: 179.420us, non-child: 179.420us, % non-child: 100.00%) - BytesSent: 17.64 KB (18060) - NetworkThroughput(*): 2.12 MB/sec - OverallThroughput: 95.99 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 353.564us - ThriftTransmitTime(*): 8.123ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s636ms, non-child: 330.504ms, % non-child: 1.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.572us - GetResultsTime: 100.418us - HTResizeTime: 1.329ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.09 MB (6386088) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 166.052ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s305ms, non-child: 121.992ms, % non-child: 0.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.910us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 10.780us - GetNewBlockTime: 289.100us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.53 MB (4754744) - PinTime: 0.000ns - ProbeRows: 832.57K (832567) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.865ms - RowsReturned: 823.59K (823588) - RowsReturnedRate: 38.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.358us EXCHANGE_NODE (id=17):(Total: 11.514us, non-child: 11.514us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 3.040us - DeserializeRowBatchTimer: 7.456us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 21s183ms, non-child: 244.869ms, % non-child: 1.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 148.411ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 160.502ms - GetNewBlockTime: 807.054us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 205.02 MB (214983992) - PinTime: 0.000ns - ProbeRows: 832.57K (832567) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 236.490ms - RowsReturned: 832.57K (832567) - RowsReturnedRate: 39.30 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.744us EXCHANGE_NODE (id=16):(Total: 239.109ms, non-child: 61.424ms, % non-child: 25.69%) BytesReceived(500.000ms): 10.26 MB, 27.38 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.275ms - DeserializeRowBatchTimer: 127.198ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 8.05 M/sec - SendersBlockedTimer: 416.423ms - SendersBlockedTotalTimer(*): 6s741ms HASH_JOIN_NODE (id=8):(Total: 20s940ms, non-child: 209.148ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 188.474ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 342.903ms - GetNewBlockTime: 397.704us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 269.02 MB (282084664) - PinTime: 0.000ns - ProbeRows: 850.47K (850472) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 200.273ms - RowsReturned: 832.57K (832567) - RowsReturnedRate: 39.76 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.216us EXCHANGE_NODE (id=15):(Total: 1s022ms, non-child: 133.251ms, % non-child: 13.03%) BytesReceived(500.000ms): 0, 0, 12.96 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 70.412ms - DeserializeRowBatchTimer: 136.788ms - FirstBatchArrivalWaitTime: 759.100ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s732ms, non-child: 47.353ms, % non-child: 0.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.024us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.042us - GetNewBlockTime: 86.220us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.51 MB (4729208) - PinTime: 0.000ns - ProbeRows: 850.47K (850472) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.030ms - RowsReturned: 850.47K (850472) - RowsReturnedRate: 41.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.158us EXCHANGE_NODE (id=14):(Total: 7.014us, non-child: 7.014us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.332us - DeserializeRowBatchTimer: 16.264us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s685ms, non-child: 67.649ms, % non-child: 0.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 67.360us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 55.926us - GetNewBlockTime: 75.060us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.04 MB (3184056) - PinTime: 0.000ns - ProbeRows: 850.47K (850472) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 56.362ms - RowsReturned: 850.47K (850472) - RowsReturnedRate: 41.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.204us EXCHANGE_NODE (id=13):(Total: 18.728us, non-child: 18.728us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.940us - DeserializeRowBatchTimer: 78.322us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 31.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s617ms, non-child: 20s617ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): 9:29/6.62 GB 2:33/7.63 GB 1:28/6.44 GB 10:27/6.23 GB 6:31/6.99 GB 8:27/6.21 GB 4:31/7.30 GB 5:31/6.94 GB 3:31/7.08 GB 7:29/6.33 GB 0:44/10.06 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s291ms Hdfs Read Thread Concurrency Bucket: 0:97.67% 1:0% 2:0% 3:0% 4:2.326% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:333 PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 205.44 MB, 278.89 MB, 278.89 MB, 278.89 MB, 278.89 MB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 22.42 - BytesRead: 278.89 MB (292434493) - BytesReadDataNodeCache: 0 - BytesReadLocal: 278.89 MB (292434493) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 278.89 MB (292434493) - DecompressionTime: 558.412ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 338.68 MB (355129624) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 45.83M (45831904) - RowsReturned: 850.47K (850472) - RowsReturnedRate: 41.25 K/sec - ScanRangesComplete: 341 (341) - ScannerThreadsInvoluntaryContextSwitches: 6.37K (6374) - ScannerThreadsTotalWallClockTime: 8m2s - MaterializeTupleTime(*): 11s253ms - ScannerThreadsSysTime: 31s166ms - ScannerThreadsUserTime: 15s171ms - ScannerThreadsVoluntaryContextSwitches: 499.93K (499927) - TotalRawHdfsReadTime(*): 200.892ms - TotalReadThroughput: 12.68 MB/sec Filter 0: - Rows processed: 131.06K (131064) - Rows rejected: 3.13K (3128) - Rows total: 131.07K (131072) Filter 2: - Rows processed: 131.06K (131064) - Rows rejected: 0 (0) - Rows total: 131.07K (131072) Filter 3: - Files processed: 341 (341) - Files rejected: 333 (333) - Files total: 341 (341) - RowGroups processed: 328.74K (328744) - RowGroups rejected: 0 (0) - RowGroups total: 328.74K (328744) - Rows processed: 131.06K (131064) - Rows rejected: 0 (0) - Rows total: 131.07K (131072) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 4: - Rows processed: 45.83M (45828776) - Rows rejected: 44.98M (44978304) - Rows total: 45.83M (45828776) Instance 3045db9f916d3ae1:2b6258aae4211ed2 (host=d2420.halxg.cloudera.com:22000):(Total: 21s543ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:36/8.29 GB 2:24/5.33 GB 1:31/6.70 GB 3:29/6.36 GB 10:35/8.38 GB 7:27/6.42 GB 5:27/6.08 GB 0:36/8.04 GB 4:40/9.36 GB 9:23/5.28 GB 6:36/7.91 GB Filter 0 arrival: 890ms Filter 3 arrival: 891ms Filter 4 arrival: 893ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.69 MB, 364.30 MB, 390.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 953.36 MB, 917.70 MB, 854.66 MB, 641.78 MB, 100.00 KB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1 - AverageThreadTokens: 22.47 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 959.67 MB (1006285728) - PerHostPeakMemUsage: 969.93 MB (1017047968) - PrepareTime: 238.490ms - RowsProduced: 301 (301) - TotalCpuTime: 8m26s - TotalNetworkReceiveTime: 717.554ms - TotalNetworkSendTime: 5.518ms - TotalStorageWaitTime: 407.449ms CodeGen:(Total: 847.477ms, non-child: 847.477ms, % non-child: 100.00%) - CodegenTime: 4.854ms - CompileTime: 180.509ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 455.853ms - PrepareTime: 209.343ms DataStreamSender (dst_id=18):(Total: 216.392us, non-child: 216.392us, % non-child: 100.00%) - BytesSent: 17.77 KB (18197) - NetworkThroughput(*): 3.83 MB/sec - OverallThroughput: 80.20 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 337.666us - ThriftTransmitTime(*): 4.532ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s523ms, non-child: 464.297ms, % non-child: 2.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 86.474us - GetResultsTime: 117.538us - HTResizeTime: 280.212us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.98 MB (6275280) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 255.939ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s059ms, non-child: 207.164ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 13.460us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 21.368us - GetNewBlockTime: 444.756us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.98 MB (5220560) - PinTime: 0.000ns - ProbeRows: 1.16M (1163080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 187.599ms - RowsReturned: 1.15M (1150532) - RowsReturnedRate: 54.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.668us EXCHANGE_NODE (id=17):(Total: 24.672us, non-child: 24.672us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 4.804us - DeserializeRowBatchTimer: 7.630us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 2.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s852ms, non-child: 432.436ms, % non-child: 2.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 204.027ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 356.308ms - GetNewBlockTime: 1.128ms - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.70 MB (214643544) - PinTime: 0.000ns - ProbeRows: 1.16M (1163080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 419.352ms - RowsReturned: 1.16M (1163080) - RowsReturnedRate: 55.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.460us EXCHANGE_NODE (id=16):(Total: 73.593ms, non-child: 73.593ms, % non-child: 100.00%) BytesReceived(500.000ms): 10.28 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 48.885ms - DeserializeRowBatchTimer: 175.646ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 26.16 M/sec - SendersBlockedTimer: 760.299ms - SendersBlockedTotalTimer(*): 11s971ms HASH_JOIN_NODE (id=8):(Total: 20s420ms, non-child: 322.696ms, % non-child: 1.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 279.574ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 405.555ms - GetNewBlockTime: 597.368us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.86 MB (280871056) - PinTime: 0.000ns - ProbeRows: 1.19M (1190409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 310.559ms - RowsReturned: 1.16M (1163080) - RowsReturnedRate: 56.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.300us EXCHANGE_NODE (id=15):(Total: 809.766ms, non-child: 220.477ms, % non-child: 27.23%) BytesReceived(500.000ms): 0, 0, 27.57 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 107.748ms - DeserializeRowBatchTimer: 230.985ms - FirstBatchArrivalWaitTime: 582.586ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 4.75 M/sec - SendersBlockedTimer: 312.601ms - SendersBlockedTotalTimer(*): 4s249ms HASH_JOIN_NODE (id=7):(Total: 20s100ms, non-child: 78.193ms, % non-child: 0.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 5.760us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 13.724us - GetNewBlockTime: 315.102us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.96 MB (3098760) - PinTime: 0.000ns - ProbeRows: 1.19M (1190409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 69.509ms - RowsReturned: 1.19M (1190409) - RowsReturnedRate: 59.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.202us EXCHANGE_NODE (id=14):(Total: 12.522us, non-child: 12.522us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 2.572us - DeserializeRowBatchTimer: 6.400us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 2.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s022ms, non-child: 118.669ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 134.164us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 683.552us - GetNewBlockTime: 134.134us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.84 MB (2980752) - PinTime: 0.000ns - ProbeRows: 1.19M (1190409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 97.740ms - RowsReturned: 1.19M (1190409) - RowsReturnedRate: 59.45 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.500us EXCHANGE_NODE (id=13):(Total: 32.357us, non-child: 32.357us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 21.780us - DeserializeRowBatchTimer: 112.902us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 18.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s903ms, non-child: 19s903ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 11 Hdfs split stats (:<# splits>/): 8:36/8.29 GB 2:24/5.33 GB 1:31/6.70 GB 3:29/6.36 GB 10:35/8.38 GB 7:27/6.42 GB 5:27/6.08 GB 0:36/8.04 GB 4:40/9.36 GB 9:23/5.28 GB 6:36/7.91 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s109ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:333 PARQUET/SNAPPY:44 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 397.23 MB, 397.23 MB, 397.23 MB, 397.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.90 - BytesRead: 397.23 MB (416527099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 397.23 MB (416527099) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 397.23 MB (416527099) - DecompressionTime: 879.092ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 485.55 MB (509135264) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 65.68M (65680698) - RowsReturned: 1.19M (1190409) - RowsReturnedRate: 59.81 K/sec - ScanRangesComplete: 344 (344) - ScannerThreadsInvoluntaryContextSwitches: 6.37K (6373) - ScannerThreadsTotalWallClockTime: 8m3s - MaterializeTupleTime(*): 16s689ms - ScannerThreadsSysTime: 26s242ms - ScannerThreadsUserTime: 21s300ms - ScannerThreadsVoluntaryContextSwitches: 433.30K (433295) - TotalRawHdfsReadTime(*): 354.075ms - TotalReadThroughput: 18.48 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 4.22K (4223) - Rows total: 180.22K (180224) Filter 2: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Filter 3: - Files processed: 344 (344) - Files rejected: 333 (333) - Files total: 344 (344) - RowGroups processed: 477.03K (477033) - RowGroups rejected: 0 (0) - RowGroups total: 477.03K (477033) - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 4: - Rows processed: 65.68M (65676475) - Rows rejected: 64.49M (64486066) - Rows total: 65.68M (65676475) Instance 3045db9f916d3ae1:2b6258aae4211ecb (host=d2409.halxg.cloudera.com:22000):(Total: 21s522ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:24/5.48 GB 10:30/7.24 GB 4:34/6.98 GB 3:36/7.90 GB 6:38/8.39 GB 9:25/5.19 GB 8:35/7.49 GB 0:26/5.93 GB 1:27/5.97 GB 5:41/9.55 GB 2:35/7.85 GB Filter 0 arrival: 734ms Filter 4 arrival: 734ms Filter 3 arrival: 735ms MemoryUsage(500.000ms): 2.33 MB, 35.45 MB, 157.48 MB, 342.52 MB, 406.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 986.92 MB, 908.43 MB, 730.89 MB, 505.15 MB ThreadUsage(500.000ms): 1, 18, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.34 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 989.31 MB (1037364488) - PerHostPeakMemUsage: 998.57 MB (1047078152) - PrepareTime: 190.734ms - RowsProduced: 301 (301) - TotalCpuTime: 8m28s - TotalNetworkReceiveTime: 1s297ms - TotalNetworkSendTime: 4.318ms - TotalStorageWaitTime: 362.715ms CodeGen:(Total: 709.501ms, non-child: 709.501ms, % non-child: 100.00%) - CodegenTime: 2.332ms - CompileTime: 142.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 393.688ms - PrepareTime: 171.686ms DataStreamSender (dst_id=18):(Total: 177.646us, non-child: 177.646us, % non-child: 100.00%) - BytesSent: 17.75 KB (18180) - NetworkThroughput(*): 5.20 MB/sec - OverallThroughput: 97.60 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 1.390ms - ThriftTransmitTime(*): 3.331ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s506ms, non-child: 420.186ms, % non-child: 1.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 67.428us - GetResultsTime: 96.508us - HTResizeTime: 290.740us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.92 MB (6204352) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 250.837ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s086ms, non-child: 181.127ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.954us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.702us - GetNewBlockTime: 163.256us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.14 MB (4343344) - PinTime: 0.000ns - ProbeRows: 1.25M (1246386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 167.784ms - RowsReturned: 1.23M (1230093) - RowsReturnedRate: 58.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.470us EXCHANGE_NODE (id=17):(Total: 11.432us, non-child: 11.432us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.360us - DeserializeRowBatchTimer: 21.960us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s905ms, non-child: 336.738ms, % non-child: 1.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 144.330ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 161.657ms - GetNewBlockTime: 814.636us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 203.96 MB (213868472) - PinTime: 0.000ns - ProbeRows: 1.25M (1246386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 327.753ms - RowsReturned: 1.25M (1246386) - RowsReturnedRate: 59.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.756us EXCHANGE_NODE (id=16):(Total: 305.932ms, non-child: 57.884ms, % non-child: 18.92%) BytesReceived(500.000ms): 327.98 KB, 10.28 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.663ms - DeserializeRowBatchTimer: 122.876ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.29 M/sec - SendersBlockedTimer: 353.994ms - SendersBlockedTotalTimer(*): 5s639ms HASH_JOIN_NODE (id=8):(Total: 20s569ms, non-child: 373.941ms, % non-child: 1.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 176.618ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 343.520ms - GetNewBlockTime: 482.646us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.50 MB (280494216) - PinTime: 0.000ns - ProbeRows: 1.28M (1276032) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 364.180ms - RowsReturned: 1.25M (1246386) - RowsReturnedRate: 60.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.360us EXCHANGE_NODE (id=15):(Total: 1s098ms, non-child: 128.672ms, % non-child: 11.71%) BytesReceived(500.000ms): 0, 0, 0, 27.38 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 67.353ms - DeserializeRowBatchTimer: 137.764ms - FirstBatchArrivalWaitTime: 822.060ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s197ms, non-child: 74.564ms, % non-child: 0.37%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.242us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.788us - GetNewBlockTime: 91.048us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.99 MB (3138760) - PinTime: 0.000ns - ProbeRows: 1.28M (1276032) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 67.470ms - RowsReturned: 1.28M (1276032) - RowsReturnedRate: 63.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.216us EXCHANGE_NODE (id=14):(Total: 7.254us, non-child: 7.254us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.330us - DeserializeRowBatchTimer: 4.544us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s122ms, non-child: 105.818ms, % non-child: 0.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 60.972us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 57.434us - GetNewBlockTime: 119.376us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.73 MB (2866400) - PinTime: 0.000ns - ProbeRows: 1.28M (1276032) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 93.783ms - RowsReturned: 1.28M (1276032) - RowsReturnedRate: 63.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.188us EXCHANGE_NODE (id=13):(Total: 18.918us, non-child: 18.918us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.104us - DeserializeRowBatchTimer: 76.416us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 31.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s016ms, non-child: 20s016ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 11 Hdfs split stats (:<# splits>/): 7:24/5.48 GB 10:30/7.24 GB 4:34/6.98 GB 3:36/7.90 GB 6:38/8.39 GB 9:25/5.19 GB 8:35/7.49 GB 0:26/5.93 GB 1:27/5.97 GB 5:41/9.55 GB 2:35/7.85 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s274ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:340 PARQUET/SNAPPY:44 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 423.53 MB, 423.53 MB, 423.53 MB, 423.53 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.72 - BytesRead: 423.53 MB (444098852) - BytesReadDataNodeCache: 0 - BytesReadLocal: 423.53 MB (444098852) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 423.53 MB (444098852) - DecompressionTime: 795.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 515.10 MB (540118040) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 69.04M (69038446) - RowsReturned: 1.28M (1276032) - RowsReturnedRate: 63.75 K/sec - ScanRangesComplete: 351 (351) - ScannerThreadsInvoluntaryContextSwitches: 6.14K (6142) - ScannerThreadsTotalWallClockTime: 8m5s - MaterializeTupleTime(*): 14s638ms - ScannerThreadsSysTime: 25s266ms - ScannerThreadsUserTime: 18s695ms - ScannerThreadsVoluntaryContextSwitches: 407.34K (407340) - TotalRawHdfsReadTime(*): 295.465ms - TotalReadThroughput: 19.25 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 4.21K (4212) - Rows total: 180.22K (180224) Filter 2: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Filter 3: - Files processed: 351 (351) - Files rejected: 340 (340) - Files total: 351 (351) - RowGroups processed: 492.49K (492487) - RowGroups rejected: 0 (0) - RowGroups total: 492.49K (492487) - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 4: - Rows processed: 69.03M (69034234) - Rows rejected: 67.76M (67758202) - Rows total: 69.03M (69034234) Instance 3045db9f916d3ae1:2b6258aae4211ec3 (host=d2412.halxg.cloudera.com:22000):(Total: 21s517ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:23/5.28 GB 0:25/5.85 GB 2:38/8.24 GB 7:34/8.00 GB 4:41/9.21 GB 1:32/7.68 GB 3:26/5.71 GB 5:32/7.23 GB 9:28/6.27 GB 6:29/6.29 GB 10:36/8.22 GB Filter 4 arrival: 705ms Filter 0 arrival: 706ms Filter 3 arrival: 708ms MemoryUsage(500.000ms): 2.68 MB, 141.51 MB, 173.48 MB, 342.50 MB, 422.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 893.37 MB, 831.70 MB, 697.99 MB, 497.88 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.48 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 901.23 MB (945007704) - PerHostPeakMemUsage: 910.49 MB (954721368) - PrepareTime: 183.226ms - RowsProduced: 301 (301) - TotalCpuTime: 8m30s - TotalNetworkReceiveTime: 1s353ms - TotalNetworkSendTime: 8.203ms - TotalStorageWaitTime: 337.901ms CodeGen:(Total: 682.017ms, non-child: 682.017ms, % non-child: 100.00%) - CodegenTime: 2.246ms - CompileTime: 141.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 373.313ms - PrepareTime: 165.177ms DataStreamSender (dst_id=18):(Total: 173.063us, non-child: 173.063us, % non-child: 100.00%) - BytesSent: 17.67 KB (18092) - NetworkThroughput(*): 4.79 MB/sec - OverallThroughput: 99.70 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 335.703us - ThriftTransmitTime(*): 3.603ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s502ms, non-child: 367.502ms, % non-child: 1.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.617us - GetResultsTime: 95.596us - HTResizeTime: 405.869us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.16 MB (5411720) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 13.00 /sec - StreamingTime: 204.005ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 21s134ms, non-child: 145.344ms, % non-child: 0.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.652us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 10.562us - GetNewBlockTime: 172.691us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.45 MB (3617456) - PinTime: 0.000ns - ProbeRows: 1.03M (1033229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.495ms - RowsReturned: 1.02M (1021166) - RowsReturnedRate: 48.32 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.012us EXCHANGE_NODE (id=17):(Total: 11.029us, non-child: 11.029us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.820us - DeserializeRowBatchTimer: 8.372us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s989ms, non-child: 302.787ms, % non-child: 1.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 148.613ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 159.297ms - GetNewBlockTime: 671.151us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 203.29 MB (213168304) - PinTime: 0.000ns - ProbeRows: 1.03M (1033229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 294.708ms - RowsReturned: 1.03M (1033229) - RowsReturnedRate: 49.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.271us EXCHANGE_NODE (id=16):(Total: 331.445ms, non-child: 53.596ms, % non-child: 16.17%) BytesReceived(500.000ms): 483.68 KB, 10.35 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.967ms - DeserializeRowBatchTimer: 115.025ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 5.81 M/sec - SendersBlockedTimer: 324.007ms - SendersBlockedTotalTimer(*): 5s475ms HASH_JOIN_NODE (id=8):(Total: 20s687ms, non-child: 259.450ms, % non-child: 1.25%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 176.054ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 352.422ms - GetNewBlockTime: 444.721us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.29 MB (280268976) - PinTime: 0.000ns - ProbeRows: 1.06M (1055908) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 250.331ms - RowsReturned: 1.03M (1033229) - RowsReturnedRate: 49.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 882.000ns EXCHANGE_NODE (id=15):(Total: 1s128ms, non-child: 125.381ms, % non-child: 11.12%) BytesReceived(500.000ms): 0, 0, 0, 33.67 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 66.277ms - DeserializeRowBatchTimer: 134.845ms - FirstBatchArrivalWaitTime: 852.150ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s429ms, non-child: 59.503ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.444us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.458us - GetNewBlockTime: 339.401us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.78 MB (2913520) - PinTime: 0.000ns - ProbeRows: 1.06M (1055908) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52.734ms - RowsReturned: 1.06M (1055908) - RowsReturnedRate: 51.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.043us EXCHANGE_NODE (id=14):(Total: 6.811us, non-child: 6.811us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.306us - DeserializeRowBatchTimer: 5.541us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s370ms, non-child: 89.200ms, % non-child: 0.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 68.891us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 57.517us - GetNewBlockTime: 120.358us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.93 MB (3071136) - PinTime: 0.000ns - ProbeRows: 1.06M (1055908) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 79.053ms - RowsReturned: 1.06M (1055908) - RowsReturnedRate: 51.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.189us EXCHANGE_NODE (id=13):(Total: 18.210us, non-child: 18.210us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.038us - DeserializeRowBatchTimer: 74.322us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 32.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s281ms, non-child: 20s281ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 8:23/5.28 GB 0:25/5.85 GB 2:38/8.24 GB 7:34/8.00 GB 4:41/9.21 GB 1:32/7.68 GB 3:26/5.71 GB 5:32/7.23 GB 9:28/6.27 GB 6:29/6.29 GB 10:36/8.22 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s313ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:334 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 353.02 MB, 353.02 MB, 353.02 MB, 353.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.86 - BytesRead: 353.02 MB (370164581) - BytesReadDataNodeCache: 0 - BytesReadLocal: 353.02 MB (370164581) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 353.02 MB (370164581) - DecompressionTime: 667.800ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 428.21 MB (449012352) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 57.60M (57604298) - RowsReturned: 1.06M (1055908) - RowsReturnedRate: 52.06 K/sec - ScanRangesComplete: 344 (344) - ScannerThreadsInvoluntaryContextSwitches: 5.88K (5885) - ScannerThreadsTotalWallClockTime: 8m7s - MaterializeTupleTime(*): 12s808ms - ScannerThreadsSysTime: 27s128ms - ScannerThreadsUserTime: 16s625ms - ScannerThreadsVoluntaryContextSwitches: 407.19K (407190) - TotalRawHdfsReadTime(*): 275.782ms - TotalReadThroughput: 16.05 MB/sec Filter 0: - Rows processed: 163.83K (163830) - Rows rejected: 4.07K (4065) - Rows total: 163.84K (163840) Filter 2: - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) Filter 3: - Files processed: 344 (344) - Files rejected: 334 (334) - Files total: 344 (344) - RowGroups processed: 414.07K (414066) - RowGroups rejected: 0 (0) - RowGroups total: 414.07K (414066) - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 57.60M (57600233) - Rows rejected: 56.54M (56544325) - Rows total: 57.60M (57600233) Instance 3045db9f916d3ae1:2b6258aae4211ed4 (host=d2413.halxg.cloudera.com:22000):(Total: 21s388ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:28/6.25 GB 8:44/10.14 GB 3:28/6.21 GB 10:28/6.27 GB 2:26/6.18 GB 5:34/7.87 GB 0:33/7.79 GB 1:33/6.87 GB 4:25/5.55 GB 6:30/6.54 GB 7:38/8.26 GB Filter 3 arrival: 728ms Filter 4 arrival: 728ms Filter 0 arrival: 728ms MemoryUsage(500.000ms): 26.29 MB, 145.71 MB, 189.48 MB, 342.52 MB, 438.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 867.85 MB, 797.01 MB, 684.73 MB, 522.99 MB ThreadUsage(500.000ms): 1, 18, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.34 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 870.06 MB (912325056) - PerHostPeakMemUsage: 879.32 MB (922038720) - PrepareTime: 191.016ms - RowsProduced: 301 (301) - TotalCpuTime: 8m24s - TotalNetworkReceiveTime: 1s113ms - TotalNetworkSendTime: 3.806ms - TotalStorageWaitTime: 266.334ms CodeGen:(Total: 700.660ms, non-child: 700.660ms, % non-child: 100.00%) - CodegenTime: 2.401ms - CompileTime: 141.566ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 385.895ms - PrepareTime: 171.777ms DataStreamSender (dst_id=18):(Total: 172.058us, non-child: 172.058us, % non-child: 100.00%) - BytesSent: 17.64 KB (18068) - NetworkThroughput(*): 5.20 MB/sec - OverallThroughput: 100.15 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 301.622us - ThriftTransmitTime(*): 3.314ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s376ms, non-child: 409.909ms, % non-child: 1.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.638us - GetResultsTime: 85.480us - HTResizeTime: 227.090us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.22 MB (7575336) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 174.196ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s966ms, non-child: 142.358ms, % non-child: 0.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.414us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 13.076us - GetNewBlockTime: 249.826us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.36 MB (5617976) - PinTime: 0.000ns - ProbeRows: 952.73K (952731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.694ms - RowsReturned: 943.61K (943609) - RowsReturnedRate: 45.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.314us EXCHANGE_NODE (id=17):(Total: 10.198us, non-child: 10.198us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.520us - DeserializeRowBatchTimer: 8.452us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 6.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s824ms, non-child: 309.772ms, % non-child: 1.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 151.752ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 164.946ms - GetNewBlockTime: 713.510us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 205.02 MB (214977080) - PinTime: 0.000ns - ProbeRows: 952.73K (952731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 301.059ms - RowsReturned: 952.73K (952731) - RowsReturnedRate: 45.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.612us EXCHANGE_NODE (id=16):(Total: 210.247ms, non-child: 65.757ms, % non-child: 31.28%) BytesReceived(500.000ms): 9.40 MB, 10.48 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.616ms - DeserializeRowBatchTimer: 132.782ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 9.16 M/sec - SendersBlockedTimer: 443.652ms - SendersBlockedTotalTimer(*): 7s225ms HASH_JOIN_NODE (id=8):(Total: 20s515ms, non-child: 274.357ms, % non-child: 1.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 176.209ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 358.742ms - GetNewBlockTime: 498.702us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 269.01 MB (282077752) - PinTime: 0.000ns - ProbeRows: 973.41K (973409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 265.245ms - RowsReturned: 952.73K (952731) - RowsReturnedRate: 46.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.238us EXCHANGE_NODE (id=15):(Total: 1s009ms, non-child: 131.478ms, % non-child: 13.03%) BytesReceived(500.000ms): 0, 0, 0, 40.76 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 65.956ms - DeserializeRowBatchTimer: 140.090ms - FirstBatchArrivalWaitTime: 732.756ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s242ms, non-child: 52.900ms, % non-child: 0.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 2.960us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.486us - GetNewBlockTime: 216.912us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.85 MB (2987216) - PinTime: 0.000ns - ProbeRows: 973.41K (973409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.083ms - RowsReturned: 973.41K (973409) - RowsReturnedRate: 48.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.090us EXCHANGE_NODE (id=14):(Total: 7.608us, non-child: 7.608us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.510us - DeserializeRowBatchTimer: 5.160us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s190ms, non-child: 81.086ms, % non-child: 0.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 79.848us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 81.120us - GetNewBlockTime: 94.356us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.04 MB (3189536) - PinTime: 0.000ns - ProbeRows: 973.41K (973409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 68.718ms - RowsReturned: 973.41K (973409) - RowsReturnedRate: 48.21 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.250us EXCHANGE_NODE (id=13):(Total: 27.812us, non-child: 27.812us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 21.496us - DeserializeRowBatchTimer: 73.024us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 21.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s108ms, non-child: 20s108ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): 9:28/6.25 GB 8:44/10.14 GB 3:28/6.21 GB 10:28/6.27 GB 2:26/6.18 GB 5:34/7.87 GB 0:33/7.79 GB 1:33/6.87 GB 4:25/5.55 GB 6:30/6.54 GB 7:38/8.26 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s291ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:338 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 321.34 MB, 321.34 MB, 321.34 MB, 321.34 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.72 - BytesRead: 321.34 MB (336950334) - BytesReadDataNodeCache: 0 - BytesReadLocal: 321.34 MB (336950334) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 321.34 MB (336950334) - DecompressionTime: 645.300ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 395.46 MB (414666320) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 53.70M (53696615) - RowsReturned: 973.41K (973409) - RowsReturnedRate: 48.41 K/sec - ScanRangesComplete: 347 (347) - ScannerThreadsInvoluntaryContextSwitches: 5.49K (5490) - ScannerThreadsTotalWallClockTime: 8m1s - MaterializeTupleTime(*): 11s946ms - ScannerThreadsSysTime: 24s031ms - ScannerThreadsUserTime: 15s888ms - ScannerThreadsVoluntaryContextSwitches: 445.87K (445865) - TotalRawHdfsReadTime(*): 240.705ms - TotalReadThroughput: 14.61 MB/sec Filter 0: - Rows processed: 147.45K (147447) - Rows rejected: 3.54K (3545) - Rows total: 147.46K (147456) Filter 2: - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) Filter 3: - Files processed: 347 (347) - Files rejected: 338 (338) - Files total: 347 (347) - RowGroups processed: 386.96K (386957) - RowGroups rejected: 0 (0) - RowGroups total: 386.96K (386957) - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 4: - Rows processed: 53.69M (53693070) - Rows rejected: 52.72M (52719661) - Rows total: 53.69M (53693070) Instance 3045db9f916d3ae1:2b6258aae4211ec5 (host=d2418.halxg.cloudera.com:22000):(Total: 21s326ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:25/5.74 GB 5:26/6.16 GB 2:29/6.70 GB 3:30/7.02 GB 1:31/7.05 GB 8:34/7.76 GB 4:34/7.66 GB 9:33/7.65 GB 0:29/6.88 GB 6:36/7.94 GB 10:33/7.42 GB Filter 3 arrival: 732ms Filter 0 arrival: 732ms Filter 4 arrival: 732ms MemoryUsage(500.000ms): 2.33 MB, 27.87 MB, 153.48 MB, 342.62 MB, 398.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 945.06 MB, 886.20 MB, 775.70 MB, 499.63 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.95 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 951.94 MB (998186624) - PerHostPeakMemUsage: 961.21 MB (1007900288) - PrepareTime: 189.315ms - RowsProduced: 301 (301) - TotalCpuTime: 8m17s - TotalNetworkReceiveTime: 1s291ms - TotalNetworkSendTime: 6.209ms - TotalStorageWaitTime: 372.746ms CodeGen:(Total: 706.310ms, non-child: 706.310ms, % non-child: 100.00%) - CodegenTime: 2.253ms - CompileTime: 144.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 388.734ms - PrepareTime: 171.097ms DataStreamSender (dst_id=18):(Total: 169.654us, non-child: 169.654us, % non-child: 100.00%) - BytesSent: 17.73 KB (18158) - NetworkThroughput(*): 3.52 MB/sec - OverallThroughput: 102.07 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 600.170us - ThriftTransmitTime(*): 4.926ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s310ms, non-child: 409.211ms, % non-child: 1.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.084us - GetResultsTime: 81.782us - HTResizeTime: 245.068us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.75 MB (7076832) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 240.283ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s901ms, non-child: 183.768ms, % non-child: 0.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 8.802us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 12.988us - GetNewBlockTime: 189.852us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.85 MB (5084416) - PinTime: 0.000ns - ProbeRows: 1.20M (1200821) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 171.409ms - RowsReturned: 1.19M (1186519) - RowsReturnedRate: 56.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.548us EXCHANGE_NODE (id=17):(Total: 12.428us, non-child: 12.428us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 3.684us - DeserializeRowBatchTimer: 7.112us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 4.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s717ms, non-child: 381.276ms, % non-child: 1.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 153.586ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 161.547ms - GetNewBlockTime: 818.176us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.54 MB (214476696) - PinTime: 0.000ns - ProbeRows: 1.20M (1200821) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 372.671ms - RowsReturned: 1.20M (1200821) - RowsReturnedRate: 57.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.220us EXCHANGE_NODE (id=16):(Total: 299.454ms, non-child: 60.257ms, % non-child: 20.12%) BytesReceived(500.000ms): 328.01 KB, 10.28 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 35.077ms - DeserializeRowBatchTimer: 124.776ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.43 M/sec - SendersBlockedTimer: 350.633ms - SendersBlockedTotalTimer(*): 5s931ms HASH_JOIN_NODE (id=8):(Total: 20s337ms, non-child: 293.118ms, % non-child: 1.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 179.426ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 342.266ms - GetNewBlockTime: 528.138us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.64 MB (280639352) - PinTime: 0.000ns - ProbeRows: 1.23M (1228058) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.636ms - RowsReturned: 1.20M (1200821) - RowsReturnedRate: 59.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.440us EXCHANGE_NODE (id=15):(Total: 1s099ms, non-child: 131.448ms, % non-child: 11.96%) BytesReceived(500.000ms): 0, 0, 0, 24.39 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 66.189ms - DeserializeRowBatchTimer: 144.902ms - FirstBatchArrivalWaitTime: 825.999ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s045ms, non-child: 70.854ms, % non-child: 0.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.798us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.466us - GetNewBlockTime: 93.386us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.85 MB (2990512) - PinTime: 0.000ns - ProbeRows: 1.23M (1228058) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 64.031ms - RowsReturned: 1.23M (1228058) - RowsReturnedRate: 61.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 922.000ns EXCHANGE_NODE (id=14):(Total: 7.806us, non-child: 7.806us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.472us - DeserializeRowBatchTimer: 7.788us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s974ms, non-child: 102.585ms, % non-child: 0.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 90.080us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 55.126us - GetNewBlockTime: 173.236us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.99 MB (3139560) - PinTime: 0.000ns - ProbeRows: 1.23M (1228058) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 90.254ms - RowsReturned: 1.23M (1228058) - RowsReturnedRate: 61.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.090us EXCHANGE_NODE (id=13):(Total: 18.066us, non-child: 18.066us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.708us - DeserializeRowBatchTimer: 75.370us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 32.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s872ms, non-child: 19s872ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 11 Hdfs split stats (:<# splits>/): 7:25/5.74 GB 5:26/6.16 GB 2:29/6.70 GB 3:30/7.02 GB 1:31/7.05 GB 8:34/7.76 GB 4:34/7.66 GB 9:33/7.65 GB 0:29/6.88 GB 6:36/7.94 GB 10:33/7.42 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s274ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:329 PARQUET/SNAPPY:44 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 396.45 MB, 396.45 MB, 396.45 MB, 396.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.90 - BytesRead: 396.45 MB (415711317) - BytesReadDataNodeCache: 0 - BytesReadLocal: 396.45 MB (415711317) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 396.45 MB (415711317) - DecompressionTime: 791.646ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 478.99 MB (502259072) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 66.12M (66120665) - RowsReturned: 1.23M (1228058) - RowsReturnedRate: 61.80 K/sec - ScanRangesComplete: 340 (340) - ScannerThreadsInvoluntaryContextSwitches: 5.49K (5487) - ScannerThreadsTotalWallClockTime: 7m54s - MaterializeTupleTime(*): 14s534ms - ScannerThreadsSysTime: 21s884ms - ScannerThreadsUserTime: 18s514ms - ScannerThreadsVoluntaryContextSwitches: 410.32K (410317) - TotalRawHdfsReadTime(*): 256.841ms - TotalReadThroughput: 18.02 MB/sec Filter 0: - Rows processed: 180.21K (180213) - Rows rejected: 4.42K (4418) - Rows total: 180.22K (180224) Filter 2: - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) Filter 3: - Files processed: 340 (340) - Files rejected: 329 (329) - Files total: 340 (340) - RowGroups processed: 473.47K (473470) - RowGroups rejected: 0 (0) - RowGroups total: 473.47K (473470) - Rows processed: 180.21K (180213) - Rows rejected: 0 (0) - Rows total: 180.22K (180224) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 4: - Rows processed: 66.12M (66116247) - Rows rejected: 64.89M (64888189) - Rows total: 66.12M (66116247) Instance 3045db9f916d3ae1:2b6258aae4211ece (host=d2408.halxg.cloudera.com:22000):(Total: 21s321ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:28/5.79 GB 0:22/4.76 GB 1:38/7.86 GB 3:38/8.72 GB 2:30/6.56 GB 8:38/8.52 GB 9:31/7.19 GB 5:27/5.88 GB 4:34/7.25 GB 7:32/7.52 GB 6:36/7.99 GB Filter 3 arrival: 727ms Filter 0 arrival: 729ms Filter 4 arrival: 729ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.59 MB, 204.46 MB, 350.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 529.23 MB, 891.39 MB, 821.12 MB, 617.73 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.48 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 899.93 MB (943642392) - PerHostPeakMemUsage: 909.19 MB (953356056) - PrepareTime: 188.896ms - RowsProduced: 301 (301) - TotalCpuTime: 8m16s - TotalNetworkReceiveTime: 1s293ms - TotalNetworkSendTime: 7.450ms - TotalStorageWaitTime: 362.403ms CodeGen:(Total: 703.289ms, non-child: 703.289ms, % non-child: 100.00%) - CodegenTime: 2.384ms - CompileTime: 142.152ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 389.648ms - PrepareTime: 169.905ms DataStreamSender (dst_id=18):(Total: 182.584us, non-child: 182.584us, % non-child: 100.00%) - BytesSent: 17.72 KB (18143) - NetworkThroughput(*): 2.59 MB/sec - OverallThroughput: 94.76 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 298.826us - ThriftTransmitTime(*): 6.692ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s305ms, non-child: 393.005ms, % non-child: 1.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.522us - GetResultsTime: 93.366us - HTResizeTime: 254.890us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.98 MB (6267152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 225.333ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s912ms, non-child: 149.106ms, % non-child: 0.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.452us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 12.326us - GetNewBlockTime: 199.034us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.14 MB (4339616) - PinTime: 0.000ns - ProbeRows: 1.06M (1057404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.789ms - RowsReturned: 1.05M (1046342) - RowsReturnedRate: 50.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.060us EXCHANGE_NODE (id=17):(Total: 9.344us, non-child: 9.344us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.476us - DeserializeRowBatchTimer: 20.756us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 6.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s763ms, non-child: 300.817ms, % non-child: 1.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 142.310ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 154.766ms - GetNewBlockTime: 935.836us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.28 MB (214204928) - PinTime: 0.000ns - ProbeRows: 1.06M (1057404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 292.428ms - RowsReturned: 1.06M (1057404) - RowsReturnedRate: 50.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.572us EXCHANGE_NODE (id=16):(Total: 313.364ms, non-child: 55.171ms, % non-child: 17.61%) BytesReceived(500.000ms): 10.21 MB, 14.23 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.363ms - DeserializeRowBatchTimer: 121.908ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.14 M/sec - SendersBlockedTimer: 347.780ms - SendersBlockedTotalTimer(*): 4s506ms HASH_JOIN_NODE (id=8):(Total: 20s463ms, non-child: 278.365ms, % non-child: 1.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 188.927ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 346.788ms - GetNewBlockTime: 716.456us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.27 MB (281305600) - PinTime: 0.000ns - ProbeRows: 1.08M (1082231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.995ms - RowsReturned: 1.06M (1057404) - RowsReturnedRate: 51.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 906.000ns EXCHANGE_NODE (id=15):(Total: 1s088ms, non-child: 130.504ms, % non-child: 11.99%) BytesReceived(500.000ms): 0, 0, 0, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 68.713ms - DeserializeRowBatchTimer: 132.647ms - FirstBatchArrivalWaitTime: 825.157ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s187ms, non-child: 64.779ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.076us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.018us - GetNewBlockTime: 79.922us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.77 MB (3950144) - PinTime: 0.000ns - ProbeRows: 1.08M (1082231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 57.897ms - RowsReturned: 1.08M (1082231) - RowsReturnedRate: 53.61 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.070us EXCHANGE_NODE (id=14):(Total: 7.946us, non-child: 7.946us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.756us - DeserializeRowBatchTimer: 5.766us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s122ms, non-child: 92.097ms, % non-child: 0.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 63.584us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 63.546us - GetNewBlockTime: 96.150us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.88 MB (3019352) - PinTime: 0.000ns - ProbeRows: 1.08M (1082231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 79.631ms - RowsReturned: 1.08M (1082231) - RowsReturnedRate: 53.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.254us EXCHANGE_NODE (id=13):(Total: 17.916us, non-child: 17.916us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.250us - DeserializeRowBatchTimer: 91.394us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 32.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s030ms, non-child: 20s030ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 10:28/5.79 GB 0:22/4.76 GB 1:38/7.86 GB 3:38/8.72 GB 2:30/6.56 GB 8:38/8.52 GB 9:31/7.19 GB 5:27/5.88 GB 4:34/7.25 GB 7:32/7.52 GB 6:36/7.99 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s274ms Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:0% 2:0% 3:0% 4:0% 5:2.381% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:344 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.51 MB, 346.85 MB, 346.85 MB, 346.85 MB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 22.40 - BytesRead: 346.85 MB (363701727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 346.85 MB (363701727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 346.85 MB (363701727) - DecompressionTime: 711.790ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 426.02 MB (446709648) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 57.85M (57853091) - RowsReturned: 1.08M (1082231) - RowsReturnedRate: 54.03 K/sec - ScanRangesComplete: 354 (354) - ScannerThreadsInvoluntaryContextSwitches: 5.63K (5629) - ScannerThreadsTotalWallClockTime: 7m54s - MaterializeTupleTime(*): 13s238ms - ScannerThreadsSysTime: 23s512ms - ScannerThreadsUserTime: 17s085ms - ScannerThreadsVoluntaryContextSwitches: 452.24K (452237) - TotalRawHdfsReadTime(*): 247.493ms - TotalReadThroughput: 16.13 MB/sec Filter 0: - Rows processed: 163.83K (163830) - Rows rejected: 3.77K (3775) - Rows total: 163.84K (163840) Filter 2: - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) Filter 3: - Files processed: 354 (354) - Files rejected: 344 (344) - Files total: 354 (354) - RowGroups processed: 414.70K (414702) - RowGroups rejected: 0 (0) - RowGroups total: 414.70K (414702) - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 57.85M (57849316) - Rows rejected: 56.77M (56767085) - Rows total: 57.85M (57849316) Instance 3045db9f916d3ae1:2b6258aae4211ed0 (host=d2410.halxg.cloudera.com:22000):(Total: 21s276ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:39/8.89 GB 8:30/6.73 GB 0:37/8.34 GB 3:33/7.24 GB 9:33/7.44 GB 2:34/7.21 GB 5:39/9.14 GB 1:31/6.79 GB 6:33/7.63 GB 4:38/8.39 GB Filter 0 arrival: 730ms Filter 3 arrival: 733ms Filter 4 arrival: 733ms MemoryUsage(500.000ms): 27.85 MB, 141.58 MB, 201.46 MB, 342.51 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 1009.99 MB, 914.57 MB, 674.69 MB ThreadUsage(500.000ms): 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.98 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 1019.92 MB (1069466680) - PerHostPeakMemUsage: 1.01 GB (1080228920) - PrepareTime: 186.121ms - RowsProduced: 301 (301) - TotalCpuTime: 8m18s - TotalNetworkReceiveTime: 1s167ms - TotalNetworkSendTime: 3.267ms - TotalStorageWaitTime: 451.566ms CodeGen:(Total: 706.725ms, non-child: 706.725ms, % non-child: 100.00%) - CodegenTime: 2.345ms - CompileTime: 142.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 395.459ms - PrepareTime: 167.165ms DataStreamSender (dst_id=18):(Total: 3.107ms, non-child: 3.107ms, % non-child: 100.00%) - BytesSent: 17.79 KB (18212) - NetworkThroughput(*): 6.06 MB/sec - OverallThroughput: 5.59 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 356.224us - ThriftTransmitTime(*): 2.864ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s263ms, non-child: 435.641ms, % non-child: 2.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.558us - GetResultsTime: 724.976us - HTResizeTime: 267.318us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.32 MB (5580096) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 269.349ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s827ms, non-child: 197.226ms, % non-child: 0.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.760us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 10.810us - GetNewBlockTime: 183.780us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.32 MB (4525376) - PinTime: 0.000ns - ProbeRows: 1.30M (1295979) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 183.313ms - RowsReturned: 1.28M (1282494) - RowsReturnedRate: 61.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.154us EXCHANGE_NODE (id=17):(Total: 12.662us, non-child: 12.662us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.506us - DeserializeRowBatchTimer: 7.188us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 4.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s630ms, non-child: 426.037ms, % non-child: 2.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 146.618ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 257.727ms - GetNewBlockTime: 487.872us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.27 MB (214190704) - PinTime: 0.000ns - ProbeRows: 1.30M (1295979) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 416.321ms - RowsReturned: 1.30M (1295979) - RowsReturnedRate: 62.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.128us EXCHANGE_NODE (id=16):(Total: 234.428ms, non-child: 56.523ms, % non-child: 24.11%) BytesReceived(500.000ms): 10.23 MB, 13.07 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.882ms - DeserializeRowBatchTimer: 121.262ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 8.21 M/sec - SendersBlockedTimer: 422.953ms - SendersBlockedTotalTimer(*): 6s016ms HASH_JOIN_NODE (id=8):(Total: 20s205ms, non-child: 306.865ms, % non-child: 1.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 171.612ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 340.226ms - GetNewBlockTime: 425.992us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.00 MB (281017896) - PinTime: 0.000ns - ProbeRows: 1.33M (1325819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 297.265ms - RowsReturned: 1.30M (1295979) - RowsReturnedRate: 64.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.066us EXCHANGE_NODE (id=15):(Total: 1s036ms, non-child: 115.128ms, % non-child: 11.10%) BytesReceived(500.000ms): 0, 0, 0, 54.33 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 64.270ms - DeserializeRowBatchTimer: 126.869ms - FirstBatchArrivalWaitTime: 755.900ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s899ms, non-child: 79.532ms, % non-child: 0.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 2.938us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.802us - GetNewBlockTime: 286.458us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.18 MB (3332168) - PinTime: 0.000ns - ProbeRows: 1.33M (1325819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 72.352ms - RowsReturned: 1.33M (1325819) - RowsReturnedRate: 66.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.098us EXCHANGE_NODE (id=14):(Total: 7.674us, non-child: 7.674us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.364us - DeserializeRowBatchTimer: 4.096us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s820ms, non-child: 129.956ms, % non-child: 0.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 75.848us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 55.832us - GetNewBlockTime: 115.668us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.79 MB (2926744) - PinTime: 0.000ns - ProbeRows: 1.33M (1325819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 115.913ms - RowsReturned: 1.33M (1325819) - RowsReturnedRate: 66.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.132us EXCHANGE_NODE (id=13):(Total: 19.392us, non-child: 19.392us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.434us - DeserializeRowBatchTimer: 74.368us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 30.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s690ms, non-child: 19s690ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 7:39/8.89 GB 8:30/6.73 GB 0:37/8.34 GB 3:33/7.24 GB 9:33/7.44 GB 2:34/7.21 GB 5:39/9.14 GB 1:31/6.79 GB 6:33/7.63 GB 4:38/8.39 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s274ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:334 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 442.56 MB, 442.56 MB, 442.56 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.38 - BytesRead: 442.56 MB (464053275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 442.56 MB (464053275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 442.56 MB (464053275) - DecompressionTime: 860.187ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 544.89 MB (571354200) - PerReadThreadRawHdfsThroughput: 1.63 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.08M (73083378) - RowsReturned: 1.33M (1325819) - RowsReturnedRate: 67.33 K/sec - ScanRangesComplete: 347 (347) - ScannerThreadsInvoluntaryContextSwitches: 5.50K (5504) - ScannerThreadsTotalWallClockTime: 7m55s - MaterializeTupleTime(*): 16s290ms - ScannerThreadsSysTime: 19s676ms - ScannerThreadsUserTime: 19s953ms - ScannerThreadsVoluntaryContextSwitches: 367.74K (367738) - TotalRawHdfsReadTime(*): 264.450ms - TotalReadThroughput: 20.58 MB/sec Filter 0: - Rows processed: 212.98K (212979) - Rows rejected: 5.19K (5192) - Rows total: 212.99K (212992) Filter 2: - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) Filter 3: - Files processed: 347 (347) - Files rejected: 334 (334) - Files total: 347 (347) - RowGroups processed: 522.79K (522791) - RowGroups rejected: 0 (0) - RowGroups total: 522.79K (522791) - Rows processed: 212.98K (212979) - Rows rejected: 0 (0) - Rows total: 212.99K (212992) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 4: - Rows processed: 73.08M (73078186) - Rows rejected: 71.75M (71752367) - Rows total: 73.08M (73078186) Instance 3045db9f916d3ae1:2b6258aae4211ed3 (host=d2406.halxg.cloudera.com:22000):(Total: 21s242ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:33/7.51 GB 9:32/7.37 GB 5:31/6.38 GB 2:28/6.48 GB 10:40/9.23 GB 3:31/7.17 GB 7:34/7.33 GB 0:38/9.17 GB 6:22/5.08 GB 1:30/7.20 GB 8:21/4.91 GB Filter 0 arrival: 718ms Filter 3 arrival: 718ms Filter 4 arrival: 719ms MemoryUsage(500.000ms): 27.87 MB, 141.51 MB, 204.46 MB, 342.50 MB, 470.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 903.85 MB, 833.06 MB, 698.04 MB ThreadUsage(500.000ms): 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.98 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 905.58 MB (949569536) - PerHostPeakMemUsage: 914.84 MB (959283200) - PrepareTime: 184.061ms - RowsProduced: 301 (301) - TotalCpuTime: 8m16s - TotalNetworkReceiveTime: 1s181ms - TotalNetworkSendTime: 9.757ms - TotalStorageWaitTime: 296.754ms CodeGen:(Total: 694.370ms, non-child: 694.370ms, % non-child: 100.00%) - CodegenTime: 2.445ms - CompileTime: 143.632ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 383.411ms - PrepareTime: 165.863ms DataStreamSender (dst_id=18):(Total: 163.926us, non-child: 163.926us, % non-child: 100.00%) - BytesSent: 17.75 KB (18180) - NetworkThroughput(*): 1.87 MB/sec - OverallThroughput: 105.77 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 290.644us - ThriftTransmitTime(*): 9.267ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s224ms, non-child: 365.511ms, % non-child: 1.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.082us - GetResultsTime: 84.682us - HTResizeTime: 281.916us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.98 MB (7323568) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 201.351ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s859ms, non-child: 150.229ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.456us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 12.756us - GetNewBlockTime: 200.336us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.52 MB (4737384) - PinTime: 0.000ns - ProbeRows: 1.08M (1077261) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 137.615ms - RowsReturned: 1.07M (1065751) - RowsReturnedRate: 51.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.322us EXCHANGE_NODE (id=17):(Total: 11.996us, non-child: 11.996us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.430us - DeserializeRowBatchTimer: 9.454us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s709ms, non-child: 269.614ms, % non-child: 1.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 144.895ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 160.798ms - GetNewBlockTime: 853.228us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.18 MB (214094488) - PinTime: 0.000ns - ProbeRows: 1.08M (1077261) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 260.920ms - RowsReturned: 1.08M (1077261) - RowsReturnedRate: 52.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.356us EXCHANGE_NODE (id=16):(Total: 254.360ms, non-child: 57.684ms, % non-child: 22.68%) BytesReceived(500.000ms): 10.23 MB, 10.43 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.716ms - DeserializeRowBatchTimer: 121.989ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 7.57 M/sec - SendersBlockedTimer: 404.450ms - SendersBlockedTotalTimer(*): 5s723ms HASH_JOIN_NODE (id=8):(Total: 20s440ms, non-child: 295.845ms, % non-child: 1.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 187.864ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 335.253ms - GetNewBlockTime: 506.260us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.17 MB (281195160) - PinTime: 0.000ns - ProbeRows: 1.10M (1103217) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 285.024ms - RowsReturned: 1.08M (1077261) - RowsReturnedRate: 52.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.024us EXCHANGE_NODE (id=15):(Total: 1s037ms, non-child: 130.959ms, % non-child: 12.63%) BytesReceived(500.000ms): 0, 0, 0, 50.25 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 68.564ms - DeserializeRowBatchTimer: 136.779ms - FirstBatchArrivalWaitTime: 772.175ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s146ms, non-child: 58.430ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.060us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.782us - GetNewBlockTime: 96.348us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.82 MB (2956208) - PinTime: 0.000ns - ProbeRows: 1.10M (1103217) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.376ms - RowsReturned: 1.10M (1103217) - RowsReturnedRate: 54.76 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.032us EXCHANGE_NODE (id=14):(Total: 6.682us, non-child: 6.682us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.130us - DeserializeRowBatchTimer: 4.008us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s087ms, non-child: 85.517ms, % non-child: 0.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 66.136us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 55.606us - GetNewBlockTime: 166.612us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.81 MB (2946576) - PinTime: 0.000ns - ProbeRows: 1.10M (1103217) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 72.746ms - RowsReturned: 1.10M (1103217) - RowsReturnedRate: 54.92 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 986.000ns EXCHANGE_NODE (id=13):(Total: 18.964us, non-child: 18.964us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.504us - DeserializeRowBatchTimer: 68.790us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 31.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s002ms, non-child: 20s002ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): 4:33/7.51 GB 9:32/7.37 GB 5:31/6.38 GB 2:28/6.48 GB 10:40/9.23 GB 3:31/7.17 GB 7:34/7.33 GB 0:38/9.17 GB 6:22/5.08 GB 1:30/7.20 GB 8:21/4.91 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s293ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:331 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 354.97 MB, 354.97 MB, 354.97 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.38 - BytesRead: 354.97 MB (372207865) - BytesReadDataNodeCache: 0 - BytesReadLocal: 354.97 MB (372207865) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 354.97 MB (372207865) - DecompressionTime: 685.340ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 431.70 MB (452671512) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 58.46M (58457070) - RowsReturned: 1.10M (1103217) - RowsReturnedRate: 55.15 K/sec - ScanRangesComplete: 340 (340) - ScannerThreadsInvoluntaryContextSwitches: 5.20K (5199) - ScannerThreadsTotalWallClockTime: 7m53s - MaterializeTupleTime(*): 12s572ms - ScannerThreadsSysTime: 21s862ms - ScannerThreadsUserTime: 16s076ms - ScannerThreadsVoluntaryContextSwitches: 380.61K (380610) - TotalRawHdfsReadTime(*): 208.314ms - TotalReadThroughput: 16.51 MB/sec Filter 0: - Rows processed: 147.45K (147447) - Rows rejected: 3.61K (3610) - Rows total: 147.46K (147456) Filter 2: - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) Filter 3: - Files processed: 340 (340) - Files rejected: 331 (331) - Files total: 340 (340) - RowGroups processed: 417.60K (417600) - RowGroups rejected: 0 (0) - RowGroups total: 417.60K (417600) - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 4: - Rows processed: 58.45M (58453460) - Rows rejected: 57.35M (57350243) - Rows total: 58.45M (58453460) Instance 3045db9f916d3ae1:2b6258aae4211ecc (host=d2415.halxg.cloudera.com:22000):(Total: 21s231ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/7.11 GB 1:31/6.87 GB 4:34/7.75 GB 3:32/7.38 GB 10:38/8.44 GB 5:30/7.19 GB 2:33/7.73 GB 6:23/5.41 GB 0:32/7.30 GB 9:29/6.30 GB 8:28/6.33 GB Filter 3 arrival: 727ms Filter 0 arrival: 727ms Filter 4 arrival: 728ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.56 MB, 218.40 MB, 374.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 1001.59 MB, 1014.55 MB, 944.39 MB, 618.04 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.48 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 1.03 GB (1100715896) - PerHostPeakMemUsage: 1.03 GB (1110429560) - PrepareTime: 188.876ms - RowsProduced: 301 (301) - TotalCpuTime: 8m14s - TotalNetworkReceiveTime: 1s257ms - TotalNetworkSendTime: 6.194ms - TotalStorageWaitTime: 418.700ms CodeGen:(Total: 701.654ms, non-child: 701.654ms, % non-child: 100.00%) - CodegenTime: 2.428ms - CompileTime: 142.464ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 388.225ms - PrepareTime: 169.333ms DataStreamSender (dst_id=18):(Total: 168.082us, non-child: 168.082us, % non-child: 100.00%) - BytesSent: 17.76 KB (18182) - NetworkThroughput(*): 3.01 MB/sec - OverallThroughput: 103.16 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 286.120us - ThriftTransmitTime(*): 5.761ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s217ms, non-child: 462.584ms, % non-child: 2.18%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 63.562us - GetResultsTime: 88.644us - HTResizeTime: 392.302us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.40 MB (8808080) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 290.656ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s754ms, non-child: 208.099ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.616us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 14.080us - GetNewBlockTime: 160.486us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.39 MB (7753360) - PinTime: 0.000ns - ProbeRows: 1.38M (1376229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 193.647ms - RowsReturned: 1.36M (1360620) - RowsReturnedRate: 65.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.412us EXCHANGE_NODE (id=17):(Total: 11.436us, non-child: 11.436us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.308us - DeserializeRowBatchTimer: 7.704us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s546ms, non-child: 386.960ms, % non-child: 1.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 149.365ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 158.880ms - GetNewBlockTime: 772.060us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 207.05 MB (217110240) - PinTime: 0.000ns - ProbeRows: 1.38M (1376229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 377.718ms - RowsReturned: 1.38M (1376229) - RowsReturnedRate: 66.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.188us EXCHANGE_NODE (id=16):(Total: 291.139ms, non-child: 66.623ms, % non-child: 22.88%) BytesReceived(500.000ms): 10.30 MB, 24.85 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.509ms - DeserializeRowBatchTimer: 129.677ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.61 M/sec - SendersBlockedTimer: 364.663ms - SendersBlockedTotalTimer(*): 6s524ms HASH_JOIN_NODE (id=8):(Total: 20s160ms, non-child: 336.946ms, % non-child: 1.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 187.402ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 344.662ms - GetNewBlockTime: 389.364us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 270.31 MB (283440736) - PinTime: 0.000ns - ProbeRows: 1.41M (1406842) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 326.323ms - RowsReturned: 1.38M (1376229) - RowsReturnedRate: 68.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.182us EXCHANGE_NODE (id=15):(Total: 1s078ms, non-child: 125.162ms, % non-child: 11.61%) BytesReceived(500.000ms): 0, 0, 7.61 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 71.249ms - DeserializeRowBatchTimer: 126.793ms - FirstBatchArrivalWaitTime: 813.534ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s825ms, non-child: 83.051ms, % non-child: 0.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.446us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 6.752us - GetNewBlockTime: 83.318us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.45 MB (3622032) - PinTime: 0.000ns - ProbeRows: 1.41M (1406842) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 75.548ms - RowsReturned: 1.41M (1406842) - RowsReturnedRate: 70.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.066us EXCHANGE_NODE (id=14):(Total: 7.188us, non-child: 7.188us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.388us - DeserializeRowBatchTimer: 5.780us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s742ms, non-child: 121.064ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 67.224us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 54.820us - GetNewBlockTime: 100.108us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.92 MB (3059488) - PinTime: 0.000ns - ProbeRows: 1.41M (1406842) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.013ms - RowsReturned: 1.41M (1406842) - RowsReturnedRate: 71.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1000.000ns EXCHANGE_NODE (id=13):(Total: 18.526us, non-child: 18.526us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.784us - DeserializeRowBatchTimer: 73.040us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 31.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s621ms, non-child: 19s621ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 12 Hdfs split stats (:<# splits>/): 7:30/7.11 GB 1:31/6.87 GB 4:34/7.75 GB 3:32/7.38 GB 10:38/8.44 GB 5:30/7.19 GB 2:33/7.73 GB 6:23/5.41 GB 0:32/7.30 GB 9:29/6.30 GB 8:28/6.33 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s273ms Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:2.381% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:328 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 436.46 MB, 473.41 MB, 473.41 MB, 473.41 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.40 - BytesRead: 473.41 MB (496405384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 473.41 MB (496405384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 473.41 MB (496405384) - DecompressionTime: 931.629ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 575.12 MB (603054472) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.20M (77197265) - RowsReturned: 1.41M (1406842) - RowsReturnedRate: 71.70 K/sec - ScanRangesComplete: 340 (340) - ScannerThreadsInvoluntaryContextSwitches: 5.33K (5325) - ScannerThreadsTotalWallClockTime: 7m52s - MaterializeTupleTime(*): 17s650ms - ScannerThreadsSysTime: 16s960ms - ScannerThreadsUserTime: 21s519ms - ScannerThreadsVoluntaryContextSwitches: 384.60K (384604) - TotalRawHdfsReadTime(*): 317.224ms - TotalReadThroughput: 22.02 MB/sec Filter 0: - Rows processed: 196.60K (196596) - Rows rejected: 4.65K (4646) - Rows total: 196.61K (196608) Filter 2: - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) Filter 3: - Files processed: 340 (340) - Files rejected: 328 (328) - Files total: 340 (340) - RowGroups processed: 558.97K (558969) - RowGroups rejected: 0 (0) - RowGroups total: 558.97K (558969) - Rows processed: 196.60K (196596) - Rows rejected: 0 (0) - Rows total: 196.61K (196608) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 4: - Rows processed: 77.19M (77192619) - Rows rejected: 75.79M (75785777) - Rows total: 77.19M (77192619) Instance 3045db9f916d3ae1:2b6258aae4211ec6 (host=d2414.halxg.cloudera.com:22000):(Total: 21s213ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:29/6.35 GB 10:38/8.86 GB 3:36/8.25 GB 1:31/6.22 GB 2:31/6.61 GB 8:32/7.31 GB 7:30/6.37 GB 4:26/5.80 GB 9:32/6.94 GB 5:33/7.59 GB 0:34/7.59 GB Filter 4 arrival: 729ms Filter 0 arrival: 729ms Filter 3 arrival: 731ms MemoryUsage(500.000ms): 2.33 MB, 27.87 MB, 145.48 MB, 342.59 MB, 398.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 804.67 MB, 753.03 MB, 720.09 MB, 524.48 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.95 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 810.16 MB (849509304) - PerHostPeakMemUsage: 819.42 MB (859222968) - PrepareTime: 191.313ms - RowsProduced: 301 (301) - TotalCpuTime: 8m20s - TotalNetworkReceiveTime: 1s293ms - TotalNetworkSendTime: 3.242ms - TotalStorageWaitTime: 196.008ms CodeGen:(Total: 704.688ms, non-child: 704.688ms, % non-child: 100.00%) - CodegenTime: 2.322ms - CompileTime: 141.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 389.268ms - PrepareTime: 172.337ms DataStreamSender (dst_id=18):(Total: 162.452us, non-child: 162.452us, % non-child: 100.00%) - BytesSent: 17.63 KB (18058) - NetworkThroughput(*): 6.28 MB/sec - OverallThroughput: 106.01 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 276.992us - ThriftTransmitTime(*): 2.741ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s201ms, non-child: 319.349ms, % non-child: 1.51%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.884us - GetResultsTime: 96.466us - HTResizeTime: 310.186us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.21 MB (7562584) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 150.464ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s882ms, non-child: 115.633ms, % non-child: 0.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.840us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.470us - GetNewBlockTime: 171.974us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.50 MB (5767528) - PinTime: 0.000ns - ProbeRows: 807.28K (807277) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 103.585ms - RowsReturned: 798.57K (798572) - RowsReturnedRate: 38.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.230us EXCHANGE_NODE (id=17):(Total: 11.960us, non-child: 11.960us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.180us - DeserializeRowBatchTimer: 7.050us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s767ms, non-child: 234.717ms, % non-child: 1.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 154.698ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 161.310ms - GetNewBlockTime: 783.642us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 203.58 MB (213466928) - PinTime: 0.000ns - ProbeRows: 807.28K (807277) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 226.078ms - RowsReturned: 807.28K (807277) - RowsReturnedRate: 38.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.152us EXCHANGE_NODE (id=16):(Total: 299.077ms, non-child: 61.649ms, % non-child: 20.61%) BytesReceived(500.000ms): 327.98 KB, 10.28 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 35.617ms - DeserializeRowBatchTimer: 125.913ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.44 M/sec - SendersBlockedTimer: 350.078ms - SendersBlockedTotalTimer(*): 5s921ms HASH_JOIN_NODE (id=8):(Total: 20s533ms, non-child: 227.935ms, % non-child: 1.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 176.951ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 341.621ms - GetNewBlockTime: 506.366us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 267.57 MB (280567600) - PinTime: 0.000ns - ProbeRows: 827.86K (827864) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 218.848ms - RowsReturned: 807.28K (807277) - RowsReturnedRate: 39.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 994.000ns EXCHANGE_NODE (id=15):(Total: 1s102ms, non-child: 125.551ms, % non-child: 11.39%) BytesReceived(500.000ms): 0, 0, 0, 21.28 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 65.721ms - DeserializeRowBatchTimer: 139.753ms - FirstBatchArrivalWaitTime: 826.874ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s307ms, non-child: 47.301ms, % non-child: 0.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 4.592us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.668us - GetNewBlockTime: 401.358us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.97 MB (3116000) - PinTime: 0.000ns - ProbeRows: 827.86K (827864) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.199ms - RowsReturned: 827.86K (827864) - RowsReturnedRate: 40.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.020us EXCHANGE_NODE (id=14):(Total: 8.468us, non-child: 8.468us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.810us - DeserializeRowBatchTimer: 8.786us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s259ms, non-child: 66.809ms, % non-child: 0.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 67.558us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 63.586us - GetNewBlockTime: 110.878us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.88 MB (3016736) - PinTime: 0.000ns - ProbeRows: 827.86K (827864) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 56.392ms - RowsReturned: 827.86K (827864) - RowsReturnedRate: 40.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 908.000ns EXCHANGE_NODE (id=13):(Total: 31.158us, non-child: 31.158us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 25.278us - DeserializeRowBatchTimer: 101.104us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 18.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 20s192ms, non-child: 20s192ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 7 Hdfs split stats (:<# splits>/): 6:29/6.35 GB 10:38/8.86 GB 3:36/8.25 GB 1:31/6.22 GB 2:31/6.61 GB 8:32/7.31 GB 7:30/6.37 GB 4:26/5.80 GB 9:32/6.94 GB 5:33/7.59 GB 0:34/7.59 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s272ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:345 PARQUET/SNAPPY:28 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 276.19 MB, 276.19 MB, 276.19 MB, 276.19 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.90 - BytesRead: 276.19 MB (289606239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 276.19 MB (289606239) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 276.19 MB (289606239) - DecompressionTime: 550.912ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 335.74 MB (352052440) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 45.27M (45267952) - RowsReturned: 827.86K (827864) - RowsReturnedRate: 41.00 K/sec - ScanRangesComplete: 352 (352) - ScannerThreadsInvoluntaryContextSwitches: 5.17K (5170) - ScannerThreadsTotalWallClockTime: 7m57s - MaterializeTupleTime(*): 10s536ms - ScannerThreadsSysTime: 23s923ms - ScannerThreadsUserTime: 14s101ms - ScannerThreadsVoluntaryContextSwitches: 434.07K (434067) - TotalRawHdfsReadTime(*): 182.814ms - TotalReadThroughput: 12.55 MB/sec Filter 0: - Rows processed: 114.68K (114681) - Rows rejected: 2.81K (2813) - Rows total: 114.69K (114688) Filter 2: - Rows processed: 114.68K (114681) - Rows rejected: 0 (0) - Rows total: 114.69K (114688) Filter 3: - Files processed: 352 (352) - Files rejected: 345 (345) - Files total: 352 (352) - RowGroups processed: 324.41K (324410) - RowGroups rejected: 0 (0) - RowGroups total: 324.41K (324410) - Rows processed: 114.68K (114681) - Rows rejected: 0 (0) - Rows total: 114.69K (114688) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Filter 4: - Rows processed: 45.27M (45265139) - Rows rejected: 44.44M (44437275) - Rows total: 45.27M (45265139) Instance 3045db9f916d3ae1:2b6258aae4211ed5 (host=d2402.halxg.cloudera.com:22000):(Total: 21s208ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:29/6.47 GB 4:25/5.55 GB 6:32/6.87 GB 3:40/9.60 GB 1:30/6.82 GB 10:30/6.77 GB 7:31/7.02 GB 5:32/7.21 GB 2:29/6.36 GB 9:32/6.89 GB 0:38/8.43 GB Filter 4 arrival: 749ms Filter 0 arrival: 752ms Filter 3 arrival: 752ms MemoryUsage(500.000ms): 1.11 MB, 27.85 MB, 169.46 MB, 342.52 MB, 430.46 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 940.30 MB, 881.78 MB, 793.72 MB, 499.15 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.95 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 946.48 MB (992451728) - PerHostPeakMemUsage: 955.75 MB (1002173584) - PrepareTime: 193.154ms - RowsProduced: 301 (301) - TotalCpuTime: 8m21s - TotalNetworkReceiveTime: 1s061ms - TotalNetworkSendTime: 2.851ms - TotalStorageWaitTime: 625.564ms CodeGen:(Total: 724.117ms, non-child: 724.117ms, % non-child: 100.00%) - CodegenTime: 2.517ms - CompileTime: 147.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 402.171ms - PrepareTime: 173.503ms DataStreamSender (dst_id=18):(Total: 185.982us, non-child: 185.982us, % non-child: 100.00%) - BytesSent: 17.72 KB (18143) - NetworkThroughput(*): 7.02 MB/sec - OverallThroughput: 93.03 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 296.891us - ThriftTransmitTime(*): 2.465ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s195ms, non-child: 501.911ms, % non-child: 2.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 67.401us - GetResultsTime: 105.580us - HTResizeTime: 275.196us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.56 MB (6878840) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 325.778ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s693ms, non-child: 278.321ms, % non-child: 1.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.723us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 14.159us - GetNewBlockTime: 274.267us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.55 MB (5824120) - PinTime: 0.000ns - ProbeRows: 1.16M (1156885) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.622ms - RowsReturned: 1.15M (1145469) - RowsReturnedRate: 55.35 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.661us EXCHANGE_NODE (id=17):(Total: 11.986us, non-child: 11.986us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.752us - DeserializeRowBatchTimer: 17.815us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s415ms, non-child: 366.534ms, % non-child: 1.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 141.526ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 150.113ms - GetNewBlockTime: 901.323us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 205.15 MB (215114576) - PinTime: 0.000ns - ProbeRows: 1.16M (1156885) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 357.333ms - RowsReturned: 1.16M (1156885) - RowsReturnedRate: 56.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.362us EXCHANGE_NODE (id=16):(Total: 206.740ms, non-child: 64.864ms, % non-child: 31.38%) BytesReceived(500.000ms): 367.03 KB, 10.26 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 32.990ms - DeserializeRowBatchTimer: 139.443ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 9.31 M/sec - SendersBlockedTimer: 457.770ms - SendersBlockedTotalTimer(*): 7s349ms HASH_JOIN_NODE (id=8):(Total: 20s049ms, non-child: 257.892ms, % non-child: 1.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 206.293ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 317.797ms - GetNewBlockTime: 646.046us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.37 MB (281409312) - PinTime: 0.000ns - ProbeRows: 1.18M (1181351) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 247.454ms - RowsReturned: 1.16M (1156885) - RowsReturnedRate: 57.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 957.000ns EXCHANGE_NODE (id=15):(Total: 965.464ms, non-child: 126.175ms, % non-child: 13.07%) BytesReceived(500.000ms): 0, 0, 0, 30.90 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 71.779ms - DeserializeRowBatchTimer: 124.849ms - FirstBatchArrivalWaitTime: 719.650ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s793ms, non-child: 70.209ms, % non-child: 0.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.605us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 9.595us - GetNewBlockTime: 144.251us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.01 MB (3151160) - PinTime: 0.000ns - ProbeRows: 1.18M (1181351) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 62.753ms - RowsReturned: 1.18M (1181351) - RowsReturnedRate: 59.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.135us EXCHANGE_NODE (id=14):(Total: 8.272us, non-child: 8.272us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.656us - DeserializeRowBatchTimer: 9.772us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s723ms, non-child: 100.739ms, % non-child: 0.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 70.424us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 76.454us - GetNewBlockTime: 289.209us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.94 MB (3078920) - PinTime: 0.000ns - ProbeRows: 1.18M (1181351) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 89.628ms - RowsReturned: 1.18M (1181351) - RowsReturnedRate: 59.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 917.000ns EXCHANGE_NODE (id=13):(Total: 19.484us, non-child: 19.484us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.880us - DeserializeRowBatchTimer: 81.711us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 30.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s622ms, non-child: 19s622ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 8:29/6.47 GB 4:25/5.55 GB 6:32/6.87 GB 3:40/9.60 GB 1:30/6.82 GB 10:30/6.77 GB 7:31/7.02 GB 5:32/7.21 GB 2:29/6.36 GB 9:32/6.89 GB 0:38/8.43 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s253ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:338 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 388.11 MB, 388.11 MB, 388.11 MB, 388.11 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.90 - BytesRead: 388.11 MB (406965843) - BytesReadDataNodeCache: 0 - BytesReadLocal: 388.11 MB (406965843) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 388.11 MB (406965843) - DecompressionTime: 785.737ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 472.53 MB (495481832) - PerReadThreadRawHdfsThroughput: 959.84 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 63.62M (63621061) - RowsReturned: 1.18M (1181351) - RowsReturnedRate: 60.20 K/sec - ScanRangesComplete: 348 (348) - ScannerThreadsInvoluntaryContextSwitches: 5.59K (5589) - ScannerThreadsTotalWallClockTime: 7m58s - MaterializeTupleTime(*): 13s995ms - ScannerThreadsSysTime: 19s460ms - ScannerThreadsUserTime: 17s607ms - ScannerThreadsVoluntaryContextSwitches: 365.08K (365080) - TotalRawHdfsReadTime(*): 404.353ms - TotalReadThroughput: 17.64 MB/sec Filter 0: - Rows processed: 163.83K (163830) - Rows rejected: 3.87K (3873) - Rows total: 163.84K (163840) Filter 2: - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) Filter 3: - Files processed: 348 (348) - Files rejected: 338 (338) - Files total: 348 (348) - RowGroups processed: 456.45K (456452) - RowGroups rejected: 0 (0) - RowGroups total: 456.45K (456452) - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 63.62M (63617188) - Rows rejected: 62.44M (62435837) - Rows total: 63.62M (63617188) Instance 3045db9f916d3ae1:2b6258aae4211ec9 (host=d2407.halxg.cloudera.com:22000):(Total: 21s171ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:40/8.97 GB 6:33/7.32 GB 9:26/5.62 GB 10:25/5.79 GB 8:31/6.97 GB 7:31/6.83 GB 1:29/6.56 GB 0:37/7.95 GB 3:31/6.81 GB 4:33/7.45 GB 5:35/7.72 GB Filter 0 arrival: 728ms Filter 3 arrival: 730ms Filter 4 arrival: 730ms MemoryUsage(500.000ms): 0, 27.85 MB, 141.50 MB, 350.57 MB, 382.46 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 469.45 MB, 893.24 MB, 840.97 MB, 753.10 MB, 497.43 MB ThreadUsage(500.000ms): 1, 1, 3, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.48 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 898.85 MB (942511072) - PerHostPeakMemUsage: 908.11 MB (952224736) - PrepareTime: 188.512ms - RowsProduced: 301 (301) - TotalCpuTime: 8m13s - TotalNetworkReceiveTime: 1s293ms - TotalNetworkSendTime: 3.530ms - TotalStorageWaitTime: 256.387ms CodeGen:(Total: 704.183ms, non-child: 704.183ms, % non-child: 100.00%) - CodegenTime: 2.322ms - CompileTime: 143.072ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 389.841ms - PrepareTime: 169.821ms DataStreamSender (dst_id=18):(Total: 164.500us, non-child: 164.500us, % non-child: 100.00%) - BytesSent: 17.70 KB (18123) - NetworkThroughput(*): 5.73 MB/sec - OverallThroughput: 105.07 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 286.886us - ThriftTransmitTime(*): 3.015ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s159ms, non-child: 366.460ms, % non-child: 1.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 69.408us - GetResultsTime: 95.570us - HTResizeTime: 427.394us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.22 MB (6517120) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 199.458ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s793ms, non-child: 146.460ms, % non-child: 0.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 6.694us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.948us - GetNewBlockTime: 246.146us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.47 MB (4692152) - PinTime: 0.000ns - ProbeRows: 1.05M (1045290) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.639ms - RowsReturned: 1.04M (1035245) - RowsReturnedRate: 49.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.190us EXCHANGE_NODE (id=17):(Total: 18.960us, non-child: 18.960us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.200us - DeserializeRowBatchTimer: 6.522us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 3.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s646ms, non-child: 268.864ms, % non-child: 1.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 150.854ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 160.215ms - GetNewBlockTime: 627.820us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.07 MB (213983088) - PinTime: 0.000ns - ProbeRows: 1.05M (1045290) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 260.246ms - RowsReturned: 1.05M (1045290) - RowsReturnedRate: 50.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.254us EXCHANGE_NODE (id=16):(Total: 305.256ms, non-child: 59.984ms, % non-child: 19.65%) BytesReceived(500.000ms): 10.28 MB, 27.83 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 35.138ms - DeserializeRowBatchTimer: 122.262ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.31 M/sec - SendersBlockedTimer: 348.268ms - SendersBlockedTotalTimer(*): 5s892ms HASH_JOIN_NODE (id=8):(Total: 20s378ms, non-child: 303.750ms, % non-child: 1.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 180.758ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 341.664ms - GetNewBlockTime: 380.990us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.06 MB (281083760) - PinTime: 0.000ns - ProbeRows: 1.07M (1068002) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 293.860ms - RowsReturned: 1.05M (1045290) - RowsReturnedRate: 51.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.150us EXCHANGE_NODE (id=15):(Total: 1s097ms, non-child: 133.820ms, % non-child: 12.20%) BytesReceived(500.000ms): 0, 0, 13.72 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 67.150ms - DeserializeRowBatchTimer: 140.586ms - FirstBatchArrivalWaitTime: 825.700ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 20s076ms, non-child: 58.076ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 14.772us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 8.882us - GetNewBlockTime: 99.698us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.29 MB (3445256) - PinTime: 0.000ns - ProbeRows: 1.07M (1068002) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.357ms - RowsReturned: 1.07M (1068002) - RowsReturnedRate: 53.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.042us EXCHANGE_NODE (id=14):(Total: 8.508us, non-child: 8.508us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.820us - DeserializeRowBatchTimer: 5.004us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 20s018ms, non-child: 92.557ms, % non-child: 0.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 68.348us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 57.840us - GetNewBlockTime: 94.816us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.06 MB (3209640) - PinTime: 0.000ns - ProbeRows: 1.07M (1068002) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 80.465ms - RowsReturned: 1.07M (1068002) - RowsReturnedRate: 53.35 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.052us EXCHANGE_NODE (id=13):(Total: 19.554us, non-child: 19.554us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 12.660us - DeserializeRowBatchTimer: 73.052us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 30.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s926ms, non-child: 19s926ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 2:40/8.97 GB 6:33/7.32 GB 9:26/5.62 GB 10:25/5.79 GB 8:31/6.97 GB 7:31/6.83 GB 1:29/6.56 GB 0:37/7.95 GB 3:31/6.81 GB 4:33/7.45 GB 5:35/7.72 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s272ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:341 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 350.62 MB, 350.62 MB, 350.62 MB, 350.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.40 - BytesRead: 350.62 MB (367646625) - BytesReadDataNodeCache: 0 - BytesReadLocal: 350.62 MB (367646625) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 350.62 MB (367646625) - DecompressionTime: 686.551ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 424.58 MB (445207944) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 58.14M (58140598) - RowsReturned: 1.07M (1068002) - RowsReturnedRate: 53.60 K/sec - ScanRangesComplete: 351 (351) - ScannerThreadsInvoluntaryContextSwitches: 5.01K (5012) - ScannerThreadsTotalWallClockTime: 7m51s - MaterializeTupleTime(*): 12s465ms - ScannerThreadsSysTime: 21s405ms - ScannerThreadsUserTime: 15s903ms - ScannerThreadsVoluntaryContextSwitches: 366.15K (366146) - TotalRawHdfsReadTime(*): 249.758ms - TotalReadThroughput: 16.31 MB/sec Filter 0: - Rows processed: 163.83K (163830) - Rows rejected: 3.81K (3812) - Rows total: 163.84K (163840) Filter 2: - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) Filter 3: - Files processed: 351 (351) - Files rejected: 341 (341) - Files total: 351 (351) - RowGroups processed: 416.36K (416360) - RowGroups rejected: 0 (0) - RowGroups total: 416.36K (416360) - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 58.14M (58136786) - Rows rejected: 57.07M (57068784) - Rows total: 58.14M (58136786) Instance 3045db9f916d3ae1:2b6258aae4211ecd (host=d2403.halxg.cloudera.com:22000):(Total: 21s123ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:34/7.47 GB 6:31/6.87 GB 7:32/7.11 GB 1:33/7.40 GB 4:31/6.86 GB 8:29/6.80 GB 5:34/8.13 GB 2:29/6.44 GB 3:28/6.58 GB 9:31/6.89 GB 0:34/7.50 GB Filter 0 arrival: 744ms Filter 4 arrival: 746ms Filter 3 arrival: 747ms MemoryUsage(500.000ms): 0, 27.87 MB, 141.51 MB, 354.66 MB, 382.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 947.62 MB, 879.51 MB, 824.68 MB, 499.08 MB ThreadUsage(500.000ms): 1, 1, 18, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.82 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 953.38 MB (999696056) - PerHostPeakMemUsage: 962.65 MB (1009409720) - PrepareTime: 194.675ms - RowsProduced: 301 (301) - TotalCpuTime: 8m18s - TotalNetworkReceiveTime: 1s250ms - TotalNetworkSendTime: 5.977ms - TotalStorageWaitTime: 323.032ms CodeGen:(Total: 721.831ms, non-child: 721.831ms, % non-child: 100.00%) - CodegenTime: 2.359ms - CompileTime: 144.654ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 399.646ms - PrepareTime: 176.076ms DataStreamSender (dst_id=18):(Total: 169.234us, non-child: 169.234us, % non-child: 100.00%) - BytesSent: 17.74 KB (18164) - NetworkThroughput(*): 4.03 MB/sec - OverallThroughput: 102.36 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 336.214us - ThriftTransmitTime(*): 4.295ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 21s108ms, non-child: 435.330ms, % non-child: 2.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 74.184us - GetResultsTime: 85.754us - HTResizeTime: 297.288us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.53 MB (7893688) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 261.507ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s673ms, non-child: 187.919ms, % non-child: 0.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 7.426us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.528us - GetNewBlockTime: 152.146us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.79 MB (6069296) - PinTime: 0.000ns - ProbeRows: 1.20M (1202403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 175.091ms - RowsReturned: 1.19M (1188261) - RowsReturnedRate: 57.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.102us EXCHANGE_NODE (id=17):(Total: 11.662us, non-child: 11.662us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.388us - DeserializeRowBatchTimer: 6.862us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s485ms, non-child: 366.738ms, % non-child: 1.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 144.580ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 163.108ms - GetNewBlockTime: 804.210us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.48 MB (214416448) - PinTime: 0.000ns - ProbeRows: 1.20M (1202403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 358.090ms - RowsReturned: 1.20M (1202403) - RowsReturnedRate: 58.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.190us EXCHANGE_NODE (id=16):(Total: 292.698ms, non-child: 56.952ms, % non-child: 19.46%) BytesReceived(500.000ms): 10.26 MB, 27.32 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 33.852ms - DeserializeRowBatchTimer: 124.355ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.58 M/sec - SendersBlockedTimer: 366.961ms - SendersBlockedTotalTimer(*): 5s851ms HASH_JOIN_NODE (id=8):(Total: 20s119ms, non-child: 326.164ms, % non-child: 1.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 198.307ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 346.160ms - GetNewBlockTime: 240.752us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 268.48 MB (281517120) - PinTime: 0.000ns - ProbeRows: 1.23M (1226625) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 316.240ms - RowsReturned: 1.20M (1202403) - RowsReturnedRate: 59.76 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 990.000ns EXCHANGE_NODE (id=15):(Total: 1s062ms, non-child: 124.719ms, % non-child: 11.73%) BytesReceived(500.000ms): 0, 0, 12.78 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 65.560ms - DeserializeRowBatchTimer: 139.837ms - FirstBatchArrivalWaitTime: 808.436ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s795ms, non-child: 84.312ms, % non-child: 0.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 3.528us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.362us - GetNewBlockTime: 137.310us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.15 MB (3298056) - PinTime: 0.000ns - ProbeRows: 1.23M (1226625) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 77.018ms - RowsReturned: 1.23M (1226625) - RowsReturnedRate: 61.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 908.000ns EXCHANGE_NODE (id=14):(Total: 7.490us, non-child: 7.490us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.408us - DeserializeRowBatchTimer: 6.130us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s710ms, non-child: 103.618ms, % non-child: 0.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 62.564us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 58.964us - GetNewBlockTime: 72.172us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.85 MB (2986368) - PinTime: 0.000ns - ProbeRows: 1.23M (1226625) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.423ms - RowsReturned: 1.23M (1226625) - RowsReturnedRate: 62.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 898.000ns EXCHANGE_NODE (id=13):(Total: 17.738us, non-child: 17.738us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.196us - DeserializeRowBatchTimer: 87.630us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 33.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s607ms, non-child: 19s607ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 10:34/7.47 GB 6:31/6.87 GB 7:32/7.11 GB 1:33/7.40 GB 4:31/6.86 GB 8:29/6.80 GB 5:34/8.13 GB 2:29/6.44 GB 3:28/6.58 GB 9:31/6.89 GB 0:34/7.50 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s270ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:336 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 394.42 MB, 394.42 MB, 394.42 MB, 394.42 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.76 - BytesRead: 394.42 MB (413582427) - BytesReadDataNodeCache: 0 - BytesReadLocal: 394.42 MB (413582427) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 394.42 MB (413582427) - DecompressionTime: 777.714ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 478.94 MB (502205152) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 65.21M (65210419) - RowsReturned: 1.23M (1226625) - RowsReturnedRate: 62.56 K/sec - ScanRangesComplete: 346 (346) - ScannerThreadsInvoluntaryContextSwitches: 6.00K (6002) - ScannerThreadsTotalWallClockTime: 7m55s - MaterializeTupleTime(*): 13s770ms - ScannerThreadsSysTime: 18s517ms - ScannerThreadsUserTime: 17s155ms - ScannerThreadsVoluntaryContextSwitches: 333.70K (333696) - TotalRawHdfsReadTime(*): 262.099ms - TotalReadThroughput: 18.35 MB/sec Filter 0: - Rows processed: 163.83K (163830) - Rows rejected: 3.99K (3990) - Rows total: 163.84K (163840) Filter 2: - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) Filter 3: - Files processed: 346 (346) - Files rejected: 336 (336) - Files total: 346 (346) - RowGroups processed: 468.71K (468711) - RowGroups rejected: 0 (0) - RowGroups total: 468.71K (468711) - Rows processed: 163.83K (163830) - Rows rejected: 0 (0) - Rows total: 163.84K (163840) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 4: - Rows processed: 65.21M (65206429) - Rows rejected: 63.98M (63979804) - Rows total: 65.21M (65206429) Instance 3045db9f916d3ae1:2b6258aae4211ec7 (host=d2405.halxg.cloudera.com:22000):(Total: 20s939ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:29/6.89 GB 10:30/7.10 GB 5:43/9.22 GB 4:32/6.98 GB 9:32/6.85 GB 8:32/7.27 GB 0:29/6.25 GB 2:30/6.59 GB 7:29/6.50 GB 1:34/7.67 GB 6:30/6.78 GB Filter 4 arrival: 728ms Filter 0 arrival: 730ms Filter 3 arrival: 729ms MemoryUsage(500.000ms): 10.04 MB, 141.51 MB, 181.48 MB, 342.65 MB, 430.48 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 469.46 MB, 904.43 MB, 832.73 MB, 689.12 MB ThreadUsage(500.000ms): 1, 18, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.33 - BloomFilterBytes: 7.00 MB (7340032) - PeakMemoryUsage: 905.85 MB (949849312) - PerHostPeakMemUsage: 915.11 MB (959562976) - PrepareTime: 189.553ms - RowsProduced: 301 (301) - TotalCpuTime: 8m14s - TotalNetworkReceiveTime: 1s300ms - TotalNetworkSendTime: 3.489ms - TotalStorageWaitTime: 291.497ms CodeGen:(Total: 703.642ms, non-child: 703.642ms, % non-child: 100.00%) - CodegenTime: 2.330ms - CompileTime: 142.020ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939820) - OptimizationTime: 389.536ms - PrepareTime: 170.530ms DataStreamSender (dst_id=18):(Total: 161.440us, non-child: 161.440us, % non-child: 100.00%) - BytesSent: 17.75 KB (18181) - NetworkThroughput(*): 5.57 MB/sec - OverallThroughput: 107.40 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 312.636us - ThriftTransmitTime(*): 3.113ms - UncompressedRowBatchSize: 28.12 KB (28800) AGGREGATION_NODE (id=11):(Total: 20s928ms, non-child: 382.679ms, % non-child: 1.83%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.536us - GetResultsTime: 97.548us - HTResizeTime: 498.140us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.99 MB (8376208) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 301 (301) - RowsReturnedRate: 14.00 /sec - StreamingTime: 215.104ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 20s546ms, non-child: 153.142ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 7.306us - BuildRows: 62 (62) - BuildRowsPartitioned: 62 (62) - BuildTime: 11.124us - GetNewBlockTime: 178.500us - HashBuckets: 128 (128) - HashCollisions: 0 (0) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.98 MB (7321488) - PinTime: 0.000ns - ProbeRows: 1.04M (1042709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 141.183ms - RowsReturned: 1.03M (1031407) - RowsReturnedRate: 50.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=17):(Total: 11.802us, non-child: 11.802us, % non-child: 100.00%) BytesReceived(500.000ms): 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB, 1.07 KB - BytesReceived: 1.07 KB (1097) - ConvertRowBatchTime: 2.262us - DeserializeRowBatchTimer: 8.084us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 5.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 20s393ms, non-child: 275.674ms, % non-child: 1.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 153.739ms - BuildRows: 1.93M (1925000) - BuildRowsPartitioned: 1.93M (1925000) - BuildTime: 163.254ms - GetNewBlockTime: 818.560us - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 206.58 MB (216613792) - PinTime: 0.000ns - ProbeRows: 1.04M (1042709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.132ms - RowsReturned: 1.04M (1042709) - RowsReturnedRate: 51.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.314us EXCHANGE_NODE (id=16):(Total: 302.931ms, non-child: 58.250ms, % non-child: 19.23%) BytesReceived(500.000ms): 3.28 MB, 10.39 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB, 31.14 MB - BytesReceived: 31.14 MB (32650814) - ConvertRowBatchTime: 34.787ms - DeserializeRowBatchTimer: 123.167ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.93M (1925000) - RowsReturnedRate: 6.35 M/sec - SendersBlockedTimer: 349.014ms - SendersBlockedTotalTimer(*): 5s896ms HASH_JOIN_NODE (id=8):(Total: 20s118ms, non-child: 316.944ms, % non-child: 1.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 173.710ms - BuildRows: 3.85M (3850000) - BuildRowsPartitioned: 3.85M (3850000) - BuildTime: 345.011ms - GetNewBlockTime: 467.400us - HashBuckets: 8.39M (8388608) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 270.57 MB (283714464) - PinTime: 0.000ns - ProbeRows: 1.07M (1069768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 307.503ms - RowsReturned: 1.04M (1042709) - RowsReturnedRate: 51.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 984.000ns EXCHANGE_NODE (id=15):(Total: 1s104ms, non-child: 132.061ms, % non-child: 11.96%) BytesReceived(500.000ms): 0, 0, 0, 35.90 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB, 54.85 MB - BytesReceived: 54.85 MB (57512492) - ConvertRowBatchTime: 65.945ms - DeserializeRowBatchTimer: 139.412ms - FirstBatchArrivalWaitTime: 825.254ms - PeakMemoryUsage: 0 - RowsReturned: 3.85M (3850000) - RowsReturnedRate: 3.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 19s803ms, non-child: 61.075ms, % non-child: 0.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 2.870us - BuildRows: 30 (30) - BuildRowsPartitioned: 30 (30) - BuildTime: 7.028us - GetNewBlockTime: 125.492us - HashBuckets: 68 (68) - HashCollisions: 0 (0) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.17 MB (4367536) - PinTime: 0.000ns - ProbeRows: 1.07M (1069768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54.094ms - RowsReturned: 1.07M (1069768) - RowsReturnedRate: 54.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 942.000ns EXCHANGE_NODE (id=14):(Total: 6.832us, non-child: 6.832us, % non-child: 100.00%) BytesReceived(500.000ms): 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B, 300.00 B - BytesReceived: 300.00 B (300) - ConvertRowBatchTime: 1.484us - DeserializeRowBatchTimer: 5.062us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 19s742ms, non-child: 94.107ms, % non-child: 0.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 69.784us - BuildRows: 591 (591) - BuildRowsPartitioned: 591 (591) - BuildTime: 60.176us - GetNewBlockTime: 977.712us - HashBuckets: 1.09K (1088) - HashCollisions: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.98 MB (3128256) - PinTime: 0.000ns - ProbeRows: 1.07M (1069768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 82.020ms - RowsReturned: 1.07M (1069768) - RowsReturnedRate: 54.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 934.000ns EXCHANGE_NODE (id=13):(Total: 17.948us, non-child: 17.948us, % non-child: 100.00%) BytesReceived(500.000ms): 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB, 25.67 KB - BytesReceived: 25.67 KB (26288) - ConvertRowBatchTime: 11.936us - DeserializeRowBatchTimer: 100.204us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 591 (591) - RowsReturnedRate: 32.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 19s647ms, non-child: 19s647ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): 3:29/6.89 GB 10:30/7.10 GB 5:43/9.22 GB 4:32/6.98 GB 9:32/6.85 GB 8:32/7.27 GB 0:29/6.25 GB 2:30/6.59 GB 7:29/6.50 GB 1:34/7.67 GB 6:30/6.78 GB Runtime filters: Only following filters arrived: 0, 3, 4, waited 19s274ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:341 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 354.98 MB, 354.98 MB, 354.98 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.71 - BytesRead: 354.98 MB (372218847) - BytesReadDataNodeCache: 0 - BytesReadLocal: 354.98 MB (372218847) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 354.98 MB (372218847) - DecompressionTime: 666.536ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 431.28 MB (452228216) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 58.01M (58011177) - RowsReturned: 1.07M (1069768) - RowsReturnedRate: 54.45 K/sec - ScanRangesComplete: 350 (350) - ScannerThreadsInvoluntaryContextSwitches: 4.42K (4415) - ScannerThreadsTotalWallClockTime: 7m51s - MaterializeTupleTime(*): 11s881ms - ScannerThreadsSysTime: 17s475ms - ScannerThreadsUserTime: 14s844ms - ScannerThreadsVoluntaryContextSwitches: 296.75K (296750) - TotalRawHdfsReadTime(*): 243.774ms - TotalReadThroughput: 16.51 MB/sec Filter 0: - Rows processed: 147.45K (147447) - Rows rejected: 3.36K (3364) - Rows total: 147.46K (147456) Filter 2: - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) Filter 3: - Files processed: 350 (350) - Files rejected: 341 (341) - Files total: 350 (350) - RowGroups processed: 416.75K (416754) - RowGroups rejected: 0 (0) - RowGroups total: 416.75K (416754) - Rows processed: 147.45K (147447) - Rows rejected: 0 (0) - Rows total: 147.46K (147456) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 4: - Rows processed: 58.01M (58007813) - Rows rejected: 56.94M (56938045) - Rows total: 58.01M (58007813) Fragment F05: Instance 3045db9f916d3ae1:2b6258aae4211ed7 (host=d2415.halxg.cloudera.com:22000):(Total: 301.774ms, non-child: 297.445ms, % non-child: 98.57%) Hdfs split stats (:<# splits>/): 2:1/11.92 KB MemoryUsage(500.000ms): 88.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 158.00 KB (161792) - PerHostPeakMemUsage: 12.41 MB (13015384) - PrepareTime: 84.746us - RowsProduced: 62 (62) - TotalCpuTime: 13.010ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 291.487ms - TotalStorageWaitTime: 3.642ms DataStreamSender (dst_id=17):(Total: 139.784us, non-child: 139.784us, % non-child: 100.00%) - BytesSent: 21.43 KB (21940) - NetworkThroughput(*): 5.35 KB/sec - OverallThroughput: 149.69 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 26.430us - ThriftTransmitTime(*): 4s005ms - UncompressedRowBatchSize: 49.63 KB (50820) HDFS_SCAN_NODE (id=5):(Total: 4.188ms, non-child: 4.188ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/11.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.59 KB (12892) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.59 KB (12892) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.59 KB (12892) - DecompressionTime: 3.030us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 70.00 KB (71680) - PerReadThreadRawHdfsThroughput: 655.37 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62 (62) - RowsReturned: 62 (62) - RowsReturnedRate: 14.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.956ms - MaterializeTupleTime(*): 9.824us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 18.760us - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 3045db9f916d3ae1:2b6258aae4211eda (host=d2417.halxg.cloudera.com:22000):(Total: 1s172ms, non-child: 4.291ms, % non-child: 0.37%) Hdfs split stats (:<# splits>/): 0:1/2.01 MB 2:1/2.01 MB MemoryUsage(500.000ms): 10.68 MB, 9.30 MB, 6.68 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.10 MB (12688400) - PerHostPeakMemUsage: 176.52 MB (185096664) - PrepareTime: 104.654us - RowsProduced: 192.63K (192632) - TotalCpuTime: 100.296ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s107ms - TotalStorageWaitTime: 9.108ms DataStreamSender (dst_id=16):(Total: 1s159ms, non-child: 1s159ms, % non-child: 100.00%) - BytesSent: 62.25 MB (65274220) - NetworkThroughput(*): 5.09 MB/sec - OverallThroughput: 53.71 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 36.365ms - ThriftTransmitTime(*): 12s232ms - UncompressedRowBatchSize: 150.08 MB (157375060) HDFS_SCAN_NODE (id=4):(Total: 8.705ms, non-child: 8.705ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 0:1/2.01 MB 2:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 1.42 MB, 1.42 MB, 1.42 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.42 MB (1486864) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.42 MB (1486864) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.42 MB (1486864) - DecompressionTime: 2.688ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 11.98 MB (12565520) - PerReadThreadRawHdfsThroughput: 2.92 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.63K (192632) - RowsReturned: 192.63K (192632) - RowsReturnedRate: 22.13 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 42.587ms - MaterializeTupleTime(*): 24.819ms - ScannerThreadsSysTime: 5.998ms - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 40 (40) - TotalRawHdfsReadTime(*): 474.152us - TotalReadThroughput: 968.01 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee1 (host=d2414.halxg.cloudera.com:22000):(Total: 1s168ms, non-child: 6.144ms, % non-child: 0.53%) Hdfs split stats (:<# splits>/): 7:1/2.01 MB 4:1/2.01 MB MemoryUsage(500.000ms): 10.64 MB, 9.18 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.10 MB (12685928) - PerHostPeakMemUsage: 176.23 MB (184787672) - PrepareTime: 118.084us - RowsProduced: 192.38K (192376) - TotalCpuTime: 93.476ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s105ms - TotalStorageWaitTime: 9.582ms DataStreamSender (dst_id=16):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) - BytesSent: 62.24 MB (65263600) - NetworkThroughput(*): 4.84 MB/sec - OverallThroughput: 53.94 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 35.036ms - ThriftTransmitTime(*): 12s868ms - UncompressedRowBatchSize: 149.89 MB (157174560) HDFS_SCAN_NODE (id=4):(Total: 8.400ms, non-child: 8.400ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 7:1/2.01 MB 4:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 1.42 MB, 1.42 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.42 MB (1485519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.42 MB (1485519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.42 MB (1485519) - DecompressionTime: 3.157ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 11.98 MB (12563048) - PerReadThreadRawHdfsThroughput: 2.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.38K (192376) - RowsReturned: 192.38K (192376) - RowsReturnedRate: 22.90 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 37.874ms - MaterializeTupleTime(*): 19.935ms - ScannerThreadsSysTime: 4.998ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 549.786us - TotalReadThroughput: 1.42 MB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee9 (host=d2420.halxg.cloudera.com:22000):(Total: 1s133ms, non-child: 10.353ms, % non-child: 0.91%) Hdfs split stats (:<# splits>/): 6:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 4.22 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318984) - PerHostPeakMemUsage: 181.92 MB (190757344) - PrepareTime: 148.958us - RowsProduced: 96.25K (96249) - TotalCpuTime: 90.175ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s065ms - TotalStorageWaitTime: 6.373ms DataStreamSender (dst_id=16):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) - BytesSent: 31.12 MB (32636100) - NetworkThroughput(*): 3.81 MB/sec - OverallThroughput: 28.01 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 29.497ms - ThriftTransmitTime(*): 8s162ms - UncompressedRowBatchSize: 75.00 MB (78644300) HDFS_SCAN_NODE (id=4):(Total: 11.519ms, non-child: 11.519ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.75 KB, 725.75 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.75 KB (743170) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.75 KB (743170) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.75 KB (743170) - DecompressionTime: 2.243ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196104) - PerReadThreadRawHdfsThroughput: 1.65 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96249) - RowsReturned: 96.25K (96249) - RowsReturnedRate: 8.36 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 25.809ms - MaterializeTupleTime(*): 13.564ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 11.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 419.992us - TotalReadThroughput: 725.75 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee4 (host=d2415.halxg.cloudera.com:22000):(Total: 1s132ms, non-child: 4.643ms, % non-child: 0.41%) Hdfs split stats (:<# splits>/): 3:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 3.89 MB, 2.00 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318984) - PerHostPeakMemUsage: 171.06 MB (179369312) - PrepareTime: 92.130us - RowsProduced: 96.25K (96249) - TotalCpuTime: 43.212ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s103ms - TotalStorageWaitTime: 2.340ms DataStreamSender (dst_id=16):(Total: 1s123ms, non-child: 1s123ms, % non-child: 100.00%) - BytesSent: 31.20 MB (32713760) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 27.78 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 13.221ms - ThriftTransmitTime(*): 12s449ms - UncompressedRowBatchSize: 75.00 MB (78645600) HDFS_SCAN_NODE (id=4):(Total: 5.002ms, non-child: 5.002ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.47 KB, 725.47 KB, 725.47 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.47 KB (742885) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.47 KB (742885) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.47 KB (742885) - DecompressionTime: 934.538us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196104) - PerReadThreadRawHdfsThroughput: 2.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96249) - RowsReturned: 96.25K (96249) - RowsReturnedRate: 19.24 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 14.077ms - MaterializeTupleTime(*): 8.858ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 290.652us - TotalReadThroughput: 483.65 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee5 (host=d2403.halxg.cloudera.com:22000):(Total: 1s130ms, non-child: 6.425ms, % non-child: 0.57%) Hdfs split stats (:<# splits>/): 1:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 4.06 MB, 1.44 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6317752) - PerHostPeakMemUsage: 171.11 MB (179419064) - PrepareTime: 99.810us - RowsProduced: 96.12K (96122) - TotalCpuTime: 47.265ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s096ms - TotalStorageWaitTime: 4.563ms DataStreamSender (dst_id=16):(Total: 1s116ms, non-child: 1s116ms, % non-child: 100.00%) - BytesSent: 31.13 MB (32637700) - NetworkThroughput(*): 4.40 MB/sec - OverallThroughput: 27.87 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 14.073ms - ThriftTransmitTime(*): 7s074ms - UncompressedRowBatchSize: 74.90 MB (78539560) HDFS_SCAN_NODE (id=4):(Total: 7.363ms, non-child: 7.363ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 724.81 KB, 724.81 KB, 724.81 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 724.81 KB (742204) - BytesReadDataNodeCache: 0 - BytesReadLocal: 724.81 KB (742204) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 724.81 KB (742204) - DecompressionTime: 1.194ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6194872) - PerReadThreadRawHdfsThroughput: 2.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.12K (96122) - RowsReturned: 96.12K (96122) - RowsReturnedRate: 13.05 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 15.671ms - MaterializeTupleTime(*): 7.980ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 232.914us - TotalReadThroughput: 483.21 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee6 (host=d2408.halxg.cloudera.com:22000):(Total: 1s129ms, non-child: 4.554ms, % non-child: 0.40%) Hdfs split stats (:<# splits>/): 6:1/2.01 MB MemoryUsage(500.000ms): 3.89 MB, 3.08 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.07 MB (6361192) - PerHostPeakMemUsage: 170.80 MB (179094984) - PrepareTime: 104.692us - RowsProduced: 96.38K (96379) - TotalCpuTime: 50.474ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s093ms - TotalStorageWaitTime: 4.062ms DataStreamSender (dst_id=16):(Total: 1s117ms, non-child: 1s117ms, % non-child: 100.00%) - BytesSent: 31.23 MB (32743460) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 27.94 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 16.552ms - ThriftTransmitTime(*): 12s435ms - UncompressedRowBatchSize: 75.10 MB (78744780) HDFS_SCAN_NODE (id=4):(Total: 7.221ms, non-child: 7.221ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 726.27 KB, 726.27 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 726.27 KB (743703) - BytesReadDataNodeCache: 0 - BytesReadLocal: 726.27 KB (743703) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 726.27 KB (743703) - DecompressionTime: 1.216ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.95 MB (6238312) - PerReadThreadRawHdfsThroughput: 2.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.38K (96379) - RowsReturned: 96.38K (96379) - RowsReturnedRate: 13.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.132ms - MaterializeTupleTime(*): 8.675ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 275.240us - TotalReadThroughput: 726.27 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211edc (host=d2411.halxg.cloudera.com:22000):(Total: 1s128ms, non-child: 5.773ms, % non-child: 0.51%) Hdfs split stats (:<# splits>/): 0:1/2.01 MB MemoryUsage(500.000ms): 3.81 MB, 3.81 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318984) - PerHostPeakMemUsage: 170.62 MB (178903776) - PrepareTime: 93.216us - RowsProduced: 96.25K (96249) - TotalCpuTime: 50.635ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s094ms - TotalStorageWaitTime: 4.277ms DataStreamSender (dst_id=16):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) - BytesSent: 31.17 MB (32684300) - NetworkThroughput(*): 2.50 MB/sec - OverallThroughput: 27.96 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 15.015ms - ThriftTransmitTime(*): 12s462ms - UncompressedRowBatchSize: 75.00 MB (78644100) HDFS_SCAN_NODE (id=4):(Total: 7.937ms, non-child: 7.937ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.70 KB, 725.70 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.70 KB (743119) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.70 KB (743119) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.70 KB (743119) - DecompressionTime: 1.312ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196104) - PerReadThreadRawHdfsThroughput: 2.80 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96249) - RowsReturned: 96.25K (96249) - RowsReturnedRate: 12.13 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 17.629ms - MaterializeTupleTime(*): 9.102ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 247.082us - TotalReadThroughput: 725.70 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211edf (host=d2416.halxg.cloudera.com:22000):(Total: 1s127ms, non-child: 6.404ms, % non-child: 0.57%) Hdfs split stats (:<# splits>/): 10:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 4.10 MB, 1.15 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6319000) - PerHostPeakMemUsage: 171.02 MB (179328392) - PrepareTime: 101.470us - RowsProduced: 96.25K (96251) - TotalCpuTime: 51.347ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s090ms - TotalStorageWaitTime: 4.141ms DataStreamSender (dst_id=16):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) - BytesSent: 31.12 MB (32627480) - NetworkThroughput(*): 2.92 MB/sec - OverallThroughput: 27.92 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 17.671ms - ThriftTransmitTime(*): 10s660ms - UncompressedRowBatchSize: 75.00 MB (78642240) HDFS_SCAN_NODE (id=4):(Total: 7.193ms, non-child: 7.193ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.58 KB, 725.58 KB, 725.58 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.58 KB (742998) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.58 KB (742998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.58 KB (742998) - DecompressionTime: 987.002us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196120) - PerReadThreadRawHdfsThroughput: 2.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96251) - RowsReturned: 96.25K (96251) - RowsReturnedRate: 13.38 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 15.916ms - MaterializeTupleTime(*): 8.942ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 244.424us - TotalReadThroughput: 483.72 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee2 (host=d2413.halxg.cloudera.com:22000):(Total: 1s127ms, non-child: 5.126ms, % non-child: 0.45%) Hdfs split stats (:<# splits>/): 7:1/2.01 MB MemoryUsage(500.000ms): 4.14 MB, 3.89 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6319000) - PerHostPeakMemUsage: 171.41 MB (179736792) - PrepareTime: 94.820us - RowsProduced: 96.25K (96251) - TotalCpuTime: 47.054ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s094ms - TotalStorageWaitTime: 4.835ms DataStreamSender (dst_id=16):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) - BytesSent: 31.10 MB (32609080) - NetworkThroughput(*): 2.59 MB/sec - OverallThroughput: 27.90 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 13.157ms - ThriftTransmitTime(*): 11s992ms - UncompressedRowBatchSize: 75.00 MB (78639140) HDFS_SCAN_NODE (id=4):(Total: 7.695ms, non-child: 7.695ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.70 KB, 725.70 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.70 KB (743121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.70 KB (743121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.70 KB (743121) - DecompressionTime: 884.898us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196120) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96251) - RowsReturned: 96.25K (96251) - RowsReturnedRate: 12.51 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 16.638ms - MaterializeTupleTime(*): 8.846ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 491.122us - TotalReadThroughput: 725.70 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211edb (host=d2407.halxg.cloudera.com:22000):(Total: 1s125ms, non-child: 6.845ms, % non-child: 0.61%) Hdfs split stats (:<# splits>/): 1:1/2.00 MB MemoryUsage(500.000ms): 5.28 MB, 3.88 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6317728) - PerHostPeakMemUsage: 170.87 MB (179167976) - PrepareTime: 98.332us - RowsProduced: 96.12K (96120) - TotalCpuTime: 48.394ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s091ms - TotalStorageWaitTime: 4.319ms DataStreamSender (dst_id=16):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) - BytesSent: 31.08 MB (32587360) - NetworkThroughput(*): 2.49 MB/sec - OverallThroughput: 27.96 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 16.079ms - ThriftTransmitTime(*): 12s457ms - UncompressedRowBatchSize: 74.90 MB (78540320) HDFS_SCAN_NODE (id=4):(Total: 7.130ms, non-child: 7.130ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/2.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.22 KB, 725.22 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.22 KB (742630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.22 KB (742630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.22 KB (742630) - DecompressionTime: 982.690us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6194848) - PerReadThreadRawHdfsThroughput: 2.77 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.12K (96120) - RowsReturned: 96.12K (96120) - RowsReturnedRate: 13.48 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 16.088ms - MaterializeTupleTime(*): 8.887ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 249.704us - TotalReadThroughput: 725.22 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee3 (host=d2406.halxg.cloudera.com:22000):(Total: 1s124ms, non-child: 5.634ms, % non-child: 0.50%) Hdfs split stats (:<# splits>/): 10:1/2.01 MB MemoryUsage(500.000ms): 3.92 MB, 3.92 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318984) - PerHostPeakMemUsage: 171.01 MB (179318424) - PrepareTime: 104.474us - RowsProduced: 96.25K (96249) - TotalCpuTime: 51.959ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s086ms - TotalStorageWaitTime: 4.155ms DataStreamSender (dst_id=16):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) - BytesSent: 31.15 MB (32658640) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 28.02 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 16.990ms - ThriftTransmitTime(*): 12s419ms - UncompressedRowBatchSize: 75.00 MB (78642300) HDFS_SCAN_NODE (id=4):(Total: 7.154ms, non-child: 7.154ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.46 KB, 725.46 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.46 KB (742874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.46 KB (742874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.46 KB (742874) - DecompressionTime: 968.324us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196104) - PerReadThreadRawHdfsThroughput: 2.85 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96249) - RowsReturned: 96.25K (96249) - RowsReturnedRate: 13.45 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 16.049ms - MaterializeTupleTime(*): 8.718ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 242.822us - TotalReadThroughput: 725.46 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ed8 (host=d2418.halxg.cloudera.com:22000):(Total: 1s122ms, non-child: 9.243ms, % non-child: 0.82%) Hdfs split stats (:<# splits>/): 0:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 3.85 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318960) - PerHostPeakMemUsage: 170.85 MB (179144808) - PrepareTime: 90.726us - RowsProduced: 96.25K (96248) - TotalCpuTime: 51.807ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s085ms - TotalStorageWaitTime: 5.260ms DataStreamSender (dst_id=16):(Total: 1s104ms, non-child: 1s104ms, % non-child: 100.00%) - BytesSent: 31.10 MB (32614560) - NetworkThroughput(*): 2.50 MB/sec - OverallThroughput: 28.16 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 15.723ms - ThriftTransmitTime(*): 12s449ms - UncompressedRowBatchSize: 74.99 MB (78635480) HDFS_SCAN_NODE (id=4):(Total: 8.564ms, non-child: 8.564ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.28 KB, 725.28 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.28 KB (742686) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.28 KB (742686) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.28 KB (742686) - DecompressionTime: 1.034ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196080) - PerReadThreadRawHdfsThroughput: 2.83 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96248) - RowsReturned: 96.25K (96248) - RowsReturnedRate: 11.24 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 17.948ms - MaterializeTupleTime(*): 9.270ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 244.134us - TotalReadThroughput: 725.28 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211edd (host=d2419.halxg.cloudera.com:22000):(Total: 1s120ms, non-child: 4.607ms, % non-child: 0.41%) Hdfs split stats (:<# splits>/): 4:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 3.96 MB, 1.11 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318960) - PerHostPeakMemUsage: 171.05 MB (179359336) - PrepareTime: 88.220us - RowsProduced: 96.25K (96248) - TotalCpuTime: 45.210ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s089ms - TotalStorageWaitTime: 3.856ms DataStreamSender (dst_id=16):(Total: 1s109ms, non-child: 1s109ms, % non-child: 100.00%) - BytesSent: 31.17 MB (32683200) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 28.10 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 13.269ms - ThriftTransmitTime(*): 12s439ms - UncompressedRowBatchSize: 74.99 MB (78634080) HDFS_SCAN_NODE (id=4):(Total: 6.921ms, non-child: 6.921ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.60 KB, 725.60 KB, 725.60 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.60 KB (743014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.60 KB (743014) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.60 KB (743014) - DecompressionTime: 1.002ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196080) - PerReadThreadRawHdfsThroughput: 2.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96248) - RowsReturned: 96.25K (96248) - RowsReturnedRate: 13.91 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 15.767ms - MaterializeTupleTime(*): 8.589ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 27 (27) - TotalRawHdfsReadTime(*): 277.317us - TotalReadThroughput: 483.73 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee7 (host=d2404.halxg.cloudera.com:22000):(Total: 1s119ms, non-child: 6.565ms, % non-child: 0.59%) Hdfs split stats (:<# splits>/): 3:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 4.10 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318992) - PerHostPeakMemUsage: 171.18 MB (179490584) - PrepareTime: 90.522us - RowsProduced: 96.25K (96250) - TotalCpuTime: 47.135ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s085ms - TotalStorageWaitTime: 3.875ms DataStreamSender (dst_id=16):(Total: 1s106ms, non-child: 1s106ms, % non-child: 100.00%) - BytesSent: 31.11 MB (32625860) - NetworkThroughput(*): 3.14 MB/sec - OverallThroughput: 28.12 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 16.016ms - ThriftTransmitTime(*): 9s915ms - UncompressedRowBatchSize: 75.00 MB (78642920) HDFS_SCAN_NODE (id=4):(Total: 6.668ms, non-child: 6.668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.59 KB, 725.59 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.59 KB (743001) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.59 KB (743001) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.59 KB (743001) - DecompressionTime: 916.050us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196112) - PerReadThreadRawHdfsThroughput: 2.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96250) - RowsReturned: 96.25K (96250) - RowsReturnedRate: 14.43 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 14.919ms - MaterializeTupleTime(*): 8.126ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 255.626us - TotalReadThroughput: 725.59 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ed9 (host=d2402.halxg.cloudera.com:22000):(Total: 1s117ms, non-child: 9.215ms, % non-child: 0.82%) Hdfs split stats (:<# splits>/): 0:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 4.07 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318960) - PerHostPeakMemUsage: 171.28 MB (179601320) - PrepareTime: 189.349us - RowsProduced: 96.25K (96248) - TotalCpuTime: 64.364ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s072ms - TotalStorageWaitTime: 10.536ms DataStreamSender (dst_id=16):(Total: 1s093ms, non-child: 1s093ms, % non-child: 100.00%) - BytesSent: 31.19 MB (32702040) - NetworkThroughput(*): 3.50 MB/sec - OverallThroughput: 28.51 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 17.290ms - ThriftTransmitTime(*): 8s909ms - UncompressedRowBatchSize: 75.00 MB (78645280) HDFS_SCAN_NODE (id=4):(Total: 14.612ms, non-child: 14.612ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.62 KB, 725.62 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.62 KB (743040) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.62 KB (743040) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.62 KB (743040) - DecompressionTime: 2.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196080) - PerReadThreadRawHdfsThroughput: 682.10 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96248) - RowsReturned: 96.25K (96248) - RowsReturnedRate: 6.59 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 27.287ms - MaterializeTupleTime(*): 11.460ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 1.038ms - TotalReadThroughput: 725.62 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ede (host=d2409.halxg.cloudera.com:22000):(Total: 1s116ms, non-child: 7.601ms, % non-child: 0.68%) Hdfs split stats (:<# splits>/): 1:1/2.01 MB MemoryUsage(500.000ms): 5.28 MB, 3.89 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6318960) - PerHostPeakMemUsage: 170.84 MB (179139704) - PrepareTime: 114.100us - RowsProduced: 96.25K (96248) - TotalCpuTime: 46.241ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s084ms - TotalStorageWaitTime: 3.433ms DataStreamSender (dst_id=16):(Total: 1s102ms, non-child: 1s102ms, % non-child: 100.00%) - BytesSent: 31.09 MB (32599060) - NetworkThroughput(*): 2.50 MB/sec - OverallThroughput: 28.20 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 14.626ms - ThriftTransmitTime(*): 12s440ms - UncompressedRowBatchSize: 75.00 MB (78639580) HDFS_SCAN_NODE (id=4):(Total: 6.529ms, non-child: 6.529ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.46 KB, 725.46 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.46 KB (742872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.46 KB (742872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.46 KB (742872) - DecompressionTime: 1.130ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196080) - PerReadThreadRawHdfsThroughput: 2.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96248) - RowsReturned: 96.25K (96248) - RowsReturnedRate: 14.74 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 15.378ms - MaterializeTupleTime(*): 8.490ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 285.620us - TotalReadThroughput: 725.46 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee0 (host=d2405.halxg.cloudera.com:22000):(Total: 1s113ms, non-child: 7.223ms, % non-child: 0.65%) Hdfs split stats (:<# splits>/): 1:1/2.01 MB MemoryUsage(500.000ms): 4.85 MB, 3.85 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.03 MB (6319000) - PerHostPeakMemUsage: 170.89 MB (179190696) - PrepareTime: 91.800us - RowsProduced: 96.25K (96251) - TotalCpuTime: 53.517ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s072ms - TotalStorageWaitTime: 4.504ms DataStreamSender (dst_id=16):(Total: 1s098ms, non-child: 1s098ms, % non-child: 100.00%) - BytesSent: 31.17 MB (32682640) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 28.36 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 17.948ms - ThriftTransmitTime(*): 12s402ms - UncompressedRowBatchSize: 75.00 MB (78638140) HDFS_SCAN_NODE (id=4):(Total: 7.103ms, non-child: 7.103ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 725.81 KB, 725.81 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 725.81 KB (743231) - BytesReadDataNodeCache: 0 - BytesReadLocal: 725.81 KB (743231) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 725.81 KB (743231) - DecompressionTime: 1.176ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.91 MB (6196120) - PerReadThreadRawHdfsThroughput: 2.94 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.25K (96251) - RowsReturned: 96.25K (96251) - RowsReturnedRate: 13.55 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 15.849ms - MaterializeTupleTime(*): 8.317ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 235.760us - TotalReadThroughput: 725.81 KB/sec Instance 3045db9f916d3ae1:2b6258aae4211ee8 (host=d2410.halxg.cloudera.com:22000):(Total: 1s097ms, non-child: 4.806ms, % non-child: 0.44%) Hdfs split stats (:<# splits>/): 2:1/2.01 MB MemoryUsage(500.000ms): 3.85 MB, 3.46 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.07 MB (6361200) - PerHostPeakMemUsage: 171.89 MB (180244632) - PrepareTime: 110.002us - RowsProduced: 96.38K (96380) - TotalCpuTime: 52.491ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s058ms - TotalStorageWaitTime: 4.084ms DataStreamSender (dst_id=16):(Total: 1s085ms, non-child: 1s085ms, % non-child: 100.00%) - BytesSent: 31.16 MB (32673220) - NetworkThroughput(*): 2.52 MB/sec - OverallThroughput: 28.70 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 17.301ms - ThriftTransmitTime(*): 12s375ms - UncompressedRowBatchSize: 75.10 MB (78747900) HDFS_SCAN_NODE (id=4):(Total: 6.931ms, non-child: 6.931ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/2.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 726.00 KB, 726.00 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 726.00 KB (743419) - BytesReadDataNodeCache: 0 - BytesReadLocal: 726.00 KB (743419) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 726.00 KB (743419) - DecompressionTime: 1.040ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.95 MB (6238320) - PerReadThreadRawHdfsThroughput: 2.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 96.38K (96380) - RowsReturned: 96.38K (96380) - RowsReturnedRate: 13.90 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 15.472ms - MaterializeTupleTime(*): 8.326ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 299.324us - TotalReadThroughput: 726.00 KB/sec Fragment F03: Instance 3045db9f916d3ae1:2b6258aae4211ef6 (host=d2419.halxg.cloudera.com:22000):(Total: 1s991ms, non-child: 4.947ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 2:1/10.68 MB 0:1/10.68 MB Filter 1 arrival: 1s531ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 18.49 MB ThreadUsage(500.000ms): 1, 1, 1, 3 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 19.04 MB (19965448) - PerHostPeakMemUsage: 379.75 MB (398195360) - PrepareTime: 64.599us - RowsProduced: 385.00K (384999) - TotalCpuTime: 2s870ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 372.659ms - TotalStorageWaitTime: 4.797ms DataStreamSender (dst_id=15):(Total: 433.643ms, non-child: 433.643ms, % non-child: 100.00%) - BytesSent: 110.61 MB (115983540) - NetworkThroughput(*): 51.21 MB/sec - OverallThroughput: 255.07 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 37.096ms - ThriftTransmitTime(*): 2s159ms - UncompressedRowBatchSize: 205.64 MB (215629520) HDFS_SCAN_NODE (id=3):(Total: 1s553ms, non-child: 1s553ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 2:1/10.68 MB 0:1/10.68 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 3.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 3.81 MB (3990193) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.81 MB (3990193) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.81 MB (3990193) - DecompressionTime: 11.747ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.89 MB (19806304) - PerReadThreadRawHdfsThroughput: 2.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 385.00K (384999) - RowsReturned: 385.00K (384999) - RowsReturnedRate: 247.91 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s253ms - MaterializeTupleTime(*): 358.286ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 38.993ms - ScannerThreadsVoluntaryContextSwitches: 145 (145) - TotalRawHdfsReadTime(*): 1.489ms - TotalReadThroughput: 1.90 MB/sec Filter 1: - Rows processed: 32.77K (32766) - Rows rejected: 0 (0) - Rows total: 32.77K (32768) Instance 3045db9f916d3ae1:2b6258aae4211ef2 (host=d2411.halxg.cloudera.com:22000):(Total: 1s988ms, non-child: 4.978ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 9:1/10.68 MB 7:1/10.68 MB Filter 1 arrival: 1s534ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 11.21 MB ThreadUsage(500.000ms): 1, 1, 3, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 19.04 MB (19965776) - PerHostPeakMemUsage: 380.80 MB (399301264) - PrepareTime: 92.622us - RowsProduced: 385.00K (385000) - TotalCpuTime: 2s832ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 368.792ms - TotalStorageWaitTime: 5.424ms DataStreamSender (dst_id=15):(Total: 430.458ms, non-child: 430.458ms, % non-child: 100.00%) - BytesSent: 109.43 MB (114747460) - NetworkThroughput(*): 48.09 MB/sec - OverallThroughput: 254.22 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 36.653ms - ThriftTransmitTime(*): 2s275ms - UncompressedRowBatchSize: 205.64 MB (215630080) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/10.68 MB 7:1/10.68 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 3.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 3.81 MB (3990031) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.81 MB (3990031) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.81 MB (3990031) - DecompressionTime: 13.743ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.91 MB (19823888) - PerReadThreadRawHdfsThroughput: 2.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 385.00K (385000) - RowsReturned: 385.00K (385000) - RowsReturnedRate: 247.94 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 1s215ms - MaterializeTupleTime(*): 336.445ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 145 (145) - TotalRawHdfsReadTime(*): 1.550ms - TotalReadThroughput: 1.90 MB/sec Filter 1: - Rows processed: 32.77K (32766) - Rows rejected: 0 (0) - Rows total: 32.77K (32768) Instance 3045db9f916d3ae1:2b6258aae4211ef8 (host=d2418.halxg.cloudera.com:22000):(Total: 1s981ms, non-child: 5.223ms, % non-child: 0.26%) Hdfs split stats (:<# splits>/): 5:1/10.69 MB 3:1/10.66 MB Filter 1 arrival: 1s527ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 13.64 MB ThreadUsage(500.000ms): 1, 1, 3, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 19.04 MB (19965832) - PerHostPeakMemUsage: 380.88 MB (399377008) - PrepareTime: 91.112us - RowsProduced: 384.48K (384484) - TotalCpuTime: 2s645ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 379.102ms - TotalStorageWaitTime: 5.367ms DataStreamSender (dst_id=15):(Total: 442.633ms, non-child: 442.633ms, % non-child: 100.00%) - BytesSent: 110.66 MB (116031080) - NetworkThroughput(*): 48.83 MB/sec - OverallThroughput: 249.99 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 43.937ms - ThriftTransmitTime(*): 2s266ms - UncompressedRowBatchSize: 205.37 MB (215341120) HDFS_SCAN_NODE (id=3):(Total: 1s533ms, non-child: 1s533ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/10.69 MB 3:1/10.66 MB Runtime filters: All filters arrived. Waited 1s525ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 3.80 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 3.80 MB (3985379) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.80 MB (3985379) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.80 MB (3985379) - DecompressionTime: 11.499ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.91 MB (19823944) - PerReadThreadRawHdfsThroughput: 2.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 384.48K (384484) - RowsReturned: 384.48K (384484) - RowsReturnedRate: 250.67 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 1s045ms - MaterializeTupleTime(*): 191.248ms - ScannerThreadsSysTime: 3.998ms - ScannerThreadsUserTime: 42.992ms - ScannerThreadsVoluntaryContextSwitches: 119 (119) - TotalRawHdfsReadTime(*): 1.246ms - TotalReadThroughput: 1.90 MB/sec Filter 1: - Rows processed: 32.77K (32766) - Rows rejected: 0 (0) - Rows total: 32.77K (32768) Instance 3045db9f916d3ae1:2b6258aae4211ef0 (host=d2405.halxg.cloudera.com:22000):(Total: 1s918ms, non-child: 6.051ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 8:1/10.69 MB Filter 1 arrival: 1s536ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 3.28 MB ThreadUsage(500.000ms): 1, 1, 2, 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.90 MB (11433088) - PerHostPeakMemUsage: 370.29 MB (388274064) - PrepareTime: 75.202us - RowsProduced: 192.50K (192500) - TotalCpuTime: 2s053ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.576ms - TotalStorageWaitTime: 2.938ms DataStreamSender (dst_id=15):(Total: 360.248ms, non-child: 360.248ms, % non-child: 100.00%) - BytesSent: 55.33 MB (58020780) - NetworkThroughput(*): 40.34 MB/sec - OverallThroughput: 153.60 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 24.349ms - ThriftTransmitTime(*): 1s371ms - UncompressedRowBatchSize: 102.82 MB (107815040) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/10.69 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 1.90 MB (1994999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1994999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1994999) - DecompressionTime: 5.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.77 MB (11291200) - PerReadThreadRawHdfsThroughput: 2.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192500) - RowsReturned: 192.50K (192500) - RowsReturnedRate: 124.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 461.220ms - MaterializeTupleTime(*): 13.784ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 16.997ms - ScannerThreadsVoluntaryContextSwitches: 26 (26) - TotalRawHdfsReadTime(*): 696.080us - TotalReadThroughput: 974.12 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eeb (host=d2412.halxg.cloudera.com:22000):(Total: 1s917ms, non-child: 5.479ms, % non-child: 0.29%) Hdfs split stats (:<# splits>/): 3:1/10.69 MB Filter 1 arrival: 1s543ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 3.81 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.81 MB (11334896) - PerHostPeakMemUsage: 369.25 MB (387189168) - PrepareTime: 92.704us - RowsProduced: 192.50K (192500) - TotalCpuTime: 1s626ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 323.122ms - TotalStorageWaitTime: 4.108ms DataStreamSender (dst_id=15):(Total: 355.587ms, non-child: 355.587ms, % non-child: 100.00%) - BytesSent: 54.75 MB (57406940) - NetworkThroughput(*): 43.23 MB/sec - OverallThroughput: 153.96 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 21.386ms - ThriftTransmitTime(*): 1s266ms - UncompressedRowBatchSize: 102.82 MB (107815040) HDFS_SCAN_NODE (id=3):(Total: 1s555ms, non-child: 1s555ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/10.69 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.90 MB (1994841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1994841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1994841) - DecompressionTime: 6.573ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.67 MB (11193008) - PerReadThreadRawHdfsThroughput: 2.63 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192500) - RowsReturned: 192.50K (192500) - RowsReturnedRate: 123.72 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 34.257ms - MaterializeTupleTime(*): 19.514ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 705.414us - TotalReadThroughput: 974.04 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef9 (host=d2404.halxg.cloudera.com:22000):(Total: 1s915ms, non-child: 4.293ms, % non-child: 0.22%) Hdfs split stats (:<# splits>/): 10:1/10.69 MB Filter 1 arrival: 1s528ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 7.63 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.91 MB (11437208) - PerHostPeakMemUsage: 370.50 MB (388499368) - PrepareTime: 82.910us - RowsProduced: 192.76K (192757) - TotalCpuTime: 3s114ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.565ms - TotalStorageWaitTime: 2.386ms DataStreamSender (dst_id=15):(Total: 359.622ms, non-child: 359.622ms, % non-child: 100.00%) - BytesSent: 52.40 MB (54942120) - NetworkThroughput(*): 40.98 MB/sec - OverallThroughput: 145.70 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 19.955ms - ThriftTransmitTime(*): 1s278ms - UncompressedRowBatchSize: 102.96 MB (107959040) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/10.69 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 1.90 MB (1997454) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1997454) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1997454) - DecompressionTime: 5.177ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.77 MB (11295320) - PerReadThreadRawHdfsThroughput: 2.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.76K (192757) - RowsReturned: 192.76K (192757) - RowsReturnedRate: 124.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 1s523ms - MaterializeTupleTime(*): 13.890ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 16.997ms - ScannerThreadsVoluntaryContextSwitches: 80 (80) - TotalRawHdfsReadTime(*): 625.342us - TotalReadThroughput: 975.32 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef3 (host=d2415.halxg.cloudera.com:22000):(Total: 1s915ms, non-child: 4.234ms, % non-child: 0.22%) Hdfs split stats (:<# splits>/): 0:1/10.67 MB Filter 1 arrival: 1s531ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 8.59 MB ThreadUsage(500.000ms): 1, 2, 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.93 MB (11461728) - PerHostPeakMemUsage: 370.38 MB (388368224) - PrepareTime: 87.672us - RowsProduced: 192.24K (192243) - TotalCpuTime: 2s868ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 327.616ms - TotalStorageWaitTime: 2.838ms DataStreamSender (dst_id=15):(Total: 359.697ms, non-child: 359.697ms, % non-child: 100.00%) - BytesSent: 54.99 MB (57658880) - NetworkThroughput(*): 40.45 MB/sec - OverallThroughput: 152.87 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 17.857ms - ThriftTransmitTime(*): 1s359ms - UncompressedRowBatchSize: 102.68 MB (107671120) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/10.67 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 1.90 MB (1992702) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1992702) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1992702) - DecompressionTime: 5.546ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.80 MB (11319840) - PerReadThreadRawHdfsThroughput: 2.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.24K (192243) - RowsReturned: 192.24K (192243) - RowsReturnedRate: 123.86 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 1s277ms - MaterializeTupleTime(*): 12.629ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 70 (70) - TotalRawHdfsReadTime(*): 751.144us - TotalReadThroughput: 973.00 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eee (host=d2416.halxg.cloudera.com:22000):(Total: 1s915ms, non-child: 5.594ms, % non-child: 0.29%) Hdfs split stats (:<# splits>/): 8:1/10.69 MB Filter 1 arrival: 1s540ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 7.59 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.87 MB (11400224) - PerHostPeakMemUsage: 369.79 MB (387749632) - PrepareTime: 129.476us - RowsProduced: 192.50K (192502) - TotalCpuTime: 2s035ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 323.801ms - TotalStorageWaitTime: 2.672ms DataStreamSender (dst_id=15):(Total: 358.595ms, non-child: 358.595ms, % non-child: 100.00%) - BytesSent: 56.21 MB (58942560) - NetworkThroughput(*): 41.66 MB/sec - OverallThroughput: 156.76 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 20.462ms - ThriftTransmitTime(*): 1s349ms - UncompressedRowBatchSize: 102.82 MB (107816160) HDFS_SCAN_NODE (id=3):(Total: 1s551ms, non-child: 1s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/10.69 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.90 MB (1995055) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1995055) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1995055) - DecompressionTime: 5.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.74 MB (11258336) - PerReadThreadRawHdfsThroughput: 2.79 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192502) - RowsReturned: 192.50K (192502) - RowsReturnedRate: 124.06 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 444.258ms - MaterializeTupleTime(*): 13.784ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 665.084us - TotalReadThroughput: 974.15 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef1 (host=d2417.halxg.cloudera.com:22000):(Total: 1s914ms, non-child: 4.554ms, % non-child: 0.24%) Hdfs split stats (:<# splits>/): 8:1/10.70 MB Filter 1 arrival: 1s535ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 7.63 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.84 MB (11371472) - PerHostPeakMemUsage: 369.86 MB (387827360) - PrepareTime: 69.684us - RowsProduced: 192.76K (192756) - TotalCpuTime: 3s131ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 319.508ms - TotalStorageWaitTime: 2.244ms DataStreamSender (dst_id=15):(Total: 357.563ms, non-child: 357.563ms, % non-child: 100.00%) - BytesSent: 55.33 MB (58021260) - NetworkThroughput(*): 40.99 MB/sec - OverallThroughput: 154.75 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 22.908ms - ThriftTransmitTime(*): 1s349ms - UncompressedRowBatchSize: 102.96 MB (107958480) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/10.70 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 1.90 MB (1997150) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1997150) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1997150) - DecompressionTime: 6.127ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.71 MB (11229584) - PerReadThreadRawHdfsThroughput: 2.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.76K (192756) - RowsReturned: 192.76K (192756) - RowsReturnedRate: 124.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s531ms - MaterializeTupleTime(*): 17.179ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 80 (80) - TotalRawHdfsReadTime(*): 709.938us - TotalReadThroughput: 975.17 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eec (host=d2406.halxg.cloudera.com:22000):(Total: 1s913ms, non-child: 6.527ms, % non-child: 0.34%) Hdfs split stats (:<# splits>/): 8:1/10.69 MB Filter 1 arrival: 1s542ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.93 MB (11465896) - PerHostPeakMemUsage: 370.85 MB (388863928) - PrepareTime: 126.390us - RowsProduced: 192.50K (192500) - TotalCpuTime: 3s165ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 315.631ms - TotalStorageWaitTime: 3.287ms DataStreamSender (dst_id=15):(Total: 353.772ms, non-child: 353.772ms, % non-child: 100.00%) - BytesSent: 53.73 MB (56344560) - NetworkThroughput(*): 39.88 MB/sec - OverallThroughput: 151.89 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 24.366ms - ThriftTransmitTime(*): 1s347ms - UncompressedRowBatchSize: 102.82 MB (107815040) HDFS_SCAN_NODE (id=3):(Total: 1s553ms, non-child: 1s553ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/10.69 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.90 MB (1994992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1994992) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1994992) - DecompressionTime: 5.388ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.80 MB (11324008) - PerReadThreadRawHdfsThroughput: 2.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192500) - RowsReturned: 192.50K (192500) - RowsReturnedRate: 123.94 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 1s567ms - MaterializeTupleTime(*): 13.271ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 84 (84) - TotalRawHdfsReadTime(*): 808.892us - TotalReadThroughput: 0.00 /sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef4 (host=d2408.halxg.cloudera.com:22000):(Total: 1s911ms, non-child: 6.164ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 3:1/10.69 MB Filter 1 arrival: 1s532ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.90 MB (11433128) - PerHostPeakMemUsage: 370.91 MB (388929448) - PrepareTime: 111.360us - RowsProduced: 192.50K (192503) - TotalCpuTime: 2s037ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 321.123ms - TotalStorageWaitTime: 2.728ms DataStreamSender (dst_id=15):(Total: 353.590ms, non-child: 353.590ms, % non-child: 100.00%) - BytesSent: 55.44 MB (58134780) - NetworkThroughput(*): 40.07 MB/sec - OverallThroughput: 156.80 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 19.841ms - ThriftTransmitTime(*): 1s383ms - UncompressedRowBatchSize: 102.82 MB (107816720) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/10.69 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 1.90 MB (1994910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1994910) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1994910) - DecompressionTime: 5.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.77 MB (11291240) - PerReadThreadRawHdfsThroughput: 2.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192503) - RowsReturned: 192.50K (192503) - RowsReturnedRate: 124.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 445.862ms - MaterializeTupleTime(*): 13.992ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 820.446us - TotalReadThroughput: 0.00 /sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eef (host=d2414.halxg.cloudera.com:22000):(Total: 1s907ms, non-child: 5.079ms, % non-child: 0.27%) Hdfs split stats (:<# splits>/): 6:1/10.70 MB Filter 1 arrival: 1s539ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 6.32 MB ThreadUsage(500.000ms): 1, 1, 2, 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.97 MB (11502656) - PerHostPeakMemUsage: 369.35 MB (387295024) - PrepareTime: 102.976us - RowsProduced: 192.76K (192757) - TotalCpuTime: 1s994ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 320.181ms - TotalStorageWaitTime: 2.531ms DataStreamSender (dst_id=15):(Total: 349.706ms, non-child: 349.706ms, % non-child: 100.00%) - BytesSent: 55.38 MB (58067700) - NetworkThroughput(*): 43.55 MB/sec - OverallThroughput: 158.35 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 20.889ms - ThriftTransmitTime(*): 1s271ms - UncompressedRowBatchSize: 102.96 MB (107959040) HDFS_SCAN_NODE (id=3):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/10.70 MB Runtime filters: All filters arrived. Waited 1s546ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 1.90 MB (1997104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1997104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1997104) - DecompressionTime: 4.995ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.83 MB (11360768) - PerReadThreadRawHdfsThroughput: 2.92 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.76K (192757) - RowsReturned: 192.76K (192757) - RowsReturnedRate: 124.16 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 407.607ms - MaterializeTupleTime(*): 15.446ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 27 (27) - TotalRawHdfsReadTime(*): 636.016us - TotalReadThroughput: 975.15 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef5 (host=d2403.halxg.cloudera.com:22000):(Total: 1s902ms, non-child: 6.093ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 10:1/10.69 MB Filter 1 arrival: 1s530ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 7.84 MB ThreadUsage(500.000ms): 1, 2, 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.84 MB (11367680) - PerHostPeakMemUsage: 373.60 MB (391747632) - PrepareTime: 87.116us - RowsProduced: 192.50K (192500) - TotalCpuTime: 2s882ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 312.142ms - TotalStorageWaitTime: 2.537ms DataStreamSender (dst_id=15):(Total: 344.716ms, non-child: 344.716ms, % non-child: 100.00%) - BytesSent: 55.02 MB (57694100) - NetworkThroughput(*): 42.37 MB/sec - OverallThroughput: 159.61 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 22.958ms - ThriftTransmitTime(*): 1s298ms - UncompressedRowBatchSize: 102.82 MB (107815040) HDFS_SCAN_NODE (id=3):(Total: 1s551ms, non-child: 1s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/10.69 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 1.90 MB (1995381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1995381) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1995381) - DecompressionTime: 5.278ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.71 MB (11225792) - PerReadThreadRawHdfsThroughput: 2.90 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192500) - RowsReturned: 192.50K (192500) - RowsReturnedRate: 124.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 1s291ms - MaterializeTupleTime(*): 16.895ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalRawHdfsReadTime(*): 641.744us - TotalReadThroughput: 974.31 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eed (host=d2413.halxg.cloudera.com:22000):(Total: 1s899ms, non-child: 5.990ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 5:1/10.69 MB Filter 1 arrival: 1s541ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 2.34 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.93 MB (11466056) - PerHostPeakMemUsage: 370.47 MB (388467208) - PrepareTime: 130.666us - RowsProduced: 192.50K (192501) - TotalCpuTime: 3s089ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 305.738ms - TotalStorageWaitTime: 2.550ms DataStreamSender (dst_id=15):(Total: 342.084ms, non-child: 342.084ms, % non-child: 100.00%) - BytesSent: 53.76 MB (56368460) - NetworkThroughput(*): 42.28 MB/sec - OverallThroughput: 157.15 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 24.329ms - ThriftTransmitTime(*): 1s271ms - UncompressedRowBatchSize: 102.82 MB (107815600) HDFS_SCAN_NODE (id=3):(Total: 1s551ms, non-child: 1s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/10.69 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 1.90 MB (1995157) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1995157) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1995157) - DecompressionTime: 5.576ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.80 MB (11324168) - PerReadThreadRawHdfsThroughput: 2.72 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192501) - RowsReturned: 192.50K (192501) - RowsReturnedRate: 124.05 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 1s495ms - MaterializeTupleTime(*): 13.765ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 79 (79) - TotalRawHdfsReadTime(*): 681.886us - TotalReadThroughput: 974.20 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211ef7 (host=d2409.halxg.cloudera.com:22000):(Total: 1s899ms, non-child: 4.052ms, % non-child: 0.21%) Hdfs split stats (:<# splits>/): 8:1/10.69 MB Filter 1 arrival: 1s515ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 4.57 MB ThreadUsage(500.000ms): 1, 1, 2, 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.69 MB (11208024) - PerHostPeakMemUsage: 369.35 MB (387295384) - PrepareTime: 70.756us - RowsProduced: 192.76K (192756) - TotalCpuTime: 2s028ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 331.170ms - TotalStorageWaitTime: 2.793ms DataStreamSender (dst_id=15):(Total: 364.187ms, non-child: 364.187ms, % non-child: 100.00%) - BytesSent: 55.87 MB (58583680) - NetworkThroughput(*): 40.13 MB/sec - OverallThroughput: 153.41 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 20.253ms - ThriftTransmitTime(*): 1s392ms - UncompressedRowBatchSize: 102.96 MB (107958480) HDFS_SCAN_NODE (id=3):(Total: 1s531ms, non-child: 1s531ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/10.69 MB Runtime filters: All filters arrived. Waited 1s525ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 1.90 MB (1997266) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1997266) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1997266) - DecompressionTime: 6.128ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.55 MB (11066136) - PerReadThreadRawHdfsThroughput: 2.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.76K (192756) - RowsReturned: 192.76K (192756) - RowsReturnedRate: 125.86 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 459.947ms - MaterializeTupleTime(*): 18.663ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 29 (29) - TotalRawHdfsReadTime(*): 824.844us - TotalReadThroughput: 975.23 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211eea (host=d2407.halxg.cloudera.com:22000):(Total: 1s890ms, non-child: 6.732ms, % non-child: 0.36%) Hdfs split stats (:<# splits>/): 10:1/10.68 MB Filter 1 arrival: 1s543ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 7.13 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.84 MB (11367736) - PerHostPeakMemUsage: 370.09 MB (388069480) - PrepareTime: 112.348us - RowsProduced: 192.50K (192500) - TotalCpuTime: 2s035ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 300.634ms - TotalStorageWaitTime: 3.035ms DataStreamSender (dst_id=15):(Total: 332.046ms, non-child: 332.046ms, % non-child: 100.00%) - BytesSent: 55.00 MB (57668400) - NetworkThroughput(*): 41.37 MB/sec - OverallThroughput: 165.63 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 19.047ms - ThriftTransmitTime(*): 1s329ms - UncompressedRowBatchSize: 102.82 MB (107815040) HDFS_SCAN_NODE (id=3):(Total: 1s551ms, non-child: 1s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/10.68 MB Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.90 MB (1994998) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1994998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1994998) - DecompressionTime: 5.718ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.71 MB (11225848) - PerReadThreadRawHdfsThroughput: 2.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.50K (192500) - RowsReturned: 192.50K (192500) - RowsReturnedRate: 124.04 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 446.705ms - MaterializeTupleTime(*): 13.180ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 26 (26) - TotalRawHdfsReadTime(*): 709.722us - TotalReadThroughput: 974.12 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Instance 3045db9f916d3ae1:2b6258aae4211efa (host=d2420.halxg.cloudera.com:22000):(Total: 1s850ms, non-child: 10.309ms, % non-child: 0.56%) Hdfs split stats (:<# splits>/): 3:1/10.68 MB Filter 1 arrival: 1s526ms MemoryUsage(500.000ms): 114.56 KB, 114.56 KB, 114.56 KB, 4.06 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 10.21 MB (10707088) - PerHostPeakMemUsage: 381.67 MB (400213664) - PrepareTime: 310.822us - RowsProduced: 192.24K (192242) - TotalCpuTime: 3s108ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 253.595ms - TotalStorageWaitTime: 4.325ms DataStreamSender (dst_id=15):(Total: 305.518ms, non-child: 305.518ms, % non-child: 100.00%) - BytesSent: 53.06 MB (55633540) - NetworkThroughput(*): 39.50 MB/sec - OverallThroughput: 173.66 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 30.337ms - ThriftTransmitTime(*): 1s343ms - UncompressedRowBatchSize: 102.68 MB (107670560) HDFS_SCAN_NODE (id=3):(Total: 1s534ms, non-child: 1s534ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/10.68 MB Runtime filters: All filters arrived. Waited 1s525ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 1.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 1.90 MB (1992617) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.90 MB (1992617) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.90 MB (1992617) - DecompressionTime: 7.152ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.08 MB (10565200) - PerReadThreadRawHdfsThroughput: 1.64 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 192.24K (192242) - RowsReturned: 192.24K (192242) - RowsReturnedRate: 125.26 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 1s511ms - MaterializeTupleTime(*): 22.234ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 81 (81) - TotalRawHdfsReadTime(*): 1.131ms - TotalReadThroughput: 972.96 KB/sec Filter 1: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Fragment F02: Instance 3045db9f916d3ae1:2b6258aae4211efb (host=d2406.halxg.cloudera.com:22000):(Total: 281.553ms, non-child: 267.968ms, % non-child: 95.17%) Hdfs split stats (:<# splits>/): 6:1/2.17 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.90 MB (1996824) - PerHostPeakMemUsage: 10.40 MB (10905152) - PrepareTime: 93.484us - RowsProduced: 30 (30) - TotalCpuTime: 30.365ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 263.235ms - TotalStorageWaitTime: 2.911ms DataStreamSender (dst_id=14):(Total: 163.030us, non-child: 163.030us, % non-child: 100.00%) - BytesSent: 5.86 KB (6000) - NetworkThroughput(*): 1.68 KB/sec - OverallThroughput: 35.10 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 18.568us - ThriftTransmitTime(*): 3s477ms - UncompressedRowBatchSize: 16.48 KB (16880) HDFS_SCAN_NODE (id=0):(Total: 13.422ms, non-child: 13.422ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.93 KB (477115) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.93 KB (477115) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.93 KB (477115) - DecompressionTime: 580.560us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.79 MB (1879512) - PerReadThreadRawHdfsThroughput: 841.42 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 30 (30) - RowsReturnedRate: 2.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 13.200ms - MaterializeTupleTime(*): 8.250ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 540.770us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 3045db9f916d3ae1:2b6258aae4211efc (host=d2403.halxg.cloudera.com:22000):(Total: 279.753ms, non-child: 262.653ms, % non-child: 93.89%) Hdfs split stats (:<# splits>/): 6:1/3.14 MB MemoryUsage(500.000ms): 53.62 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.79 MB (1873344) - PerHostPeakMemUsage: 10.38 MB (10887432) - PrepareTime: 160.228us - RowsProduced: 591 (591) - TotalCpuTime: 34.255ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.247ms - TotalStorageWaitTime: 7.063ms DataStreamSender (dst_id=13):(Total: 419.654us, non-child: 419.654us, % non-child: 100.00%) - BytesSent: 513.44 KB (525760) - NetworkThroughput(*): 152.75 KB/sec - OverallThroughput: 1.17 GB/sec - PeakMemoryUsage: 45.62 KB (46720) - SerializeBatchTime: 301.684us - ThriftTransmitTime(*): 3s361ms - UncompressedRowBatchSize: 1008.61 KB (1032820) HDFS_SCAN_NODE (id=2):(Total: 16.679ms, non-child: 16.679ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/3.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 487.70 KB (499409) - BytesReadDataNodeCache: 0 - BytesReadLocal: 487.70 KB (499409) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 487.70 KB (499409) - DecompressionTime: 98.346us - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.73 MB (1818432) - PerReadThreadRawHdfsThroughput: 315.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 32.00K (32000) - RowsReturned: 591 (591) - RowsReturnedRate: 35.43 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.320ms - MaterializeTupleTime(*): 7.669ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 1.508ms - TotalReadThroughput: 0.00 /sec