================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 573.95us | 0ns | 573.95us | 564 | 100 | | 08:TOP-N | 15 | 433.43us | 0ns | 529.70us | 564 | 100 | | 13:AGGREGATE | 15 | 215.07ms | 0ns | 224.17ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 252.04us | 0ns | 429.76us | 8.46K | 3.83K | | 07:AGGREGATE | 15 | 387.00ms | 0ns | 416.76ms | 8.46K | 3.83K | | 06:HASH JOIN | 15 | 10.93ms | 0ns | 11.56ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 46.30us | 0ns | 61.83us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 3.77ms | 0ns | 3.77ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 13.64ms | 0ns | 14.47ms | 542.70K | 4.27K | | |--10:EXCHANGE | 15 | 27.24us | 0ns | 36.65us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 438.60ms | 0ns | 438.60ms | 365 | 114 | | 04:HASH JOIN | 15 | 1.55s | 0ns | 1.68s | 542.70K | 68.35K | | |--09:EXCHANGE | 15 | 684.79us | 0ns | 813.53us | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 490.76ms | 0ns | 490.76ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 183.92ms | 0ns | 250.38ms | 546.93M | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=704cb17570766816:e892c0b08b2f8197): Summary: Session ID: d94b300ad977faf2:58367fe70bc5d95 Session Type: BEESWAX Start Time: 2016-05-01 23:11:46.047492000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a6aba933a52514c663a6dfb21fca25ea71413073) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:54847 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=20B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.95KB | tuple-ids=6 row-size=20B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=24B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=126B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=122B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=110B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=36.41GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=20B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 31.884ms - Analysis finished: 7.708ms (7.708ms) - Equivalence classes computed: 8.107ms (399.176us) - Single node plan created: 19.886ms (11.778ms) - Runtime filters computed: 20.242ms (355.861us) - Distributed plan created: 25.022ms (4.780ms) - Lineage info computed: 26.449ms (1.426ms) - Planning finished: 31.884ms (5.435ms) Query Timeline: 3s480ms - Start execution: 342.289us (342.289us) - Planning finished: 42.514ms (42.172ms) - Ready to start 33 remote fragments: 48.430ms (5.915ms) - All 33 remote fragments started: 81.243ms (32.813ms) - Rows available: 3s406ms (3s324ms) - First row fetched: 3s460ms (53.972ms) ImpalaServer: - ClientFetchWaitTimer: 54.732ms - RowMaterializationTimer: 800.411us Execution Profile 704cb17570766816:e892c0b08b2f8197:(Total: 3s369ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 8ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 10ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(242.35 MB) vb0206.halxg.cloudera.com:22000(314.48 MB) vb0228.halxg.cloudera.com:22000(253.86 MB) vb0220.halxg.cloudera.com:22000(294.92 MB) vb0212.halxg.cloudera.com:22000(254.49 MB) vb0218.halxg.cloudera.com:22000(294.52 MB) vb0224.halxg.cloudera.com:22000(274.96 MB) vb0222.halxg.cloudera.com:22000(251.35 MB) vb0230.halxg.cloudera.com:22000(269.97 MB) vb0208.halxg.cloudera.com:22000(251.05 MB) vb0234.halxg.cloudera.com:22000(251.93 MB) vb0216.halxg.cloudera.com:22000(244.65 MB) vb0226.halxg.cloudera.com:22000(274.98 MB) vb0214.halxg.cloudera.com:22000(317.58 MB) vb0204.halxg.cloudera.com:22000(260.35 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 3s320ms, non-child: 1.075ms, % non-child: 0.03%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 72.41 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 171.341us - RowsProduced: 100 (100) - TotalCpuTime: 3s414ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 3s319ms, non-child: 573.945us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 9.51 KB - BytesReceived: 9.51 KB (9741) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 152.996us - FirstBatchArrivalWaitTime: 3s319ms - MergeGetNext: 452.131us - MergeGetNextBatch: 75.318us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 169.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 2s928ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:3s346ms max:3s356ms mean: 3s353ms stddev:2.955ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447273) - PerHostPeakMemUsage: 270.10 MB (283215323) - PrepareTime: 213.661ms - RowsProduced: 37 (37) - TotalCpuTime: 637.162ms - TotalNetworkReceiveTime: 2s711ms - TotalNetworkSendTime: 390.559us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 631.194ms, non-child: 631.194ms, % non-child: 100.00%) - CodegenTime: 1.296ms - CompileTime: 88.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.395ms - PrepareTime: 211.393ms DataStreamSender (dst_id=14):(Total: 125.797us, non-child: 125.797us, % non-child: 100.00%) - BytesSent: 649.00 B (649) - NetworkThroughput(*): 15.41 MB/sec - OverallThroughput: 5.27 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 58.218us - TransmitDataRPCTime: 42.735us - UncompressedRowBatchSize: 1.03 KB (1056) SORT_NODE (id=8):(Total: 2s927ms, non-child: 433.432us, % non-child: 0.01%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s926ms, non-child: 215.071ms, % non-child: 7.35%) - BuildTime: 132.706us - GetNewBlockTime: 124.242us - GetResultsTime: 56.983us - HTResizeTime: 3.032us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.513us EXCHANGE_NODE (id=12):(Total: 2s711ms, non-child: 2s711ms, % non-child: 100.00%) - BytesReceived: 8.54 KB (8747) - ConvertRowBatchTime: 55.987us - DeserializeRowBatchTimer: 246.213us - FirstBatchArrivalWaitTime: 2s418ms - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 207.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 2s169ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.36 GB, max: 2.50 GB, avg: 2.43 GB, stddev: 40.05 MB completion times: min:3s054ms max:3s337ms mean: 3s183ms stddev:87.924ms execution rates: min:744.35 MB/sec max:814.01 MB/sec mean:781.25 MB/sec stddev:18.11 MB/sec num instances: 15 - AverageThreadTokens: 6.79 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 267.82 MB (280825449) - PerHostPeakMemUsage: 270.10 MB (283215323) - PrepareTime: 213.223ms - RowsProduced: 564 (564) - TotalCpuTime: 18s389ms - TotalNetworkReceiveTime: 152.116us - TotalNetworkSendTime: 21.055ms - TotalStorageWaitTime: 3s265ms CodeGen:(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%) - CodegenTime: 1.111ms - CompileTime: 315.936ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 690.901ms - PrepareTime: 202.018ms DataStreamSender (dst_id=12):(Total: 1.004ms, non-child: 1.004ms, % non-child: 100.00%) - BytesSent: 8.54 KB (8747) - NetworkThroughput(*): 23.00 MB/sec - OverallThroughput: 8.71 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 570.272us - TransmitDataRPCTime: 389.983us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s142ms, non-child: 387.002ms, % non-child: 18.07%) - GetNewBlockTime: 62.556us - GetResultsTime: 91.718us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.79 MB (12365450) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 263.00 /sec - StreamingTime: 166.316ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s755ms, non-child: 10.925ms, % non-child: 0.62%) - BuildPartitionTime: 92.880us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 28.930us - GetNewBlockTime: 928.382us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.57 MB (12127882) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.321ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 20.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.813us EXCHANGE_NODE (id=11):(Total: 46.299us, non-child: 46.299us, % non-child: 100.00%) - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 32.723us - DeserializeRowBatchTimer: 20.694us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s744ms, non-child: 13.638ms, % non-child: 0.78%) - BuildPartitionTime: 46.285us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 14.997us - GetNewBlockTime: 1.117ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.54 MB (12103306) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.835ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 20.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.703us EXCHANGE_NODE (id=10):(Total: 27.239us, non-child: 27.239us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.061us - DeserializeRowBatchTimer: 22.949us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s730ms, non-child: 1s545ms, % non-child: 89.33%) - BuildPartitionTime: 5.167ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 555.291us - GetNewBlockTime: 1.011ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038393) - PinTime: 0.000ns - ProbeRows: 36.46M (36461704) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s498ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 20.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.601us EXCHANGE_NODE (id=9):(Total: 684.794us, non-child: 684.794us, % non-child: 100.00%) - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 510.324us - DeserializeRowBatchTimer: 2.428ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 183.917ms, non-child: 183.917ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 1.23 - AverageScannerThreadConcurrency: 9.43 - BytesRead: 441.19 MB (462616144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 440.65 MB (462056357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 440.65 MB (462056357) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 247.23 MB (259235089) - PerReadThreadRawHdfsThroughput: 177.71 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.48M (36475001) - RowsReturned: 36.46M (36461704) - RowsReturnedRate: 200.68 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1404) - ScannerThreadsTotalWallClockTime: 18s227ms - MaterializeTupleTime(*): 14s800ms - ScannerThreadsSysTime: 702.953ms - ScannerThreadsUserTime: 4s800ms - ScannerThreadsVoluntaryContextSwitches: 34.86K (34857) - TotalRawHdfsReadTime(*): 2s524ms - TotalReadThroughput: 150.02 MB/sec Filter 0 (4.00 KB): - Rows processed: 563.58K (563575) - Rows rejected: 13.30K (13297) - Rows total: 563.61K (563609) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.41K (36405) - RowGroups rejected: 0 (0) - RowGroups total: 36.41K (36405) - Rows processed: 563.58K (563575) - Rows rejected: 0 (0) - Rows total: 563.61K (563609) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Averaged Fragment F03:(Total: 231.205ms, non-child: 227.038ms, % non-child: 98.20%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:232.931ms max:232.931ms mean: 232.931ms stddev:0.000ns execution rates: min:381.75 KB/sec max:381.75 KB/sec mean:381.75 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 76.123us - RowsProduced: 1.00K (1002) - TotalCpuTime: 9.677ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 223.298ms - TotalStorageWaitTime: 3.025ms DataStreamSender (dst_id=11):(Total: 401.342us, non-child: 401.342us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 436.49 MB/sec - OverallThroughput: 296.41 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 72.747us - TransmitDataRPCTime: 272.543us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.766ms, non-child: 3.766ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.758us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 266.05 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.552ms - MaterializeTupleTime(*): 81.102us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 63.588us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 235.884ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:596.829ms max:596.829ms mean: 596.829ms stddev:0.000ns execution rates: min:3.63 MB/sec max:3.63 MB/sec mean:3.63 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.20 MB (5451832) - PrepareTime: 206.259ms - RowsProduced: 365 (365) - TotalCpuTime: 607.592ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.328us - TotalStorageWaitTime: 14.601ms CodeGen:(Total: 562.884ms, non-child: 562.884ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 72.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 285.738ms - PrepareTime: 203.545ms DataStreamSender (dst_id=10):(Total: 471.763us, non-child: 471.763us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 104.83 MB/sec - OverallThroughput: 91.12 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 28.191us - TransmitDataRPCTime: 410.082us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 438.598ms, non-child: 438.598ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 217.563us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 48.41 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 832.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 25.966ms - MaterializeTupleTime(*): 9.583ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 9.692ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 298.002ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:668.199ms max:668.199ms mean: 668.199ms stddev:0.000ns execution rates: min:42.33 MB/sec max:42.33 MB/sec mean:42.33 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 201.801ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 751.503ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 783.272us - TotalStorageWaitTime: 7.334ms CodeGen:(Total: 568.105ms, non-child: 568.105ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 287.481ms - PrepareTime: 199.980ms DataStreamSender (dst_id=9):(Total: 7.657ms, non-child: 7.657ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 2.75 GB/sec - OverallThroughput: 1.14 GB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 4.414ms - TransmitDataRPCTime: 3.187ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 490.759ms, non-child: 490.759ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.146ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.39 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 92.298ms - MaterializeTupleTime(*): 78.628ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 81.987ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 1.788ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 704cb17570766816:e892c0b08b2f81a1 (host=vb0218.halxg.cloudera.com:22000):(Total: 2s932ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447072) - PerHostPeakMemUsage: 294.52 MB (308823888) - PrepareTime: 214.345ms - RowsProduced: 25 (25) - TotalCpuTime: 634.830ms - TotalNetworkReceiveTime: 2s714ms - TotalNetworkSendTime: 383.067us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.382ms, non-child: 629.382ms, % non-child: 100.00%) - CodegenTime: 1.239ms - CompileTime: 87.048ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.518ms - PrepareTime: 212.204ms DataStreamSender (dst_id=14):(Total: 123.078us, non-child: 123.078us, % non-child: 100.00%) - BytesSent: 460.00 B (460) - NetworkThroughput(*): 12.44 MB/sec - OverallThroughput: 3.56 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 25 (25) - SerializeBatchTime: 61.780us - TransmitDataRPCTime: 35.272us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 2s930ms, non-child: 436.740us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec AGGREGATION_NODE (id=13):(Total: 2s930ms, non-child: 215.671ms, % non-child: 7.36%) ExecOption: Codegen Enabled - BuildTime: 78.075us - GetNewBlockTime: 119.318us - GetResultsTime: 44.129us - HTResizeTime: 2.779us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.513us EXCHANGE_NODE (id=12):(Total: 2s714ms, non-child: 172.272us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 403.00 B - BytesReceived: 5.93 KB (6075) - ConvertRowBatchTime: 39.684us - DeserializeRowBatchTimer: 266.392us - FirstBatchArrivalWaitTime: 2s417ms - PeakMemoryUsage: 0 - RowsReturned: 375 (375) - RowsReturnedRate: 138.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a5 (host=vb0206.halxg.cloudera.com:22000):(Total: 2s931ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 314.48 MB (329759808) - PrepareTime: 211.832ms - RowsProduced: 37 (37) - TotalCpuTime: 634.382ms - TotalNetworkReceiveTime: 2s716ms - TotalNetworkSendTime: 360.094us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.035ms, non-child: 629.035ms, % non-child: 100.00%) - CodegenTime: 1.279ms - CompileTime: 86.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.178ms - PrepareTime: 209.678ms DataStreamSender (dst_id=14):(Total: 123.118us, non-child: 123.118us, % non-child: 100.00%) - BytesSent: 645.00 B (645) - NetworkThroughput(*): 11.47 MB/sec - OverallThroughput: 5.00 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 56.086us - TransmitDataRPCTime: 53.630us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s930ms, non-child: 389.459us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s929ms, non-child: 213.266ms, % non-child: 7.28%) ExecOption: Codegen Enabled - BuildTime: 219.431us - GetNewBlockTime: 127.252us - GetResultsTime: 55.035us - HTResizeTime: 4.022us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.152us EXCHANGE_NODE (id=12):(Total: 2s716ms, non-child: 230.861us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 8.28 KB (8475) - ConvertRowBatchTime: 62.169us - DeserializeRowBatchTimer: 399.858us - FirstBatchArrivalWaitTime: 2s434ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 204.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a0 (host=vb0224.halxg.cloudera.com:22000):(Total: 2s931ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 274.96 MB (288313360) - PrepareTime: 215.396ms - RowsProduced: 33 (33) - TotalCpuTime: 636.288ms - TotalNetworkReceiveTime: 2s712ms - TotalNetworkSendTime: 325.379us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 630.921ms, non-child: 630.921ms, % non-child: 100.00%) - CodegenTime: 1.228ms - CompileTime: 87.379ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.712ms - PrepareTime: 213.201ms DataStreamSender (dst_id=14):(Total: 99.726us, non-child: 99.726us, % non-child: 100.00%) - BytesSent: 548.00 B (548) - NetworkThroughput(*): 17.52 MB/sec - OverallThroughput: 5.24 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 45.737us - TransmitDataRPCTime: 29.829us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s929ms, non-child: 342.405us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s929ms, non-child: 216.936ms, % non-child: 7.41%) ExecOption: Codegen Enabled - BuildTime: 259.279us - GetNewBlockTime: 136.804us - GetResultsTime: 57.984us - HTResizeTime: 2.367us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.225us EXCHANGE_NODE (id=12):(Total: 2s712ms, non-child: 178.583us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.56 KB (7741) - ConvertRowBatchTime: 42.529us - DeserializeRowBatchTimer: 359.907us - FirstBatchArrivalWaitTime: 2s415ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 182.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a2 (host=vb0212.halxg.cloudera.com:22000):(Total: 2s931ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 254.49 MB (266849544) - PrepareTime: 214.395ms - RowsProduced: 39 (39) - TotalCpuTime: 637.732ms - TotalNetworkReceiveTime: 2s711ms - TotalNetworkSendTime: 307.987us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.593ms, non-child: 629.593ms, % non-child: 100.00%) - CodegenTime: 1.331ms - CompileTime: 88.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.074ms - PrepareTime: 212.155ms DataStreamSender (dst_id=14):(Total: 194.903us, non-child: 194.903us, % non-child: 100.00%) - BytesSent: 685.00 B (685) - NetworkThroughput(*): 11.18 MB/sec - OverallThroughput: 3.35 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 107.085us - TransmitDataRPCTime: 58.432us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s928ms, non-child: 503.780us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s927ms, non-child: 215.794ms, % non-child: 7.37%) ExecOption: Codegen Enabled - BuildTime: 96.601us - GetNewBlockTime: 129.702us - GetResultsTime: 65.709us - HTResizeTime: 3.485us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.709us EXCHANGE_NODE (id=12):(Total: 2s711ms, non-child: 429.761us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 616.00 B - BytesReceived: 8.90 KB (9118) - ConvertRowBatchTime: 66.351us - DeserializeRowBatchTimer: 338.390us - FirstBatchArrivalWaitTime: 2s414ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 215.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a6 (host=vb0204.halxg.cloudera.com:22000):(Total: 2s931ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 260.35 MB (272995640) - PrepareTime: 222.739ms - RowsProduced: 40 (40) - TotalCpuTime: 648.686ms - TotalNetworkReceiveTime: 2s702ms - TotalNetworkSendTime: 537.383us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 639.225ms, non-child: 639.225ms, % non-child: 100.00%) - CodegenTime: 1.237ms - CompileTime: 88.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.004ms - PrepareTime: 219.876ms DataStreamSender (dst_id=14):(Total: 181.761us, non-child: 181.761us, % non-child: 100.00%) - BytesSent: 689.00 B (689) - NetworkThroughput(*): 10.03 MB/sec - OverallThroughput: 3.62 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 88.974us - TransmitDataRPCTime: 65.485us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s927ms, non-child: 510.519us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s926ms, non-child: 224.168ms, % non-child: 7.66%) ExecOption: Codegen Enabled - BuildTime: 76.586us - GetNewBlockTime: 121.799us - GetResultsTime: 45.314us - HTResizeTime: 2.259us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.666us EXCHANGE_NODE (id=12):(Total: 2s702ms, non-child: 259.367us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.10 KB (9320) - ConvertRowBatchTime: 59.901us - DeserializeRowBatchTimer: 129.269us - FirstBatchArrivalWaitTime: 2s420ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 222.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a7 (host=vb0232.halxg.cloudera.com:22000):(Total: 2s930ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447360) - PerHostPeakMemUsage: 242.35 MB (254121232) - PrepareTime: 216.095ms - RowsProduced: 43 (43) - TotalCpuTime: 640.940ms - TotalNetworkReceiveTime: 2s710ms - TotalNetworkSendTime: 652.085us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 635.396ms, non-child: 635.396ms, % non-child: 100.00%) - CodegenTime: 1.398ms - CompileTime: 89.080ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 331.834ms - PrepareTime: 213.851ms DataStreamSender (dst_id=14):(Total: 100.480us, non-child: 100.480us, % non-child: 100.00%) - BytesSent: 745.00 B (745) - NetworkThroughput(*): 15.52 MB/sec - OverallThroughput: 7.07 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 43 (43) - SerializeBatchTime: 27.870us - TransmitDataRPCTime: 45.788us - UncompressedRowBatchSize: 1.18 KB (1208) SORT_NODE (id=8):(Total: 2s928ms, non-child: 453.228us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s928ms, non-child: 217.565ms, % non-child: 7.43%) ExecOption: Codegen Enabled - BuildTime: 93.700us - GetNewBlockTime: 108.575us - GetResultsTime: 74.304us - HTResizeTime: 3.140us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.268us EXCHANGE_NODE (id=12):(Total: 2s710ms, non-child: 384.419us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 5.14 KB - BytesReceived: 9.70 KB (9936) - ConvertRowBatchTime: 51.559us - DeserializeRowBatchTimer: 296.931us - FirstBatchArrivalWaitTime: 2s428ms - PeakMemoryUsage: 0 - RowsReturned: 645 (645) - RowsReturnedRate: 237.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819d (host=vb0208.halxg.cloudera.com:22000):(Total: 2s929ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 251.05 MB (263243304) - PrepareTime: 213.512ms - RowsProduced: 37 (37) - TotalCpuTime: 634.352ms - TotalNetworkReceiveTime: 2s713ms - TotalNetworkSendTime: 319.879us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 628.863ms, non-child: 628.863ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 89.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.020ms - PrepareTime: 211.273ms DataStreamSender (dst_id=14):(Total: 127.929us, non-child: 127.929us, % non-child: 100.00%) - BytesSent: 631.00 B (631) - NetworkThroughput(*): 11.16 MB/sec - OverallThroughput: 4.70 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 45.805us - TransmitDataRPCTime: 53.933us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s928ms, non-child: 413.843us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s928ms, non-child: 215.070ms, % non-child: 7.34%) ExecOption: Codegen Enabled - BuildTime: 91.397us - GetNewBlockTime: 121.549us - GetResultsTime: 66.857us - HTResizeTime: 3.027us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.455us EXCHANGE_NODE (id=12):(Total: 2s713ms, non-child: 421.088us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 3.90 KB - BytesReceived: 8.44 KB (8642) - ConvertRowBatchTime: 67.182us - DeserializeRowBatchTimer: 134.441us - FirstBatchArrivalWaitTime: 2s417ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 204.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a3 (host=vb0220.halxg.cloudera.com:22000):(Total: 2s929ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447344) - PerHostPeakMemUsage: 294.92 MB (309240864) - PrepareTime: 215.608ms - RowsProduced: 42 (42) - TotalCpuTime: 640.287ms - TotalNetworkReceiveTime: 2s710ms - TotalNetworkSendTime: 429.165us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 634.726ms, non-child: 634.726ms, % non-child: 100.00%) - CodegenTime: 1.351ms - CompileTime: 88.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.192ms - PrepareTime: 213.329ms DataStreamSender (dst_id=14):(Total: 101.929us, non-child: 101.929us, % non-child: 100.00%) - BytesSent: 738.00 B (738) - NetworkThroughput(*): 15.45 MB/sec - OverallThroughput: 6.90 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 42 (42) - SerializeBatchTime: 28.420us - TransmitDataRPCTime: 45.553us - UncompressedRowBatchSize: 1.15 KB (1180) SORT_NODE (id=8):(Total: 2s928ms, non-child: 404.691us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s927ms, non-child: 217.039ms, % non-child: 7.41%) ExecOption: Codegen Enabled - BuildTime: 98.535us - GetNewBlockTime: 117.265us - GetResultsTime: 60.524us - HTResizeTime: 2.927us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.452us EXCHANGE_NODE (id=12):(Total: 2s710ms, non-child: 177.837us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.58 KB (9808) - ConvertRowBatchTime: 46.588us - DeserializeRowBatchTimer: 356.316us - FirstBatchArrivalWaitTime: 2s413ms - PeakMemoryUsage: 0 - RowsReturned: 630 (630) - RowsReturnedRate: 232.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819f (host=vb0222.halxg.cloudera.com:22000):(Total: 2s928ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 251.35 MB (263555000) - PrepareTime: 212.001ms - RowsProduced: 33 (33) - TotalCpuTime: 635.327ms - TotalNetworkReceiveTime: 2s713ms - TotalNetworkSendTime: 340.427us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.723ms, non-child: 629.723ms, % non-child: 100.00%) - CodegenTime: 1.247ms - CompileTime: 88.516ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.734ms - PrepareTime: 209.868ms DataStreamSender (dst_id=14):(Total: 158.033us, non-child: 158.033us, % non-child: 100.00%) - BytesSent: 559.00 B (559) - NetworkThroughput(*): 10.19 MB/sec - OverallThroughput: 3.37 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 80.504us - TransmitDataRPCTime: 52.340us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s927ms, non-child: 471.138us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s926ms, non-child: 213.386ms, % non-child: 7.29%) ExecOption: Codegen Enabled - BuildTime: 82.602us - GetNewBlockTime: 122.185us - GetResultsTime: 56.792us - HTResizeTime: 2.770us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.572us EXCHANGE_NODE (id=12):(Total: 2s713ms, non-child: 227.369us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.54 KB (7726) - ConvertRowBatchTime: 49.108us - DeserializeRowBatchTimer: 295.839us - FirstBatchArrivalWaitTime: 2s416ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 182.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819e (host=vb0230.halxg.cloudera.com:22000):(Total: 2s928ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447328) - PerHostPeakMemUsage: 269.97 MB (283081000) - PrepareTime: 211.325ms - RowsProduced: 41 (41) - TotalCpuTime: 635.122ms - TotalNetworkReceiveTime: 2s713ms - TotalNetworkSendTime: 461.679us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.481ms, non-child: 629.481ms, % non-child: 100.00%) - CodegenTime: 1.221ms - CompileTime: 88.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.932ms - PrepareTime: 209.181ms DataStreamSender (dst_id=14):(Total: 117.528us, non-child: 117.528us, % non-child: 100.00%) - BytesSent: 728.00 B (728) - NetworkThroughput(*): 21.89 MB/sec - OverallThroughput: 5.91 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 41 (41) - SerializeBatchTime: 60.360us - TransmitDataRPCTime: 31.710us - UncompressedRowBatchSize: 1.12 KB (1152) SORT_NODE (id=8):(Total: 2s926ms, non-child: 411.617us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s925ms, non-child: 212.762ms, % non-child: 7.27%) ExecOption: Codegen Enabled - BuildTime: 94.767us - GetNewBlockTime: 118.037us - GetResultsTime: 60.042us - HTResizeTime: 2.886us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.217us EXCHANGE_NODE (id=12):(Total: 2s713ms, non-child: 198.165us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.08 KB (9302) - ConvertRowBatchTime: 57.954us - DeserializeRowBatchTimer: 115.272us - FirstBatchArrivalWaitTime: 2s416ms - PeakMemoryUsage: 0 - RowsReturned: 615 (615) - RowsReturnedRate: 226.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819b (host=vb0216.halxg.cloudera.com:22000):(Total: 2s928ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447216) - PerHostPeakMemUsage: 244.65 MB (256535584) - PrepareTime: 214.195ms - RowsProduced: 34 (34) - TotalCpuTime: 635.437ms - TotalNetworkReceiveTime: 2s710ms - TotalNetworkSendTime: 275.432us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.965ms, non-child: 629.965ms, % non-child: 100.00%) - CodegenTime: 1.218ms - CompileTime: 87.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.379ms - PrepareTime: 212.035ms DataStreamSender (dst_id=14):(Total: 138.457us, non-child: 138.457us, % non-child: 100.00%) - BytesSent: 600.00 B (600) - NetworkThroughput(*): 16.01 MB/sec - OverallThroughput: 4.13 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 34 (34) - SerializeBatchTime: 74.386us - TransmitDataRPCTime: 35.746us - UncompressedRowBatchSize: 956.00 B (956) SORT_NODE (id=8):(Total: 2s926ms, non-child: 421.218us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s926ms, non-child: 215.600ms, % non-child: 7.37%) ExecOption: Codegen Enabled - BuildTime: 79.843us - GetNewBlockTime: 128.636us - GetResultsTime: 51.280us - HTResizeTime: 2.431us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.188us EXCHANGE_NODE (id=12):(Total: 2s710ms, non-child: 235.820us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 7.38 KB - BytesReceived: 7.92 KB (8106) - ConvertRowBatchTime: 46.889us - DeserializeRowBatchTimer: 150.643us - FirstBatchArrivalWaitTime: 2s414ms - PeakMemoryUsage: 0 - RowsReturned: 510 (510) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f81a4 (host=vb0228.halxg.cloudera.com:22000):(Total: 2s927ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447232) - PerHostPeakMemUsage: 253.86 MB (266191344) - PrepareTime: 212.415ms - RowsProduced: 35 (35) - TotalCpuTime: 639.920ms - TotalNetworkReceiveTime: 2s711ms - TotalNetworkSendTime: 295.397us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 634.097ms, non-child: 634.097ms, % non-child: 100.00%) - CodegenTime: 1.386ms - CompileTime: 90.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.869ms - PrepareTime: 210.006ms DataStreamSender (dst_id=14):(Total: 128.526us, non-child: 128.526us, % non-child: 100.00%) - BytesSent: 583.00 B (583) - NetworkThroughput(*): 19.01 MB/sec - OverallThroughput: 4.33 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 35 (35) - SerializeBatchTime: 78.329us - TransmitDataRPCTime: 29.250us - UncompressedRowBatchSize: 984.00 B (984) SORT_NODE (id=8):(Total: 2s925ms, non-child: 529.701us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s925ms, non-child: 213.800ms, % non-child: 7.31%) ExecOption: Codegen Enabled - BuildTime: 299.320us - GetNewBlockTime: 155.784us - GetResultsTime: 57.262us - HTResizeTime: 3.454us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.301us EXCHANGE_NODE (id=12):(Total: 2s711ms, non-child: 203.243us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 544.00 B - BytesReceived: 7.98 KB (8172) - ConvertRowBatchTime: 53.434us - DeserializeRowBatchTimer: 179.934us - FirstBatchArrivalWaitTime: 2s414ms - PeakMemoryUsage: 0 - RowsReturned: 525 (525) - RowsReturnedRate: 193.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819a (host=vb0226.halxg.cloudera.com:22000):(Total: 2s926ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 274.98 MB (288340904) - PrepareTime: 211.160ms - RowsProduced: 39 (39) - TotalCpuTime: 634.272ms - TotalNetworkReceiveTime: 2s711ms - TotalNetworkSendTime: 322.919us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 628.256ms, non-child: 628.256ms, % non-child: 100.00%) - CodegenTime: 1.350ms - CompileTime: 88.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.262ms - PrepareTime: 208.876ms DataStreamSender (dst_id=14):(Total: 114.949us, non-child: 114.949us, % non-child: 100.00%) - BytesSent: 689.00 B (689) - NetworkThroughput(*): 21.53 MB/sec - OverallThroughput: 5.72 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 55.052us - TransmitDataRPCTime: 30.513us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s924ms, non-child: 430.295us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s923ms, non-child: 212.433ms, % non-child: 7.27%) ExecOption: Codegen Enabled - BuildTime: 94.458us - GetNewBlockTime: 119.409us - GetResultsTime: 65.022us - HTResizeTime: 4.098us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.681us EXCHANGE_NODE (id=12):(Total: 2s711ms, non-child: 247.698us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 4.03 KB - BytesReceived: 8.73 KB (8940) - ConvertRowBatchTime: 67.848us - DeserializeRowBatchTimer: 174.534us - FirstBatchArrivalWaitTime: 2s415ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 215.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f8199 (host=vb0214.halxg.cloudera.com:22000):(Total: 2s925ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 317.58 MB (333010272) - PrepareTime: 214.729ms - RowsProduced: 40 (40) - TotalCpuTime: 637.593ms - TotalNetworkReceiveTime: 2s707ms - TotalNetworkSendTime: 580.292us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 632.279ms, non-child: 632.279ms, % non-child: 100.00%) - CodegenTime: 1.325ms - CompileTime: 88.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.956ms - PrepareTime: 212.484ms DataStreamSender (dst_id=14):(Total: 101.041us, non-child: 101.041us, % non-child: 100.00%) - BytesSent: 655.00 B (655) - NetworkThroughput(*): 15.88 MB/sec - OverallThroughput: 6.18 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 36.003us - TransmitDataRPCTime: 39.325us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s923ms, non-child: 344.282us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s923ms, non-child: 216.025ms, % non-child: 7.39%) ExecOption: Codegen Enabled - BuildTime: 231.284us - GetNewBlockTime: 120.803us - GetResultsTime: 32.014us - HTResizeTime: 2.932us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.509us EXCHANGE_NODE (id=12):(Total: 2s707ms, non-child: 211.224us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.03 KB (9246) - ConvertRowBatchTime: 59.627us - DeserializeRowBatchTimer: 327.620us - FirstBatchArrivalWaitTime: 2s411ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 221.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 704cb17570766816:e892c0b08b2f819c (host=vb0234.halxg.cloudera.com:22000):(Total: 2s922ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447408) - PerHostPeakMemUsage: 251.93 MB (264168104) - PrepareTime: 205.174ms - RowsProduced: 46 (46) - TotalCpuTime: 632.269ms - TotalNetworkReceiveTime: 2s714ms - TotalNetworkSendTime: 267.206us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 626.963ms, non-child: 626.963ms, % non-child: 100.00%) - CodegenTime: 1.283ms - CompileTime: 93.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.255ms - PrepareTime: 202.881ms DataStreamSender (dst_id=14):(Total: 75.508us, non-child: 75.508us, % non-child: 100.00%) - BytesSent: 786.00 B (786) - NetworkThroughput(*): 21.90 MB/sec - OverallThroughput: 9.93 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 46 (46) - SerializeBatchTime: 26.889us - TransmitDataRPCTime: 34.233us - UncompressedRowBatchSize: 1.26 KB (1292) SORT_NODE (id=8):(Total: 2s921ms, non-child: 438.565us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 15.00 /sec AGGREGATION_NODE (id=13):(Total: 2s921ms, non-child: 206.546ms, % non-child: 7.07%) ExecOption: Codegen Enabled - BuildTime: 94.712us - GetNewBlockTime: 116.519us - GetResultsTime: 62.478us - HTResizeTime: 2.910us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 15.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.797us EXCHANGE_NODE (id=12):(Total: 2s714ms, non-child: 202.975us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 10.36 KB (10606) - ConvertRowBatchTime: 68.996us - DeserializeRowBatchTimer: 167.851us - FirstBatchArrivalWaitTime: 2s418ms - PeakMemoryUsage: 0 - RowsReturned: 690 (690) - RowsReturnedRate: 254.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 704cb17570766816:e892c0b08b2f81b1 (host=vb0212.halxg.cloudera.com:22000):(Total: 2s320ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Filter 0 arrival: 1s227ms Filter 1 arrival: 1s227ms Filter 2 arrival: 1s233ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 221.08 MB, 224.49 MB, 238.89 MB, 102.06 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 12, 5 - AverageThreadTokens: 6.29 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 252.21 MB (264460216) - PerHostPeakMemUsage: 254.49 MB (266849544) - PrepareTime: 214.696ms - RowsProduced: 564 (564) - TotalCpuTime: 19s520ms - TotalNetworkReceiveTime: 177.855us - TotalNetworkSendTime: 4.935ms - TotalStorageWaitTime: 2s969ms CodeGen:(Total: 1s213ms, non-child: 1s213ms, % non-child: 100.00%) - CodegenTime: 1.160ms - CompileTime: 317.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 691.524ms - PrepareTime: 203.348ms DataStreamSender (dst_id=12):(Total: 1.006ms, non-child: 1.006ms, % non-child: 100.00%) - BytesSent: 8.60 KB (8807) - NetworkThroughput(*): 19.32 MB/sec - OverallThroughput: 8.35 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 537.461us - TransmitDataRPCTime: 434.748us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s309ms, non-child: 416.762ms, % non-child: 18.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 75.380us - GetResultsTime: 105.032us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.74 MB (13359872) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 244.00 /sec - StreamingTime: 178.020ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s892ms, non-child: 10.993ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 105.798us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.689us - GetNewBlockTime: 846.775us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.51 MB (13122304) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.288ms - RowsReturned: 34.84K (34845) - RowsReturnedRate: 18.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.818us EXCHANGE_NODE (id=11):(Total: 49.873us, non-child: 49.873us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.670us - DeserializeRowBatchTimer: 18.760us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s881ms, non-child: 13.728ms, % non-child: 0.73%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.127us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.976us - GetNewBlockTime: 1.192ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.49 MB (13097728) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.998ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 19.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.703us EXCHANGE_NODE (id=10):(Total: 25.652us, non-child: 25.652us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.384us - DeserializeRowBatchTimer: 11.001us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s867ms, non-child: 1s616ms, % non-child: 86.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.185ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 632.483us - GetNewBlockTime: 981.178us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039576) - PinTime: 0.000ns - ProbeRows: 36.30M (36299898) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s564ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 19.15 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.971us EXCHANGE_NODE (id=9):(Total: 747.597us, non-child: 747.597us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 544.660us - DeserializeRowBatchTimer: 2.145ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 20.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 250.382ms, non-child: 250.382ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 147.32 MB, 263.80 MB, 386.44 MB, 422.77 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 9.25 - BytesRead: 438.61 MB (459911198) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.31 MB (459603998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.31 MB (459603998) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 231.28 MB (242517944) - PerReadThreadRawHdfsThroughput: 188.87 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 36.31M (36314066) - RowsReturned: 36.30M (36299898) - RowsReturnedRate: 144.98 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1579) - ScannerThreadsTotalWallClockTime: 19s147ms - MaterializeTupleTime(*): 15s992ms - ScannerThreadsSysTime: 778.876ms - ScannerThreadsUserTime: 5s132ms - ScannerThreadsVoluntaryContextSwitches: 32.62K (32620) - TotalRawHdfsReadTime(*): 2s322ms - TotalReadThroughput: 140.92 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.17K (14168) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 36.30K (36298) - RowGroups rejected: 0 (0) - RowGroups total: 36.30K (36298) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b5 (host=vb0204.halxg.cloudera.com:22000):(Total: 2s304ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Filter 0 arrival: 1s230ms Filter 1 arrival: 1s230ms Filter 2 arrival: 1s237ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 141.89 MB, 244.69 MB, 252.30 MB, 230.95 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 9 - AverageThreadTokens: 7.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 258.06 MB (270598120) - PerHostPeakMemUsage: 260.35 MB (272995640) - PrepareTime: 219.274ms - RowsProduced: 564 (564) - TotalCpuTime: 19s675ms - TotalNetworkReceiveTime: 119.299us - TotalNetworkSendTime: 15.719ms - TotalStorageWaitTime: 2s923ms CodeGen:(Total: 1s216ms, non-child: 1s216ms, % non-child: 100.00%) - CodegenTime: 1.046ms - CompileTime: 316.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 691.685ms - PrepareTime: 207.974ms DataStreamSender (dst_id=12):(Total: 868.229us, non-child: 868.229us, % non-child: 100.00%) - BytesSent: 8.81 KB (9025) - NetworkThroughput(*): 22.64 MB/sec - OverallThroughput: 9.91 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 438.983us - TransmitDataRPCTime: 380.161us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s280ms, non-child: 376.467ms, % non-child: 16.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60.296us - GetResultsTime: 61.179us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11841856) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 247.00 /sec - StreamingTime: 171.010ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s904ms, non-child: 11.031ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 55.940us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 15.385us - GetNewBlockTime: 594.758us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.07 MB (11604288) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.426ms - RowsReturned: 36.15K (36151) - RowsReturnedRate: 18.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.319us EXCHANGE_NODE (id=11):(Total: 30.178us, non-child: 30.178us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 19.824us - DeserializeRowBatchTimer: 19.377us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 33.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s893ms, non-child: 14.231ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 22.974us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 10.702us - GetNewBlockTime: 608.226us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11579712) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.186ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 19.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=10):(Total: 15.574us, non-child: 15.574us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 8.738us - DeserializeRowBatchTimer: 176.006us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 23.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s879ms, non-child: 1s677ms, % non-child: 89.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 6.560ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 670.354us - GetNewBlockTime: 585.620us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039672) - PinTime: 0.000ns - ProbeRows: 37.46M (37459947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s621ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 19.71 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 929.000ns EXCHANGE_NODE (id=9):(Total: 692.199us, non-child: 692.199us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 545.224us - DeserializeRowBatchTimer: 2.660ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 200.648ms, non-child: 200.648ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 32 Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:50% 2:0% 3:0% 4:25% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:96 BytesRead(500.000ms): 0, 0, 81.76 MB, 208.68 MB, 313.66 MB, 447.94 MB - AverageHdfsReadThreadConcurrency: 1.50 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 453.92 MB (475966344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 453.53 MB (475556744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 453.53 MB (475556744) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 236.15 MB (247625040) - PerReadThreadRawHdfsThroughput: 184.87 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 37.47M (37472260) - RowsReturned: 37.46M (37459947) - RowsReturnedRate: 186.69 M/sec - ScanRangesComplete: 32 (32) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1602) - ScannerThreadsTotalWallClockTime: 19s287ms - MaterializeTupleTime(*): 16s207ms - ScannerThreadsSysTime: 725.884ms - ScannerThreadsUserTime: 4s970ms - ScannerThreadsVoluntaryContextSwitches: 35.66K (35655) - TotalRawHdfsReadTime(*): 2s455ms - TotalReadThroughput: 149.31 MB/sec Filter 0 (4.00 KB): - Rows processed: 524.26K (524256) - Rows rejected: 12.31K (12313) - Rows total: 524.29K (524288) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.35K (37347) - RowGroups rejected: 0 (0) - RowGroups total: 37.35K (37347) - Rows processed: 524.26K (524256) - Rows rejected: 0 (0) - Rows total: 524.29K (524288) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81a8 (host=vb0214.halxg.cloudera.com:22000):(Total: 2s277ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Filter 0 arrival: 1s225ms Filter 1 arrival: 1s225ms Filter 2 arrival: 1s230ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 133.32 MB, 227.74 MB, 304.38 MB, 219.71 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 9 - AverageThreadTokens: 7.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 315.30 MB (330620944) - PerHostPeakMemUsage: 317.58 MB (333010272) - PrepareTime: 213.822ms - RowsProduced: 564 (564) - TotalCpuTime: 20s070ms - TotalNetworkReceiveTime: 468.719us - TotalNetworkSendTime: 4.780ms - TotalStorageWaitTime: 4s246ms CodeGen:(Total: 1s210ms, non-child: 1s210ms, % non-child: 100.00%) - CodegenTime: 1.070ms - CompileTime: 316.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 691.247ms - PrepareTime: 202.734ms DataStreamSender (dst_id=12):(Total: 844.670us, non-child: 844.670us, % non-child: 100.00%) - BytesSent: 8.52 KB (8724) - NetworkThroughput(*): 25.33 MB/sec - OverallThroughput: 9.85 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 472.043us - TransmitDataRPCTime: 328.506us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s265ms, non-child: 408.208ms, % non-child: 18.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 54.139us - GetResultsTime: 97.677us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.78 MB (12352744) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 248.00 /sec - StreamingTime: 168.171ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s857ms, non-child: 10.964ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 57.119us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 33.527us - GetNewBlockTime: 533.347us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.55 MB (12115176) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.367ms - RowsReturned: 36.18K (36181) - RowsReturnedRate: 19.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.613us EXCHANGE_NODE (id=11):(Total: 30.413us, non-child: 30.413us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 18.846us - DeserializeRowBatchTimer: 18.210us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 32.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s846ms, non-child: 13.573ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.869us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.032us - GetNewBlockTime: 1.109ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.53 MB (12090600) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.767ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us EXCHANGE_NODE (id=10):(Total: 32.269us, non-child: 32.269us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 7.181us - DeserializeRowBatchTimer: 13.059us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s833ms, non-child: 1s642ms, % non-child: 89.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 3.406ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 316.539us - GetNewBlockTime: 866.133us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039448) - PinTime: 0.000ns - ProbeRows: 37.68M (37681030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s587ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.229us EXCHANGE_NODE (id=9):(Total: 813.534us, non-child: 813.534us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 329.356us - DeserializeRowBatchTimer: 2.299ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 18.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 190.153ms, non-child: 190.153ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:25% 2:0% 3:50% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 75.70 MB, 248.16 MB, 402.92 MB, 457.13 MB - AverageHdfsReadThreadConcurrency: 1.75 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 457.13 MB (479330749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 455.95 MB (478101949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 455.95 MB (478101949) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 294.39 MB (308695056) - PerReadThreadRawHdfsThroughput: 131.44 MB/sec - RemoteScanRanges: 12 (12) - RowsRead: 37.69M (37692944) - RowsReturned: 37.68M (37681030) - RowsReturnedRate: 198.16 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1550) - ScannerThreadsTotalWallClockTime: 20s060ms - MaterializeTupleTime(*): 15s661ms - ScannerThreadsSysTime: 730.885ms - ScannerThreadsUserTime: 5s086ms - ScannerThreadsVoluntaryContextSwitches: 36.41K (36407) - TotalRawHdfsReadTime(*): 3s477ms - TotalReadThroughput: 152.38 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.91K (11914) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.52K (37523) - RowGroups rejected: 0 (0) - RowGroups total: 37.52K (37523) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b0 (host=vb0218.halxg.cloudera.com:22000):(Total: 2s226ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Filter 1 arrival: 1s219ms Filter 0 arrival: 1s219ms Filter 2 arrival: 1s225ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 232.14 MB, 225.84 MB, 287.01 MB, 151.74 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 11, 7 - AverageThreadTokens: 6.43 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 292.24 MB (306434560) - PerHostPeakMemUsage: 294.52 MB (308823888) - PrepareTime: 210.619ms - RowsProduced: 564 (564) - TotalCpuTime: 19s570ms - TotalNetworkReceiveTime: 103.434us - TotalNetworkSendTime: 4.045ms - TotalStorageWaitTime: 2s819ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.074ms - CompileTime: 315.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.773ms - PrepareTime: 199.493ms DataStreamSender (dst_id=12):(Total: 806.869us, non-child: 806.869us, % non-child: 100.00%) - BytesSent: 8.47 KB (8671) - NetworkThroughput(*): 30.34 MB/sec - OverallThroughput: 10.25 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 490.462us - TransmitDataRPCTime: 272.546us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s215ms, non-child: 407.898ms, % non-child: 18.41%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 57.860us - GetResultsTime: 106.815us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11839320) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 254.00 /sec - StreamingTime: 169.212ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s807ms, non-child: 11.157ms, % non-child: 0.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 112.532us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.130us - GetNewBlockTime: 1.268ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11601752) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.530ms - RowsReturned: 35.84K (35840) - RowsReturnedRate: 19.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.881us EXCHANGE_NODE (id=11):(Total: 48.300us, non-child: 48.300us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.463us - DeserializeRowBatchTimer: 19.977us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s796ms, non-child: 14.169ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.094us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.532us - GetNewBlockTime: 1.140ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11577176) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.385ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 20.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.638us EXCHANGE_NODE (id=10):(Total: 29.097us, non-child: 29.097us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.288us - DeserializeRowBatchTimer: 11.628us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s782ms, non-child: 1s591ms, % non-child: 89.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.224ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 638.402us - GetNewBlockTime: 1.176ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038312) - PinTime: 0.000ns - ProbeRows: 37.08M (37082146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s542ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 20.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.856us EXCHANGE_NODE (id=9):(Total: 700.345us, non-child: 700.345us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 562.041us - DeserializeRowBatchTimer: 2.243ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 190.315ms, non-child: 190.315ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 30 Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:90 BytesRead(500.000ms): 0, 0, 138.72 MB, 280.83 MB, 448.99 MB, 448.99 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 9.50 - BytesRead: 448.99 MB (470799910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.70 MB (470492710) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.70 MB (470492710) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 272.87 MB (286124376) - PerReadThreadRawHdfsThroughput: 176.85 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37093767) - RowsReturned: 37.08M (37082146) - RowsReturnedRate: 194.85 M/sec - ScanRangesComplete: 30 (30) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1581) - ScannerThreadsTotalWallClockTime: 19s146ms - MaterializeTupleTime(*): 16s164ms - ScannerThreadsSysTime: 742.881ms - ScannerThreadsUserTime: 5s121ms - ScannerThreadsVoluntaryContextSwitches: 35.90K (35901) - TotalRawHdfsReadTime(*): 2s538ms - TotalReadThroughput: 149.66 MB/sec Filter 0 (4.00 KB): - Rows processed: 491.49K (491490) - Rows rejected: 11.62K (11621) - Rows total: 491.52K (491520) Filter 1 (4.00 KB): - Files processed: 30 (30) - Files rejected: 0 (0) - Files total: 30 (30) - RowGroups processed: 36.91K (36913) - RowGroups rejected: 0 (0) - RowGroups total: 36.91K (36913) - Rows processed: 491.49K (491490) - Rows rejected: 0 (0) - Rows total: 491.52K (491520) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81ad (host=vb0230.halxg.cloudera.com:22000):(Total: 2s222ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Filter 0 arrival: 1s221ms Filter 1 arrival: 1s221ms Filter 2 arrival: 1s227ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 201.23 MB, 229.64 MB, 241.34 MB, 164.01 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 7 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 267.69 MB (280691672) - PerHostPeakMemUsage: 269.97 MB (283081000) - PrepareTime: 213.960ms - RowsProduced: 564 (564) - TotalCpuTime: 19s186ms - TotalNetworkReceiveTime: 138.784us - TotalNetworkSendTime: 28.617ms - TotalStorageWaitTime: 2s893ms CodeGen:(Total: 1s206ms, non-child: 1s206ms, % non-child: 100.00%) - CodegenTime: 1.100ms - CompileTime: 316.215ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 687.413ms - PrepareTime: 202.609ms DataStreamSender (dst_id=12):(Total: 982.032us, non-child: 982.032us, % non-child: 100.00%) - BytesSent: 8.44 KB (8640) - NetworkThroughput(*): 18.12 MB/sec - OverallThroughput: 8.39 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 482.935us - TransmitDataRPCTime: 454.848us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s187ms, non-child: 356.754ms, % non-child: 16.31%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 54.334us - GetResultsTime: 68.710us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11837120) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 257.00 /sec - StreamingTime: 156.512ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s830ms, non-child: 10.857ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 108.093us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.894us - GetNewBlockTime: 1.179ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11599552) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.171ms - RowsReturned: 34.74K (34738) - RowsReturnedRate: 18.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.756us EXCHANGE_NODE (id=11):(Total: 49.093us, non-child: 49.093us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.619us - DeserializeRowBatchTimer: 21.554us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s819ms, non-child: 13.516ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.174us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 11.081us - GetNewBlockTime: 1.428ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11574976) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.509ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 19.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.917us EXCHANGE_NODE (id=10):(Total: 25.769us, non-child: 25.769us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.679us - DeserializeRowBatchTimer: 10.833us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s806ms, non-child: 1s621ms, % non-child: 89.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.061ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 643.684us - GetNewBlockTime: 1.357ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038744) - PinTime: 0.000ns - ProbeRows: 35.79M (35792492) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s569ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 19.69 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.325us EXCHANGE_NODE (id=9):(Total: 695.063us, non-child: 695.063us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 533.127us - DeserializeRowBatchTimer: 2.113ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 184.337ms, non-child: 184.337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 120.02 MB, 235.31 MB, 362.66 MB, 432.69 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 432.69 MB (453711238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 432.11 MB (453096838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 432.11 MB (453096838) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 246.76 MB (258749400) - PerReadThreadRawHdfsThroughput: 200.56 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.80M (35804448) - RowsReturned: 35.79M (35792492) - RowsReturnedRate: 194.17 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1520) - ScannerThreadsTotalWallClockTime: 18s865ms - MaterializeTupleTime(*): 15s816ms - ScannerThreadsSysTime: 704.886ms - ScannerThreadsUserTime: 4s905ms - ScannerThreadsVoluntaryContextSwitches: 34.35K (34348) - TotalRawHdfsReadTime(*): 2s157ms - TotalReadThroughput: 144.23 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.96K (11956) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 35.68K (35679) - RowGroups rejected: 0 (0) - RowGroups total: 35.68K (35679) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b2 (host=vb0220.halxg.cloudera.com:22000):(Total: 2s221ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Filter 1 arrival: 1s219ms Filter 0 arrival: 1s219ms Filter 2 arrival: 1s225ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 198.16 MB, 202.56 MB, 260.42 MB, 190.00 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 8 - AverageThreadTokens: 7.67 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 292.64 MB (306851536) - PerHostPeakMemUsage: 294.92 MB (309240864) - PrepareTime: 210.019ms - RowsProduced: 564 (564) - TotalCpuTime: 18s574ms - TotalNetworkReceiveTime: 135.263us - TotalNetworkSendTime: 46.012ms - TotalStorageWaitTime: 3s319ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.129ms - CompileTime: 315.455ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 690.075ms - PrepareTime: 198.864ms DataStreamSender (dst_id=12):(Total: 959.116us, non-child: 959.116us, % non-child: 100.00%) - BytesSent: 8.87 KB (9085) - NetworkThroughput(*): 22.62 MB/sec - OverallThroughput: 9.03 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 533.015us - TransmitDataRPCTime: 383.066us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s168ms, non-child: 399.643ms, % non-child: 18.43%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.960us - GetResultsTime: 105.597us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.28 MB (11831512) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 260.00 /sec - StreamingTime: 163.226ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s768ms, non-child: 10.836ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 126.096us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.333us - GetNewBlockTime: 1.189ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11593944) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.207ms - RowsReturned: 35.48K (35475) - RowsReturnedRate: 20.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.363us EXCHANGE_NODE (id=11):(Total: 50.723us, non-child: 50.723us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.251us - DeserializeRowBatchTimer: 18.990us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s758ms, non-child: 13.364ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 43.327us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.092us - GetNewBlockTime: 1.094ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.03 MB (11569368) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.688ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 20.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.716us EXCHANGE_NODE (id=10):(Total: 26.984us, non-child: 26.984us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.968us - DeserializeRowBatchTimer: 13.839us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s744ms, non-child: 1s556ms, % non-child: 89.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.114ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 625.621us - GetNewBlockTime: 1.171ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037112) - PinTime: 0.000ns - ProbeRows: 36.55M (36551452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s509ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 20.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.085us EXCHANGE_NODE (id=9):(Total: 696.431us, non-child: 696.431us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 539.785us - DeserializeRowBatchTimer: 2.169ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 187.785ms, non-child: 187.785ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 29 Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:0% 2:50% 3:25% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:87 BytesRead(500.000ms): 0, 0, 122.76 MB, 207.27 MB, 374.29 MB, 442.37 MB - AverageHdfsReadThreadConcurrency: 1.75 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 442.37 MB (463853916) - BytesReadDataNodeCache: 0 - BytesReadLocal: 441.68 MB (463137116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 441.68 MB (463137116) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 273.25 MB (286519512) - PerReadThreadRawHdfsThroughput: 165.75 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.56M (36562683) - RowsReturned: 36.55M (36551452) - RowsReturnedRate: 194.64 M/sec - ScanRangesComplete: 29 (29) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1402) - ScannerThreadsTotalWallClockTime: 18s561ms - MaterializeTupleTime(*): 15s084ms - ScannerThreadsSysTime: 689.887ms - ScannerThreadsUserTime: 4s648ms - ScannerThreadsVoluntaryContextSwitches: 35.39K (35391) - TotalRawHdfsReadTime(*): 2s668ms - TotalReadThroughput: 147.46 MB/sec Filter 0 (4.00 KB): - Rows processed: 475.11K (475107) - Rows rejected: 11.23K (11231) - Rows total: 475.14K (475136) Filter 1 (4.00 KB): - Files processed: 29 (29) - Files rejected: 0 (0) - Files total: 29 (29) - RowGroups processed: 36.35K (36352) - RowGroups rejected: 0 (0) - RowGroups total: 36.35K (36352) - Rows processed: 475.11K (475107) - Rows rejected: 0 (0) - Rows total: 475.14K (475136) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81ae (host=vb0222.halxg.cloudera.com:22000):(Total: 2s217ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Filter 0 arrival: 1s220ms Filter 1 arrival: 1s221ms Filter 2 arrival: 1s226ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 248.65 MB, 196.68 MB, 211.20 MB, 93.11 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 12, 4 - AverageThreadTokens: 6.14 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 249.07 MB (261165672) - PerHostPeakMemUsage: 251.35 MB (263555000) - PrepareTime: 211.241ms - RowsProduced: 564 (564) - TotalCpuTime: 18s496ms - TotalNetworkReceiveTime: 112.770us - TotalNetworkSendTime: 15.148ms - TotalStorageWaitTime: 3s194ms CodeGen:(Total: 1s206ms, non-child: 1s206ms, % non-child: 100.00%) - CodegenTime: 1.195ms - CompileTime: 317.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 688.977ms - PrepareTime: 200.064ms DataStreamSender (dst_id=12):(Total: 993.632us, non-child: 993.632us, % non-child: 100.00%) - BytesSent: 8.54 KB (8744) - NetworkThroughput(*): 25.09 MB/sec - OverallThroughput: 8.39 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 628.112us - TransmitDataRPCTime: 332.408us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s196ms, non-child: 409.373ms, % non-child: 18.64%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.069us - GetResultsTime: 107.403us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.29 MB (12890488) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 256.00 /sec - StreamingTime: 157.755ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s786ms, non-child: 11.564ms, % non-child: 0.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 53.174us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 25.374us - GetNewBlockTime: 605.203us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12652920) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.973ms - RowsReturned: 35.88K (35876) - RowsReturnedRate: 20.08 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.179us EXCHANGE_NODE (id=11):(Total: 28.638us, non-child: 28.638us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 19.362us - DeserializeRowBatchTimer: 19.439us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 34.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s775ms, non-child: 14.087ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 68.634us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.578us - GetNewBlockTime: 1.041ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.04 MB (12628344) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.338ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 20.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.669us EXCHANGE_NODE (id=10):(Total: 26.858us, non-child: 26.858us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.550us - DeserializeRowBatchTimer: 8.550us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s761ms, non-child: 1s586ms, % non-child: 90.06%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.398ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 336.179us - GetNewBlockTime: 805.522us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038248) - PinTime: 0.000ns - ProbeRows: 36.66M (36660584) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s540ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 20.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.078us EXCHANGE_NODE (id=9):(Total: 648.652us, non-child: 648.652us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 512.736us - DeserializeRowBatchTimer: 2.183ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 174.358ms, non-child: 174.358ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 39 Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:25% 2:25% 3:0% 4:25% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:117 BytesRead(500.000ms): 0, 0, 160.90 MB, 219.28 MB, 363.19 MB, 442.65 MB - AverageHdfsReadThreadConcurrency: 1.75 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 442.65 MB (464154286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 442.16 MB (463642286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 442.16 MB (463642286) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 228.14 MB (239223400) - PerReadThreadRawHdfsThroughput: 187.52 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.68M (36675563) - RowsReturned: 36.66M (36660584) - RowsReturnedRate: 210.26 M/sec - ScanRangesComplete: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 1.02K (1022) - ScannerThreadsTotalWallClockTime: 18s465ms - MaterializeTupleTime(*): 15s129ms - ScannerThreadsSysTime: 524.913ms - ScannerThreadsUserTime: 3s861ms - ScannerThreadsVoluntaryContextSwitches: 33.59K (33587) - TotalRawHdfsReadTime(*): 2s360ms - TotalReadThroughput: 147.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 638.94K (638937) - Rows rejected: 14.98K (14979) - Rows total: 638.98K (638976) Filter 1 (4.00 KB): - Files processed: 39 (39) - Files rejected: 0 (0) - Files total: 39 (39) - RowGroups processed: 36.68K (36681) - RowGroups rejected: 0 (0) - RowGroups total: 36.68K (36681) - Rows processed: 638.94K (638937) - Rows rejected: 0 (0) - Rows total: 638.98K (638976) - Splits processed: 39 (39) - Splits rejected: 0 (0) - Splits total: 39 (39) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81ac (host=vb0208.halxg.cloudera.com:22000):(Total: 2s173ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Filter 0 arrival: 1s224ms Filter 1 arrival: 1s224ms Filter 2 arrival: 1s230ms MemoryUsage(500.000ms): 0, 2.08 MB, 2.88 MB, 212.24 MB, 218.53 MB, 225.53 MB, 41.23 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 9, 2 - AverageThreadTokens: 5.43 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 248.77 MB (260853976) - PerHostPeakMemUsage: 251.05 MB (263243304) - PrepareTime: 215.136ms - RowsProduced: 564 (564) - TotalCpuTime: 18s152ms - TotalNetworkReceiveTime: 148.155us - TotalNetworkSendTime: 24.787ms - TotalStorageWaitTime: 3s228ms CodeGen:(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 313.551ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 691.516ms - PrepareTime: 204.123ms DataStreamSender (dst_id=12):(Total: 632.037us, non-child: 632.037us, % non-child: 100.00%) - BytesSent: 8.48 KB (8679) - NetworkThroughput(*): 33.33 MB/sec - OverallThroughput: 13.10 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 339.535us - TransmitDataRPCTime: 248.313us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s142ms, non-child: 368.625ms, % non-child: 17.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 67.153us - GetResultsTime: 59.441us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11839112) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 263.00 /sec - StreamingTime: 166.709ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s773ms, non-child: 10.616ms, % non-child: 0.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 111.340us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.993us - GetNewBlockTime: 1.247ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11601544) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.129ms - RowsReturned: 35.16K (35159) - RowsReturnedRate: 19.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.588us EXCHANGE_NODE (id=11):(Total: 52.953us, non-child: 52.953us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.312us - DeserializeRowBatchTimer: 21.585us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s762ms, non-child: 13.248ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.513us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.361us - GetNewBlockTime: 1.370ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11576968) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.480ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 20.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.031us EXCHANGE_NODE (id=10):(Total: 28.558us, non-child: 28.558us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.962us - DeserializeRowBatchTimer: 10.867us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s749ms, non-child: 1s562ms, % non-child: 89.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.409ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 315.715us - GetNewBlockTime: 1.230ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038384) - PinTime: 0.000ns - ProbeRows: 36.39M (36392001) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s514ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 20.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.702us EXCHANGE_NODE (id=9):(Total: 691.298us, non-child: 691.298us, % non-child: 100.00%) BytesReceived(500.000ms): 261.27 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 521.039us - DeserializeRowBatchTimer: 2.356ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 186.110ms, non-child: 186.110ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 192.01 MB, 298.44 MB, 428.67 MB, 440.67 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 7.75 - BytesRead: 440.67 MB (462080766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 439.99 MB (461363966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 439.99 MB (461363966) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 227.84 MB (238911704) - PerReadThreadRawHdfsThroughput: 172.03 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.41M (36406157) - RowsReturned: 36.39M (36392001) - RowsReturnedRate: 195.54 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1440) - ScannerThreadsTotalWallClockTime: 18s139ms - MaterializeTupleTime(*): 14s725ms - ScannerThreadsSysTime: 785.873ms - ScannerThreadsUserTime: 5s325ms - ScannerThreadsVoluntaryContextSwitches: 34.76K (34755) - TotalRawHdfsReadTime(*): 2s561ms - TotalReadThroughput: 146.89 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 14.16K (14156) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 35 (35) - Files rejected: 0 (0) - Files total: 35 (35) - RowGroups processed: 36.39K (36392) - RowGroups rejected: 0 (0) - RowGroups total: 36.39K (36392) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81af (host=vb0224.halxg.cloudera.com:22000):(Total: 2s099ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Filter 0 arrival: 1s217ms Filter 1 arrival: 1s218ms Filter 2 arrival: 1s223ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 167.41 MB, 181.86 MB, 219.04 MB, 174.67 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 11, 8 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 272.68 MB (285924032) - PerHostPeakMemUsage: 274.96 MB (288313360) - PrepareTime: 211.985ms - RowsProduced: 564 (564) - TotalCpuTime: 17s983ms - TotalNetworkReceiveTime: 130.223us - TotalNetworkSendTime: 15.056ms - TotalStorageWaitTime: 4s087ms CodeGen:(Total: 1s203ms, non-child: 1s203ms, % non-child: 100.00%) - CodegenTime: 1.069ms - CompileTime: 314.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 687.760ms - PrepareTime: 200.933ms DataStreamSender (dst_id=12):(Total: 1.476ms, non-child: 1.476ms, % non-child: 100.00%) - BytesSent: 8.48 KB (8684) - NetworkThroughput(*): 10.16 MB/sec - OverallThroughput: 5.61 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 628.310us - TransmitDataRPCTime: 815.453us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s078ms, non-child: 367.496ms, % non-child: 17.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.074us - GetResultsTime: 106.670us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.95 MB (12525904) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 271.00 /sec - StreamingTime: 167.870ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s711ms, non-child: 10.963ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 109.080us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.710us - GetNewBlockTime: 1.116ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.72 MB (12288336) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.292ms - RowsReturned: 34.83K (34832) - RowsReturnedRate: 20.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.080us EXCHANGE_NODE (id=11):(Total: 47.173us, non-child: 47.173us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.751us - DeserializeRowBatchTimer: 20.533us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s700ms, non-child: 12.876ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.828us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 14.014us - GetNewBlockTime: 1.213ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.70 MB (12263760) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.101ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 20.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.699us EXCHANGE_NODE (id=10):(Total: 27.980us, non-child: 27.980us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.750us - DeserializeRowBatchTimer: 9.392us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s687ms, non-child: 1s505ms, % non-child: 89.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.103ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 638.591us - GetNewBlockTime: 1.144ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036520) - PinTime: 0.000ns - ProbeRows: 35.98M (35976925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s461ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 21.15 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.924us EXCHANGE_NODE (id=9):(Total: 660.934us, non-child: 660.934us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 509.646us - DeserializeRowBatchTimer: 3.399ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 180.990ms, non-child: 180.990ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 38 Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:0% 2:25% 3:50% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:114 BytesRead(500.000ms): 0, 0, 91.91 MB, 202.63 MB, 367.96 MB, 435.74 MB - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 435.74 MB (456903383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.15 MB (456288983) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.15 MB (456288983) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 253.28 MB (265587416) - PerReadThreadRawHdfsThroughput: 144.88 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.99M (35991725) - RowsReturned: 35.98M (35976925) - RowsReturnedRate: 198.78 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1366) - ScannerThreadsTotalWallClockTime: 17s970ms - MaterializeTupleTime(*): 13s720ms - ScannerThreadsSysTime: 725.885ms - ScannerThreadsUserTime: 4s724ms - ScannerThreadsVoluntaryContextSwitches: 34.81K (34811) - TotalRawHdfsReadTime(*): 3s007ms - TotalReadThroughput: 145.25 MB/sec Filter 0 (4.00 KB): - Rows processed: 622.55K (622554) - Rows rejected: 14.80K (14800) - Rows total: 622.59K (622592) Filter 1 (4.00 KB): - Files processed: 38 (38) - Files rejected: 0 (0) - Files total: 38 (38) - RowGroups processed: 36.01K (36013) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36013) - Rows processed: 622.55K (622554) - Rows rejected: 0 (0) - Rows total: 622.59K (622592) - Splits processed: 38 (38) - Splits rejected: 0 (0) - Splits total: 38 (38) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81aa (host=vb0216.halxg.cloudera.com:22000):(Total: 2s099ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Filter 0 arrival: 1s219ms Filter 1 arrival: 1s219ms Filter 2 arrival: 1s225ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 164.50 MB, 185.67 MB, 201.42 MB, 154.24 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 7 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 242.37 MB (254146256) - PerHostPeakMemUsage: 244.65 MB (256535584) - PrepareTime: 212.487ms - RowsProduced: 564 (564) - TotalCpuTime: 17s051ms - TotalNetworkReceiveTime: 121.457us - TotalNetworkSendTime: 13.611ms - TotalStorageWaitTime: 3s288ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.104ms - CompileTime: 314.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.217ms - PrepareTime: 201.477ms DataStreamSender (dst_id=12):(Total: 1.049ms, non-child: 1.049ms, % non-child: 100.00%) - BytesSent: 8.43 KB (8628) - NetworkThroughput(*): 23.98 MB/sec - OverallThroughput: 7.84 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 663.448us - TransmitDataRPCTime: 343.068us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s079ms, non-child: 401.664ms, % non-child: 19.31%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.070us - GetResultsTime: 106.725us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11839592) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 271.00 /sec - StreamingTime: 164.456ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s677ms, non-child: 10.879ms, % non-child: 0.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 53.613us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 23.355us - GetNewBlockTime: 553.072us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11602024) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.370ms - RowsReturned: 35.19K (35186) - RowsReturnedRate: 20.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.197us EXCHANGE_NODE (id=11):(Total: 47.890us, non-child: 47.890us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 38.202us - DeserializeRowBatchTimer: 19.373us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s667ms, non-child: 13.604ms, % non-child: 0.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 51.211us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.713us - GetNewBlockTime: 973.840us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11577448) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.944ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 21.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.613us EXCHANGE_NODE (id=10):(Total: 25.202us, non-child: 25.202us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.300us - DeserializeRowBatchTimer: 8.465us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s653ms, non-child: 1s473ms, % non-child: 89.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.462ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 630.970us - GetNewBlockTime: 723.779us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036968) - PinTime: 0.000ns - ProbeRows: 36.05M (36046248) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s430ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 21.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=9):(Total: 678.431us, non-child: 678.431us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 533.903us - DeserializeRowBatchTimer: 2.164ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 179.668ms, non-child: 179.668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:25% 2:0% 3:25% 4:25% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 93.73 MB, 215.73 MB, 329.41 MB, 435.61 MB - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 435.61 MB (456770099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.22 MB (456360499) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.22 MB (456360499) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 223.02 MB (233856064) - PerReadThreadRawHdfsThroughput: 180.51 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.06M (36059456) - RowsReturned: 36.05M (36046248) - RowsReturnedRate: 200.63 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.34K (1340) - ScannerThreadsTotalWallClockTime: 17s039ms - MaterializeTupleTime(*): 13s578ms - ScannerThreadsSysTime: 752.879ms - ScannerThreadsUserTime: 4s976ms - ScannerThreadsVoluntaryContextSwitches: 34.69K (34692) - TotalRawHdfsReadTime(*): 2s413ms - TotalReadThroughput: 145.20 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.21K (13208) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 35.99K (35993) - RowGroups rejected: 0 (0) - RowGroups total: 35.99K (35993) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b6 (host=vb0232.halxg.cloudera.com:22000):(Total: 2s098ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Filter 1 arrival: 1s215ms Filter 0 arrival: 1s215ms Filter 2 arrival: 1s220ms MemoryUsage(500.000ms): 0, 2.88 MB, 2.88 MB, 189.68 MB, 217.74 MB, 195.31 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 9 - AverageThreadTokens: 6.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 240.07 MB (251731904) - PerHostPeakMemUsage: 242.35 MB (254121232) - PrepareTime: 212.699ms - RowsProduced: 564 (564) - TotalCpuTime: 17s525ms - TotalNetworkReceiveTime: 106.592us - TotalNetworkSendTime: 4.014ms - TotalStorageWaitTime: 3s341ms CodeGen:(Total: 1s201ms, non-child: 1s201ms, % non-child: 100.00%) - CodegenTime: 1.115ms - CompileTime: 316.487ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 682.675ms - PrepareTime: 201.601ms DataStreamSender (dst_id=12):(Total: 1.055ms, non-child: 1.055ms, % non-child: 100.00%) - BytesSent: 8.41 KB (8611) - NetworkThroughput(*): 24.44 MB/sec - OverallThroughput: 7.78 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 630.483us - TransmitDataRPCTime: 335.999us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s088ms, non-child: 409.458ms, % non-child: 19.61%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50.742us - GetResultsTime: 115.493us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12895344) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 270.00 /sec - StreamingTime: 168.651ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s678ms, non-child: 10.583ms, % non-child: 0.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 111.460us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.481us - GetNewBlockTime: 1.148ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12657776) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.181ms - RowsReturned: 34.30K (34300) - RowsReturnedRate: 20.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.043us EXCHANGE_NODE (id=11):(Total: 61.826us, non-child: 61.826us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.222us - DeserializeRowBatchTimer: 18.368us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 16.21 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s667ms, non-child: 13.695ms, % non-child: 0.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 46.824us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 18.811us - GetNewBlockTime: 1.162ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.05 MB (12633200) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.930ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 21.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.612us EXCHANGE_NODE (id=10):(Total: 22.067us, non-child: 22.067us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 12.847us - DeserializeRowBatchTimer: 10.240us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s654ms, non-child: 1s461ms, % non-child: 88.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.835ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 645.649us - GetNewBlockTime: 830.313us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040016) - PinTime: 0.000ns - ProbeRows: 35.53M (35527574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s417ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 21.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.401us EXCHANGE_NODE (id=9):(Total: 663.216us, non-child: 663.216us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 532.716us - DeserializeRowBatchTimer: 2.447ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 191.818ms, non-child: 191.818ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:33.33% 2:33.33% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 180.23 MB, 288.76 MB, 421.02 MB - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 428.91 MB (449745737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 428.52 MB (449336137) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 428.52 MB (449336137) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 218.14 MB (228738896) - PerReadThreadRawHdfsThroughput: 166.87 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 35.54M (35541507) - RowsReturned: 35.53M (35527574) - RowsReturnedRate: 185.21 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1452) - ScannerThreadsTotalWallClockTime: 17s513ms - MaterializeTupleTime(*): 14s001ms - ScannerThreadsSysTime: 784.876ms - ScannerThreadsUserTime: 5s448ms - ScannerThreadsVoluntaryContextSwitches: 34.79K (34790) - TotalRawHdfsReadTime(*): 2s570ms - TotalReadThroughput: 168.41 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.93K (13933) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 35.54K (35536) - RowGroups rejected: 0 (0) - RowGroups total: 35.54K (35536) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b4 (host=vb0206.halxg.cloudera.com:22000):(Total: 2s096ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Filter 0 arrival: 1s210ms Filter 1 arrival: 1s211ms Filter 2 arrival: 1s216ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 156.11 MB, 214.53 MB, 284.39 MB, 84.37 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 11, 4 - AverageThreadTokens: 6.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 312.20 MB (327370480) - PerHostPeakMemUsage: 314.48 MB (329759808) - PrepareTime: 211.280ms - RowsProduced: 564 (564) - TotalCpuTime: 17s569ms - TotalNetworkReceiveTime: 154.845us - TotalNetworkSendTime: 49.093ms - TotalStorageWaitTime: 3s609ms CodeGen:(Total: 1s196ms, non-child: 1s196ms, % non-child: 100.00%) - CodegenTime: 1.155ms - CompileTime: 313.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 681.726ms - PrepareTime: 200.104ms DataStreamSender (dst_id=12):(Total: 837.448us, non-child: 837.448us, % non-child: 100.00%) - BytesSent: 8.47 KB (8670) - NetworkThroughput(*): 24.22 MB/sec - OverallThroughput: 9.87 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 465.008us - TransmitDataRPCTime: 341.338us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s040ms, non-child: 377.684ms, % non-child: 18.51%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 79.480us - GetResultsTime: 106.032us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12895056) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 276.00 /sec - StreamingTime: 159.196ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s662ms, non-child: 10.954ms, % non-child: 0.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 109.181us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.348us - GetNewBlockTime: 650.118us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12657488) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.371ms - RowsReturned: 34.83K (34830) - RowsReturnedRate: 20.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.345us EXCHANGE_NODE (id=11):(Total: 48.864us, non-child: 48.864us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.931us - DeserializeRowBatchTimer: 22.494us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s651ms, non-child: 13.533ms, % non-child: 0.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.504us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.588us - GetNewBlockTime: 1.013ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.05 MB (12632912) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.907ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 21.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.516us EXCHANGE_NODE (id=10):(Total: 26.500us, non-child: 26.500us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.880us - DeserializeRowBatchTimer: 26.511us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s638ms, non-child: 1s473ms, % non-child: 89.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.278ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 316.849us - GetNewBlockTime: 1.305ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037232) - PinTime: 0.000ns - ProbeRows: 36.01M (36010376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s433ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 21.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.643us EXCHANGE_NODE (id=9):(Total: 586.222us, non-child: 586.222us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 413.118us - DeserializeRowBatchTimer: 2.131ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 163.746ms, non-child: 163.746ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 97.50 MB, 245.24 MB, 436.45 MB, 436.45 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 8.75 - BytesRead: 436.45 MB (457655084) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.57 MB (456733484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.57 MB (456733484) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 291.28 MB (305428208) - PerReadThreadRawHdfsThroughput: 164.96 MB/sec - RemoteScanRanges: 9 (9) - RowsRead: 36.02M (36024352) - RowsReturned: 36.01M (36010376) - RowsReturnedRate: 219.92 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1324) - ScannerThreadsTotalWallClockTime: 17s558ms - MaterializeTupleTime(*): 13s800ms - ScannerThreadsSysTime: 643.896ms - ScannerThreadsUserTime: 4s496ms - ScannerThreadsVoluntaryContextSwitches: 34.91K (34907) - TotalRawHdfsReadTime(*): 2s645ms - TotalReadThroughput: 145.48 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.98K (13976) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.01K (36009) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36009) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81b3 (host=vb0228.halxg.cloudera.com:22000):(Total: 2s082ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Filter 0 arrival: 1s235ms Filter 1 arrival: 1s235ms Filter 2 arrival: 1s241ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 219.58 MB, 225.73 MB, 229.12 MB, 36.12 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 10, 2 - AverageThreadTokens: 5.57 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 251.58 MB (263802016) - PerHostPeakMemUsage: 253.86 MB (266191344) - PrepareTime: 212.037ms - RowsProduced: 564 (564) - TotalCpuTime: 17s654ms - TotalNetworkReceiveTime: 143.387us - TotalNetworkSendTime: 39.361ms - TotalStorageWaitTime: 2s449ms CodeGen:(Total: 1s221ms, non-child: 1s221ms, % non-child: 100.00%) - CodegenTime: 1.103ms - CompileTime: 317.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 703.292ms - PrepareTime: 200.739ms DataStreamSender (dst_id=12):(Total: 1.516ms, non-child: 1.516ms, % non-child: 100.00%) - BytesSent: 8.48 KB (8687) - NetworkThroughput(*): 17.89 MB/sec - OverallThroughput: 5.46 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 1.005ms - TransmitDataRPCTime: 463.156us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s035ms, non-child: 363.093ms, % non-child: 17.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.071us - GetResultsTime: 100.791us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11838008) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 277.00 /sec - StreamingTime: 164.054ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s672ms, non-child: 10.961ms, % non-child: 0.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 55.202us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 21.874us - GetNewBlockTime: 746.671us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11600440) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.376ms - RowsReturned: 35.07K (35072) - RowsReturnedRate: 20.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.561us EXCHANGE_NODE (id=11):(Total: 51.563us, non-child: 51.563us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 44.640us - DeserializeRowBatchTimer: 30.297us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s661ms, non-child: 13.719ms, % non-child: 0.83%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 50.002us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.598us - GetNewBlockTime: 1.064ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11575864) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.794ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 21.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.927us EXCHANGE_NODE (id=10):(Total: 36.645us, non-child: 36.645us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.825us - DeserializeRowBatchTimer: 13.179us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s647ms, non-child: 1s491ms, % non-child: 90.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.466ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 635.607us - GetNewBlockTime: 899.258us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036192) - PinTime: 0.000ns - ProbeRows: 36.07M (36074797) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s445ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 21.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.364us EXCHANGE_NODE (id=9):(Total: 664.128us, non-child: 664.128us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 504.478us - DeserializeRowBatchTimer: 2.194ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 154.880ms, non-child: 154.880ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 151.27 MB, 252.34 MB, 407.52 MB, 436.64 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 436.64 MB (457845252) - BytesReadDataNodeCache: 0 - BytesReadLocal: 436.24 MB (457435652) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 436.24 MB (457435652) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 231.30 MB (242539680) - PerReadThreadRawHdfsThroughput: 213.85 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.09M (36088679) - RowsReturned: 36.07M (36074797) - RowsReturnedRate: 232.92 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1235) - ScannerThreadsTotalWallClockTime: 17s025ms - MaterializeTupleTime(*): 14s431ms - ScannerThreadsSysTime: 626.900ms - ScannerThreadsUserTime: 4s186ms - ScannerThreadsVoluntaryContextSwitches: 33.91K (33909) - TotalRawHdfsReadTime(*): 2s041ms - TotalReadThroughput: 145.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.88K (13882) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.07K (36068) - RowGroups rejected: 0 (0) - RowGroups total: 36.07K (36068) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81ab (host=vb0234.halxg.cloudera.com:22000):(Total: 2s081ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Filter 0 arrival: 1s241ms Filter 1 arrival: 1s241ms Filter 2 arrival: 1s248ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 156.48 MB, 207.51 MB, 212.31 MB, 155.08 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 7 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 249.65 MB (261778776) - PerHostPeakMemUsage: 251.93 MB (264168104) - PrepareTime: 213.616ms - RowsProduced: 564 (564) - TotalCpuTime: 17s595ms - TotalNetworkReceiveTime: 155.240us - TotalNetworkSendTime: 30.811ms - TotalStorageWaitTime: 2s929ms CodeGen:(Total: 1s227ms, non-child: 1s227ms, % non-child: 100.00%) - CodegenTime: 1.178ms - CompileTime: 321.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 703.216ms - PrepareTime: 201.943ms DataStreamSender (dst_id=12):(Total: 1.178ms, non-child: 1.178ms, % non-child: 100.00%) - BytesSent: 8.56 KB (8769) - NetworkThroughput(*): 20.84 MB/sec - OverallThroughput: 7.10 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 741.866us - TransmitDataRPCTime: 401.232us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s042ms, non-child: 379.151ms, % non-child: 18.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.551us - GetResultsTime: 69.581us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.22 MB (13857360) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 276.00 /sec - StreamingTime: 178.998ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s663ms, non-child: 11.472ms, % non-child: 0.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 109.832us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.740us - GetNewBlockTime: 1.014ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.99 MB (13619792) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.716ms - RowsReturned: 36.02K (36020) - RowsReturnedRate: 21.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.417us EXCHANGE_NODE (id=11):(Total: 51.060us, non-child: 51.060us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.276us - DeserializeRowBatchTimer: 22.279us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s652ms, non-child: 12.762ms, % non-child: 0.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 46.763us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.426us - GetNewBlockTime: 1.256ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.97 MB (13595216) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.816ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 22.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.111us EXCHANGE_NODE (id=10):(Total: 27.367us, non-child: 27.367us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.508us - DeserializeRowBatchTimer: 11.478us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s639ms, non-child: 1s475ms, % non-child: 89.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 6.029ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 634.775us - GetNewBlockTime: 1.151ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039168) - PinTime: 0.000ns - ProbeRows: 37.08M (37078673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s431ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 22.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.115us EXCHANGE_NODE (id=9):(Total: 755.463us, non-child: 755.463us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 576.476us - DeserializeRowBatchTimer: 3.601ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 20.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 163.475ms, non-child: 163.475ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 83.69 MB, 206.08 MB, 363.15 MB, 448.33 MB - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 448.33 MB (470112363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.04 MB (469805163) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.04 MB (469805163) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 228.74 MB (239852888) - PerReadThreadRawHdfsThroughput: 215.77 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37092714) - RowsReturned: 37.08M (37078673) - RowsReturnedRate: 226.81 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1395) - ScannerThreadsTotalWallClockTime: 17s432ms - MaterializeTupleTime(*): 14s335ms - ScannerThreadsSysTime: 667.893ms - ScannerThreadsUserTime: 4s545ms - ScannerThreadsVoluntaryContextSwitches: 36.02K (36020) - TotalRawHdfsReadTime(*): 2s077ms - TotalReadThroughput: 149.44 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.04K (14041) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 37.05K (37046) - RowGroups rejected: 0 (0) - RowGroups total: 37.05K (37046) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 704cb17570766816:e892c0b08b2f81a9 (host=vb0226.halxg.cloudera.com:22000):(Total: 2s027ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Filter 0 arrival: 1s242ms Filter 1 arrival: 1s242ms Filter 2 arrival: 1s247ms MemoryUsage(500.000ms): 0, 2.28 MB, 2.88 MB, 191.90 MB, 211.16 MB, 197.15 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 8 - AverageThreadTokens: 5.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 272.70 MB (285951576) - PerHostPeakMemUsage: 274.98 MB (288340904) - PrepareTime: 215.474ms - RowsProduced: 564 (564) - TotalCpuTime: 17s213ms - TotalNetworkReceiveTime: 65.720us - TotalNetworkSendTime: 19.839ms - TotalStorageWaitTime: 3s687ms CodeGen:(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%) - CodegenTime: 1.089ms - CompileTime: 313.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 693.419ms - PrepareTime: 204.262ms DataStreamSender (dst_id=12):(Total: 859.131us, non-child: 859.131us, % non-child: 100.00%) - BytesSent: 8.58 KB (8789) - NetworkThroughput(*): 26.62 MB/sec - OverallThroughput: 9.76 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 497.263us - TransmitDataRPCTime: 314.909us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s001ms, non-child: 362.751ms, % non-child: 18.12%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 72.171us - GetResultsTime: 58.624us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11838464) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 281.00 /sec - StreamingTime: 160.899ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s638ms, non-child: 10.039ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 114.746us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.123us - GetNewBlockTime: 1.231ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11600896) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.425ms - RowsReturned: 35.57K (35570) - RowsReturnedRate: 21.71 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.048us EXCHANGE_NODE (id=11):(Total: 45.945us, non-child: 45.945us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 33.487us - DeserializeRowBatchTimer: 19.186us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s628ms, non-child: 14.469ms, % non-child: 0.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.444us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.458us - GetNewBlockTime: 1.095ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11576320) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.685ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 22.33 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.272us EXCHANGE_NODE (id=10):(Total: 32.067us, non-child: 32.067us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 15.063us - DeserializeRowBatchTimer: 9.192us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s614ms, non-child: 1s453ms, % non-child: 90.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.975ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 647.954us - GetNewBlockTime: 935.711us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040304) - PinTime: 0.000ns - ProbeRows: 36.29M (36291418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s413ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 22.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.229us EXCHANGE_NODE (id=9):(Total: 578.401us, non-child: 578.401us, % non-child: 100.00%) BytesReceived(500.000ms): 331.01 KB, 612.24 KB, 612.24 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 496.556us - DeserializeRowBatchTimer: 2.313ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 160.091ms, non-child: 160.091ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:33.33% 3:33.33% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 164.05 MB, 273.97 MB, 431.25 MB - AverageHdfsReadThreadConcurrency: 1.67 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 439.07 MB (460401841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.59 MB (459889841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.59 MB (459889841) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 251.92 MB (264156760) - PerReadThreadRawHdfsThroughput: 170.98 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.30M (36304703) - RowsReturned: 36.29M (36291418) - RowsReturnedRate: 226.69 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1256) - ScannerThreadsTotalWallClockTime: 17s201ms - MaterializeTupleTime(*): 13s365ms - ScannerThreadsSysTime: 657.894ms - ScannerThreadsUserTime: 4s581ms - ScannerThreadsVoluntaryContextSwitches: 35.07K (35074) - TotalRawHdfsReadTime(*): 2s567ms - TotalReadThroughput: 172.50 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.29K (13285) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.23K (36231) - RowGroups rejected: 0 (0) - RowGroups total: 36.23K (36231) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Fragment F03: Instance 704cb17570766816:e892c0b08b2f81b7 (host=vb0230.halxg.cloudera.com:22000):(Total: 231.205ms, non-child: 227.038ms, % non-child: 98.20%) Hdfs split stats (:<# splits>/): 7:1/88.92 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 76.123us - RowsProduced: 1.00K (1002) - TotalCpuTime: 9.677ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 223.298ms - TotalStorageWaitTime: 3.025ms DataStreamSender (dst_id=11):(Total: 401.342us, non-child: 401.342us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 436.49 MB/sec - OverallThroughput: 296.41 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 72.747us - TransmitDataRPCTime: 272.543us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.766ms, non-child: 3.766ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.758us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 266.05 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.552ms - MaterializeTupleTime(*): 81.102us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 63.588us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 704cb17570766816:e892c0b08b2f81b8 (host=vb0228.halxg.cloudera.com:22000):(Total: 235.884ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/2.17 MB MemoryUsage(500.000ms): 0, 128.00 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.20 MB (5451832) - PrepareTime: 206.259ms - RowsProduced: 365 (365) - TotalCpuTime: 607.592ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.328us - TotalStorageWaitTime: 14.601ms CodeGen:(Total: 562.884ms, non-child: 562.884ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 72.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 285.738ms - PrepareTime: 203.545ms DataStreamSender (dst_id=10):(Total: 471.763us, non-child: 471.763us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 104.83 MB/sec - OverallThroughput: 91.12 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 28.191us - TransmitDataRPCTime: 410.082us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 438.598ms, non-child: 438.598ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 217.563us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 48.41 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 832.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 25.966ms - MaterializeTupleTime(*): 9.583ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 9.692ms - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 704cb17570766816:e892c0b08b2f81b9 (host=vb0234.halxg.cloudera.com:22000):(Total: 298.002ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/28.28 MB MemoryUsage(500.000ms): 38.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 201.801ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 751.503ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 783.272us - TotalStorageWaitTime: 7.334ms CodeGen:(Total: 568.105ms, non-child: 568.105ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 287.481ms - PrepareTime: 199.980ms DataStreamSender (dst_id=9):(Total: 7.657ms, non-child: 7.657ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 2.75 GB/sec - OverallThroughput: 1.14 GB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 4.414ms - TransmitDataRPCTime: 3.187ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 490.759ms, non-child: 490.759ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.146ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.39 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 92.298ms - MaterializeTupleTime(*): 78.628ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 81.987ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 1.788ms - TotalReadThroughput: 0.00 /sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 540.09us | 0ns | 540.09us | 564 | 100 | | 08:TOP-N | 15 | 456.41us | 0ns | 547.55us | 564 | 100 | | 13:AGGREGATE | 15 | 213.08ms | 0ns | 223.69ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 211.76us | 0ns | 248.35us | 8.46K | 3.83K | | 07:AGGREGATE | 15 | 361.65ms | 0ns | 403.15ms | 8.46K | 3.83K | | 06:HASH JOIN | 15 | 10.34ms | 0ns | 10.92ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 49.11us | 0ns | 61.37us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 3.96ms | 0ns | 3.96ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 12.70ms | 0ns | 13.35ms | 542.70K | 4.27K | | |--10:EXCHANGE | 15 | 25.69us | 0ns | 33.55us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 428.68ms | 0ns | 428.68ms | 365 | 114 | | 04:HASH JOIN | 15 | 1.51s | 0ns | 1.66s | 542.70K | 68.35K | | |--09:EXCHANGE | 15 | 610.86us | 0ns | 714.13us | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 492.22ms | 0ns | 492.22ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 170.69ms | 0ns | 193.84ms | 546.93M | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=324e6bda6a0762b7:6c5c00026bef0492): Summary: Session ID: c1418b726159af96:cf53b518fa0c8ea3 Session Type: BEESWAX Start Time: 2016-05-01 23:11:49.614552000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a6aba933a52514c663a6dfb21fca25ea71413073) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:54854 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=20B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.95KB | tuple-ids=6 row-size=20B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=24B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=126B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=122B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=110B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=36.41GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=20B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 38.425ms - Analysis finished: 11.886ms (11.886ms) - Equivalence classes computed: 14.258ms (2.372ms) - Single node plan created: 28.016ms (13.757ms) - Runtime filters computed: 28.367ms (350.952us) - Distributed plan created: 32.649ms (4.282ms) - Lineage info computed: 33.855ms (1.205ms) - Planning finished: 38.425ms (4.569ms) Query Timeline: 3s385ms - Start execution: 317.973us (317.973us) - Planning finished: 49.996ms (49.678ms) - Ready to start 33 remote fragments: 55.944ms (5.947ms) - All 33 remote fragments started: 86.700ms (30.756ms) - Rows available: 3s343ms (3s256ms) - First row fetched: 3s364ms (21.102ms) ImpalaServer: - ClientFetchWaitTimer: 21.777ms - RowMaterializationTimer: 954.971us Execution Profile 324e6bda6a0762b7:6c5c00026bef0492:(Total: 3s298ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 8ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(263.92 MB) vb0206.halxg.cloudera.com:22000(315.92 MB) vb0228.halxg.cloudera.com:22000(281.93 MB) vb0220.halxg.cloudera.com:22000(300.06 MB) vb0212.halxg.cloudera.com:22000(267.49 MB) vb0218.halxg.cloudera.com:22000(315.93 MB) vb0224.halxg.cloudera.com:22000(268.92 MB) vb0222.halxg.cloudera.com:22000(252.41 MB) vb0230.halxg.cloudera.com:22000(275.94 MB) vb0208.halxg.cloudera.com:22000(296.48 MB) vb0234.halxg.cloudera.com:22000(281.94 MB) vb0216.halxg.cloudera.com:22000(293.36 MB) vb0226.halxg.cloudera.com:22000(316.90 MB) vb0214.halxg.cloudera.com:22000(323.48 MB) vb0204.halxg.cloudera.com:22000(296.49 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 3s253ms, non-child: 1.085ms, % non-child: 0.03%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 72.41 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 174.197us - RowsProduced: 100 (100) - TotalCpuTime: 3s311ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 3s252ms, non-child: 540.091us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 9.71 KB - BytesReceived: 9.71 KB (9940) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 697.464us - FirstBatchArrivalWaitTime: 3s251ms - MergeGetNext: 431.638us - MergeGetNextBatch: 84.213us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 173.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 2s859ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:3s276ms max:3s289ms mean: 3s282ms stddev:4.053ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447273) - PerHostPeakMemUsage: 290.08 MB (304169203) - PrepareTime: 211.496ms - RowsProduced: 37 (37) - TotalCpuTime: 634.283ms - TotalNetworkReceiveTime: 2s644ms - TotalNetworkSendTime: 400.754us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 628.341ms, non-child: 628.341ms, % non-child: 100.00%) - CodegenTime: 1.298ms - CompileTime: 88.806ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.629ms - PrepareTime: 209.260ms DataStreamSender (dst_id=14):(Total: 122.983us, non-child: 122.983us, % non-child: 100.00%) - BytesSent: 662.00 B (662) - NetworkThroughput(*): 15.90 MB/sec - OverallThroughput: 5.36 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 55.134us - TransmitDataRPCTime: 41.944us - UncompressedRowBatchSize: 1.03 KB (1056) SORT_NODE (id=8):(Total: 2s858ms, non-child: 456.407us, % non-child: 0.02%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s857ms, non-child: 213.082ms, % non-child: 7.46%) - BuildTime: 103.022us - GetNewBlockTime: 126.767us - GetResultsTime: 64.436us - HTResizeTime: 2.858us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.654us EXCHANGE_NODE (id=12):(Total: 2s644ms, non-child: 2s644ms, % non-child: 100.00%) - BytesReceived: 8.54 KB (8747) - ConvertRowBatchTime: 57.666us - DeserializeRowBatchTimer: 489.236us - FirstBatchArrivalWaitTime: 2s342ms - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 212.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 2s082ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.36 GB, max: 2.50 GB, avg: 2.43 GB, stddev: 40.05 MB completion times: min:2s966ms max:3s275ms mean: 3s096ms stddev:77.060ms execution rates: min:768.61 MB/sec max:829.00 MB/sec mean:803.21 MB/sec stddev:15.74 MB/sec num instances: 15 - AverageThreadTokens: 7.20 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 287.80 MB (301779329) - PerHostPeakMemUsage: 290.08 MB (304169203) - PrepareTime: 212.975ms - RowsProduced: 564 (564) - TotalCpuTime: 20s468ms - TotalNetworkReceiveTime: 106.611us - TotalNetworkSendTime: 11.693ms - TotalStorageWaitTime: 608.944ms CodeGen:(Total: 1s210ms, non-child: 1s210ms, % non-child: 100.00%) - CodegenTime: 1.128ms - CompileTime: 316.279ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 691.617ms - PrepareTime: 201.806ms DataStreamSender (dst_id=12):(Total: 881.564us, non-child: 881.564us, % non-child: 100.00%) - BytesSent: 8.54 KB (8747) - NetworkThroughput(*): 27.62 MB/sec - OverallThroughput: 9.97 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 507.313us - TransmitDataRPCTime: 332.728us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s064ms, non-child: 361.646ms, % non-child: 17.52%) - GetNewBlockTime: 63.866us - GetResultsTime: 76.379us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.11 MB (12702842) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 273.00 /sec - StreamingTime: 159.586ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s702ms, non-child: 10.340ms, % non-child: 0.61%) - BuildPartitionTime: 130.547us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.042us - GetNewBlockTime: 953.972us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.89 MB (12465274) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.785ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 20.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.009us EXCHANGE_NODE (id=11):(Total: 49.107us, non-child: 49.107us, % non-child: 100.00%) - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 32.909us - DeserializeRowBatchTimer: 21.549us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s692ms, non-child: 12.704ms, % non-child: 0.75%) - BuildPartitionTime: 45.494us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 16.819us - GetNewBlockTime: 1.060ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.86 MB (12440698) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.923ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 21.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.704us EXCHANGE_NODE (id=10):(Total: 25.687us, non-child: 25.687us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.338us - DeserializeRowBatchTimer: 19.295us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s679ms, non-child: 1s508ms, % non-child: 89.80%) - BuildPartitionTime: 4.773ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 604.473us - GetNewBlockTime: 1.061ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038393) - PinTime: 0.000ns - ProbeRows: 36.46M (36461704) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s463ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 21.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.890us EXCHANGE_NODE (id=9):(Total: 610.864us, non-child: 610.864us, % non-child: 100.00%) - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 485.371us - DeserializeRowBatchTimer: 2.270ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 25.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 170.687ms, non-child: 170.687ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 9.74 - BytesRead: 441.19 MB (462616144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 440.65 MB (462056357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 440.65 MB (462056357) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 267.38 MB (280370232) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.48M (36475001) - RowsReturned: 36.46M (36461704) - RowsReturnedRate: 214.99 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1510) - ScannerThreadsTotalWallClockTime: 17s983ms - MaterializeTupleTime(*): 17s203ms - ScannerThreadsSysTime: 706.887ms - ScannerThreadsUserTime: 4s835ms - ScannerThreadsVoluntaryContextSwitches: 34.96K (34962) - TotalRawHdfsReadTime(*): 370.850ms - TotalReadThroughput: 150.92 MB/sec Filter 0 (4.00 KB): - Rows processed: 563.58K (563575) - Rows rejected: 13.30K (13297) - Rows total: 563.61K (563609) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.41K (36405) - RowGroups rejected: 0 (0) - RowGroups total: 36.41K (36405) - Rows processed: 563.58K (563575) - Rows rejected: 0 (0) - Rows total: 563.61K (563609) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Averaged Fragment F03:(Total: 224.926ms, non-child: 220.615ms, % non-child: 98.08%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:225.151ms max:225.151ms mean: 225.151ms stddev:0.000ns execution rates: min:394.94 KB/sec max:394.94 KB/sec mean:394.94 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 97.366us - RowsProduced: 1.00K (1002) - TotalCpuTime: 10.203ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.461ms - TotalStorageWaitTime: 3.239ms DataStreamSender (dst_id=11):(Total: 352.082us, non-child: 352.082us, % non-child: 100.00%) - BytesSent: 121.79 KB (124710) - NetworkThroughput(*): 542.23 MB/sec - OverallThroughput: 337.80 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 61.582us - TransmitDataRPCTime: 219.340us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.958ms, non-child: 3.958ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 887.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 253.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.701ms - MaterializeTupleTime(*): 44.687us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 59.192us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 224.454ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:588.453ms max:588.453ms mean: 588.453ms stddev:0.000ns execution rates: min:3.68 MB/sec max:3.68 MB/sec mean:3.68 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.00 MB (5244448) - PrepareTime: 208.036ms - RowsProduced: 365 (365) - TotalCpuTime: 595.298ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.763us - TotalStorageWaitTime: 5.018ms CodeGen:(Total: 567.962ms, non-child: 567.962ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 74.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 287.941ms - PrepareTime: 205.237ms DataStreamSender (dst_id=10):(Total: 250.536us, non-child: 250.536us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 229.21 MB/sec - OverallThroughput: 171.58 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 30.811us - TransmitDataRPCTime: 187.541us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 428.683ms, non-child: 428.683ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 182.766us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 713.36 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 851.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 12.417ms - MaterializeTupleTime(*): 6.265ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 657.753us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 300.817ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:666.937ms max:666.937ms mean: 666.937ms stddev:0.000ns execution rates: min:42.41 MB/sec max:42.41 MB/sec mean:42.41 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 204.103ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 750.088ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 934.947us - TotalStorageWaitTime: 7.464ms CodeGen:(Total: 566.924ms, non-child: 566.924ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 285.142ms - PrepareTime: 202.361ms DataStreamSender (dst_id=9):(Total: 10.905ms, non-child: 10.905ms, % non-child: 100.00%) - BytesSent: 9.47 MB (9931545) - NetworkThroughput(*): 2.80 GB/sec - OverallThroughput: 868.51 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 7.562ms - TransmitDataRPCTime: 3.305ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 492.222ms, non-child: 492.222ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.333ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 92.142ms - MaterializeTupleTime(*): 78.142ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 82.987ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 1.832ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 324e6bda6a0762b7:6c5c00026bef04a0 (host=vb0206.halxg.cloudera.com:22000):(Total: 2s864ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 315.92 MB (331269064) - PrepareTime: 212.222ms - RowsProduced: 37 (37) - TotalCpuTime: 632.027ms - TotalNetworkReceiveTime: 2s648ms - TotalNetworkSendTime: 396.747us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 626.409ms, non-child: 626.409ms, % non-child: 100.00%) - CodegenTime: 1.197ms - CompileTime: 87.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.158ms - PrepareTime: 210.099ms DataStreamSender (dst_id=14):(Total: 120.812us, non-child: 120.812us, % non-child: 100.00%) - BytesSent: 662.00 B (662) - NetworkThroughput(*): 11.53 MB/sec - OverallThroughput: 5.23 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 40.191us - TransmitDataRPCTime: 54.736us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s863ms, non-child: 391.323us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s862ms, non-child: 213.794ms, % non-child: 7.47%) ExecOption: Codegen Enabled - BuildTime: 90.640us - GetNewBlockTime: 124.565us - GetResultsTime: 92.356us - HTResizeTime: 3.222us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.572us EXCHANGE_NODE (id=12):(Total: 2s648ms, non-child: 175.108us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 8.28 KB (8475) - ConvertRowBatchTime: 49.800us - DeserializeRowBatchTimer: 271.673us - FirstBatchArrivalWaitTime: 2s345ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 209.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049c (host=vb0218.halxg.cloudera.com:22000):(Total: 2s863ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447072) - PerHostPeakMemUsage: 315.93 MB (331273888) - PrepareTime: 212.091ms - RowsProduced: 25 (25) - TotalCpuTime: 631.654ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 372.535us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 625.889ms, non-child: 625.889ms, % non-child: 100.00%) - CodegenTime: 1.219ms - CompileTime: 87.651ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.641ms - PrepareTime: 209.984ms DataStreamSender (dst_id=14):(Total: 142.054us, non-child: 142.054us, % non-child: 100.00%) - BytesSent: 429.00 B (429) - NetworkThroughput(*): 7.97 MB/sec - OverallThroughput: 2.88 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 25 (25) - SerializeBatchTime: 65.373us - TransmitDataRPCTime: 51.324us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 2s862ms, non-child: 440.831us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec AGGREGATION_NODE (id=13):(Total: 2s861ms, non-child: 213.828ms, % non-child: 7.47%) ExecOption: Codegen Enabled - BuildTime: 76.492us - GetNewBlockTime: 118.738us - GetResultsTime: 52.185us - HTResizeTime: 2.539us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.670us EXCHANGE_NODE (id=12):(Total: 2s647ms, non-child: 202.515us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 408.00 B - BytesReceived: 5.93 KB (6075) - ConvertRowBatchTime: 50.131us - DeserializeRowBatchTimer: 342.945us - FirstBatchArrivalWaitTime: 2s345ms - PeakMemoryUsage: 0 - RowsReturned: 375 (375) - RowsReturnedRate: 141.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049d (host=vb0212.halxg.cloudera.com:22000):(Total: 2s862ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 267.49 MB (280485352) - PrepareTime: 210.620ms - RowsProduced: 39 (39) - TotalCpuTime: 632.199ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 304.785us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 626.620ms, non-child: 626.620ms, % non-child: 100.00%) - CodegenTime: 1.296ms - CompileTime: 89.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.204ms - PrepareTime: 208.407ms DataStreamSender (dst_id=14):(Total: 109.748us, non-child: 109.748us, % non-child: 100.00%) - BytesSent: 685.00 B (685) - NetworkThroughput(*): 17.25 MB/sec - OverallThroughput: 5.95 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 43.796us - TransmitDataRPCTime: 37.878us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s860ms, non-child: 392.494us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s860ms, non-child: 212.193ms, % non-child: 7.42%) ExecOption: Codegen Enabled - BuildTime: 229.594us - GetNewBlockTime: 131.213us - GetResultsTime: 74.430us - HTResizeTime: 2.677us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.469us EXCHANGE_NODE (id=12):(Total: 2s648ms, non-child: 248.354us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.19 KB - BytesReceived: 8.90 KB (9118) - ConvertRowBatchTime: 58.679us - DeserializeRowBatchTimer: 348.589us - FirstBatchArrivalWaitTime: 2s345ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 220.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef04a2 (host=vb0232.halxg.cloudera.com:22000):(Total: 2s861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447360) - PerHostPeakMemUsage: 263.92 MB (276742192) - PrepareTime: 214.686ms - RowsProduced: 43 (43) - TotalCpuTime: 637.729ms - TotalNetworkReceiveTime: 2s643ms - TotalNetworkSendTime: 317.185us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 632.097ms, non-child: 632.097ms, % non-child: 100.00%) - CodegenTime: 1.313ms - CompileTime: 88.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.196ms - PrepareTime: 212.466ms DataStreamSender (dst_id=14):(Total: 93.051us, non-child: 93.051us, % non-child: 100.00%) - BytesSent: 758.00 B (758) - NetworkThroughput(*): 18.94 MB/sec - OverallThroughput: 7.77 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 43 (43) - SerializeBatchTime: 27.289us - TransmitDataRPCTime: 38.172us - UncompressedRowBatchSize: 1.18 KB (1208) SORT_NODE (id=8):(Total: 2s860ms, non-child: 456.942us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 15.00 /sec AGGREGATION_NODE (id=13):(Total: 2s859ms, non-child: 216.242ms, % non-child: 7.56%) ExecOption: Codegen Enabled - BuildTime: 105.335us - GetNewBlockTime: 116.996us - GetResultsTime: 72.072us - HTResizeTime: 2.790us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 15.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.467us EXCHANGE_NODE (id=12):(Total: 2s643ms, non-child: 197.653us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 7.10 KB - BytesReceived: 9.70 KB (9936) - ConvertRowBatchTime: 55.159us - DeserializeRowBatchTimer: 409.417us - FirstBatchArrivalWaitTime: 2s340ms - PeakMemoryUsage: 0 - RowsReturned: 645 (645) - RowsReturnedRate: 243.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049b (host=vb0224.halxg.cloudera.com:22000):(Total: 2s861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 268.92 MB (281986288) - PrepareTime: 206.938ms - RowsProduced: 33 (33) - TotalCpuTime: 627.876ms - TotalNetworkReceiveTime: 2s651ms - TotalNetworkSendTime: 314.372us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 622.345ms, non-child: 622.345ms, % non-child: 100.00%) - CodegenTime: 1.395ms - CompileTime: 88.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.401ms - PrepareTime: 204.661ms DataStreamSender (dst_id=14):(Total: 152.599us, non-child: 152.599us, % non-child: 100.00%) - BytesSent: 589.00 B (589) - NetworkThroughput(*): 13.32 MB/sec - OverallThroughput: 3.68 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 84.644us - TransmitDataRPCTime: 42.169us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s860ms, non-child: 495.204us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s859ms, non-child: 208.173ms, % non-child: 7.28%) ExecOption: Codegen Enabled - BuildTime: 86.198us - GetNewBlockTime: 125.426us - GetResultsTime: 57.228us - HTResizeTime: 3.628us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.565us EXCHANGE_NODE (id=12):(Total: 2s651ms, non-child: 222.222us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.56 KB (7741) - ConvertRowBatchTime: 55.737us - DeserializeRowBatchTimer: 564.383us - FirstBatchArrivalWaitTime: 2s348ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049e (host=vb0220.halxg.cloudera.com:22000):(Total: 2s860ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447344) - PerHostPeakMemUsage: 300.06 MB (314633568) - PrepareTime: 211.489ms - RowsProduced: 42 (42) - TotalCpuTime: 635.127ms - TotalNetworkReceiveTime: 2s645ms - TotalNetworkSendTime: 322.994us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 628.984ms, non-child: 628.984ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 89.185ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.974ms - PrepareTime: 209.178ms DataStreamSender (dst_id=14):(Total: 91.475us, non-child: 91.475us, % non-child: 100.00%) - BytesSent: 730.00 B (730) - NetworkThroughput(*): 18.95 MB/sec - OverallThroughput: 7.61 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 42 (42) - SerializeBatchTime: 28.387us - TransmitDataRPCTime: 36.747us - UncompressedRowBatchSize: 1.15 KB (1180) SORT_NODE (id=8):(Total: 2s859ms, non-child: 469.207us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s858ms, non-child: 213.054ms, % non-child: 7.45%) ExecOption: Codegen Enabled - BuildTime: 100.383us - GetNewBlockTime: 121.922us - GetResultsTime: 59.194us - HTResizeTime: 3.236us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.035us EXCHANGE_NODE (id=12):(Total: 2s645ms, non-child: 217.603us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.58 KB (9808) - ConvertRowBatchTime: 67.666us - DeserializeRowBatchTimer: 275.492us - FirstBatchArrivalWaitTime: 2s343ms - PeakMemoryUsage: 0 - RowsReturned: 630 (630) - RowsReturnedRate: 238.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0496 (host=vb0216.halxg.cloudera.com:22000):(Total: 2s860ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447216) - PerHostPeakMemUsage: 293.36 MB (307609680) - PrepareTime: 209.456ms - RowsProduced: 34 (34) - TotalCpuTime: 629.106ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 359.672us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 623.399ms, non-child: 623.399ms, % non-child: 100.00%) - CodegenTime: 1.223ms - CompileTime: 87.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.653ms - PrepareTime: 207.296ms DataStreamSender (dst_id=14):(Total: 152.951us, non-child: 152.951us, % non-child: 100.00%) - BytesSent: 582.00 B (582) - NetworkThroughput(*): 10.91 MB/sec - OverallThroughput: 3.63 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 34 (34) - SerializeBatchTime: 75.639us - TransmitDataRPCTime: 50.884us - UncompressedRowBatchSize: 956.00 B (956) SORT_NODE (id=8):(Total: 2s858ms, non-child: 442.369us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s858ms, non-child: 211.103ms, % non-child: 7.39%) ExecOption: Codegen Enabled - BuildTime: 89.621us - GetNewBlockTime: 135.480us - GetResultsTime: 52.174us - HTResizeTime: 2.706us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.907us EXCHANGE_NODE (id=12):(Total: 2s647ms, non-child: 214.109us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 7.40 KB - BytesReceived: 7.92 KB (8106) - ConvertRowBatchTime: 51.765us - DeserializeRowBatchTimer: 3.044ms - FirstBatchArrivalWaitTime: 2s345ms - PeakMemoryUsage: 0 - RowsReturned: 510 (510) - RowsReturnedRate: 192.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0499 (host=vb0230.halxg.cloudera.com:22000):(Total: 2s859ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447328) - PerHostPeakMemUsage: 275.94 MB (289342816) - PrepareTime: 207.772ms - RowsProduced: 41 (41) - TotalCpuTime: 630.330ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 643.964us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 624.652ms, non-child: 624.652ms, % non-child: 100.00%) - CodegenTime: 1.205ms - CompileTime: 88.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.761ms - PrepareTime: 205.631ms DataStreamSender (dst_id=14):(Total: 116.913us, non-child: 116.913us, % non-child: 100.00%) - BytesSent: 721.00 B (721) - NetworkThroughput(*): 22.11 MB/sec - OverallThroughput: 5.88 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 41 (41) - SerializeBatchTime: 59.565us - TransmitDataRPCTime: 31.102us - UncompressedRowBatchSize: 1.12 KB (1152) SORT_NODE (id=8):(Total: 2s857ms, non-child: 467.637us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s857ms, non-child: 209.290ms, % non-child: 7.32%) ExecOption: Codegen Enabled - BuildTime: 95.108us - GetNewBlockTime: 120.005us - GetResultsTime: 59.490us - HTResizeTime: 2.705us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.616us EXCHANGE_NODE (id=12):(Total: 2s647ms, non-child: 220.221us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.08 KB (9302) - ConvertRowBatchTime: 62.137us - DeserializeRowBatchTimer: 312.478us - FirstBatchArrivalWaitTime: 2s345ms - PeakMemoryUsage: 0 - RowsReturned: 615 (615) - RowsReturnedRate: 232.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef04a1 (host=vb0204.halxg.cloudera.com:22000):(Total: 2s859ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 296.49 MB (310893024) - PrepareTime: 221.538ms - RowsProduced: 40 (40) - TotalCpuTime: 648.797ms - TotalNetworkReceiveTime: 2s631ms - TotalNetworkSendTime: 422.908us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 639.438ms, non-child: 639.438ms, % non-child: 100.00%) - CodegenTime: 1.299ms - CompileTime: 88.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.753ms - PrepareTime: 219.251ms DataStreamSender (dst_id=14):(Total: 134.414us, non-child: 134.414us, % non-child: 100.00%) - BytesSent: 704.00 B (704) - NetworkThroughput(*): 16.24 MB/sec - OverallThroughput: 4.99 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 66.538us - TransmitDataRPCTime: 41.343us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s855ms, non-child: 547.554us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s855ms, non-child: 223.692ms, % non-child: 7.83%) ExecOption: Codegen Enabled - BuildTime: 98.329us - GetNewBlockTime: 126.485us - GetResultsTime: 63.639us - HTResizeTime: 2.440us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.081us EXCHANGE_NODE (id=12):(Total: 2s631ms, non-child: 225.238us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.10 KB (9320) - ConvertRowBatchTime: 59.338us - DeserializeRowBatchTimer: 204.350us - FirstBatchArrivalWaitTime: 2s328ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049a (host=vb0222.halxg.cloudera.com:22000):(Total: 2s858ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 252.41 MB (264669816) - PrepareTime: 207.922ms - RowsProduced: 33 (33) - TotalCpuTime: 631.412ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 265.665us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 625.739ms, non-child: 625.739ms, % non-child: 100.00%) - CodegenTime: 1.217ms - CompileTime: 89.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.988ms - PrepareTime: 205.814ms DataStreamSender (dst_id=14):(Total: 145.800us, non-child: 145.800us, % non-child: 100.00%) - BytesSent: 567.00 B (567) - NetworkThroughput(*): 10.25 MB/sec - OverallThroughput: 3.71 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 65.078us - TransmitDataRPCTime: 52.762us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s857ms, non-child: 506.435us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s857ms, non-child: 209.592ms, % non-child: 7.34%) ExecOption: Codegen Enabled - BuildTime: 87.167us - GetNewBlockTime: 121.712us - GetResultsTime: 56.098us - HTResizeTime: 2.859us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.926us EXCHANGE_NODE (id=12):(Total: 2s647ms, non-child: 217.453us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.54 KB (7726) - ConvertRowBatchTime: 59.613us - DeserializeRowBatchTimer: 567.668us - FirstBatchArrivalWaitTime: 2s344ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef049f (host=vb0228.halxg.cloudera.com:22000):(Total: 2s857ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447232) - PerHostPeakMemUsage: 281.93 MB (295623144) - PrepareTime: 206.790ms - RowsProduced: 35 (35) - TotalCpuTime: 633.259ms - TotalNetworkReceiveTime: 2s647ms - TotalNetworkSendTime: 515.724us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 627.933ms, non-child: 627.933ms, % non-child: 100.00%) - CodegenTime: 1.271ms - CompileTime: 90.494ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.211ms - PrepareTime: 204.558ms DataStreamSender (dst_id=14):(Total: 105.857us, non-child: 105.857us, % non-child: 100.00%) - BytesSent: 647.00 B (647) - NetworkThroughput(*): 20.63 MB/sec - OverallThroughput: 5.83 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 35 (35) - SerializeBatchTime: 48.348us - TransmitDataRPCTime: 29.915us - UncompressedRowBatchSize: 984.00 B (984) SORT_NODE (id=8):(Total: 2s856ms, non-child: 467.285us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s855ms, non-child: 208.221ms, % non-child: 7.29%) ExecOption: Codegen Enabled - BuildTime: 83.462us - GetNewBlockTime: 114.583us - GetResultsTime: 59.471us - HTResizeTime: 2.785us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.940us EXCHANGE_NODE (id=12):(Total: 2s647ms, non-child: 162.508us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 535.00 B - BytesReceived: 7.98 KB (8172) - ConvertRowBatchTime: 46.869us - DeserializeRowBatchTimer: 221.660us - FirstBatchArrivalWaitTime: 2s344ms - PeakMemoryUsage: 0 - RowsReturned: 525 (525) - RowsReturnedRate: 198.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0495 (host=vb0226.halxg.cloudera.com:22000):(Total: 2s856ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 316.90 MB (332297944) - PrepareTime: 213.341ms - RowsProduced: 39 (39) - TotalCpuTime: 635.341ms - TotalNetworkReceiveTime: 2s639ms - TotalNetworkSendTime: 375.976us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.677ms, non-child: 629.677ms, % non-child: 100.00%) - CodegenTime: 1.334ms - CompileTime: 89.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.775ms - PrepareTime: 211.112ms DataStreamSender (dst_id=14):(Total: 129.632us, non-child: 129.632us, % non-child: 100.00%) - BytesSent: 696.00 B (696) - NetworkThroughput(*): 16.19 MB/sec - OverallThroughput: 5.12 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 60.536us - TransmitDataRPCTime: 41.009us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s855ms, non-child: 441.479us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s854ms, non-child: 214.872ms, % non-child: 7.53%) ExecOption: Codegen Enabled - BuildTime: 101.090us - GetNewBlockTime: 123.266us - GetResultsTime: 80.524us - HTResizeTime: 2.961us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.517us EXCHANGE_NODE (id=12):(Total: 2s639ms, non-child: 232.725us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 4.06 KB - BytesReceived: 8.73 KB (8940) - ConvertRowBatchTime: 74.306us - DeserializeRowBatchTimer: 159.887us - FirstBatchArrivalWaitTime: 2s338ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 221.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0494 (host=vb0214.halxg.cloudera.com:22000):(Total: 2s856ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 323.48 MB (339195048) - PrepareTime: 210.745ms - RowsProduced: 40 (40) - TotalCpuTime: 632.737ms - TotalNetworkReceiveTime: 2s642ms - TotalNetworkSendTime: 390.886us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 626.995ms, non-child: 626.995ms, % non-child: 100.00%) - CodegenTime: 1.332ms - CompileTime: 88.849ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.993ms - PrepareTime: 208.480ms DataStreamSender (dst_id=14):(Total: 137.908us, non-child: 137.908us, % non-child: 100.00%) - BytesSent: 726.00 B (726) - NetworkThroughput(*): 12.67 MB/sec - OverallThroughput: 5.02 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 55.525us - TransmitDataRPCTime: 54.627us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s854ms, non-child: 435.828us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s854ms, non-child: 212.313ms, % non-child: 7.44%) ExecOption: Codegen Enabled - BuildTime: 101.928us - GetNewBlockTime: 114.612us - GetResultsTime: 60.877us - HTResizeTime: 2.890us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.118us EXCHANGE_NODE (id=12):(Total: 2s642ms, non-child: 212.073us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.03 KB (9246) - ConvertRowBatchTime: 55.931us - DeserializeRowBatchTimer: 249.456us - FirstBatchArrivalWaitTime: 2s340ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0498 (host=vb0208.halxg.cloudera.com:22000):(Total: 2s856ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 296.48 MB (310881448) - PrepareTime: 214.280ms - RowsProduced: 37 (37) - TotalCpuTime: 639.012ms - TotalNetworkReceiveTime: 2s638ms - TotalNetworkSendTime: 581.337us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 633.295ms, non-child: 633.295ms, % non-child: 100.00%) - CodegenTime: 1.486ms - CompileTime: 88.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.273ms - PrepareTime: 211.703ms DataStreamSender (dst_id=14):(Total: 91.994us, non-child: 91.994us, % non-child: 100.00%) - BytesSent: 640.00 B (640) - NetworkThroughput(*): 17.83 MB/sec - OverallThroughput: 6.63 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 39.941us - TransmitDataRPCTime: 34.230us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s854ms, non-child: 400.760us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s854ms, non-child: 215.674ms, % non-child: 7.56%) ExecOption: Codegen Enabled - BuildTime: 91.107us - GetNewBlockTime: 154.287us - GetResultsTime: 63.829us - HTResizeTime: 2.625us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.348us EXCHANGE_NODE (id=12):(Total: 2s638ms, non-child: 204.585us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 3.96 KB - BytesReceived: 8.44 KB (8642) - ConvertRowBatchTime: 55.558us - DeserializeRowBatchTimer: 161.399us - FirstBatchArrivalWaitTime: 2s336ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 210.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 324e6bda6a0762b7:6c5c00026bef0497 (host=vb0234.halxg.cloudera.com:22000):(Total: 2s855ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447408) - PerHostPeakMemUsage: 281.94 MB (295634784) - PrepareTime: 212.555ms - RowsProduced: 46 (46) - TotalCpuTime: 637.639ms - TotalNetworkReceiveTime: 2s639ms - TotalNetworkSendTime: 426.573us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 631.644ms, non-child: 631.644ms, % non-child: 100.00%) - CodegenTime: 1.306ms - CompileTime: 89.302ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 331.457ms - PrepareTime: 210.258ms DataStreamSender (dst_id=14):(Total: 119.537us, non-child: 119.537us, % non-child: 100.00%) - BytesSent: 804.00 B (804) - NetworkThroughput(*): 23.76 MB/sec - OverallThroughput: 6.41 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 46 (46) - SerializeBatchTime: 66.170us - TransmitDataRPCTime: 32.274us - UncompressedRowBatchSize: 1.26 KB (1292) SORT_NODE (id=8):(Total: 2s854ms, non-child: 490.769us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 16.00 /sec AGGREGATION_NODE (id=13):(Total: 2s853ms, non-child: 214.185ms, % non-child: 7.51%) ExecOption: Codegen Enabled - BuildTime: 108.890us - GetNewBlockTime: 152.226us - GetResultsTime: 62.986us - HTResizeTime: 2.808us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 16.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.586us EXCHANGE_NODE (id=12):(Total: 2s639ms, non-child: 224.122us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 10.36 KB (10606) - ConvertRowBatchTime: 62.304us - DeserializeRowBatchTimer: 204.609us - FirstBatchArrivalWaitTime: 2s337ms - PeakMemoryUsage: 0 - RowsReturned: 690 (690) - RowsReturnedRate: 261.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 324e6bda6a0762b7:6c5c00026bef04a9 (host=vb0222.halxg.cloudera.com:22000):(Total: 2s255ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Filter 0 arrival: 1s226ms Filter 1 arrival: 1s226ms Filter 2 arrival: 1s232ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 213.47 MB, 237.85 MB, 226.18 MB, 161.74 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 7 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 250.13 MB (262280488) - PerHostPeakMemUsage: 252.41 MB (264669816) - PrepareTime: 214.732ms - RowsProduced: 564 (564) - TotalCpuTime: 21s915ms - TotalNetworkReceiveTime: 108.793us - TotalNetworkSendTime: 5.010ms - TotalStorageWaitTime: 664.687ms CodeGen:(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%) - CodegenTime: 1.100ms - CompileTime: 317.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 690.850ms - PrepareTime: 203.363ms DataStreamSender (dst_id=12):(Total: 981.504us, non-child: 981.504us, % non-child: 100.00%) - BytesSent: 8.54 KB (8744) - NetworkThroughput(*): 23.54 MB/sec - OverallThroughput: 8.50 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 581.872us - TransmitDataRPCTime: 354.203us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s243ms, non-child: 369.018ms, % non-child: 16.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 54.293us - GetResultsTime: 113.924us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.73 MB (13346008) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 251.00 /sec - StreamingTime: 167.461ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s874ms, non-child: 10.922ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 107.762us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.847us - GetNewBlockTime: 1.071ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.50 MB (13108440) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.948ms - RowsReturned: 35.88K (35876) - RowsReturnedRate: 19.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.848us EXCHANGE_NODE (id=11):(Total: 48.762us, non-child: 48.762us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.810us - DeserializeRowBatchTimer: 19.033us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s863ms, non-child: 13.352ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.932us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 17.356us - GetNewBlockTime: 1.129ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.48 MB (13083864) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.126ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 19.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.582us EXCHANGE_NODE (id=10):(Total: 27.730us, non-child: 27.730us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.489us - DeserializeRowBatchTimer: 15.520us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s850ms, non-child: 1s655ms, % non-child: 89.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.142ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 629.008us - GetNewBlockTime: 1.061ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038248) - PinTime: 0.000ns - ProbeRows: 36.66M (36660584) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s607ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 19.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.956us EXCHANGE_NODE (id=9):(Total: 678.376us, non-child: 678.376us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 547.662us - DeserializeRowBatchTimer: 1.906ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 193.835ms, non-child: 193.835ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 39 Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:117 BytesRead(500.000ms): 0, 0, 140.93 MB, 265.62 MB, 342.63 MB, 442.65 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 442.65 MB (464154286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 442.16 MB (463642286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 442.16 MB (463642286) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 230.73 MB (241940168) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.68M (36675563) - RowsReturned: 36.66M (36660584) - RowsReturnedRate: 189.13 M/sec - ScanRangesComplete: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1556) - ScannerThreadsTotalWallClockTime: 19s304ms - MaterializeTupleTime(*): 18s470ms - ScannerThreadsSysTime: 701.888ms - ScannerThreadsUserTime: 4s866ms - ScannerThreadsVoluntaryContextSwitches: 34.85K (34855) - TotalRawHdfsReadTime(*): 378.616ms - TotalReadThroughput: 147.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 638.94K (638937) - Rows rejected: 14.98K (14979) - Rows total: 638.98K (638976) Filter 1 (4.00 KB): - Files processed: 39 (39) - Files rejected: 0 (0) - Files total: 39 (39) - RowGroups processed: 36.68K (36681) - RowGroups rejected: 0 (0) - RowGroups total: 36.68K (36681) - Rows processed: 638.94K (638937) - Rows rejected: 0 (0) - Rows total: 638.98K (638976) - Splits processed: 39 (39) - Splits rejected: 0 (0) - Splits total: 39 (39) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a3 (host=vb0214.halxg.cloudera.com:22000):(Total: 2s192ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Filter 0 arrival: 1s220ms Filter 1 arrival: 1s220ms Filter 2 arrival: 1s226ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 220.33 MB, 259.93 MB, 310.62 MB, 239.81 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 10 - AverageThreadTokens: 8.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 321.20 MB (336805720) - PerHostPeakMemUsage: 323.48 MB (339195048) - PrepareTime: 210.603ms - RowsProduced: 564 (564) - TotalCpuTime: 22s092ms - TotalNetworkReceiveTime: 136.822us - TotalNetworkSendTime: 4.295ms - TotalStorageWaitTime: 645.820ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.121ms - CompileTime: 316.716ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 688.907ms - PrepareTime: 199.348ms DataStreamSender (dst_id=12):(Total: 1.176ms, non-child: 1.176ms, % non-child: 100.00%) - BytesSent: 8.52 KB (8724) - NetworkThroughput(*): 13.62 MB/sec - OverallThroughput: 7.07 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 525.395us - TransmitDataRPCTime: 610.749us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s181ms, non-child: 356.917ms, % non-child: 16.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 49.544us - GetResultsTime: 97.968us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11840536) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 258.00 /sec - StreamingTime: 159.567ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s824ms, non-child: 10.688ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 115.836us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.054us - GetNewBlockTime: 1.197ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.07 MB (11602968) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.982ms - RowsReturned: 36.18K (36181) - RowsReturnedRate: 19.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.020us EXCHANGE_NODE (id=11):(Total: 51.201us, non-child: 51.201us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.155us - DeserializeRowBatchTimer: 20.003us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s813ms, non-child: 13.015ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 45.564us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.869us - GetNewBlockTime: 1.474ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11578392) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.114ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.581us EXCHANGE_NODE (id=10):(Total: 25.354us, non-child: 25.354us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.761us - DeserializeRowBatchTimer: 12.602us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s800ms, non-child: 1s608ms, % non-child: 89.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.233ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 638.157us - GetNewBlockTime: 1.067ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039448) - PinTime: 0.000ns - ProbeRows: 37.68M (37681030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s557ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.711us EXCHANGE_NODE (id=9):(Total: 692.702us, non-child: 692.702us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 533.146us - DeserializeRowBatchTimer: 2.036ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 191.752ms, non-child: 191.752ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 147.05 MB, 295.01 MB, 428.00 MB, 457.13 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 457.13 MB (479330749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 455.95 MB (478101949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 455.95 MB (478101949) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 300.84 MB (315449808) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 12 (12) - RowsRead: 37.69M (37692944) - RowsReturned: 37.68M (37681030) - RowsReturnedRate: 196.51 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1553) - ScannerThreadsTotalWallClockTime: 19s528ms - MaterializeTupleTime(*): 18s709ms - ScannerThreadsSysTime: 735.883ms - ScannerThreadsUserTime: 4s916ms - ScannerThreadsVoluntaryContextSwitches: 35.94K (35944) - TotalRawHdfsReadTime(*): 402.351ms - TotalReadThroughput: 152.38 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.91K (11914) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.52K (37523) - RowGroups rejected: 0 (0) - RowGroups total: 37.52K (37523) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04b0 (host=vb0204.halxg.cloudera.com:22000):(Total: 2s157ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Filter 0 arrival: 1s237ms Filter 1 arrival: 1s237ms Filter 2 arrival: 1s242ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 155.24 MB, 252.08 MB, 227.95 MB, 246.08 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 10 - AverageThreadTokens: 8.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 294.20 MB (308495504) - PerHostPeakMemUsage: 296.49 MB (310893024) - PrepareTime: 217.737ms - RowsProduced: 564 (564) - TotalCpuTime: 21s509ms - TotalNetworkReceiveTime: 83.584us - TotalNetworkSendTime: 9.135ms - TotalStorageWaitTime: 588.192ms CodeGen:(Total: 1s222ms, non-child: 1s222ms, % non-child: 100.00%) - CodegenTime: 1.157ms - CompileTime: 319.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 696.479ms - PrepareTime: 206.327ms DataStreamSender (dst_id=12):(Total: 607.559us, non-child: 607.559us, % non-child: 100.00%) - BytesSent: 8.81 KB (9025) - NetworkThroughput(*): 42.61 MB/sec - OverallThroughput: 14.17 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 364.504us - TransmitDataRPCTime: 201.989us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s142ms, non-child: 371.141ms, % non-child: 17.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 71.447us - GetResultsTime: 81.913us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.90 MB (12475744) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 263.00 /sec - StreamingTime: 167.015ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s771ms, non-child: 10.294ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 53.238us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 15.914us - GetNewBlockTime: 447.228us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.67 MB (12238176) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.551ms - RowsReturned: 36.15K (36151) - RowsReturnedRate: 20.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.508us EXCHANGE_NODE (id=11):(Total: 36.673us, non-child: 36.673us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 23.167us - DeserializeRowBatchTimer: 19.570us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 27.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s761ms, non-child: 13.258ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 21.594us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 11.521us - GetNewBlockTime: 495.762us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.65 MB (12213600) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.342ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 21.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.053us EXCHANGE_NODE (id=10):(Total: 15.617us, non-child: 15.617us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 7.348us - DeserializeRowBatchTimer: 19.868us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 23.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s747ms, non-child: 1s567ms, % non-child: 89.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.188ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 641.201us - GetNewBlockTime: 556.502us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039672) - PinTime: 0.000ns - ProbeRows: 37.46M (37459947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s521ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 21.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 976.000ns EXCHANGE_NODE (id=9):(Total: 583.332us, non-child: 583.332us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 480.431us - DeserializeRowBatchTimer: 2.260ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 179.884ms, non-child: 179.884ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 32 Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:0% 3:0% 4:25% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:96 BytesRead(500.000ms): 0, 0, 69.98 MB, 195.49 MB, 297.58 MB, 453.92 MB - AverageHdfsReadThreadConcurrency: 1.25 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 453.92 MB (475966344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 453.53 MB (475556744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 453.53 MB (475556744) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 273.25 MB (286520464) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 37.47M (37472260) - RowsReturned: 37.46M (37459947) - RowsReturnedRate: 208.24 M/sec - ScanRangesComplete: 32 (32) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1623) - ScannerThreadsTotalWallClockTime: 18s921ms - MaterializeTupleTime(*): 18s147ms - ScannerThreadsSysTime: 667.892ms - ScannerThreadsUserTime: 4s758ms - ScannerThreadsVoluntaryContextSwitches: 35.69K (35686) - TotalRawHdfsReadTime(*): 389.397ms - TotalReadThroughput: 151.31 MB/sec Filter 0 (4.00 KB): - Rows processed: 524.26K (524256) - Rows rejected: 12.31K (12313) - Rows total: 524.29K (524288) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.35K (37347) - RowGroups rejected: 0 (0) - RowGroups total: 37.35K (37347) - Rows processed: 524.26K (524256) - Rows rejected: 0 (0) - Rows total: 524.29K (524288) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04af (host=vb0206.halxg.cloudera.com:22000):(Total: 2s130ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Filter 0 arrival: 1s216ms Filter 1 arrival: 1s217ms Filter 2 arrival: 1s222ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 195.39 MB, 230.36 MB, 302.51 MB, 196.86 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 9 - AverageThreadTokens: 7.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 313.64 MB (328879736) - PerHostPeakMemUsage: 315.92 MB (331269064) - PrepareTime: 215.634ms - RowsProduced: 564 (564) - TotalCpuTime: 21s394ms - TotalNetworkReceiveTime: 92.054us - TotalNetworkSendTime: 5.002ms - TotalStorageWaitTime: 601.887ms CodeGen:(Total: 1s202ms, non-child: 1s202ms, % non-child: 100.00%) - CodegenTime: 1.125ms - CompileTime: 312.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 684.987ms - PrepareTime: 204.649ms DataStreamSender (dst_id=12):(Total: 795.670us, non-child: 795.670us, % non-child: 100.00%) - BytesSent: 8.47 KB (8670) - NetworkThroughput(*): 28.12 MB/sec - OverallThroughput: 10.39 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 469.705us - TransmitDataRPCTime: 294.073us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s118ms, non-child: 352.749ms, % non-child: 16.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.364us - GetResultsTime: 65.817us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11835728) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 266.00 /sec - StreamingTime: 150.326ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s766ms, non-child: 9.346ms, % non-child: 0.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 89.929us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 33.578us - GetNewBlockTime: 390.204us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11598160) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.998ms - RowsReturned: 34.83K (34830) - RowsReturnedRate: 19.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.527us EXCHANGE_NODE (id=11):(Total: 30.218us, non-child: 30.218us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 17.182us - DeserializeRowBatchTimer: 19.659us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 33.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s756ms, non-child: 12.124ms, % non-child: 0.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 55.468us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.103us - GetNewBlockTime: 918.551us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11573584) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.592ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 20.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.105us EXCHANGE_NODE (id=10):(Total: 29.374us, non-child: 29.374us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.970us - DeserializeRowBatchTimer: 16.389us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s744ms, non-child: 1s568ms, % non-child: 89.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.801ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 314.494us - GetNewBlockTime: 976.920us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037232) - PinTime: 0.000ns - ProbeRows: 36.01M (36010376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s520ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 20.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.854us EXCHANGE_NODE (id=9):(Total: 568.445us, non-child: 568.445us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 459.718us - DeserializeRowBatchTimer: 1.873ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 27.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 176.117ms, non-child: 176.117ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 129.99 MB, 238.94 MB, 420.63 MB, 436.45 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 436.45 MB (457655084) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.57 MB (456733484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.57 MB (456733484) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 294.28 MB (308579776) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 9 (9) - RowsRead: 36.02M (36024352) - RowsReturned: 36.01M (36010376) - RowsReturnedRate: 204.47 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1600) - ScannerThreadsTotalWallClockTime: 18s860ms - MaterializeTupleTime(*): 18s099ms - ScannerThreadsSysTime: 717.886ms - ScannerThreadsUserTime: 5s053ms - ScannerThreadsVoluntaryContextSwitches: 34.76K (34762) - TotalRawHdfsReadTime(*): 391.527ms - TotalReadThroughput: 145.48 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.98K (13976) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.01K (36009) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36009) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04b1 (host=vb0232.halxg.cloudera.com:22000):(Total: 2s095ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Filter 0 arrival: 1s211ms Filter 1 arrival: 1s212ms Filter 2 arrival: 1s217ms MemoryUsage(500.000ms): 0, 1.98 MB, 2.88 MB, 219.10 MB, 221.67 MB, 255.10 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 261.64 MB (274352864) - PerHostPeakMemUsage: 263.92 MB (276742192) - PrepareTime: 209.651ms - RowsProduced: 564 (564) - TotalCpuTime: 20s848ms - TotalNetworkReceiveTime: 106.253us - TotalNetworkSendTime: 3.886ms - TotalStorageWaitTime: 536.401ms CodeGen:(Total: 1s197ms, non-child: 1s197ms, % non-child: 100.00%) - CodegenTime: 1.076ms - CompileTime: 313.107ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 684.889ms - PrepareTime: 198.555ms DataStreamSender (dst_id=12):(Total: 740.036us, non-child: 740.036us, % non-child: 100.00%) - BytesSent: 8.41 KB (8611) - NetworkThroughput(*): 29.08 MB/sec - OverallThroughput: 11.10 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 416.532us - TransmitDataRPCTime: 282.382us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s085ms, non-child: 357.432ms, % non-child: 17.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 51.943us - GetResultsTime: 77.890us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.01 MB (12589152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 270.00 /sec - StreamingTime: 161.082ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s728ms, non-child: 9.918ms, % non-child: 0.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 112.306us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.458us - GetNewBlockTime: 1.229ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.78 MB (12351584) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.470ms - RowsReturned: 34.30K (34300) - RowsReturnedRate: 19.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.065us EXCHANGE_NODE (id=11):(Total: 53.853us, non-child: 53.853us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.726us - DeserializeRowBatchTimer: 19.265us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s718ms, non-child: 12.499ms, % non-child: 0.73%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 46.218us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.515us - GetNewBlockTime: 1.336ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.76 MB (12327008) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.666ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 20.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.824us EXCHANGE_NODE (id=10):(Total: 33.554us, non-child: 33.554us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 21.262us - DeserializeRowBatchTimer: 13.304us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s705ms, non-child: 1s517ms, % non-child: 88.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.053ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 643.665us - GetNewBlockTime: 1.285ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040016) - PinTime: 0.000ns - ProbeRows: 35.53M (35527574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s470ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 20.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.041us EXCHANGE_NODE (id=9):(Total: 658.322us, non-child: 658.322us, % non-child: 100.00%) BytesReceived(500.000ms): 209.21 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 533.866us - DeserializeRowBatchTimer: 2.061ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 187.580ms, non-child: 187.580ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 142.61 MB, 258.92 MB, 428.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 428.91 MB (449745737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 428.52 MB (449336137) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 428.52 MB (449336137) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 240.72 MB (252410592) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 35.54M (35541507) - RowsReturned: 35.53M (35527574) - RowsReturnedRate: 189.40 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1567) - ScannerThreadsTotalWallClockTime: 18s279ms - MaterializeTupleTime(*): 17s563ms - ScannerThreadsSysTime: 744.882ms - ScannerThreadsUserTime: 5s320ms - ScannerThreadsVoluntaryContextSwitches: 33.88K (33880) - TotalRawHdfsReadTime(*): 346.963ms - TotalReadThroughput: 171.56 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.93K (13933) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 35.54K (35536) - RowGroups rejected: 0 (0) - RowGroups total: 35.54K (35536) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a6 (host=vb0234.halxg.cloudera.com:22000):(Total: 2s076ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Filter 1 arrival: 1s238ms Filter 0 arrival: 1s238ms Filter 2 arrival: 1s244ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 189.71 MB, 202.54 MB, 225.05 MB, 196.11 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 8 - AverageThreadTokens: 7.67 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 279.66 MB (293245456) - PerHostPeakMemUsage: 281.94 MB (295634784) - PrepareTime: 211.711ms - RowsProduced: 564 (564) - TotalCpuTime: 20s305ms - TotalNetworkReceiveTime: 119.796us - TotalNetworkSendTime: 3.768ms - TotalStorageWaitTime: 602.044ms CodeGen:(Total: 1s224ms, non-child: 1s224ms, % non-child: 100.00%) - CodegenTime: 1.167ms - CompileTime: 319.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 703.291ms - PrepareTime: 200.305ms DataStreamSender (dst_id=12):(Total: 832.205us, non-child: 832.205us, % non-child: 100.00%) - BytesSent: 8.56 KB (8769) - NetworkThroughput(*): 27.50 MB/sec - OverallThroughput: 10.05 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 481.251us - TransmitDataRPCTime: 304.069us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s066ms, non-child: 366.815ms, % non-child: 17.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.982us - GetResultsTime: 74.656us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.50 MB (12058728) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 272.00 /sec - StreamingTime: 168.848ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s699ms, non-child: 10.433ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 110.694us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 61.163us - GetNewBlockTime: 1.550ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11821160) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.864ms - RowsReturned: 36.02K (36020) - RowsReturnedRate: 21.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.485us EXCHANGE_NODE (id=11):(Total: 56.085us, non-child: 56.085us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 42.776us - DeserializeRowBatchTimer: 21.365us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 17.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s689ms, non-child: 12.873ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 33.981us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 13.199us - GetNewBlockTime: 1.639ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.25 MB (11796584) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.909ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 21.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.612us EXCHANGE_NODE (id=10):(Total: 22.084us, non-child: 22.084us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 9.798us - DeserializeRowBatchTimer: 11.863us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s676ms, non-child: 1s499ms, % non-child: 89.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.172ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 644.404us - GetNewBlockTime: 1.562ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039168) - PinTime: 0.000ns - ProbeRows: 37.08M (37078673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s454ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 21.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.076us EXCHANGE_NODE (id=9):(Total: 678.188us, non-child: 678.188us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 537.092us - DeserializeRowBatchTimer: 3.035ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 175.998ms, non-child: 175.998ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 117.21 MB, 218.30 MB, 319.92 MB, 448.33 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 448.33 MB (470112363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.04 MB (469805163) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.04 MB (469805163) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.73 MB (271303184) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37092714) - RowsReturned: 37.08M (37078673) - RowsReturnedRate: 210.68 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1590) - ScannerThreadsTotalWallClockTime: 17s793ms - MaterializeTupleTime(*): 17s001ms - ScannerThreadsSysTime: 764.879ms - ScannerThreadsUserTime: 5s175ms - ScannerThreadsVoluntaryContextSwitches: 35.43K (35433) - TotalRawHdfsReadTime(*): 368.453ms - TotalReadThroughput: 149.44 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.04K (14041) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 37.05K (37046) - RowGroups rejected: 0 (0) - RowGroups total: 37.05K (37046) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04ae (host=vb0228.halxg.cloudera.com:22000):(Total: 2s075ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Filter 0 arrival: 1s234ms Filter 1 arrival: 1s234ms Filter 2 arrival: 1s238ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 227.47 MB, 230.63 MB, 251.27 MB, 85.20 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 11, 4 - AverageThreadTokens: 6.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 279.65 MB (293233816) - PerHostPeakMemUsage: 281.93 MB (295623144) - PrepareTime: 217.011ms - RowsProduced: 564 (564) - TotalCpuTime: 19s681ms - TotalNetworkReceiveTime: 119.663us - TotalNetworkSendTime: 4.183ms - TotalStorageWaitTime: 681.462ms CodeGen:(Total: 1s219ms, non-child: 1s219ms, % non-child: 100.00%) - CodegenTime: 1.134ms - CompileTime: 318.801ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 693.685ms - PrepareTime: 205.868ms DataStreamSender (dst_id=12):(Total: 1.222ms, non-child: 1.222ms, % non-child: 100.00%) - BytesSent: 8.48 KB (8687) - NetworkThroughput(*): 18.42 MB/sec - OverallThroughput: 6.78 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 725.295us - TransmitDataRPCTime: 449.673us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s063ms, non-child: 403.152ms, % non-child: 19.54%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 86.661us - GetResultsTime: 108.441us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.29 MB (12890192) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 273.00 /sec - StreamingTime: 163.665ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s660ms, non-child: 10.582ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 108.649us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.563us - GetNewBlockTime: 1.017ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12652624) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.289ms - RowsReturned: 35.07K (35072) - RowsReturnedRate: 21.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.736us EXCHANGE_NODE (id=11):(Total: 61.374us, non-child: 61.374us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 34.784us - DeserializeRowBatchTimer: 21.510us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 16.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s649ms, non-child: 11.793ms, % non-child: 0.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 46.139us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 14.548us - GetNewBlockTime: 1.158ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.04 MB (12628048) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.074ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 21.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.777us EXCHANGE_NODE (id=10):(Total: 27.533us, non-child: 27.533us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.039us - DeserializeRowBatchTimer: 13.107us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s638ms, non-child: 1s476ms, % non-child: 90.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 3.753ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 324.894us - GetNewBlockTime: 1.085ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036192) - PinTime: 0.000ns - ProbeRows: 36.07M (36074797) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s435ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 21.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.182us EXCHANGE_NODE (id=9):(Total: 477.955us, non-child: 477.955us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 358.198us - DeserializeRowBatchTimer: 2.973ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 32.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 161.149ms, non-child: 161.149ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 161.13 MB, 265.22 MB, 428.81 MB, 436.64 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 8.75 - BytesRead: 436.64 MB (457845252) - BytesReadDataNodeCache: 0 - BytesReadLocal: 436.24 MB (457435652) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 436.24 MB (457435652) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 260.26 MB (272900872) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.09M (36088679) - RowsReturned: 36.07M (36074797) - RowsReturnedRate: 223.86 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.53K (1535) - ScannerThreadsTotalWallClockTime: 17s264ms - MaterializeTupleTime(*): 16s423ms - ScannerThreadsSysTime: 728.883ms - ScannerThreadsUserTime: 4s866ms - ScannerThreadsVoluntaryContextSwitches: 34.76K (34759) - TotalRawHdfsReadTime(*): 415.193ms - TotalReadThroughput: 145.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.88K (13882) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.07K (36068) - RowGroups rejected: 0 (0) - RowGroups total: 36.07K (36068) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04ab (host=vb0218.halxg.cloudera.com:22000):(Total: 2s073ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Filter 0 arrival: 1s222ms Filter 1 arrival: 1s223ms Filter 2 arrival: 1s228ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 225.25 MB, 244.71 MB, 280.21 MB, 110.20 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 11, 5 - AverageThreadTokens: 7.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 313.65 MB (328884560) - PerHostPeakMemUsage: 315.93 MB (331273888) - PrepareTime: 211.409ms - RowsProduced: 564 (564) - TotalCpuTime: 20s476ms - TotalNetworkReceiveTime: 62.616us - TotalNetworkSendTime: 36.565ms - TotalStorageWaitTime: 607.867ms CodeGen:(Total: 1s207ms, non-child: 1s207ms, % non-child: 100.00%) - CodegenTime: 1.157ms - CompileTime: 313.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 692.582ms - PrepareTime: 200.264ms DataStreamSender (dst_id=12):(Total: 836.184us, non-child: 836.184us, % non-child: 100.00%) - BytesSent: 8.47 KB (8671) - NetworkThroughput(*): 25.09 MB/sec - OverallThroughput: 9.89 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 466.582us - TransmitDataRPCTime: 329.628us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s029ms, non-child: 363.352ms, % non-child: 17.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 54.858us - GetResultsTime: 64.456us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12033672) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 277.00 /sec - StreamingTime: 165.341ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s666ms, non-child: 10.144ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 453.737us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.445us - GetNewBlockTime: 653.375us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.25 MB (11796104) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.662ms - RowsReturned: 35.84K (35840) - RowsReturnedRate: 21.51 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=11):(Total: 28.183us, non-child: 28.183us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 18.714us - DeserializeRowBatchTimer: 20.316us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 35.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s656ms, non-child: 12.626ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 45.224us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.417us - GetNewBlockTime: 952.574us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.23 MB (11771528) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.922ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 22.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.804us EXCHANGE_NODE (id=10):(Total: 26.602us, non-child: 26.602us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.422us - DeserializeRowBatchTimer: 51.709us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s643ms, non-child: 1s464ms, % non-child: 89.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.338ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 632.859us - GetNewBlockTime: 1.278ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038312) - PinTime: 0.000ns - ProbeRows: 37.08M (37082146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s421ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 22.33 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.462us EXCHANGE_NODE (id=9):(Total: 614.417us, non-child: 614.417us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 528.532us - DeserializeRowBatchTimer: 2.025ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 25.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 178.707ms, non-child: 178.707ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 30 Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:90 BytesRead(500.000ms): 0, 0, 152.12 MB, 286.79 MB, 448.99 MB, 448.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 448.99 MB (470799910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.70 MB (470492710) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.70 MB (470492710) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 292.69 MB (306909520) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37093767) - RowsReturned: 37.08M (37082146) - RowsReturnedRate: 207.50 M/sec - ScanRangesComplete: 30 (30) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1693) - ScannerThreadsTotalWallClockTime: 18s025ms - MaterializeTupleTime(*): 17s261ms - ScannerThreadsSysTime: 858.863ms - ScannerThreadsUserTime: 5s886ms - ScannerThreadsVoluntaryContextSwitches: 35.83K (35833) - TotalRawHdfsReadTime(*): 321.122ms - TotalReadThroughput: 149.66 MB/sec Filter 0 (4.00 KB): - Rows processed: 491.49K (491490) - Rows rejected: 11.62K (11621) - Rows total: 491.52K (491520) Filter 1 (4.00 KB): - Files processed: 30 (30) - Files rejected: 0 (0) - Files total: 30 (30) - RowGroups processed: 36.91K (36913) - RowGroups rejected: 0 (0) - RowGroups total: 36.91K (36913) - Rows processed: 491.49K (491490) - Rows rejected: 0 (0) - Rows total: 491.52K (491520) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04ad (host=vb0220.halxg.cloudera.com:22000):(Total: 2s072ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Filter 1 arrival: 1s223ms Filter 0 arrival: 1s224ms Filter 2 arrival: 1s228ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 192.85 MB, 218.54 MB, 259.42 MB, 184.64 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 8 - AverageThreadTokens: 7.67 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 297.78 MB (312244240) - PerHostPeakMemUsage: 300.06 MB (314633568) - PrepareTime: 214.593ms - RowsProduced: 564 (564) - TotalCpuTime: 19s974ms - TotalNetworkReceiveTime: 98.337us - TotalNetworkSendTime: 38.842ms - TotalStorageWaitTime: 578.981ms CodeGen:(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 315.901ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.322ms - PrepareTime: 203.440ms DataStreamSender (dst_id=12):(Total: 1.044ms, non-child: 1.044ms, % non-child: 100.00%) - BytesSent: 8.87 KB (9085) - NetworkThroughput(*): 18.31 MB/sec - OverallThroughput: 8.29 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 525.179us - TransmitDataRPCTime: 473.144us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s026ms, non-child: 352.017ms, % non-child: 17.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.979us - GetResultsTime: 58.791us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.75 MB (14414656) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 278.00 /sec - StreamingTime: 151.005ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s674ms, non-child: 10.896ms, % non-child: 0.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 123.175us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 15.806us - GetNewBlockTime: 1.229ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.52 MB (14177088) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.269ms - RowsReturned: 35.48K (35475) - RowsReturnedRate: 21.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.718us EXCHANGE_NODE (id=11):(Total: 61.165us, non-child: 61.165us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.184us - DeserializeRowBatchTimer: 20.832us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 16.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s663ms, non-child: 13.087ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 43.474us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 17.806us - GetNewBlockTime: 1.100ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.50 MB (14152512) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.278ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 21.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.102us EXCHANGE_NODE (id=10):(Total: 24.754us, non-child: 24.754us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.414us - DeserializeRowBatchTimer: 14.157us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s650ms, non-child: 1s490ms, % non-child: 90.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 3.620ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 320.936us - GetNewBlockTime: 1.052ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037112) - PinTime: 0.000ns - ProbeRows: 36.55M (36551452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s450ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 22.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.926us EXCHANGE_NODE (id=9):(Total: 476.812us, non-child: 476.812us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 359.838us - DeserializeRowBatchTimer: 1.841ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 32.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 159.144ms, non-child: 159.144ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 29 Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:87 BytesRead(500.000ms): 0, 0, 121.58 MB, 186.83 MB, 349.70 MB, 442.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 442.37 MB (463853916) - BytesReadDataNodeCache: 0 - BytesReadLocal: 441.68 MB (463137116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 441.68 MB (463137116) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 278.25 MB (291762336) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.56M (36562683) - RowsReturned: 36.55M (36551452) - RowsReturnedRate: 229.68 M/sec - ScanRangesComplete: 29 (29) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1385) - ScannerThreadsTotalWallClockTime: 17s501ms - MaterializeTupleTime(*): 16s745ms - ScannerThreadsSysTime: 680.891ms - ScannerThreadsUserTime: 4s463ms - ScannerThreadsVoluntaryContextSwitches: 34.82K (34816) - TotalRawHdfsReadTime(*): 394.156ms - TotalReadThroughput: 147.46 MB/sec Filter 0 (4.00 KB): - Rows processed: 475.11K (475107) - Rows rejected: 11.23K (11231) - Rows total: 475.14K (475136) Filter 1 (4.00 KB): - Files processed: 29 (29) - Files rejected: 0 (0) - Files total: 29 (29) - RowGroups processed: 36.35K (36352) - RowGroups rejected: 0 (0) - RowGroups total: 36.35K (36352) - Rows processed: 475.11K (475107) - Rows rejected: 0 (0) - Rows total: 475.14K (475136) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a5 (host=vb0216.halxg.cloudera.com:22000):(Total: 2s072ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Filter 0 arrival: 1s219ms Filter 1 arrival: 1s220ms Filter 2 arrival: 1s225ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 45.76 MB, 220.73 MB, 229.74 MB, 204.11 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 8 - AverageThreadTokens: 7.67 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 291.08 MB (305220352) - PerHostPeakMemUsage: 293.36 MB (307609680) - PrepareTime: 208.781ms - RowsProduced: 564 (564) - TotalCpuTime: 20s179ms - TotalNetworkReceiveTime: 93.818us - TotalNetworkSendTime: 37.088ms - TotalStorageWaitTime: 589.275ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 314.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 693.545ms - PrepareTime: 197.435ms DataStreamSender (dst_id=12):(Total: 919.781us, non-child: 919.781us, % non-child: 100.00%) - BytesSent: 8.43 KB (8628) - NetworkThroughput(*): 23.04 MB/sec - OverallThroughput: 8.95 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 516.399us - TransmitDataRPCTime: 357.121us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s028ms, non-child: 349.117ms, % non-child: 17.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 77.766us - GetResultsTime: 99.233us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.02 MB (13655136) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 278.00 /sec - StreamingTime: 153.422ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s679ms, non-child: 10.170ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 106.298us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.325us - GetNewBlockTime: 609.897us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.80 MB (13417568) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.227ms - RowsReturned: 35.19K (35186) - RowsReturnedRate: 20.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.974us EXCHANGE_NODE (id=11):(Total: 49.062us, non-child: 49.062us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 34.560us - DeserializeRowBatchTimer: 21.130us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s668ms, non-child: 13.255ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 79.997us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.388us - GetNewBlockTime: 969.979us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.77 MB (13392992) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.375ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 21.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.098us EXCHANGE_NODE (id=10):(Total: 30.503us, non-child: 30.503us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.406us - DeserializeRowBatchTimer: 19.238us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s655ms, non-child: 1s493ms, % non-child: 90.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.876ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 637.695us - GetNewBlockTime: 876.033us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036968) - PinTime: 0.000ns - ProbeRows: 36.05M (36046248) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s451ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 21.76 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.460us EXCHANGE_NODE (id=9):(Total: 616.938us, non-child: 616.938us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 505.222us - DeserializeRowBatchTimer: 2.333ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 161.425ms, non-child: 161.425ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:0% 2:0% 3:25% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 700.00 KB, 189.06 MB, 319.73 MB, 435.61 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 435.61 MB (456770099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.22 MB (456360499) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.22 MB (456360499) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 271.69 MB (284884912) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.06M (36059456) - RowsReturned: 36.05M (36046248) - RowsReturnedRate: 223.30 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1438) - ScannerThreadsTotalWallClockTime: 17s710ms - MaterializeTupleTime(*): 16s950ms - ScannerThreadsSysTime: 679.892ms - ScannerThreadsUserTime: 4s369ms - ScannerThreadsVoluntaryContextSwitches: 34.81K (34815) - TotalRawHdfsReadTime(*): 357.358ms - TotalReadThroughput: 145.20 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.21K (13208) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 35.99K (35993) - RowGroups rejected: 0 (0) - RowGroups total: 35.99K (35993) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a7 (host=vb0208.halxg.cloudera.com:22000):(Total: 2s060ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Filter 1 arrival: 1s236ms Filter 0 arrival: 1s236ms Filter 2 arrival: 1s240ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 212.93 MB, 222.23 MB, 279.02 MB, 43.08 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 11, 3 - AverageThreadTokens: 5.86 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 294.20 MB (308492120) - PerHostPeakMemUsage: 296.48 MB (310881448) - PrepareTime: 213.558ms - RowsProduced: 564 (564) - TotalCpuTime: 20s516ms - TotalNetworkReceiveTime: 72.570us - TotalNetworkSendTime: 13.360ms - TotalStorageWaitTime: 707.475ms CodeGen:(Total: 1s216ms, non-child: 1s216ms, % non-child: 100.00%) - CodegenTime: 1.104ms - CompileTime: 316.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 696.703ms - PrepareTime: 202.935ms DataStreamSender (dst_id=12):(Total: 1.033ms, non-child: 1.033ms, % non-child: 100.00%) - BytesSent: 8.48 KB (8679) - NetworkThroughput(*): 25.87 MB/sec - OverallThroughput: 8.01 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 678.822us - TransmitDataRPCTime: 319.968us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s040ms, non-child: 362.070ms, % non-child: 17.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 82.587us - GetResultsTime: 58.434us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.32 MB (12914256) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 276.00 /sec - StreamingTime: 160.690ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s678ms, non-child: 10.348ms, % non-child: 0.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 125.927us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 18.937us - GetNewBlockTime: 853.328us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.09 MB (12676688) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.106ms - RowsReturned: 35.16K (35159) - RowsReturnedRate: 20.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.804us EXCHANGE_NODE (id=11):(Total: 51.582us, non-child: 51.582us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.149us - DeserializeRowBatchTimer: 35.359us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s667ms, non-child: 12.974ms, % non-child: 0.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 41.721us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.677us - GetNewBlockTime: 831.773us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12652112) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.622ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 21.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.266us EXCHANGE_NODE (id=10):(Total: 22.286us, non-child: 22.286us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.434us - DeserializeRowBatchTimer: 22.520us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s654ms, non-child: 1s509ms, % non-child: 91.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 3.326ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 314.707us - GetNewBlockTime: 827.913us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038384) - PinTime: 0.000ns - ProbeRows: 36.39M (36392001) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s468ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 21.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.357us EXCHANGE_NODE (id=9):(Total: 395.389us, non-child: 395.389us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 311.934us - DeserializeRowBatchTimer: 3.427ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 38.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 144.712ms, non-child: 144.712ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 140.93 MB, 268.00 MB, 440.67 MB, 440.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.50 - BytesRead: 440.67 MB (462080766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 439.99 MB (461363966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 439.99 MB (461363966) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 273.28 MB (286549848) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.41M (36406157) - RowsReturned: 36.39M (36392001) - RowsReturnedRate: 251.48 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.36K (1365) - ScannerThreadsTotalWallClockTime: 18s145ms - MaterializeTupleTime(*): 17s262ms - ScannerThreadsSysTime: 550.912ms - ScannerThreadsUserTime: 3s988ms - ScannerThreadsVoluntaryContextSwitches: 35.39K (35389) - TotalRawHdfsReadTime(*): 411.381ms - TotalReadThroughput: 146.89 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 14.16K (14156) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 35 (35) - Files rejected: 0 (0) - Files total: 35 (35) - RowGroups processed: 36.39K (36392) - RowGroups rejected: 0 (0) - RowGroups total: 36.39K (36392) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04ac (host=vb0212.halxg.cloudera.com:22000):(Total: 2s030ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Filter 0 arrival: 1s226ms Filter 1 arrival: 1s226ms Filter 2 arrival: 1s232ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 211.11 MB, 230.95 MB, 265.21 MB, 84.83 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 4 - AverageThreadTokens: 7.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 265.21 MB (278096024) - PerHostPeakMemUsage: 267.49 MB (280485352) - PrepareTime: 212.746ms - RowsProduced: 564 (564) - TotalCpuTime: 19s893ms - TotalNetworkReceiveTime: 110.719us - TotalNetworkSendTime: 3.662ms - TotalStorageWaitTime: 608.354ms CodeGen:(Total: 1s212ms, non-child: 1s212ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 320.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.917ms - PrepareTime: 201.699ms DataStreamSender (dst_id=12):(Total: 898.539us, non-child: 898.539us, % non-child: 100.00%) - BytesSent: 8.60 KB (8807) - NetworkThroughput(*): 27.42 MB/sec - OverallThroughput: 9.35 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 548.213us - TransmitDataRPCTime: 306.328us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s020ms, non-child: 360.020ms, % non-child: 17.82%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60.755us - GetResultsTime: 58.589us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.29 MB (12886160) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 279.00 /sec - StreamingTime: 160.454ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s660ms, non-child: 10.574ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 113.651us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 33.065us - GetNewBlockTime: 683.181us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.06 MB (12648592) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.037ms - RowsReturned: 34.84K (34845) - RowsReturnedRate: 20.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.752us EXCHANGE_NODE (id=11):(Total: 55.186us, non-child: 55.186us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 39.836us - DeserializeRowBatchTimer: 22.090us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s650ms, non-child: 12.567ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 39.985us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 14.125us - GetNewBlockTime: 816.616us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.04 MB (12624016) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.987ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 21.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.948us EXCHANGE_NODE (id=10):(Total: 19.438us, non-child: 19.438us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 9.141us - DeserializeRowBatchTimer: 24.842us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 18.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s637ms, non-child: 1s468ms, % non-child: 89.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.486ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.023ms - GetNewBlockTime: 1.165ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039576) - PinTime: 0.000ns - ProbeRows: 36.30M (36299898) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s423ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 21.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.762us EXCHANGE_NODE (id=9):(Total: 628.434us, non-child: 628.434us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 498.586us - DeserializeRowBatchTimer: 2.342ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 168.077ms, non-child: 168.077ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 136.27 MB, 278.50 MB, 415.46 MB, 438.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 438.61 MB (459911198) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.31 MB (459603998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.31 MB (459603998) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 244.29 MB (256153752) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 36.31M (36314066) - RowsReturned: 36.30M (36299898) - RowsReturnedRate: 215.97 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1494) - ScannerThreadsTotalWallClockTime: 17s447ms - MaterializeTupleTime(*): 16s666ms - ScannerThreadsSysTime: 719.885ms - ScannerThreadsUserTime: 4s992ms - ScannerThreadsVoluntaryContextSwitches: 34.63K (34627) - TotalRawHdfsReadTime(*): 355.066ms - TotalReadThroughput: 146.20 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.17K (14168) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 36.30K (36298) - RowGroups rejected: 0 (0) - RowGroups total: 36.30K (36298) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04aa (host=vb0224.halxg.cloudera.com:22000):(Total: 2s017ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Filter 0 arrival: 1s212ms Filter 1 arrival: 1s211ms Filter 2 arrival: 1s217ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 230.26 MB, 240.13 MB, 245.68 MB, 145.21 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 6 - AverageThreadTokens: 7.33 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 266.64 MB (279596960) - PerHostPeakMemUsage: 268.92 MB (281986288) - PrepareTime: 210.151ms - RowsProduced: 564 (564) - TotalCpuTime: 19s778ms - TotalNetworkReceiveTime: 140.248us - TotalNetworkSendTime: 3.676ms - TotalStorageWaitTime: 628.088ms CodeGen:(Total: 1s197ms, non-child: 1s197ms, % non-child: 100.00%) - CodegenTime: 1.166ms - CompileTime: 309.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 687.864ms - PrepareTime: 198.862ms DataStreamSender (dst_id=12):(Total: 884.735us, non-child: 884.735us, % non-child: 100.00%) - BytesSent: 8.48 KB (8684) - NetworkThroughput(*): 31.62 MB/sec - OverallThroughput: 9.36 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 574.194us - TransmitDataRPCTime: 261.899us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s007ms, non-child: 358.461ms, % non-child: 17.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 57.851us - GetResultsTime: 67.941us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.50 MB (12060472) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 280.00 /sec - StreamingTime: 161.721ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s649ms, non-child: 10.298ms, % non-child: 0.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 110.887us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.381us - GetNewBlockTime: 1.101ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.28 MB (11822904) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.764ms - RowsReturned: 34.83K (34832) - RowsReturnedRate: 21.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.883us EXCHANGE_NODE (id=11):(Total: 51.006us, non-child: 51.006us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 34.985us - DeserializeRowBatchTimer: 17.751us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s639ms, non-child: 12.628ms, % non-child: 0.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.354us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 11.476us - GetNewBlockTime: 1.311ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.25 MB (11798328) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.017ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 21.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.724us EXCHANGE_NODE (id=10):(Total: 26.158us, non-child: 26.158us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.586us - DeserializeRowBatchTimer: 19.308us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s626ms, non-child: 1s453ms, % non-child: 89.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.359ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 643.013us - GetNewBlockTime: 1.019ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036520) - PinTime: 0.000ns - ProbeRows: 35.98M (35976925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s409ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 21.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.583us EXCHANGE_NODE (id=9):(Total: 714.134us, non-child: 714.134us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 548.672us - DeserializeRowBatchTimer: 2.122ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 172.285ms, non-child: 172.285ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 38 Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:114 BytesRead(500.000ms): 0, 0, 164.76 MB, 251.41 MB, 388.34 MB, 435.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.50 - BytesRead: 435.74 MB (456903383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.15 MB (456288983) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.15 MB (456288983) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 245.72 MB (257654688) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.99M (35991725) - RowsReturned: 35.98M (35976925) - RowsReturnedRate: 208.82 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1516) - ScannerThreadsTotalWallClockTime: 17s378ms - MaterializeTupleTime(*): 16s577ms - ScannerThreadsSysTime: 764.878ms - ScannerThreadsUserTime: 4s926ms - ScannerThreadsVoluntaryContextSwitches: 34.02K (34025) - TotalRawHdfsReadTime(*): 344.977ms - TotalReadThroughput: 145.25 MB/sec Filter 0 (4.00 KB): - Rows processed: 622.55K (622554) - Rows rejected: 14.80K (14800) - Rows total: 622.59K (622592) Filter 1 (4.00 KB): - Files processed: 38 (38) - Files rejected: 0 (0) - Files total: 38 (38) - RowGroups processed: 36.01K (36013) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36013) - Rows processed: 622.55K (622554) - Rows rejected: 0 (0) - Rows total: 622.59K (622592) - Splits processed: 38 (38) - Splits rejected: 0 (0) - Splits total: 38 (38) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a4 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s976ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Filter 1 arrival: 1s223ms Filter 0 arrival: 1s224ms Filter 2 arrival: 1s230ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 224.45 MB, 222.64 MB, 259.14 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 10 - AverageThreadTokens: 6.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 314.63 MB (329908616) - PerHostPeakMemUsage: 316.90 MB (332297944) - PrepareTime: 215.184ms - RowsProduced: 564 (564) - TotalCpuTime: 19s511ms - TotalNetworkReceiveTime: 138.911us - TotalNetworkSendTime: 2.815ms - TotalStorageWaitTime: 587.090ms CodeGen:(Total: 1s210ms, non-child: 1s210ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 316.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 688.807ms - PrepareTime: 204.071ms DataStreamSender (dst_id=12):(Total: 506.225us, non-child: 506.225us, % non-child: 100.00%) - BytesSent: 8.58 KB (8789) - NetworkThroughput(*): 50.54 MB/sec - OverallThroughput: 16.56 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 312.656us - TransmitDataRPCTime: 165.832us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 1s968ms, non-child: 357.365ms, % non-child: 18.15%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.754us - GetResultsTime: 58.831us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12894136) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 286.00 /sec - StreamingTime: 155.661ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s611ms, non-child: 10.639ms, % non-child: 0.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 114.713us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.055us - GetNewBlockTime: 1.056ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12656568) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.166ms - RowsReturned: 35.57K (35570) - RowsReturnedRate: 22.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.320us EXCHANGE_NODE (id=11):(Total: 52.456us, non-child: 52.456us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.369us - DeserializeRowBatchTimer: 20.705us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s600ms, non-child: 12.840ms, % non-child: 0.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.591us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.296us - GetNewBlockTime: 734.023us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.05 MB (12631992) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.836ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 22.71 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.304us EXCHANGE_NODE (id=10):(Total: 26.860us, non-child: 26.860us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.435us - DeserializeRowBatchTimer: 20.606us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s588ms, non-child: 1s435ms, % non-child: 90.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.082ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 638.318us - GetNewBlockTime: 942.416us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040304) - PinTime: 0.000ns - ProbeRows: 36.29M (36291418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s391ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 22.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.955us EXCHANGE_NODE (id=9):(Total: 713.855us, non-child: 713.855us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 549.667us - DeserializeRowBatchTimer: 2.016ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 152.372ms, non-child: 152.372ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 143.87 MB, 275.61 MB, 439.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 439.07 MB (460401841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.59 MB (459889841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.59 MB (459889841) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 292.71 MB (306931000) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.30M (36304703) - RowsReturned: 36.29M (36291418) - RowsReturnedRate: 238.18 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1376) - ScannerThreadsTotalWallClockTime: 17s104ms - MaterializeTupleTime(*): 16s363ms - ScannerThreadsSysTime: 641.897ms - ScannerThreadsUserTime: 4s389ms - ScannerThreadsVoluntaryContextSwitches: 35.02K (35022) - TotalRawHdfsReadTime(*): 341.895ms - TotalReadThroughput: 175.63 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.29K (13285) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.23K (36231) - RowGroups rejected: 0 (0) - RowGroups total: 36.23K (36231) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 324e6bda6a0762b7:6c5c00026bef04a8 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s948ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Filter 1 arrival: 1s227ms Filter 0 arrival: 1s227ms Filter 2 arrival: 1s233ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 220.85 MB, 237.53 MB, 263.80 MB, 111.51 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 11, 5 - AverageThreadTokens: 7.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 273.66 MB (286953488) - PerHostPeakMemUsage: 275.94 MB (289342816) - PrepareTime: 211.128ms - RowsProduced: 564 (564) - TotalCpuTime: 18s949ms - TotalNetworkReceiveTime: 114.986us - TotalNetworkSendTime: 4.111ms - TotalStorageWaitTime: 506.543ms CodeGen:(Total: 1s213ms, non-child: 1s213ms, % non-child: 100.00%) - CodegenTime: 1.155ms - CompileTime: 320.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 692.423ms - PrepareTime: 199.965ms DataStreamSender (dst_id=12):(Total: 743.794us, non-child: 743.794us, % non-child: 100.00%) - BytesSent: 8.44 KB (8640) - NetworkThroughput(*): 29.44 MB/sec - OverallThroughput: 11.08 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 423.106us - TransmitDataRPCTime: 279.873us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 1s938ms, non-child: 345.070ms, % non-child: 17.80%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.212us - GetResultsTime: 58.806us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.06 MB (12648064) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 290.00 /sec - StreamingTime: 147.539ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s593ms, non-child: 9.849ms, % non-child: 0.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 111.404us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 36.042us - GetNewBlockTime: 1.218ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.84 MB (12410496) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.444ms - RowsReturned: 34.74K (34738) - RowsReturnedRate: 21.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.336us EXCHANGE_NODE (id=11):(Total: 49.807us, non-child: 49.807us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8314) - ConvertRowBatchTime: 35.249us - DeserializeRowBatchTimer: 24.650us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s583ms, non-child: 11.672ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 43.175us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 18.993us - GetNewBlockTime: 1.031ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.81 MB (12385920) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.986ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 22.45 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.788us EXCHANGE_NODE (id=10):(Total: 27.461us, non-child: 27.461us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.573us - DeserializeRowBatchTimer: 14.392us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s572ms, non-child: 1s414ms, % non-child: 89.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.164ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.020ms - GetNewBlockTime: 1.158ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038744) - PinTime: 0.000ns - ProbeRows: 35.79M (35792492) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s374ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 22.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.058us EXCHANGE_NODE (id=9):(Total: 665.674us, non-child: 665.674us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB, 646.58 KB - BytesReceived: 646.58 KB (662103) - ConvertRowBatchTime: 528.008us - DeserializeRowBatchTimer: 1.799ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 157.270ms, non-child: 157.270ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 146.46 MB, 271.78 MB, 432.69 MB, 432.69 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 432.69 MB (453711238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 432.11 MB (453096838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 432.11 MB (453096838) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 253.30 MB (265602568) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.80M (35804448) - RowsReturned: 35.79M (35792492) - RowsReturnedRate: 227.59 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.36K (1364) - ScannerThreadsTotalWallClockTime: 16s483ms - MaterializeTupleTime(*): 15s815ms - ScannerThreadsSysTime: 643.897ms - ScannerThreadsUserTime: 4s565ms - ScannerThreadsVoluntaryContextSwitches: 34.59K (34591) - TotalRawHdfsReadTime(*): 344.302ms - TotalReadThroughput: 144.23 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.96K (11956) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 35.68K (35679) - RowGroups rejected: 0 (0) - RowGroups total: 35.68K (35679) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Fragment F03: Instance 324e6bda6a0762b7:6c5c00026bef04b2 (host=vb0230.halxg.cloudera.com:22000):(Total: 224.926ms, non-child: 220.615ms, % non-child: 98.08%) Hdfs split stats (:<# splits>/): 7:1/88.92 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 97.366us - RowsProduced: 1.00K (1002) - TotalCpuTime: 10.203ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.461ms - TotalStorageWaitTime: 3.239ms DataStreamSender (dst_id=11):(Total: 352.082us, non-child: 352.082us, % non-child: 100.00%) - BytesSent: 121.79 KB (124710) - NetworkThroughput(*): 542.23 MB/sec - OverallThroughput: 337.80 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 61.582us - TransmitDataRPCTime: 219.340us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.958ms, non-child: 3.958ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 887.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 253.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.701ms - MaterializeTupleTime(*): 44.687us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 59.192us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 324e6bda6a0762b7:6c5c00026bef04b3 (host=vb0228.halxg.cloudera.com:22000):(Total: 224.454ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/2.17 MB MemoryUsage(500.000ms): 128.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.00 MB (5244448) - PrepareTime: 208.036ms - RowsProduced: 365 (365) - TotalCpuTime: 595.298ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.763us - TotalStorageWaitTime: 5.018ms CodeGen:(Total: 567.962ms, non-child: 567.962ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 74.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 287.941ms - PrepareTime: 205.237ms DataStreamSender (dst_id=10):(Total: 250.536us, non-child: 250.536us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 229.21 MB/sec - OverallThroughput: 171.58 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 30.811us - TransmitDataRPCTime: 187.541us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 428.683ms, non-child: 428.683ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 182.766us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 713.36 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 851.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 12.417ms - MaterializeTupleTime(*): 6.265ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 657.753us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 324e6bda6a0762b7:6c5c00026bef04b4 (host=vb0234.halxg.cloudera.com:22000):(Total: 300.817ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/28.28 MB MemoryUsage(500.000ms): 38.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 204.103ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 750.088ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 934.947us - TotalStorageWaitTime: 7.464ms CodeGen:(Total: 566.924ms, non-child: 566.924ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 285.142ms - PrepareTime: 202.361ms DataStreamSender (dst_id=9):(Total: 10.905ms, non-child: 10.905ms, % non-child: 100.00%) - BytesSent: 9.47 MB (9931545) - NetworkThroughput(*): 2.80 GB/sec - OverallThroughput: 868.51 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 7.562ms - TransmitDataRPCTime: 3.305ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 492.222ms, non-child: 492.222ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.333ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 92.142ms - MaterializeTupleTime(*): 78.142ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 82.987ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 1.832ms - TotalReadThroughput: 0.00 /sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 566.39us | 0ns | 566.39us | 564 | 100 | | 08:TOP-N | 15 | 450.11us | 0ns | 698.29us | 564 | 100 | | 13:AGGREGATE | 15 | 213.80ms | 0ns | 219.94ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 215.84us | 0ns | 250.69us | 8.46K | 3.83K | | 07:AGGREGATE | 15 | 362.90ms | 0ns | 378.23ms | 8.46K | 3.83K | | 06:HASH JOIN | 15 | 10.52ms | 0ns | 12.04ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 75.68us | 0ns | 416.88us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 3.97ms | 0ns | 3.97ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 12.95ms | 0ns | 13.57ms | 542.70K | 4.27K | | |--10:EXCHANGE | 15 | 25.64us | 0ns | 29.71us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 429.40ms | 0ns | 429.40ms | 365 | 114 | | 04:HASH JOIN | 15 | 1.52s | 0ns | 1.59s | 542.70K | 68.35K | | |--09:EXCHANGE | 15 | 651.48us | 0ns | 1.02ms | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 494.50ms | 0ns | 494.50ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 174.57ms | 0ns | 190.48ms | 546.93M | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=d848ba179c9db493:8ad3fb48d1a6898d): Summary: Session ID: 7743ad13d49bdd4a:a9c19146e9dc3e95 Session Type: BEESWAX Start Time: 2016-05-01 23:11:53.085185000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build a6aba933a52514c663a6dfb21fca25ea71413073) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:54868 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=20B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.95KB | tuple-ids=6 row-size=20B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=24B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=24B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=126B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=122B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=110B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=36.41GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=20B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 51.950ms - Analysis finished: 8.814ms (8.814ms) - Equivalence classes computed: 9.219ms (405.037us) - Single node plan created: 23.821ms (14.601ms) - Runtime filters computed: 24.537ms (716.043us) - Distributed plan created: 45.195ms (20.658ms) - Lineage info computed: 46.752ms (1.556ms) - Planning finished: 51.950ms (5.198ms) Query Timeline: 3s345ms - Start execution: 279.441us (279.441us) - Planning finished: 62.396ms (62.116ms) - Ready to start 33 remote fragments: 68.694ms (6.298ms) - All 33 remote fragments started: 98.414ms (29.719ms) - Rows available: 3s317ms (3s218ms) - First row fetched: 3s325ms (8.562ms) ImpalaServer: - ClientFetchWaitTimer: 9.351ms - RowMaterializationTimer: 821.455us Execution Profile d848ba179c9db493:8ad3fb48d1a6898d:(Total: 3s259ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 12ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ----------------------------------------------------------------------------------------------- 2 4 1 15 LOCAL false 1 (15) N/A N/A 1 5 1 15 LOCAL true 1 (15) N/A N/A 0 6 1 15 LOCAL false 1 (15) N/A N/A Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(269.91 MB) vb0206.halxg.cloudera.com:22000(302.93 MB) vb0228.halxg.cloudera.com:22000(289.93 MB) vb0220.halxg.cloudera.com:22000(319.35 MB) vb0212.halxg.cloudera.com:22000(270.91 MB) vb0218.halxg.cloudera.com:22000(319.04 MB) vb0224.halxg.cloudera.com:22000(284.47 MB) vb0222.halxg.cloudera.com:22000(255.92 MB) vb0230.halxg.cloudera.com:22000(301.47 MB) vb0208.halxg.cloudera.com:22000(297.77 MB) vb0234.halxg.cloudera.com:22000(273.93 MB) vb0216.halxg.cloudera.com:22000(294.93 MB) vb0226.halxg.cloudera.com:22000(289.91 MB) vb0214.halxg.cloudera.com:22000(317.06 MB) vb0204.halxg.cloudera.com:22000(301.51 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 3s210ms, non-child: 1.435ms, % non-child: 0.04%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 173.489us - RowsProduced: 100 (100) - TotalCpuTime: 3s260ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 3s208ms, non-child: 566.392us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.61 KB (9838) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 910.265us - FirstBatchArrivalWaitTime: 3s208ms - MergeGetNext: 435.136us - MergeGetNextBatch: 87.800us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 175.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 2s809ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:3s230ms max:3s246ms mean: 3s237ms stddev:4.803ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447273) - PerHostPeakMemUsage: 292.60 MB (306816349) - PrepareTime: 211.972ms - RowsProduced: 37 (37) - TotalCpuTime: 638.691ms - TotalNetworkReceiveTime: 2s593ms - TotalNetworkSendTime: 429.041us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 631.090ms, non-child: 631.090ms, % non-child: 100.00%) - CodegenTime: 1.306ms - CompileTime: 88.968ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 331.758ms - PrepareTime: 209.708ms DataStreamSender (dst_id=14):(Total: 115.694us, non-child: 115.694us, % non-child: 100.00%) - BytesSent: 655.00 B (655) - NetworkThroughput(*): 17.74 MB/sec - OverallThroughput: 5.58 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 51.848us - TransmitDataRPCTime: 38.099us - UncompressedRowBatchSize: 1.03 KB (1056) SORT_NODE (id=8):(Total: 2s807ms, non-child: 450.112us, % non-child: 0.02%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s807ms, non-child: 213.799ms, % non-child: 7.62%) - BuildTime: 199.816us - GetNewBlockTime: 129.469us - GetResultsTime: 56.840us - HTResizeTime: 2.851us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.554us EXCHANGE_NODE (id=12):(Total: 2s593ms, non-child: 2s593ms, % non-child: 100.00%) - BytesReceived: 8.54 KB (8747) - ConvertRowBatchTime: 60.345us - DeserializeRowBatchTimer: 212.050us - FirstBatchArrivalWaitTime: 2s366ms - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 217.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 2s088ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.36 GB, max: 2.50 GB, avg: 2.43 GB, stddev: 40.05 MB completion times: min:2s994ms max:3s222ms mean: 3s104ms stddev:67.923ms execution rates: min:772.53 MB/sec max:821.32 MB/sec mean:800.95 MB/sec stddev:13.45 MB/sec num instances: 15 - AverageThreadTokens: 7.22 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 290.32 MB (304426475) - PerHostPeakMemUsage: 292.60 MB (306816349) - PrepareTime: 214.169ms - RowsProduced: 564 (564) - TotalCpuTime: 20s737ms - TotalNetworkReceiveTime: 97.216us - TotalNetworkSendTime: 4.381ms - TotalStorageWaitTime: 564.761ms CodeGen:(Total: 1s213ms, non-child: 1s213ms, % non-child: 100.00%) - CodegenTime: 1.189ms - CompileTime: 315.736ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 694.507ms - PrepareTime: 202.583ms DataStreamSender (dst_id=12):(Total: 967.198us, non-child: 967.198us, % non-child: 100.00%) - BytesSent: 8.54 KB (8747) - NetworkThroughput(*): 23.05 MB/sec - OverallThroughput: 8.90 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 539.598us - TransmitDataRPCTime: 383.827us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s077ms, non-child: 362.896ms, % non-child: 17.47%) - GetNewBlockTime: 65.834us - GetResultsTime: 93.997us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.20 MB (12787497) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 271.00 /sec - StreamingTime: 162.510ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s714ms, non-child: 10.521ms, % non-child: 0.61%) - BuildPartitionTime: 106.169us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 33.269us - GetNewBlockTime: 948.451us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.97 MB (12549929) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.791ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 20.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.684us EXCHANGE_NODE (id=11):(Total: 75.684us, non-child: 75.684us, % non-child: 100.00%) - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 59.294us - DeserializeRowBatchTimer: 27.669us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s703ms, non-child: 12.948ms, % non-child: 0.76%) - BuildPartitionTime: 44.205us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 17.960us - GetNewBlockTime: 1.111ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.95 MB (12525353) - PinTime: 0.000ns - ProbeRows: 36.18K (36180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.020ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 21.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.777us EXCHANGE_NODE (id=10):(Total: 25.643us, non-child: 25.643us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 12.911us - DeserializeRowBatchTimer: 14.838us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s690ms, non-child: 1s515ms, % non-child: 89.64%) - BuildPartitionTime: 5.034ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 559.295us - GetNewBlockTime: 1.099ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038393) - PinTime: 0.000ns - ProbeRows: 36.46M (36461704) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s469ms - RowsReturned: 36.18K (36180) - RowsReturnedRate: 21.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.773us EXCHANGE_NODE (id=9):(Total: 651.480us, non-child: 651.480us, % non-child: 100.00%) - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 532.710us - DeserializeRowBatchTimer: 2.133ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 174.568ms, non-child: 174.568ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 9.93 - BytesRead: 441.19 MB (462616144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 440.65 MB (462056357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 440.65 MB (462056357) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 269.32 MB (282403076) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.48M (36475001) - RowsReturned: 36.46M (36461704) - RowsReturnedRate: 209.63 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1589) - ScannerThreadsTotalWallClockTime: 18s191ms - MaterializeTupleTime(*): 17s455ms - ScannerThreadsSysTime: 756.679ms - ScannerThreadsUserTime: 5s161ms - ScannerThreadsVoluntaryContextSwitches: 35.09K (35094) - TotalRawHdfsReadTime(*): 327.949ms - TotalReadThroughput: 152.88 MB/sec Filter 0 (4.00 KB): - Rows processed: 563.58K (563575) - Rows rejected: 13.30K (13297) - Rows total: 563.61K (563609) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.41K (36405) - RowGroups rejected: 0 (0) - RowGroups total: 36.41K (36405) - Rows processed: 563.58K (563575) - Rows rejected: 0 (0) - Rows total: 563.61K (563609) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Averaged Fragment F03:(Total: 228.864ms, non-child: 224.376ms, % non-child: 98.04%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:231.291ms max:231.291ms mean: 231.291ms stddev:0.000ns execution rates: min:384.45 KB/sec max:384.45 KB/sec mean:384.45 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 128.979us - RowsProduced: 1.00K (1002) - TotalCpuTime: 11.647ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 219.723ms - TotalStorageWaitTime: 3.057ms DataStreamSender (dst_id=11):(Total: 522.679us, non-child: 522.679us, % non-child: 100.00%) - BytesSent: 121.83 KB (124755) - NetworkThroughput(*): 409.91 MB/sec - OverallThroughput: 227.63 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 128.896us - TransmitDataRPCTime: 290.246us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.965ms, non-child: 3.965ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 2.062us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 252.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.605ms - MaterializeTupleTime(*): 82.875us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 66.034us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 224.552ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:586.765ms max:586.765ms mean: 586.765ms stddev:0.000ns execution rates: min:3.69 MB/sec max:3.69 MB/sec mean:3.69 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.00 MB (5244448) - PrepareTime: 208.317ms - RowsProduced: 365 (365) - TotalCpuTime: 593.700ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.705us - TotalStorageWaitTime: 5.120ms CodeGen:(Total: 566.563ms, non-child: 566.563ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 73.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 286.347ms - PrepareTime: 205.645ms DataStreamSender (dst_id=10):(Total: 261.906us, non-child: 261.906us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 216.74 MB/sec - OverallThroughput: 164.13 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 32.031us - TransmitDataRPCTime: 198.338us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 429.403ms, non-child: 429.403ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 175.460us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 714.27 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 850.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 12.613ms - MaterializeTupleTime(*): 6.263ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 6.998ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 656.914us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 302.773ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:670.609ms max:670.609ms mean: 670.609ms stddev:0.000ns execution rates: min:42.18 MB/sec max:42.18 MB/sec mean:42.18 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 203.773ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 755.312ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 734.645us - TotalStorageWaitTime: 8.789ms CodeGen:(Total: 567.855ms, non-child: 567.855ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 286.470ms - PrepareTime: 201.966ms DataStreamSender (dst_id=9):(Total: 10.492ms, non-child: 10.492ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9402180) - NetworkThroughput(*): 2.44 GB/sec - OverallThroughput: 854.56 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 6.859ms - TransmitDataRPCTime: 3.589ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 494.503ms, non-child: 494.503ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 94.856ms - MaterializeTupleTime(*): 79.324ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 83.987ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 2.202ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance d848ba179c9db493:8ad3fb48d1a6899b (host=vb0206.halxg.cloudera.com:22000):(Total: 2s821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 302.93 MB (317645488) - PrepareTime: 205.091ms - RowsProduced: 37 (37) - TotalCpuTime: 629.902ms - TotalNetworkReceiveTime: 2s608ms - TotalNetworkSendTime: 316.110us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 619.458ms, non-child: 619.458ms, % non-child: 100.00%) - CodegenTime: 1.355ms - CompileTime: 88.703ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.280ms - PrepareTime: 202.840ms DataStreamSender (dst_id=14):(Total: 110.405us, non-child: 110.405us, % non-child: 100.00%) - BytesSent: 655.00 B (655) - NetworkThroughput(*): 17.65 MB/sec - OverallThroughput: 5.66 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 47.832us - TransmitDataRPCTime: 35.388us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s819ms, non-child: 401.483us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s819ms, non-child: 211.244ms, % non-child: 7.49%) ExecOption: Codegen Enabled - BuildTime: 87.552us - GetNewBlockTime: 123.122us - GetResultsTime: 58.721us - HTResizeTime: 4.207us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.685us EXCHANGE_NODE (id=12):(Total: 2s608ms, non-child: 188.754us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 8.28 KB (8475) - ConvertRowBatchTime: 57.362us - DeserializeRowBatchTimer: 141.939us - FirstBatchArrivalWaitTime: 2s381ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 212.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68997 (host=vb0218.halxg.cloudera.com:22000):(Total: 2s816ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447072) - PerHostPeakMemUsage: 319.04 MB (334539000) - PrepareTime: 209.467ms - RowsProduced: 25 (25) - TotalCpuTime: 629.299ms - TotalNetworkReceiveTime: 2s603ms - TotalNetworkSendTime: 527.181us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 623.828ms, non-child: 623.828ms, % non-child: 100.00%) - CodegenTime: 1.187ms - CompileTime: 88.080ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.762ms - PrepareTime: 207.381ms DataStreamSender (dst_id=14):(Total: 111.762us, non-child: 111.762us, % non-child: 100.00%) - BytesSent: 458.00 B (458) - NetworkThroughput(*): 13.90 MB/sec - OverallThroughput: 3.91 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 25 (25) - SerializeBatchTime: 55.508us - TransmitDataRPCTime: 31.426us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 2s814ms, non-child: 443.705us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec AGGREGATION_NODE (id=13):(Total: 2s814ms, non-child: 210.965ms, % non-child: 7.50%) ExecOption: Codegen Enabled - BuildTime: 304.364us - GetNewBlockTime: 122.913us - GetResultsTime: 52.035us - HTResizeTime: 3.191us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 8.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.591us EXCHANGE_NODE (id=12):(Total: 2s603ms, non-child: 200.839us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 5.93 KB (6075) - ConvertRowBatchTime: 43.228us - DeserializeRowBatchTimer: 240.706us - FirstBatchArrivalWaitTime: 2s376ms - PeakMemoryUsage: 0 - RowsReturned: 375 (375) - RowsReturnedRate: 144.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68996 (host=vb0224.halxg.cloudera.com:22000):(Total: 2s815ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 284.47 MB (298291024) - PrepareTime: 210.393ms - RowsProduced: 33 (33) - TotalCpuTime: 630.896ms - TotalNetworkReceiveTime: 2s601ms - TotalNetworkSendTime: 585.481us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 624.992ms, non-child: 624.992ms, % non-child: 100.00%) - CodegenTime: 1.331ms - CompileTime: 88.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 327.789ms - PrepareTime: 208.050ms DataStreamSender (dst_id=14):(Total: 101.437us, non-child: 101.437us, % non-child: 100.00%) - BytesSent: 584.00 B (584) - NetworkThroughput(*): 14.83 MB/sec - OverallThroughput: 5.49 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 49.509us - TransmitDataRPCTime: 37.557us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s813ms, non-child: 384.119us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s813ms, non-child: 212.074ms, % non-child: 7.54%) ExecOption: Codegen Enabled - BuildTime: 253.889us - GetNewBlockTime: 127.649us - GetResultsTime: 66.914us - HTResizeTime: 3.094us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.735us EXCHANGE_NODE (id=12):(Total: 2s601ms, non-child: 220.316us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.56 KB (7741) - ConvertRowBatchTime: 57.451us - DeserializeRowBatchTimer: 138.488us - FirstBatchArrivalWaitTime: 2s374ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 190.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a6899c (host=vb0204.halxg.cloudera.com:22000):(Total: 2s814ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 301.51 MB (316154752) - PrepareTime: 217.545ms - RowsProduced: 40 (40) - TotalCpuTime: 643.408ms - TotalNetworkReceiveTime: 2s590ms - TotalNetworkSendTime: 972.384us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 633.737ms, non-child: 633.737ms, % non-child: 100.00%) - CodegenTime: 1.240ms - CompileTime: 89.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.752ms - PrepareTime: 215.277ms DataStreamSender (dst_id=14):(Total: 115.843us, non-child: 115.843us, % non-child: 100.00%) - BytesSent: 732.00 B (732) - NetworkThroughput(*): 14.65 MB/sec - OverallThroughput: 6.03 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 41.068us - TransmitDataRPCTime: 47.643us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s810ms, non-child: 370.151us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s810ms, non-child: 219.404ms, % non-child: 7.81%) ExecOption: Codegen Enabled - BuildTime: 73.596us - GetNewBlockTime: 122.207us - GetResultsTime: 37.275us - HTResizeTime: 1.560us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.220us EXCHANGE_NODE (id=12):(Total: 2s590ms, non-child: 215.982us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.10 KB (9320) - ConvertRowBatchTime: 57.560us - DeserializeRowBatchTimer: 117.816us - FirstBatchArrivalWaitTime: 2s363ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 231.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68998 (host=vb0212.halxg.cloudera.com:22000):(Total: 2s814ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 270.91 MB (284072960) - PrepareTime: 212.641ms - RowsProduced: 39 (39) - TotalCpuTime: 635.724ms - TotalNetworkReceiveTime: 2s597ms - TotalNetworkSendTime: 384.528us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 629.367ms, non-child: 629.367ms, % non-child: 100.00%) - CodegenTime: 1.336ms - CompileTime: 88.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 329.637ms - PrepareTime: 210.398ms DataStreamSender (dst_id=14):(Total: 139.895us, non-child: 139.895us, % non-child: 100.00%) - BytesSent: 674.00 B (674) - NetworkThroughput(*): 11.85 MB/sec - OverallThroughput: 4.59 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 58.419us - TransmitDataRPCTime: 54.229us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s812ms, non-child: 433.826us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s812ms, non-child: 214.303ms, % non-child: 7.62%) ExecOption: Codegen Enabled - BuildTime: 250.824us - GetNewBlockTime: 127.411us - GetResultsTime: 62.178us - HTResizeTime: 3.048us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.752us EXCHANGE_NODE (id=12):(Total: 2s597ms, non-child: 193.589us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.18 KB - BytesReceived: 8.90 KB (9118) - ConvertRowBatchTime: 55.865us - DeserializeRowBatchTimer: 314.544us - FirstBatchArrivalWaitTime: 2s371ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 225.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68999 (host=vb0220.halxg.cloudera.com:22000):(Total: 2s813ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447344) - PerHostPeakMemUsage: 319.35 MB (334863240) - PrepareTime: 216.643ms - RowsProduced: 42 (42) - TotalCpuTime: 640.884ms - TotalNetworkReceiveTime: 2s592ms - TotalNetworkSendTime: 326.834us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 634.983ms, non-child: 634.983ms, % non-child: 100.00%) - CodegenTime: 1.334ms - CompileTime: 88.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 331.560ms - PrepareTime: 214.353ms DataStreamSender (dst_id=14):(Total: 102.321us, non-child: 102.321us, % non-child: 100.00%) - BytesSent: 705.00 B (705) - NetworkThroughput(*): 14.73 MB/sec - OverallThroughput: 6.57 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 42 (42) - SerializeBatchTime: 27.421us - TransmitDataRPCTime: 45.656us - UncompressedRowBatchSize: 1.15 KB (1180) SORT_NODE (id=8):(Total: 2s811ms, non-child: 471.835us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s811ms, non-child: 218.063ms, % non-child: 7.76%) ExecOption: Codegen Enabled - BuildTime: 360.962us - GetNewBlockTime: 126.700us - GetResultsTime: 55.150us - HTResizeTime: 2.875us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.746us EXCHANGE_NODE (id=12):(Total: 2s592ms, non-child: 208.109us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.58 KB (9808) - ConvertRowBatchTime: 55.919us - DeserializeRowBatchTimer: 146.074us - FirstBatchArrivalWaitTime: 2s366ms - PeakMemoryUsage: 0 - RowsReturned: 630 (630) - RowsReturnedRate: 242.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68991 (host=vb0216.halxg.cloudera.com:22000):(Total: 2s813ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447216) - PerHostPeakMemUsage: 294.93 MB (309251840) - PrepareTime: 209.138ms - RowsProduced: 34 (34) - TotalCpuTime: 629.552ms - TotalNetworkReceiveTime: 2s600ms - TotalNetworkSendTime: 340.764us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 623.770ms, non-child: 623.770ms, % non-child: 100.00%) - CodegenTime: 1.208ms - CompileTime: 87.823ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.319ms - PrepareTime: 207.009ms DataStreamSender (dst_id=14):(Total: 131.005us, non-child: 131.005us, % non-child: 100.00%) - BytesSent: 606.00 B (606) - NetworkThroughput(*): 18.44 MB/sec - OverallThroughput: 4.41 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 34 (34) - SerializeBatchTime: 74.783us - TransmitDataRPCTime: 31.335us - UncompressedRowBatchSize: 956.00 B (956) SORT_NODE (id=8):(Total: 2s811ms, non-child: 398.584us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s811ms, non-child: 210.865ms, % non-child: 7.50%) ExecOption: Codegen Enabled - BuildTime: 272.744us - GetNewBlockTime: 118.959us - GetResultsTime: 49.469us - HTResizeTime: 2.421us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.540us EXCHANGE_NODE (id=12):(Total: 2s600ms, non-child: 211.635us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.92 KB (8106) - ConvertRowBatchTime: 56.652us - DeserializeRowBatchTimer: 311.785us - FirstBatchArrivalWaitTime: 2s373ms - PeakMemoryUsage: 0 - RowsReturned: 510 (510) - RowsReturnedRate: 196.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a6899d (host=vb0232.halxg.cloudera.com:22000):(Total: 2s812ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447360) - PerHostPeakMemUsage: 269.91 MB (283022632) - PrepareTime: 218.601ms - RowsProduced: 43 (43) - TotalCpuTime: 645.231ms - TotalNetworkReceiveTime: 2s589ms - TotalNetworkSendTime: 316.330us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 638.404ms, non-child: 638.404ms, % non-child: 100.00%) - CodegenTime: 1.312ms - CompileTime: 89.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.310ms - PrepareTime: 216.354ms DataStreamSender (dst_id=14):(Total: 88.153us, non-child: 88.153us, % non-child: 100.00%) - BytesSent: 744.00 B (744) - NetworkThroughput(*): 22.41 MB/sec - OverallThroughput: 8.05 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 43 (43) - SerializeBatchTime: 27.748us - TransmitDataRPCTime: 31.667us - UncompressedRowBatchSize: 1.18 KB (1208) SORT_NODE (id=8):(Total: 2s810ms, non-child: 462.379us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 15.00 /sec AGGREGATION_NODE (id=13):(Total: 2s809ms, non-child: 219.936ms, % non-child: 7.83%) ExecOption: Codegen Enabled - BuildTime: 328.542us - GetNewBlockTime: 121.880us - GetResultsTime: 67.886us - HTResizeTime: 2.977us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 15.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.050us EXCHANGE_NODE (id=12):(Total: 2s589ms, non-child: 215.466us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 5.81 KB - BytesReceived: 9.70 KB (9936) - ConvertRowBatchTime: 85.144us - DeserializeRowBatchTimer: 157.048us - FirstBatchArrivalWaitTime: 2s362ms - PeakMemoryUsage: 0 - RowsReturned: 645 (645) - RowsReturnedRate: 249.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68993 (host=vb0208.halxg.cloudera.com:22000):(Total: 2s811ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447264) - PerHostPeakMemUsage: 297.77 MB (312232768) - PrepareTime: 207.523ms - RowsProduced: 37 (37) - TotalCpuTime: 630.267ms - TotalNetworkReceiveTime: 2s600ms - TotalNetworkSendTime: 393.408us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 624.859ms, non-child: 624.859ms, % non-child: 100.00%) - CodegenTime: 1.286ms - CompileTime: 90.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 328.438ms - PrepareTime: 205.313ms DataStreamSender (dst_id=14):(Total: 129.006us, non-child: 129.006us, % non-child: 100.00%) - BytesSent: 614.00 B (614) - NetworkThroughput(*): 15.90 MB/sec - OverallThroughput: 4.54 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 37 (37) - SerializeBatchTime: 61.835us - TransmitDataRPCTime: 36.820us - UncompressedRowBatchSize: 1.02 KB (1040) SORT_NODE (id=8):(Total: 2s809ms, non-child: 441.265us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s809ms, non-child: 208.937ms, % non-child: 7.44%) ExecOption: Codegen Enabled - BuildTime: 92.907us - GetNewBlockTime: 125.176us - GetResultsTime: 64.123us - HTResizeTime: 3.468us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.435us EXCHANGE_NODE (id=12):(Total: 2s600ms, non-child: 205.710us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 3.92 KB - BytesReceived: 8.44 KB (8642) - ConvertRowBatchTime: 56.235us - DeserializeRowBatchTimer: 400.300us - FirstBatchArrivalWaitTime: 2s374ms - PeakMemoryUsage: 0 - RowsReturned: 555 (555) - RowsReturnedRate: 213.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a6899a (host=vb0228.halxg.cloudera.com:22000):(Total: 2s809ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447232) - PerHostPeakMemUsage: 289.93 MB (304014128) - PrepareTime: 214.462ms - RowsProduced: 35 (35) - TotalCpuTime: 642.145ms - TotalNetworkReceiveTime: 2s591ms - TotalNetworkSendTime: 412.946us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 636.377ms, non-child: 636.377ms, % non-child: 100.00%) - CodegenTime: 1.364ms - CompileTime: 88.312ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 335.313ms - PrepareTime: 212.138ms DataStreamSender (dst_id=14):(Total: 106.229us, non-child: 106.229us, % non-child: 100.00%) - BytesSent: 627.00 B (627) - NetworkThroughput(*): 20.06 MB/sec - OverallThroughput: 5.63 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 35 (35) - SerializeBatchTime: 47.555us - TransmitDataRPCTime: 29.808us - UncompressedRowBatchSize: 984.00 B (984) SORT_NODE (id=8):(Total: 2s808ms, non-child: 406.253us, % non-child: 0.01%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 12.00 /sec AGGREGATION_NODE (id=13):(Total: 2s807ms, non-child: 216.001ms, % non-child: 7.69%) ExecOption: Codegen Enabled - BuildTime: 83.322us - GetNewBlockTime: 144.865us - GetResultsTime: 68.756us - HTResizeTime: 2.275us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 12.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.628us EXCHANGE_NODE (id=12):(Total: 2s591ms, non-child: 239.604us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 537.00 B - BytesReceived: 7.98 KB (8172) - ConvertRowBatchTime: 79.807us - DeserializeRowBatchTimer: 279.105us - FirstBatchArrivalWaitTime: 2s364ms - PeakMemoryUsage: 0 - RowsReturned: 525 (525) - RowsReturnedRate: 202.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68995 (host=vb0222.halxg.cloudera.com:22000):(Total: 2s809ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447200) - PerHostPeakMemUsage: 255.92 MB (268353528) - PrepareTime: 205.900ms - RowsProduced: 33 (33) - TotalCpuTime: 631.364ms - TotalNetworkReceiveTime: 2s600ms - TotalNetworkSendTime: 316.508us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 625.866ms, non-child: 625.866ms, % non-child: 100.00%) - CodegenTime: 1.250ms - CompileTime: 88.901ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 332.604ms - PrepareTime: 203.744ms DataStreamSender (dst_id=14):(Total: 171.307us, non-child: 171.307us, % non-child: 100.00%) - BytesSent: 571.00 B (571) - NetworkThroughput(*): 8.30 MB/sec - OverallThroughput: 3.18 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 33 (33) - SerializeBatchTime: 79.554us - TransmitDataRPCTime: 65.613us - UncompressedRowBatchSize: 928.00 B (928) SORT_NODE (id=8):(Total: 2s808ms, non-child: 481.872us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec AGGREGATION_NODE (id=13):(Total: 2s807ms, non-child: 207.326ms, % non-child: 7.38%) ExecOption: Codegen Enabled - BuildTime: 86.733us - GetNewBlockTime: 127.040us - GetResultsTime: 56.625us - HTResizeTime: 3.089us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 11.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.971us EXCHANGE_NODE (id=12):(Total: 2s600ms, non-child: 226.486us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 7.54 KB (7726) - ConvertRowBatchTime: 50.042us - DeserializeRowBatchTimer: 404.133us - FirstBatchArrivalWaitTime: 2s373ms - PeakMemoryUsage: 0 - RowsReturned: 495 (495) - RowsReturnedRate: 190.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68990 (host=vb0226.halxg.cloudera.com:22000):(Total: 2s809ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447296) - PerHostPeakMemUsage: 289.91 MB (303995576) - PrepareTime: 210.855ms - RowsProduced: 39 (39) - TotalCpuTime: 634.023ms - TotalNetworkReceiveTime: 2s595ms - TotalNetworkSendTime: 349.898us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 628.438ms, non-child: 628.438ms, % non-child: 100.00%) - CodegenTime: 1.352ms - CompileTime: 88.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 330.280ms - PrepareTime: 208.583ms DataStreamSender (dst_id=14):(Total: 98.898us, non-child: 98.898us, % non-child: 100.00%) - BytesSent: 669.00 B (669) - NetworkThroughput(*): 17.34 MB/sec - OverallThroughput: 6.45 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 39 (39) - SerializeBatchTime: 35.221us - TransmitDataRPCTime: 36.799us - UncompressedRowBatchSize: 1.07 KB (1096) SORT_NODE (id=8):(Total: 2s807ms, non-child: 698.286us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec AGGREGATION_NODE (id=13):(Total: 2s807ms, non-child: 212.009ms, % non-child: 7.55%) ExecOption: Codegen Enabled - BuildTime: 287.362us - GetNewBlockTime: 126.970us - GetResultsTime: 37.626us - HTResizeTime: 2.956us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 13.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.401us EXCHANGE_NODE (id=12):(Total: 2s595ms, non-child: 250.690us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 4.05 KB - BytesReceived: 8.73 KB (8940) - ConvertRowBatchTime: 80.441us - DeserializeRowBatchTimer: 137.936us - FirstBatchArrivalWaitTime: 2s368ms - PeakMemoryUsage: 0 - RowsReturned: 585 (585) - RowsReturnedRate: 225.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68992 (host=vb0234.halxg.cloudera.com:22000):(Total: 2s806ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447408) - PerHostPeakMemUsage: 273.93 MB (287231896) - PrepareTime: 210.782ms - RowsProduced: 46 (46) - TotalCpuTime: 637.577ms - TotalNetworkReceiveTime: 2s592ms - TotalNetworkSendTime: 323.120us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 632.066ms, non-child: 632.066ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 89.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 333.317ms - PrepareTime: 208.422ms DataStreamSender (dst_id=14):(Total: 107.465us, non-child: 107.465us, % non-child: 100.00%) - BytesSent: 786.00 B (786) - NetworkThroughput(*): 35.45 MB/sec - OverallThroughput: 6.98 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 46 (46) - SerializeBatchTime: 59.922us - TransmitDataRPCTime: 21.142us - UncompressedRowBatchSize: 1.26 KB (1292) SORT_NODE (id=8):(Total: 2s804ms, non-child: 431.154us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 16.00 /sec AGGREGATION_NODE (id=13):(Total: 2s804ms, non-child: 211.986ms, % non-child: 7.56%) ExecOption: Codegen Enabled - BuildTime: 104.814us - GetNewBlockTime: 154.300us - GetResultsTime: 58.478us - HTResizeTime: 2.364us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 16.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.762us EXCHANGE_NODE (id=12):(Total: 2s592ms, non-child: 207.527us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 10.36 KB (10606) - ConvertRowBatchTime: 55.638us - DeserializeRowBatchTimer: 130.798us - FirstBatchArrivalWaitTime: 2s365ms - PeakMemoryUsage: 0 - RowsReturned: 690 (690) - RowsReturnedRate: 266.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a6898f (host=vb0214.halxg.cloudera.com:22000):(Total: 2s799ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447312) - PerHostPeakMemUsage: 317.06 MB (332457080) - PrepareTime: 213.259ms - RowsProduced: 40 (40) - TotalCpuTime: 646.317ms - TotalNetworkReceiveTime: 2s582ms - TotalNetworkSendTime: 414.345us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 640.467ms, non-child: 640.467ms, % non-child: 100.00%) - CodegenTime: 1.343ms - CompileTime: 89.416ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 339.410ms - PrepareTime: 210.989ms DataStreamSender (dst_id=14):(Total: 117.292us, non-child: 117.292us, % non-child: 100.00%) - BytesSent: 719.00 B (719) - NetworkThroughput(*): 19.87 MB/sec - OverallThroughput: 5.85 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 40 (40) - SerializeBatchTime: 54.366us - TransmitDataRPCTime: 34.503us - UncompressedRowBatchSize: 1.10 KB (1124) SORT_NODE (id=8):(Total: 2s797ms, non-child: 432.645us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s797ms, non-child: 214.930ms, % non-child: 7.68%) ExecOption: Codegen Enabled - BuildTime: 98.663us - GetNewBlockTime: 124.368us - GetResultsTime: 58.471us - HTResizeTime: 2.813us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.372us EXCHANGE_NODE (id=12):(Total: 2s582ms, non-child: 220.412us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.03 KB (9246) - ConvertRowBatchTime: 56.078us - DeserializeRowBatchTimer: 118.290us - FirstBatchArrivalWaitTime: 2s354ms - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 232.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d848ba179c9db493:8ad3fb48d1a68994 (host=vb0230.halxg.cloudera.com:22000):(Total: 2s779ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.26 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.33 MB (2447328) - PerHostPeakMemUsage: 301.47 MB (316119328) - PrepareTime: 217.281ms - RowsProduced: 41 (41) - TotalCpuTime: 673.780ms - TotalNetworkReceiveTime: 2s557ms - TotalNetworkSendTime: 455.786us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.05 MB (1097728) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 649.737ms, non-child: 649.737ms, % non-child: 100.00%) - CodegenTime: 1.339ms - CompileTime: 90.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 290 (290) - NumInstructions: 3.46K (3460) - OptimizationTime: 343.599ms - PrepareTime: 214.772ms DataStreamSender (dst_id=14):(Total: 104.406us, non-child: 104.406us, % non-child: 100.00%) - BytesSent: 694.00 B (694) - NetworkThroughput(*): 20.75 MB/sec - OverallThroughput: 6.34 MB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 41 (41) - SerializeBatchTime: 56.989us - TransmitDataRPCTime: 31.900us - UncompressedRowBatchSize: 1.12 KB (1152) SORT_NODE (id=8):(Total: 2s777ms, non-child: 494.114us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec AGGREGATION_NODE (id=13):(Total: 2s776ms, non-child: 218.941ms, % non-child: 7.88%) ExecOption: Codegen Enabled - BuildTime: 310.970us - GetNewBlockTime: 148.482us - GetResultsTime: 58.904us - HTResizeTime: 2.430us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 14.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.435us EXCHANGE_NODE (id=12):(Total: 2s557ms, non-child: 232.454us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 - BytesReceived: 9.08 KB (9302) - ConvertRowBatchTime: 57.761us - DeserializeRowBatchTimer: 141.798us - FirstBatchArrivalWaitTime: 2s331ms - PeakMemoryUsage: 0 - RowsReturned: 615 (615) - RowsReturnedRate: 240.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance d848ba179c9db493:8ad3fb48d1a689a1 (host=vb0234.halxg.cloudera.com:22000):(Total: 2s189ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Filter 0 arrival: 1s244ms Filter 1 arrival: 1s245ms Filter 2 arrival: 1s250ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 192.63 MB, 220.79 MB, 246.99 MB, 244.00 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 11 - AverageThreadTokens: 8.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 271.65 MB (284842568) - PerHostPeakMemUsage: 273.93 MB (287231896) - PrepareTime: 214.714ms - RowsProduced: 564 (564) - TotalCpuTime: 21s968ms - TotalNetworkReceiveTime: 118.264us - TotalNetworkSendTime: 3.851ms - TotalStorageWaitTime: 585.871ms CodeGen:(Total: 1s229ms, non-child: 1s229ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 320.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 705.224ms - PrepareTime: 203.088ms DataStreamSender (dst_id=12):(Total: 852.188us, non-child: 852.188us, % non-child: 100.00%) - BytesSent: 8.56 KB (8769) - NetworkThroughput(*): 25.95 MB/sec - OverallThroughput: 9.81 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 484.780us - TransmitDataRPCTime: 322.263us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s178ms, non-child: 378.233ms, % non-child: 17.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 75.181us - GetResultsTime: 87.703us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.08 MB (11618832) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 258.00 /sec - StreamingTime: 176.442ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s800ms, non-child: 10.488ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 109.805us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.945us - GetNewBlockTime: 800.772us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.85 MB (11381264) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.890ms - RowsReturned: 36.02K (36020) - RowsReturnedRate: 20.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.098us EXCHANGE_NODE (id=11):(Total: 47.693us, non-child: 47.693us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 34.891us - DeserializeRowBatchTimer: 19.663us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s789ms, non-child: 13.390ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.678us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.050us - GetNewBlockTime: 1.309ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.83 MB (11356688) - PinTime: 0.000ns - ProbeRows: 36.84K (36836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.514ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 20.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.045us EXCHANGE_NODE (id=10):(Total: 25.805us, non-child: 25.805us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.011us - DeserializeRowBatchTimer: 15.117us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s776ms, non-child: 1s587ms, % non-child: 89.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.174ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 634.970us - GetNewBlockTime: 1.159ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039168) - PinTime: 0.000ns - ProbeRows: 37.08M (37078673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s542ms - RowsReturned: 36.84K (36836) - RowsReturnedRate: 20.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.023us EXCHANGE_NODE (id=9):(Total: 668.905us, non-child: 668.905us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 525.032us - DeserializeRowBatchTimer: 3.264ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 187.722ms, non-child: 187.722ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 6:3/195.33 MB 4:2/186.53 MB 5:4/321.05 MB 2:3/195.46 MB 1:2/186.40 MB 0:4/391.72 MB 9:4/153.16 MB 3:6/269.92 MB 8:3/194.28 MB 7:3/125.77 MB 10:3/314.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 117.94 MB, 203.98 MB, 315.47 MB, 448.33 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 10.75 - BytesRead: 448.33 MB (470112363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.04 MB (469805163) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.04 MB (469805163) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 250.72 MB (262900296) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37092714) - RowsReturned: 37.08M (37078673) - RowsReturnedRate: 197.52 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 19s326ms - MaterializeTupleTime(*): 18s551ms - ScannerThreadsSysTime: 859.865ms - ScannerThreadsUserTime: 5s574ms - ScannerThreadsVoluntaryContextSwitches: 36.22K (36222) - TotalRawHdfsReadTime(*): 325.146ms - TotalReadThroughput: 149.44 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.04K (14041) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 37.05K (37046) - RowGroups rejected: 0 (0) - RowGroups total: 37.05K (37046) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a6 (host=vb0218.halxg.cloudera.com:22000):(Total: 2s170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Filter 0 arrival: 1s215ms Filter 1 arrival: 1s216ms Filter 2 arrival: 1s222ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 222.43 MB, 245.83 MB, 302.75 MB, 169.62 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 8 - AverageThreadTokens: 7.67 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 316.76 MB (332149672) - PerHostPeakMemUsage: 319.04 MB (334539000) - PrepareTime: 212.181ms - RowsProduced: 564 (564) - TotalCpuTime: 22s205ms - TotalNetworkReceiveTime: 147.111us - TotalNetworkSendTime: 5.181ms - TotalStorageWaitTime: 518.733ms CodeGen:(Total: 1s201ms, non-child: 1s201ms, % non-child: 100.00%) - CodegenTime: 1.098ms - CompileTime: 311.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 688.541ms - PrepareTime: 200.994ms DataStreamSender (dst_id=12):(Total: 1.178ms, non-child: 1.178ms, % non-child: 100.00%) - BytesSent: 8.47 KB (8671) - NetworkThroughput(*): 23.19 MB/sec - OverallThroughput: 7.02 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 775.123us - TransmitDataRPCTime: 356.664us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s157ms, non-child: 369.784ms, % non-child: 17.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.848us - GetResultsTime: 57.610us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.51 MB (13121136) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 261.00 /sec - StreamingTime: 171.276ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s787ms, non-child: 10.432ms, % non-child: 0.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 55.833us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 36.368us - GetNewBlockTime: 639.707us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.29 MB (12883568) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.883ms - RowsReturned: 35.84K (35840) - RowsReturnedRate: 20.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.222us EXCHANGE_NODE (id=11):(Total: 28.564us, non-child: 28.564us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 19.009us - DeserializeRowBatchTimer: 110.155us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 35.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s776ms, non-child: 12.709ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 26.271us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 10.145us - GetNewBlockTime: 1.311ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.26 MB (12858992) - PinTime: 0.000ns - ProbeRows: 36.70K (36697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.966ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 20.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.859us EXCHANGE_NODE (id=10):(Total: 17.928us, non-child: 17.928us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 7.112us - DeserializeRowBatchTimer: 15.623us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 20.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s764ms, non-child: 1s573ms, % non-child: 89.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.114ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 643.214us - GetNewBlockTime: 798.347us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038312) - PinTime: 0.000ns - ProbeRows: 37.08M (37082146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s523ms - RowsReturned: 36.70K (36697) - RowsReturnedRate: 20.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.189us EXCHANGE_NODE (id=9):(Total: 1.016ms, non-child: 1.016ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 844.498us - DeserializeRowBatchTimer: 1.948ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 15.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 189.915ms, non-child: 189.915ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 30 Hdfs split stats (:<# splits>/): 7:2/67.32 MB 6:4/234.76 MB 9:3/144.29 MB 0:2/136.58 MB 4:1/128.00 MB 8:1/58.93 MB 1:4/372.92 MB 3:3/333.99 MB 2:5/519.67 MB 5:5/519.80 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:90 BytesRead(500.000ms): 0, 0, 139.71 MB, 286.65 MB, 433.11 MB, 448.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 448.99 MB (470799910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 448.70 MB (470492710) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 448.70 MB (470492710) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 295.81 MB (310174632) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 37.09M (37093767) - RowsReturned: 37.08M (37082146) - RowsReturnedRate: 195.26 M/sec - ScanRangesComplete: 30 (30) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1810) - ScannerThreadsTotalWallClockTime: 19s543ms - MaterializeTupleTime(*): 18s844ms - ScannerThreadsSysTime: 863.863ms - ScannerThreadsUserTime: 5s927ms - ScannerThreadsVoluntaryContextSwitches: 35.89K (35892) - TotalRawHdfsReadTime(*): 322.639ms - TotalReadThroughput: 149.66 MB/sec Filter 0 (4.00 KB): - Rows processed: 491.49K (491490) - Rows rejected: 11.62K (11621) - Rows total: 491.52K (491520) Filter 1 (4.00 KB): - Files processed: 30 (30) - Files rejected: 0 (0) - Files total: 30 (30) - RowGroups processed: 36.91K (36913) - RowGroups rejected: 0 (0) - RowGroups total: 36.91K (36913) - Rows processed: 491.49K (491490) - Rows rejected: 0 (0) - Rows total: 491.52K (491520) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a6899e (host=vb0214.halxg.cloudera.com:22000):(Total: 2s170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Filter 0 arrival: 1s238ms Filter 1 arrival: 1s238ms Filter 2 arrival: 1s243ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 226.07 MB, 255.21 MB, 307.53 MB, 203.37 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 9 - AverageThreadTokens: 7.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 314.78 MB (330067752) - PerHostPeakMemUsage: 317.06 MB (332457080) - PrepareTime: 221.188ms - RowsProduced: 564 (564) - TotalCpuTime: 22s084ms - TotalNetworkReceiveTime: 64.806us - TotalNetworkSendTime: 4.500ms - TotalStorageWaitTime: 573.554ms CodeGen:(Total: 1s219ms, non-child: 1s219ms, % non-child: 100.00%) - CodegenTime: 1.619ms - CompileTime: 314.252ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 698.151ms - PrepareTime: 206.347ms DataStreamSender (dst_id=12):(Total: 895.431us, non-child: 895.431us, % non-child: 100.00%) - BytesSent: 8.52 KB (8724) - NetworkThroughput(*): 20.00 MB/sec - OverallThroughput: 9.29 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 433.798us - TransmitDataRPCTime: 415.933us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s158ms, non-child: 364.870ms, % non-child: 16.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 93.786us - GetResultsTime: 73.226us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.56 MB (12121056) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 261.00 /sec - StreamingTime: 161.527ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s793ms, non-child: 12.040ms, % non-child: 0.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 64.804us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.732us - GetNewBlockTime: 500.672us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.33 MB (11883488) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.333ms - RowsReturned: 36.18K (36181) - RowsReturnedRate: 20.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.265us EXCHANGE_NODE (id=11):(Total: 32.890us, non-child: 32.890us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 18.947us - DeserializeRowBatchTimer: 18.643us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 30.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s781ms, non-child: 13.567ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.929us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 24.737us - GetNewBlockTime: 938.684us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.31 MB (11858912) - PinTime: 0.000ns - ProbeRows: 37.04K (37037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.952ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.108us EXCHANGE_NODE (id=10):(Total: 22.609us, non-child: 22.609us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.456us - DeserializeRowBatchTimer: 12.598us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s767ms, non-child: 1s579ms, % non-child: 89.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.930ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 638.169us - GetNewBlockTime: 1.077ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039448) - PinTime: 0.000ns - ProbeRows: 37.68M (37681030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s527ms - RowsReturned: 37.04K (37037) - RowsReturnedRate: 20.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.313us EXCHANGE_NODE (id=9):(Total: 582.621us, non-child: 582.621us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 493.615us - DeserializeRowBatchTimer: 1.845ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 187.470ms, non-child: 187.470ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 2:3/314.76 MB 1:2/256.00 MB 7:2/256.00 MB 5:2/117.59 MB 3:2/117.17 MB 6:2/67.03 MB 9:4/323.47 MB 10:3/145.20 MB 0:3/213.50 MB 8:2/256.00 MB 4:6/489.86 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 159.63 MB, 271.73 MB, 433.97 MB, 457.13 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 457.13 MB (479330749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 455.95 MB (478101949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 455.95 MB (478101949) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 294.39 MB (308695216) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 12 (12) - RowsRead: 37.69M (37692944) - RowsReturned: 37.68M (37681030) - RowsReturnedRate: 201.00 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1700) - ScannerThreadsTotalWallClockTime: 19s465ms - MaterializeTupleTime(*): 18s727ms - ScannerThreadsSysTime: 822.869ms - ScannerThreadsUserTime: 5s437ms - ScannerThreadsVoluntaryContextSwitches: 36.38K (36383) - TotalRawHdfsReadTime(*): 351.683ms - TotalReadThroughput: 152.38 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.91K (11914) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.52K (37523) - RowGroups rejected: 0 (0) - RowGroups total: 37.52K (37523) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a0 (host=vb0216.halxg.cloudera.com:22000):(Total: 2s167ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Filter 0 arrival: 1s218ms Filter 1 arrival: 1s218ms Filter 2 arrival: 1s222ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 175.61 MB, 215.09 MB, 218.95 MB, 253.06 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 10 - AverageThreadTokens: 8.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 292.65 MB (306862512) - PerHostPeakMemUsage: 294.93 MB (309251840) - PrepareTime: 207.488ms - RowsProduced: 564 (564) - TotalCpuTime: 21s841ms - TotalNetworkReceiveTime: 71.915us - TotalNetworkSendTime: 4.789ms - TotalStorageWaitTime: 516.951ms CodeGen:(Total: 1s203ms, non-child: 1s203ms, % non-child: 100.00%) - CodegenTime: 1.124ms - CompileTime: 312.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 694.776ms - PrepareTime: 196.089ms DataStreamSender (dst_id=12):(Total: 1.064ms, non-child: 1.064ms, % non-child: 100.00%) - BytesSent: 8.43 KB (8628) - NetworkThroughput(*): 22.73 MB/sec - OverallThroughput: 7.73 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 629.061us - TransmitDataRPCTime: 362.023us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s156ms, non-child: 359.025ms, % non-child: 16.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 63.127us - GetResultsTime: 60.497us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.18 MB (13822008) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 261.00 /sec - StreamingTime: 165.444ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s797ms, non-child: 9.823ms, % non-child: 0.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 118.172us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 40.061us - GetNewBlockTime: 675.633us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.96 MB (13584440) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.142ms - RowsReturned: 35.19K (35186) - RowsReturnedRate: 19.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.442us EXCHANGE_NODE (id=11):(Total: 47.862us, non-child: 47.862us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 33.694us - DeserializeRowBatchTimer: 25.858us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s787ms, non-child: 13.279ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 25.953us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 10.248us - GetNewBlockTime: 703.292us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.93 MB (13559864) - PinTime: 0.000ns - ProbeRows: 36.04K (36037) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.429ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 20.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.088us EXCHANGE_NODE (id=10):(Total: 18.889us, non-child: 18.889us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 8.650us - DeserializeRowBatchTimer: 18.889us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 19.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s773ms, non-child: 1s587ms, % non-child: 89.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 3.432ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 317.542us - GetNewBlockTime: 797.816us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036968) - PinTime: 0.000ns - ProbeRows: 36.05M (36046248) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s537ms - RowsReturned: 36.04K (36037) - RowsReturnedRate: 20.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.544us EXCHANGE_NODE (id=9):(Total: 399.420us, non-child: 399.420us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 317.217us - DeserializeRowBatchTimer: 1.968ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 38.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 186.544ms, non-child: 186.544ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 8:1/58.48 MB 0:2/186.54 MB 7:1/77.03 MB 3:3/194.84 MB 6:2/186.28 MB 1:5/330.73 MB 9:3/263.56 MB 10:4/203.05 MB 4:3/194.26 MB 5:5/431.69 MB 2:5/330.67 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:25% 1:50% 2:0% 3:25% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 100.95 MB, 163.43 MB, 291.80 MB, 435.61 MB - AverageHdfsReadThreadConcurrency: 1.25 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 435.61 MB (456770099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.22 MB (456360499) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.22 MB (456360499) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 271.72 MB (284920240) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.06M (36059456) - RowsReturned: 36.05M (36046248) - RowsReturnedRate: 193.23 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1714) - ScannerThreadsTotalWallClockTime: 19s176ms - MaterializeTupleTime(*): 18s491ms - ScannerThreadsSysTime: 821.870ms - ScannerThreadsUserTime: 5s729ms - ScannerThreadsVoluntaryContextSwitches: 35.67K (35668) - TotalRawHdfsReadTime(*): 310.451ms - TotalReadThroughput: 145.20 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.21K (13208) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 35.99K (35993) - RowGroups rejected: 0 (0) - RowGroups total: 35.99K (35993) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a9 (host=vb0228.halxg.cloudera.com:22000):(Total: 2s129ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Filter 0 arrival: 1s234ms Filter 1 arrival: 1s234ms Filter 2 arrival: 1s240ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 226.64 MB, 182.87 MB, 274.12 MB, 152.46 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 7 - AverageThreadTokens: 7.50 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 287.65 MB (301624800) - PerHostPeakMemUsage: 289.93 MB (304014128) - PrepareTime: 220.584ms - RowsProduced: 564 (564) - TotalCpuTime: 21s061ms - TotalNetworkReceiveTime: 58.249us - TotalNetworkSendTime: 3.782ms - TotalStorageWaitTime: 561.043ms CodeGen:(Total: 1s219ms, non-child: 1s219ms, % non-child: 100.00%) - CodegenTime: 1.182ms - CompileTime: 315.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 693.914ms - PrepareTime: 208.913ms DataStreamSender (dst_id=12):(Total: 668.977us, non-child: 668.977us, % non-child: 100.00%) - BytesSent: 8.48 KB (8687) - NetworkThroughput(*): 34.91 MB/sec - OverallThroughput: 12.38 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 398.660us - TransmitDataRPCTime: 237.279us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s118ms, non-child: 375.765ms, % non-child: 17.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 70.883us - GetResultsTime: 59.073us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.10 MB (14781696) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 266.00 /sec - StreamingTime: 169.189ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s743ms, non-child: 10.506ms, % non-child: 0.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 111.076us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 30.281us - GetNewBlockTime: 1.066ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.87 MB (14544128) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.711ms - RowsReturned: 35.07K (35072) - RowsReturnedRate: 20.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.053us EXCHANGE_NODE (id=11):(Total: 47.956us, non-child: 47.956us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 36.151us - DeserializeRowBatchTimer: 37.619us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s732ms, non-child: 12.765ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 48.515us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 9.624us - GetNewBlockTime: 1.261ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.85 MB (14519552) - PinTime: 0.000ns - ProbeRows: 35.92K (35918) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.888ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 20.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.363us EXCHANGE_NODE (id=10):(Total: 27.140us, non-child: 27.140us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.183us - DeserializeRowBatchTimer: 14.169us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s719ms, non-child: 1s537ms, % non-child: 89.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.415ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 321.188us - GetNewBlockTime: 1.100ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036192) - PinTime: 0.000ns - ProbeRows: 36.07M (36074797) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s490ms - RowsReturned: 35.92K (35918) - RowsReturnedRate: 20.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.250us EXCHANGE_NODE (id=9):(Total: 585.810us, non-child: 585.810us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 508.400us - DeserializeRowBatchTimer: 2.189ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 181.731ms, non-child: 181.731ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/117.46 MB 8:2/136.26 MB 2:1/76.72 MB 3:4/460.47 MB 0:2/67.97 MB 9:5/400.41 MB 5:4/135.84 MB 6:6/441.37 MB 4:4/234.88 MB 1:4/253.87 MB 7:2/136.08 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 151.75 MB, 240.84 MB, 413.49 MB, 436.64 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 436.64 MB (457845252) - BytesReadDataNodeCache: 0 - BytesReadLocal: 436.24 MB (457435652) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 436.24 MB (457435652) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 266.73 MB (279682528) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 36.09M (36088679) - RowsReturned: 36.07M (36074797) - RowsReturnedRate: 198.51 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1689) - ScannerThreadsTotalWallClockTime: 18s471ms - MaterializeTupleTime(*): 17s720ms - ScannerThreadsSysTime: 814.871ms - ScannerThreadsUserTime: 5s647ms - ScannerThreadsVoluntaryContextSwitches: 34.28K (34279) - TotalRawHdfsReadTime(*): 313.483ms - TotalReadThroughput: 145.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.88K (13882) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.07K (36068) - RowGroups rejected: 0 (0) - RowGroups total: 36.07K (36068) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a4 (host=vb0222.halxg.cloudera.com:22000):(Total: 2s123ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Filter 0 arrival: 1s224ms Filter 1 arrival: 1s225ms Filter 2 arrival: 1s230ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 224.15 MB, 233.73 MB, 229.47 MB, 117.34 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 5 - AverageThreadTokens: 7.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 253.64 MB (265964200) - PerHostPeakMemUsage: 255.92 MB (268353528) - PrepareTime: 212.272ms - RowsProduced: 564 (564) - TotalCpuTime: 21s091ms - TotalNetworkReceiveTime: 64.655us - TotalNetworkSendTime: 4.391ms - TotalStorageWaitTime: 588.997ms CodeGen:(Total: 1s209ms, non-child: 1s209ms, % non-child: 100.00%) - CodegenTime: 1.159ms - CompileTime: 316.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 692.053ms - PrepareTime: 200.846ms DataStreamSender (dst_id=12):(Total: 998.392us, non-child: 998.392us, % non-child: 100.00%) - BytesSent: 8.54 KB (8744) - NetworkThroughput(*): 22.32 MB/sec - OverallThroughput: 8.35 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 591.361us - TransmitDataRPCTime: 373.531us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s111ms, non-child: 365.102ms, % non-child: 17.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.066us - GetResultsTime: 100.283us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12893368) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 267.00 /sec - StreamingTime: 166.104ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s746ms, non-child: 10.452ms, % non-child: 0.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 105.306us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.541us - GetNewBlockTime: 1.297ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12655800) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.781ms - RowsReturned: 35.88K (35876) - RowsReturnedRate: 20.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.025us EXCHANGE_NODE (id=11):(Total: 48.819us, non-child: 48.819us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.532us - DeserializeRowBatchTimer: 21.836us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s736ms, non-child: 13.082ms, % non-child: 0.75%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.688us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.440us - GetNewBlockTime: 1.280ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.05 MB (12631224) - PinTime: 0.000ns - ProbeRows: 36.66K (36655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.199ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 21.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.007us EXCHANGE_NODE (id=10):(Total: 27.742us, non-child: 27.742us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.062us - DeserializeRowBatchTimer: 16.763us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s723ms, non-child: 1s532ms, % non-child: 88.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.126ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 629.178us - GetNewBlockTime: 1.210ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038248) - PinTime: 0.000ns - ProbeRows: 36.66M (36660584) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s485ms - RowsReturned: 36.66K (36655) - RowsReturnedRate: 21.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.789us EXCHANGE_NODE (id=9):(Total: 621.547us, non-child: 621.547us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 534.908us - DeserializeRowBatchTimer: 1.797ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 190.483ms, non-child: 190.483ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 39 Hdfs split stats (:<# splits>/): 2:1/8.69 MB 5:3/175.97 MB 0:2/67.85 MB 3:1/76.65 MB 8:5/261.83 MB 9:4/202.53 MB 7:6/457.87 MB 4:5/211.62 MB 10:6/527.64 MB 6:6/526.61 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:117 BytesRead(500.000ms): 0, 0, 150.10 MB, 273.48 MB, 395.14 MB, 442.65 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.25 - BytesRead: 442.65 MB (464154286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 442.16 MB (463642286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 442.16 MB (463642286) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 232.71 MB (244013736) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.68M (36675563) - RowsReturned: 36.66M (36660584) - RowsReturnedRate: 192.46 M/sec - ScanRangesComplete: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1586) - ScannerThreadsTotalWallClockTime: 18s536ms - MaterializeTupleTime(*): 17s760ms - ScannerThreadsSysTime: 777.877ms - ScannerThreadsUserTime: 5s565ms - ScannerThreadsVoluntaryContextSwitches: 34.71K (34711) - TotalRawHdfsReadTime(*): 329.544ms - TotalReadThroughput: 147.55 MB/sec Filter 0 (4.00 KB): - Rows processed: 638.94K (638937) - Rows rejected: 14.98K (14979) - Rows total: 638.98K (638976) Filter 1 (4.00 KB): - Files processed: 39 (39) - Files rejected: 0 (0) - Files total: 39 (39) - RowGroups processed: 36.68K (36681) - RowGroups rejected: 0 (0) - RowGroups total: 36.68K (36681) - Rows processed: 638.94K (638937) - Rows rejected: 0 (0) - Rows total: 638.98K (638976) - Splits processed: 39 (39) - Splits rejected: 0 (0) - Splits total: 39 (39) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689ab (host=vb0204.halxg.cloudera.com:22000):(Total: 2s115ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Filter 1 arrival: 1s240ms Filter 0 arrival: 1s240ms Filter 2 arrival: 1s246ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 185.07 MB, 233.69 MB, 243.78 MB, 216.17 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 9 - AverageThreadTokens: 7.83 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 299.22 MB (313757232) - PerHostPeakMemUsage: 301.51 MB (316154752) - PrepareTime: 219.050ms - RowsProduced: 564 (564) - TotalCpuTime: 20s772ms - TotalNetworkReceiveTime: 129.078us - TotalNetworkSendTime: 5.112ms - TotalStorageWaitTime: 543.995ms CodeGen:(Total: 1s225ms, non-child: 1s225ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 322.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 694.594ms - PrepareTime: 207.600ms DataStreamSender (dst_id=12):(Total: 835.520us, non-child: 835.520us, % non-child: 100.00%) - BytesSent: 8.81 KB (9025) - NetworkThroughput(*): 31.71 MB/sec - OverallThroughput: 10.30 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 513.726us - TransmitDataRPCTime: 271.433us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s104ms, non-child: 371.022ms, % non-child: 17.63%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.304us - GetResultsTime: 64.174us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.18 MB (12766864) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 268.00 /sec - StreamingTime: 165.860ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s733ms, non-child: 10.539ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 114.493us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 36.259us - GetNewBlockTime: 1.263ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.95 MB (12529296) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.924ms - RowsReturned: 36.15K (36151) - RowsReturnedRate: 20.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.129us EXCHANGE_NODE (id=11):(Total: 60.593us, non-child: 60.593us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.101us - DeserializeRowBatchTimer: 20.253us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 16.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s722ms, non-child: 12.792ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.097us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 18.959us - GetNewBlockTime: 1.205ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.93 MB (12504720) - PinTime: 0.000ns - ProbeRows: 37.03K (37034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.931ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 21.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.757us EXCHANGE_NODE (id=10):(Total: 29.715us, non-child: 29.715us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.998us - DeserializeRowBatchTimer: 15.636us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s709ms, non-child: 1s539ms, % non-child: 90.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.229ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 634.006us - GetNewBlockTime: 1.196ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039672) - PinTime: 0.000ns - ProbeRows: 37.46M (37459947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s492ms - RowsReturned: 37.03K (37034) - RowsReturnedRate: 21.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.996us EXCHANGE_NODE (id=9):(Total: 701.963us, non-child: 701.963us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 549.269us - DeserializeRowBatchTimer: 2.382ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 169.472ms, non-child: 169.472ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 32 Hdfs split stats (:<# splits>/): 10:3/93.30 MB 2:1/8.60 MB 5:2/66.86 MB 4:4/273.00 MB 0:3/262.98 MB 7:4/373.59 MB 1:6/560.55 MB 9:4/322.33 MB 8:2/256.00 MB 3:3/333.97 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:96 BytesRead(500.000ms): 0, 0, 124.29 MB, 211.26 MB, 337.94 MB, 453.92 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.25 - BytesRead: 453.92 MB (475966344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 453.53 MB (475556744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 453.53 MB (475556744) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 278.30 MB (291814960) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 37.47M (37472260) - RowsReturned: 37.46M (37459947) - RowsReturnedRate: 221.04 M/sec - ScanRangesComplete: 32 (32) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 18s172ms - MaterializeTupleTime(*): 17s469ms - ScannerThreadsSysTime: 770.877ms - ScannerThreadsUserTime: 5s023ms - ScannerThreadsVoluntaryContextSwitches: 35.80K (35800) - TotalRawHdfsReadTime(*): 330.241ms - TotalReadThroughput: 151.31 MB/sec Filter 0 (4.00 KB): - Rows processed: 524.26K (524256) - Rows rejected: 12.31K (12313) - Rows total: 524.29K (524288) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 37.35K (37347) - RowGroups rejected: 0 (0) - RowGroups total: 37.35K (37347) - Rows processed: 524.26K (524256) - Rows rejected: 0 (0) - Rows total: 524.29K (524288) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a8 (host=vb0220.halxg.cloudera.com:22000):(Total: 2s085ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Filter 0 arrival: 1s222ms Filter 1 arrival: 1s223ms Filter 2 arrival: 1s228ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 208.71 MB, 212.23 MB, 269.61 MB, 220.91 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 10 - AverageThreadTokens: 8.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 317.07 MB (332473912) - PerHostPeakMemUsage: 319.35 MB (334863240) - PrepareTime: 214.048ms - RowsProduced: 564 (564) - TotalCpuTime: 20s845ms - TotalNetworkReceiveTime: 128.963us - TotalNetworkSendTime: 4.475ms - TotalStorageWaitTime: 531.489ms CodeGen:(Total: 1s208ms, non-child: 1s208ms, % non-child: 100.00%) - CodegenTime: 1.168ms - CompileTime: 314.088ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 690.867ms - PrepareTime: 202.741ms DataStreamSender (dst_id=12):(Total: 908.312us, non-child: 908.312us, % non-child: 100.00%) - BytesSent: 8.87 KB (9085) - NetworkThroughput(*): 23.55 MB/sec - OverallThroughput: 9.54 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 497.905us - TransmitDataRPCTime: 367.939us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s073ms, non-child: 350.471ms, % non-child: 16.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.486us - GetResultsTime: 58.613us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.39 MB (12996216) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 271.00 /sec - StreamingTime: 150.022ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s723ms, non-child: 11.042ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 134.344us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 34.138us - GetNewBlockTime: 509.744us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.17 MB (12758648) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.219ms - RowsReturned: 35.48K (35475) - RowsReturnedRate: 20.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.477us EXCHANGE_NODE (id=11):(Total: 416.881us, non-child: 416.881us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 398.823us - DeserializeRowBatchTimer: 19.924us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 2.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s712ms, non-child: 13.490ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 46.700us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 13.239us - GetNewBlockTime: 918.195us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.14 MB (12734072) - PinTime: 0.000ns - ProbeRows: 36.36K (36364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.362ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 21.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.892us EXCHANGE_NODE (id=10):(Total: 27.272us, non-child: 27.272us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.633us - DeserializeRowBatchTimer: 14.717us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s698ms, non-child: 1s526ms, % non-child: 89.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.282ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 628.697us - GetNewBlockTime: 1.121ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037112) - PinTime: 0.000ns - ProbeRows: 36.55M (36551452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s483ms - RowsReturned: 36.36K (36364) - RowsReturnedRate: 21.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.610us EXCHANGE_NODE (id=9):(Total: 681.368us, non-child: 681.368us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 531.085us - DeserializeRowBatchTimer: 1.845ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 171.418ms, non-child: 171.418ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 29 Hdfs split stats (:<# splits>/): 3:1/128.00 MB 1:2/135.19 MB 6:2/117.15 MB 0:2/136.54 MB 9:2/153.88 MB 5:3/245.45 MB 7:3/263.49 MB 4:2/136.34 MB 8:4/373.00 MB 2:4/409.90 MB 10:4/391.85 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:87 BytesRead(500.000ms): 0, 0, 132.16 MB, 160.62 MB, 349.67 MB, 442.37 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.50 - BytesRead: 442.37 MB (463853916) - BytesReadDataNodeCache: 0 - BytesReadLocal: 441.68 MB (463137116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 441.68 MB (463137116) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 296.15 MB (310531640) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.56M (36562683) - RowsReturned: 36.55M (36551452) - RowsReturnedRate: 213.23 M/sec - ScanRangesComplete: 29 (29) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1513) - ScannerThreadsTotalWallClockTime: 18s275ms - MaterializeTupleTime(*): 17s589ms - ScannerThreadsSysTime: 672.893ms - ScannerThreadsUserTime: 4s743ms - ScannerThreadsVoluntaryContextSwitches: 35.58K (35582) - TotalRawHdfsReadTime(*): 326.725ms - TotalReadThroughput: 147.46 MB/sec Filter 0 (4.00 KB): - Rows processed: 475.11K (475107) - Rows rejected: 11.23K (11231) - Rows total: 475.14K (475136) Filter 1 (4.00 KB): - Files processed: 29 (29) - Files rejected: 0 (0) - Files total: 29 (29) - RowGroups processed: 36.35K (36352) - RowGroups rejected: 0 (0) - RowGroups total: 36.35K (36352) - Rows processed: 475.11K (475107) - Rows rejected: 0 (0) - Rows total: 475.14K (475136) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689ac (host=vb0232.halxg.cloudera.com:22000):(Total: 2s058ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Filter 0 arrival: 1s228ms Filter 1 arrival: 1s228ms Filter 2 arrival: 1s234ms MemoryUsage(500.000ms): 0, 2.18 MB, 2.88 MB, 219.20 MB, 206.39 MB, 233.51 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 10 - AverageThreadTokens: 6.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 267.63 MB (280633304) - PerHostPeakMemUsage: 269.91 MB (283022632) - PrepareTime: 218.673ms - RowsProduced: 564 (564) - TotalCpuTime: 19s956ms - TotalNetworkReceiveTime: 64.602us - TotalNetworkSendTime: 4.479ms - TotalStorageWaitTime: 542.037ms CodeGen:(Total: 1s214ms, non-child: 1s214ms, % non-child: 100.00%) - CodegenTime: 1.183ms - CompileTime: 315.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 690.668ms - PrepareTime: 207.266ms DataStreamSender (dst_id=12):(Total: 928.000us, non-child: 928.000us, % non-child: 100.00%) - BytesSent: 8.41 KB (8611) - NetworkThroughput(*): 17.13 MB/sec - OverallThroughput: 8.85 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 417.132us - TransmitDataRPCTime: 479.349us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s045ms, non-child: 364.689ms, % non-child: 17.83%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 74.888us - GetResultsTime: 107.276us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12895928) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 275.00 /sec - StreamingTime: 159.511ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s680ms, non-child: 10.584ms, % non-child: 0.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 112.312us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 32.085us - GetNewBlockTime: 817.603us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.07 MB (12658360) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.086ms - RowsReturned: 34.30K (34300) - RowsReturnedRate: 20.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.128us EXCHANGE_NODE (id=11):(Total: 53.033us, non-child: 53.033us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.610us - DeserializeRowBatchTimer: 21.634us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s669ms, non-child: 13.135ms, % non-child: 0.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 43.288us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.216us - GetNewBlockTime: 1.006ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.05 MB (12633784) - PinTime: 0.000ns - ProbeRows: 35.11K (35114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.354ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 21.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.859us EXCHANGE_NODE (id=10):(Total: 24.774us, non-child: 24.774us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.834us - DeserializeRowBatchTimer: 13.243us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s656ms, non-child: 1s483ms, % non-child: 89.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.163ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 542.836us - GetNewBlockTime: 1.069ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040016) - PinTime: 0.000ns - ProbeRows: 35.53M (35527574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s439ms - RowsReturned: 35.11K (35114) - RowsReturnedRate: 21.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.959us EXCHANGE_NODE (id=9):(Total: 607.737us, non-child: 607.737us, % non-child: 100.00%) BytesReceived(500.000ms): 296.18 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 523.405us - DeserializeRowBatchTimer: 2.394ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 25.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 173.014ms, non-child: 173.014ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:4/271.26 MB 1:1/58.81 MB 5:3/245.04 MB 4:2/206.01 MB 3:6/250.10 MB 8:1/128.00 MB 10:4/304.30 MB 2:3/126.21 MB 7:3/193.49 MB 0:6/510.14 MB 6:3/125.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 144.92 MB, 255.10 MB, 428.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 428.91 MB (449745737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 428.52 MB (449336137) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 428.52 MB (449336137) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 245.72 MB (257658768) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 4 (4) - RowsRead: 35.54M (35541507) - RowsReturned: 35.53M (35527574) - RowsReturnedRate: 205.34 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.46K (1461) - ScannerThreadsTotalWallClockTime: 17s422ms - MaterializeTupleTime(*): 16s712ms - ScannerThreadsSysTime: 694.890ms - ScannerThreadsUserTime: 4s459ms - ScannerThreadsVoluntaryContextSwitches: 34.25K (34247) - TotalRawHdfsReadTime(*): 322.507ms - TotalReadThroughput: 171.56 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.93K (13933) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 35.54K (35536) - RowGroups rejected: 0 (0) - RowGroups total: 35.54K (35536) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a6899f (host=vb0226.halxg.cloudera.com:22000):(Total: 2s049ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Filter 0 arrival: 1s220ms Filter 1 arrival: 1s220ms Filter 2 arrival: 1s225ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 239.87 MB, 221.57 MB, 251.12 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 10 - AverageThreadTokens: 6.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 287.63 MB (301606248) - PerHostPeakMemUsage: 289.91 MB (303995576) - PrepareTime: 210.831ms - RowsProduced: 564 (564) - TotalCpuTime: 20s034ms - TotalNetworkReceiveTime: 112.768us - TotalNetworkSendTime: 4.771ms - TotalStorageWaitTime: 565.004ms CodeGen:(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - CodegenTime: 1.141ms - CompileTime: 312.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 692.453ms - PrepareTime: 199.466ms DataStreamSender (dst_id=12):(Total: 869.736us, non-child: 869.736us, % non-child: 100.00%) - BytesSent: 8.58 KB (8789) - NetworkThroughput(*): 24.94 MB/sec - OverallThroughput: 9.64 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 489.968us - TransmitDataRPCTime: 336.092us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s039ms, non-child: 359.212ms, % non-child: 17.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.230us - GetResultsTime: 57.493us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.96 MB (12545608) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 276.00 /sec - StreamingTime: 162.175ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s679ms, non-child: 10.271ms, % non-child: 0.61%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 115.646us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 34.470us - GetNewBlockTime: 1.159ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.74 MB (12308040) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.746ms - RowsReturned: 35.57K (35570) - RowsReturnedRate: 21.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 13.919us EXCHANGE_NODE (id=11):(Total: 51.294us, non-child: 51.294us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 34.887us - DeserializeRowBatchTimer: 17.717us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s669ms, non-child: 12.917ms, % non-child: 0.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 52.293us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.050us - GetNewBlockTime: 1.201ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.71 MB (12283464) - PinTime: 0.000ns - ProbeRows: 36.36K (36362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.106ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 21.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.730us EXCHANGE_NODE (id=10):(Total: 25.677us, non-child: 25.677us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.539us - DeserializeRowBatchTimer: 14.182us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s656ms, non-child: 1s486ms, % non-child: 89.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.060ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 636.033us - GetNewBlockTime: 1.225ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12040304) - PinTime: 0.000ns - ProbeRows: 36.29M (36291418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s442ms - RowsReturned: 36.36K (36362) - RowsReturnedRate: 21.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.651us EXCHANGE_NODE (id=9):(Total: 672.038us, non-child: 672.038us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 536.697us - DeserializeRowBatchTimer: 1.696ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 169.356ms, non-child: 169.356ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 34 Hdfs split stats (:<# splits>/): 5:1/128.00 MB 0:4/251.75 MB 1:2/67.06 MB 7:7/518.42 MB 3:5/518.97 MB 2:2/204.87 MB 9:3/195.30 MB 10:4/134.26 MB 6:3/263.11 MB 4:3/194.04 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:102 BytesRead(500.000ms): 0, 0, 156.63 MB, 279.04 MB, 439.07 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 439.07 MB (460401841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.59 MB (459889841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.59 MB (459889841) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 266.71 MB (279663976) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 5 (5) - RowsRead: 36.30M (36304703) - RowsReturned: 36.29M (36291418) - RowsReturnedRate: 214.29 M/sec - ScanRangesComplete: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1498) - ScannerThreadsTotalWallClockTime: 17s533ms - MaterializeTupleTime(*): 16s802ms - ScannerThreadsSysTime: 734.884ms - ScannerThreadsUserTime: 5s137ms - ScannerThreadsVoluntaryContextSwitches: 34.72K (34717) - TotalRawHdfsReadTime(*): 321.619ms - TotalReadThroughput: 175.63 MB/sec Filter 0 (4.00 KB): - Rows processed: 557.02K (557022) - Rows rejected: 13.29K (13285) - Rows total: 557.06K (557056) Filter 1 (4.00 KB): - Files processed: 34 (34) - Files rejected: 0 (0) - Files total: 34 (34) - RowGroups processed: 36.23K (36231) - RowGroups rejected: 0 (0) - RowGroups total: 36.23K (36231) - Rows processed: 557.02K (557022) - Rows rejected: 0 (0) - Rows total: 557.06K (557056) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a7 (host=vb0212.halxg.cloudera.com:22000):(Total: 2s047ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Filter 1 arrival: 1s230ms Filter 0 arrival: 1s230ms Filter 2 arrival: 1s236ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 228.07 MB, 225.43 MB, 248.49 MB, 67.00 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 12, 3 - AverageThreadTokens: 6.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 268.63 MB (281683632) - PerHostPeakMemUsage: 270.91 MB (284072960) - PrepareTime: 211.787ms - RowsProduced: 564 (564) - TotalCpuTime: 20s327ms - TotalNetworkReceiveTime: 85.762us - TotalNetworkSendTime: 3.637ms - TotalStorageWaitTime: 566.963ms CodeGen:(Total: 1s216ms, non-child: 1s216ms, % non-child: 100.00%) - CodegenTime: 1.158ms - CompileTime: 319.814ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 695.209ms - PrepareTime: 200.580ms DataStreamSender (dst_id=12):(Total: 900.013us, non-child: 900.013us, % non-child: 100.00%) - BytesSent: 8.60 KB (8807) - NetworkThroughput(*): 23.32 MB/sec - OverallThroughput: 9.33 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 496.215us - TransmitDataRPCTime: 360.216us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s037ms, non-child: 362.493ms, % non-child: 17.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 57.406us - GetResultsTime: 401.054us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.88 MB (12453656) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 276.00 /sec - StreamingTime: 163.633ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s674ms, non-child: 10.638ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 118.460us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 34.729us - GetNewBlockTime: 1.286ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.65 MB (12216088) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.971ms - RowsReturned: 34.84K (34845) - RowsReturnedRate: 20.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.439us EXCHANGE_NODE (id=11):(Total: 65.200us, non-child: 65.200us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.849us - DeserializeRowBatchTimer: 18.607us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 15.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s664ms, non-child: 12.616ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 43.696us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 21.135us - GetNewBlockTime: 912.862us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.63 MB (12191512) - PinTime: 0.000ns - ProbeRows: 35.77K (35768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.907ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 21.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.453us EXCHANGE_NODE (id=10):(Total: 26.622us, non-child: 26.622us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.798us - DeserializeRowBatchTimer: 13.401us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s651ms, non-child: 1s484ms, % non-child: 89.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.062ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 581.478us - GetNewBlockTime: 1.259ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12039576) - PinTime: 0.000ns - ProbeRows: 36.30M (36299898) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s440ms - RowsReturned: 35.77K (35768) - RowsReturnedRate: 21.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.089us EXCHANGE_NODE (id=9):(Total: 591.468us, non-child: 591.468us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 486.321us - DeserializeRowBatchTimer: 1.853ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 166.169ms, non-child: 166.169ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 37 Hdfs split stats (:<# splits>/): 0:1/58.37 MB 7:1/8.90 MB 4:1/8.71 MB 3:4/253.80 MB 6:3/212.72 MB 5:5/382.09 MB 8:7/515.48 MB 9:2/135.94 MB 1:3/314.71 MB 10:5/331.17 MB 2:5/262.73 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:111 BytesRead(500.000ms): 0, 0, 159.07 MB, 258.91 MB, 415.45 MB, 438.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.75 - BytesRead: 438.61 MB (459911198) - BytesReadDataNodeCache: 0 - BytesReadLocal: 438.31 MB (459603998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 438.31 MB (459603998) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 247.71 MB (259741360) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 3 (3) - RowsRead: 36.31M (36314066) - RowsReturned: 36.30M (36299898) - RowsReturnedRate: 218.45 M/sec - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1546) - ScannerThreadsTotalWallClockTime: 17s819ms - MaterializeTupleTime(*): 17s077ms - ScannerThreadsSysTime: 697.888ms - ScannerThreadsUserTime: 4s906ms - ScannerThreadsVoluntaryContextSwitches: 34.60K (34601) - TotalRawHdfsReadTime(*): 309.934ms - TotalReadThroughput: 146.20 MB/sec Filter 0 (4.00 KB): - Rows processed: 606.17K (606171) - Rows rejected: 14.17K (14168) - Rows total: 606.21K (606208) Filter 1 (4.00 KB): - Files processed: 37 (37) - Files rejected: 0 (0) - Files total: 37 (37) - RowGroups processed: 36.30K (36298) - RowGroups rejected: 0 (0) - RowGroups total: 36.30K (36298) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689aa (host=vb0206.halxg.cloudera.com:22000):(Total: 2s039ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Filter 0 arrival: 1s221ms Filter 1 arrival: 1s222ms Filter 2 arrival: 1s228ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 214.77 MB, 228.15 MB, 273.88 MB, 168.44 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 10, 8 - AverageThreadTokens: 7.33 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 300.65 MB (315256160) - PerHostPeakMemUsage: 302.93 MB (317645488) - PrepareTime: 212.569ms - RowsProduced: 564 (564) - TotalCpuTime: 20s159ms - TotalNetworkReceiveTime: 97.713us - TotalNetworkSendTime: 4.402ms - TotalStorageWaitTime: 636.030ms CodeGen:(Total: 1s207ms, non-child: 1s207ms, % non-child: 100.00%) - CodegenTime: 1.040ms - CompileTime: 315.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.997ms - PrepareTime: 201.492ms DataStreamSender (dst_id=12):(Total: 1.069ms, non-child: 1.069ms, % non-child: 100.00%) - BytesSent: 8.47 KB (8670) - NetworkThroughput(*): 16.67 MB/sec - OverallThroughput: 7.73 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 540.488us - TransmitDataRPCTime: 496.131us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 2s027ms, non-child: 354.570ms, % non-child: 17.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.683us - GetResultsTime: 75.675us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.13 MB (12722064) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 278.00 /sec - StreamingTime: 155.379ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s673ms, non-child: 10.735ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 106.361us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.177us - GetNewBlockTime: 898.895us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.91 MB (12484496) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.205ms - RowsReturned: 34.83K (34830) - RowsReturnedRate: 20.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.790us EXCHANGE_NODE (id=11):(Total: 49.617us, non-child: 49.617us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.276us - DeserializeRowBatchTimer: 22.409us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s662ms, non-child: 13.001ms, % non-child: 0.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.471us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.711us - GetNewBlockTime: 1.038ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.88 MB (12459920) - PinTime: 0.000ns - ProbeRows: 35.63K (35635) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.322ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 21.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.040us EXCHANGE_NODE (id=10):(Total: 27.113us, non-child: 27.113us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.914us - DeserializeRowBatchTimer: 14.480us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s649ms, non-child: 1s488ms, % non-child: 90.24%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.279ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 607.684us - GetNewBlockTime: 1.056ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12037232) - PinTime: 0.000ns - ProbeRows: 36.01M (36010376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s444ms - RowsReturned: 35.63K (35635) - RowsReturnedRate: 21.60 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.685us EXCHANGE_NODE (id=9):(Total: 643.848us, non-child: 643.848us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 524.480us - DeserializeRowBatchTimer: 3.034ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 160.388ms, non-child: 160.388ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 10:2/66.83 MB 2:5/262.39 MB 8:1/59.02 MB 0:4/184.54 MB 4:5/449.99 MB 1:3/194.90 MB 5:3/213.94 MB 7:3/314.53 MB 9:3/195.68 MB 3:7/518.43 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 146.90 MB, 264.85 MB, 436.45 MB, 436.45 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 9.50 - BytesRead: 436.45 MB (457655084) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.57 MB (456733484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.57 MB (456733484) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 278.27 MB (291791160) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 9 (9) - RowsRead: 36.02M (36024352) - RowsReturned: 36.01M (36010376) - RowsReturnedRate: 224.52 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1546) - ScannerThreadsTotalWallClockTime: 17s738ms - MaterializeTupleTime(*): 16s943ms - ScannerThreadsSysTime: 669.893ms - ScannerThreadsUserTime: 4s465ms - ScannerThreadsVoluntaryContextSwitches: 35.04K (35039) - TotalRawHdfsReadTime(*): 376.603ms - TotalReadThroughput: 145.48 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 13.98K (13976) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 36 (36) - Files rejected: 0 (0) - Files total: 36 (36) - RowGroups processed: 36.01K (36009) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36009) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a2 (host=vb0208.halxg.cloudera.com:22000):(Total: 1s998ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Filter 0 arrival: 1s227ms Filter 1 arrival: 1s228ms Filter 2 arrival: 1s233ms MemoryUsage(500.000ms): 0, 1.38 MB, 2.88 MB, 213.68 MB, 225.06 MB, 231.12 MB ThreadUsage(500.000ms): 1, 1, 1, 12, 12, 9 - AverageThreadTokens: 6.00 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 295.49 MB (309843440) - PerHostPeakMemUsage: 297.77 MB (312232768) - PrepareTime: 209.467ms - RowsProduced: 564 (564) - TotalCpuTime: 19s598ms - TotalNetworkReceiveTime: 98.732us - TotalNetworkSendTime: 3.799ms - TotalStorageWaitTime: 550.521ms CodeGen:(Total: 1s213ms, non-child: 1s213ms, % non-child: 100.00%) - CodegenTime: 1.107ms - CompileTime: 318.029ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 696.381ms - PrepareTime: 198.076ms DataStreamSender (dst_id=12):(Total: 778.941us, non-child: 778.941us, % non-child: 100.00%) - BytesSent: 8.48 KB (8679) - NetworkThroughput(*): 27.37 MB/sec - OverallThroughput: 10.63 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 441.017us - TransmitDataRPCTime: 302.395us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 1s988ms, non-child: 356.376ms, % non-child: 17.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.095us - GetResultsTime: 67.604us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.78 MB (12348168) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 283.00 /sec - StreamingTime: 160.760ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s632ms, non-child: 10.483ms, % non-child: 0.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 108.320us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 29.956us - GetNewBlockTime: 1.163ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.55 MB (12110600) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.730ms - RowsReturned: 35.16K (35159) - RowsReturnedRate: 21.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.547us EXCHANGE_NODE (id=11):(Total: 53.497us, non-child: 53.497us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.526us - DeserializeRowBatchTimer: 21.256us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s622ms, non-child: 13.058ms, % non-child: 0.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 44.767us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 22.347us - GetNewBlockTime: 1.260ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.53 MB (12086024) - PinTime: 0.000ns - ProbeRows: 35.99K (35993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.236ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 22.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.514us EXCHANGE_NODE (id=10):(Total: 24.369us, non-child: 24.369us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.788us - DeserializeRowBatchTimer: 14.585us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s609ms, non-child: 1s449ms, % non-child: 90.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.127ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 318.805us - GetNewBlockTime: 1.211ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038384) - PinTime: 0.000ns - ProbeRows: 36.39M (36392001) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s405ms - RowsReturned: 35.99K (35993) - RowsReturnedRate: 22.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.510us EXCHANGE_NODE (id=9):(Total: 633.924us, non-child: 633.924us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 515.004us - DeserializeRowBatchTimer: 1.848ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 158.574ms, non-child: 158.574ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 36 Hdfs split stats (:<# splits>/): 9:2/186.82 MB 8:4/134.08 MB 7:3/195.51 MB 6:5/450.90 MB 4:2/117.24 MB 10:3/245.14 MB 5:6/440.93 MB 1:4/254.05 MB 0:5/312.75 MB 2:2/136.64 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:108 BytesRead(500.000ms): 0, 0, 142.21 MB, 280.79 MB, 440.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 440.67 MB (462080766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 439.99 MB (461363966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 439.99 MB (461363966) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 274.79 MB (288138736) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 7 (7) - RowsRead: 36.41M (36406157) - RowsReturned: 36.39M (36392001) - RowsReturnedRate: 229.50 M/sec - ScanRangesComplete: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1396) - ScannerThreadsTotalWallClockTime: 17s124ms - MaterializeTupleTime(*): 16s395ms - ScannerThreadsSysTime: 714.885ms - ScannerThreadsUserTime: 4s961ms - ScannerThreadsVoluntaryContextSwitches: 34.95K (34945) - TotalRawHdfsReadTime(*): 290.280ms - TotalReadThroughput: 176.27 MB/sec Filter 0 (4.00 KB): - Rows processed: 589.79K (589788) - Rows rejected: 14.16K (14156) - Rows total: 589.82K (589824) Filter 1 (4.00 KB): - Files processed: 35 (35) - Files rejected: 0 (0) - Files total: 35 (35) - RowGroups processed: 36.39K (36392) - RowGroups rejected: 0 (0) - RowGroups total: 36.39K (36392) - Rows processed: 589.79K (589788) - Rows rejected: 0 (0) - Rows total: 589.82K (589824) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a3 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s993ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Filter 0 arrival: 1s245ms Filter 1 arrival: 1s246ms Filter 2 arrival: 1s251ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 210.03 MB, 247.05 MB, 296.77 MB, 115.24 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 5 - AverageThreadTokens: 7.17 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 299.20 MB (313730000) - PerHostPeakMemUsage: 301.47 MB (316119328) - PrepareTime: 217.116ms - RowsProduced: 564 (564) - TotalCpuTime: 19s769ms - TotalNetworkReceiveTime: 108.811us - TotalNetworkSendTime: 3.754ms - TotalStorageWaitTime: 601.179ms CodeGen:(Total: 1s228ms, non-child: 1s228ms, % non-child: 100.00%) - CodegenTime: 1.013ms - CompileTime: 316.378ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 705.139ms - PrepareTime: 206.221ms DataStreamSender (dst_id=12):(Total: 1.330ms, non-child: 1.330ms, % non-child: 100.00%) - BytesSent: 8.44 KB (8640) - NetworkThroughput(*): 19.02 MB/sec - OverallThroughput: 6.19 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 836.786us - TransmitDataRPCTime: 433.209us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 1s983ms, non-child: 356.682ms, % non-child: 17.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.472us - GetResultsTime: 68.328us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.29 MB (12887856) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 284.00 /sec - StreamingTime: 152.656ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s626ms, non-child: 9.658ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 108.735us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.153us - GetNewBlockTime: 979.134us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.06 MB (12650288) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.511ms - RowsReturned: 34.74K (34738) - RowsReturnedRate: 21.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.242us EXCHANGE_NODE (id=11):(Total: 51.713us, non-child: 51.713us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 35.944us - DeserializeRowBatchTimer: 20.803us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s616ms, non-child: 11.930ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 47.569us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 19.607us - GetNewBlockTime: 1.255ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.04 MB (12625712) - PinTime: 0.000ns - ProbeRows: 35.56K (35560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.380ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 21.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.259us EXCHANGE_NODE (id=10):(Total: 29.645us, non-child: 29.645us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.670us - DeserializeRowBatchTimer: 15.294us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s604ms, non-child: 1s438ms, % non-child: 89.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 4.963ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 628.698us - GetNewBlockTime: 1.073ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12038744) - PinTime: 0.000ns - ProbeRows: 35.79M (35792492) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s395ms - RowsReturned: 35.56K (35560) - RowsReturnedRate: 22.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.121us EXCHANGE_NODE (id=9):(Total: 676.177us, non-child: 676.177us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 547.914us - DeserializeRowBatchTimer: 2.034ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 165.681ms, non-child: 165.681ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 31 Hdfs split stats (:<# splits>/): 4:2/67.51 MB 0:3/314.47 MB 2:2/135.14 MB 9:3/245.52 MB 7:1/128.00 MB 8:2/117.39 MB 1:3/314.81 MB 10:2/256.00 MB 6:5/329.53 MB 3:3/142.99 MB 5:5/379.92 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:93 BytesRead(500.000ms): 0, 0, 134.66 MB, 283.26 MB, 403.47 MB, 432.69 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 9.25 - BytesRead: 432.69 MB (453711238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 432.11 MB (453096838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 432.11 MB (453096838) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 12 (12) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 279.80 MB (293392616) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.80M (35804448) - RowsReturned: 35.79M (35792492) - RowsReturnedRate: 216.03 M/sec - ScanRangesComplete: 31 (31) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1549) - ScannerThreadsTotalWallClockTime: 17s339ms - MaterializeTupleTime(*): 16s576ms - ScannerThreadsSysTime: 693.890ms - ScannerThreadsUserTime: 4s884ms - ScannerThreadsVoluntaryContextSwitches: 33.90K (33901) - TotalRawHdfsReadTime(*): 346.190ms - TotalReadThroughput: 144.23 MB/sec Filter 0 (4.00 KB): - Rows processed: 507.87K (507873) - Rows rejected: 11.96K (11956) - Rows total: 507.90K (507904) Filter 1 (4.00 KB): - Files processed: 31 (31) - Files rejected: 0 (0) - Files total: 31 (31) - RowGroups processed: 35.68K (35679) - RowGroups rejected: 0 (0) - RowGroups total: 35.68K (35679) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance d848ba179c9db493:8ad3fb48d1a689a5 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s988ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Filter 1 arrival: 1s215ms Filter 0 arrival: 1s215ms Filter 2 arrival: 1s221ms MemoryUsage(500.000ms): 1.38 MB, 2.88 MB, 202.76 MB, 224.74 MB, 258.60 MB, 127.34 MB ThreadUsage(500.000ms): 1, 1, 12, 12, 12, 6 - AverageThreadTokens: 7.33 - BloomFilterBytes: 12.00 KB (12288) - PeakMemoryUsage: 282.19 MB (295901696) - PerHostPeakMemUsage: 284.47 MB (298291024) - PrepareTime: 210.567ms - RowsProduced: 564 (564) - TotalCpuTime: 19s339ms - TotalNetworkReceiveTime: 106.811us - TotalNetworkSendTime: 4.792ms - TotalStorageWaitTime: 589.053ms CodeGen:(Total: 1s200ms, non-child: 1s200ms, % non-child: 100.00%) - CodegenTime: 1.504ms - CompileTime: 310.726ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 360 (360) - NumInstructions: 8.49K (8493) - OptimizationTime: 689.641ms - PrepareTime: 199.027ms DataStreamSender (dst_id=12):(Total: 1.229ms, non-child: 1.229ms, % non-child: 100.00%) - BytesSent: 8.48 KB (8684) - NetworkThroughput(*): 12.88 MB/sec - OverallThroughput: 6.74 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 564 (564) - SerializeBatchTime: 547.959us - TransmitDataRPCTime: 642.953us - UncompressedRowBatchSize: 19.89 KB (20364) AGGREGATION_NODE (id=7):(Total: 1s977ms, non-child: 355.144ms, % non-child: 17.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.057us - GetResultsTime: 71.353us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11838008) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 285.00 /sec - StreamingTime: 157.667ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s622ms, non-child: 10.128ms, % non-child: 0.62%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 108.869us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 31.143us - GetNewBlockTime: 1.167ms - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.06 MB (11600440) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.726ms - RowsReturned: 34.83K (34832) - RowsReturnedRate: 21.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.486us EXCHANGE_NODE (id=11):(Total: 79.652us, non-child: 79.652us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8317) - ConvertRowBatchTime: 64.175us - DeserializeRowBatchTimer: 18.672us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 12.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1s612ms, non-child: 12.495ms, % non-child: 0.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 52.169us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 18.897us - GetNewBlockTime: 1.074ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.04 MB (11575864) - PinTime: 0.000ns - ProbeRows: 35.69K (35694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.751ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 22.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.684us EXCHANGE_NODE (id=10):(Total: 29.347us, non-child: 29.347us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 14.028us - DeserializeRowBatchTimer: 13.879us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1s599ms, non-child: 1s438ms, % non-child: 89.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 0 of 1 Runtime Filter Published, 1 Disabled - BuildPartitionTime: 5.149ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 626.930us - GetNewBlockTime: 1.131ms - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.48 MB (12036520) - PinTime: 0.000ns - ProbeRows: 35.98M (35976925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s396ms - RowsReturned: 35.69K (35694) - RowsReturnedRate: 22.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.873us EXCHANGE_NODE (id=9):(Total: 688.775us, non-child: 688.775us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB, 612.12 KB - BytesReceived: 612.12 KB (626812) - ConvertRowBatchTime: 552.806us - DeserializeRowBatchTimer: 1.907ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 160.589ms, non-child: 160.589ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 38 Hdfs split stats (:<# splits>/): 2:2/186.77 MB 8:2/17.20 MB 1:1/58.42 MB 3:6/371.25 MB 5:3/314.70 MB 10:5/230.94 MB 6:3/245.19 MB 7:4/304.08 MB 9:4/153.43 MB 0:8/577.16 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:114 BytesRead(500.000ms): 0, 0, 135.03 MB, 263.21 MB, 389.47 MB, 435.74 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 9.50 - BytesRead: 435.74 MB (456903383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 435.15 MB (456288983) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 435.15 MB (456288983) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 260.28 MB (272926288) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 6 (6) - RowsRead: 35.99M (35991725) - RowsReturned: 35.98M (35976925) - RowsReturnedRate: 224.03 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1503) - ScannerThreadsTotalWallClockTime: 16s928ms - MaterializeTupleTime(*): 16s167ms - ScannerThreadsSysTime: 738.882ms - ScannerThreadsUserTime: 4s958ms - ScannerThreadsVoluntaryContextSwitches: 34.43K (34427) - TotalRawHdfsReadTime(*): 342.189ms - TotalReadThroughput: 145.25 MB/sec Filter 0 (4.00 KB): - Rows processed: 622.55K (622554) - Rows rejected: 14.80K (14800) - Rows total: 622.59K (622592) Filter 1 (4.00 KB): - Files processed: 38 (38) - Files rejected: 0 (0) - Files total: 38 (38) - RowGroups processed: 36.01K (36013) - RowGroups rejected: 0 (0) - RowGroups total: 36.01K (36013) - Rows processed: 622.55K (622554) - Rows rejected: 0 (0) - Rows total: 622.59K (622592) - Splits processed: 38 (38) - Splits rejected: 0 (0) - Splits total: 38 (38) Filter 2 (4.00 KB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Fragment F03: Instance d848ba179c9db493:8ad3fb48d1a689ad (host=vb0230.halxg.cloudera.com:22000):(Total: 228.864ms, non-child: 224.376ms, % non-child: 98.04%) Hdfs split stats (:<# splits>/): 7:1/88.92 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.89 MB (4076528) - PrepareTime: 128.979us - RowsProduced: 1.00K (1002) - TotalCpuTime: 11.647ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 219.723ms - TotalStorageWaitTime: 3.057ms DataStreamSender (dst_id=11):(Total: 522.679us, non-child: 522.679us, % non-child: 100.00%) - BytesSent: 121.83 KB (124755) - NetworkThroughput(*): 409.91 MB/sec - OverallThroughput: 227.63 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - RowsReturned: 1.00K (1002) - SerializeBatchTime: 128.896us - TransmitDataRPCTime: 290.246us - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.965ms, non-child: 3.965ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 2.062us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 252.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.605ms - MaterializeTupleTime(*): 82.875us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 66.034us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance d848ba179c9db493:8ad3fb48d1a689ae (host=vb0228.halxg.cloudera.com:22000):(Total: 224.552ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/2.17 MB MemoryUsage(500.000ms): 128.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.00 MB (5244448) - PrepareTime: 208.317ms - RowsProduced: 365 (365) - TotalCpuTime: 593.700ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.705us - TotalStorageWaitTime: 5.120ms CodeGen:(Total: 566.563ms, non-child: 566.563ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 73.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 302 (302) - NumInstructions: 3.23K (3231) - OptimizationTime: 286.347ms - PrepareTime: 205.645ms DataStreamSender (dst_id=10):(Total: 261.906us, non-child: 261.906us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 216.74 MB/sec - OverallThroughput: 164.13 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - RowsReturned: 365 (365) - SerializeBatchTime: 32.031us - TransmitDataRPCTime: 198.338us - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 429.403ms, non-child: 429.403ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 175.460us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 714.27 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 850.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 12.613ms - MaterializeTupleTime(*): 6.263ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 6.998ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 656.914us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance d848ba179c9db493:8ad3fb48d1a689af (host=vb0234.halxg.cloudera.com:22000):(Total: 302.773ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/28.28 MB MemoryUsage(500.000ms): 38.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.40 MB (10906752) - PrepareTime: 203.773ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 755.312ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 734.645us - TotalStorageWaitTime: 8.789ms CodeGen:(Total: 567.855ms, non-child: 567.855ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529348) - NumFunctions: 289 (289) - NumInstructions: 2.86K (2856) - OptimizationTime: 286.470ms - PrepareTime: 201.966ms DataStreamSender (dst_id=9):(Total: 10.492ms, non-child: 10.492ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9402180) - NetworkThroughput(*): 2.44 GB/sec - OverallThroughput: 854.56 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - RowsReturned: 15.41K (15406) - SerializeBatchTime: 6.859ms - TransmitDataRPCTime: 3.589ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 494.503ms, non-child: 494.503ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 94.856ms - MaterializeTupleTime(*): 79.324ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 83.987ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 2.202ms - TotalReadThroughput: 0.00 /sec ================================================================================