================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 606.91us | 0ns | 606.91us | 564 | 100 | | 08:TOP-N | 15 | 413.98us | 0ns | 730.27us | 564 | 100 | | 13:AGGREGATE | 15 | 147.26ms | 0ns | 155.86ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 178.42us | 0ns | 246.40us | 8.32K | 3.83K | | 07:AGGREGATE | 15 | 237.71ms | 0ns | 314.33ms | 8.32K | 3.83K | | 06:HASH JOIN | 15 | 7.09ms | 0ns | 8.25ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 48.08us | 0ns | 68.95us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 4.47ms | 0ns | 4.47ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 6.70ms | 0ns | 7.41ms | 542.77K | 4.27K | | |--10:EXCHANGE | 15 | 33.87us | 0ns | 38.04us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 292.89ms | 0ns | 292.89ms | 365 | 114 | | 04:HASH JOIN | 15 | 16.57ms | 0ns | 19.11ms | 542.77K | 68.35K | | |--09:EXCHANGE | 15 | 564.99us | 0ns | 954.57us | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 359.35ms | 0ns | 359.35ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 679.32ms | 0ns | 873.47ms | 542.77K | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=834fefb7ff3195ff:852b952ee22d9490): Summary: Session ID: f9422092951d8723:7fe3fc93c175b6b3 Session Type: BEESWAX Start Time: 2016-04-21 10:56:11.037457000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:46263 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=12B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.17KB | tuple-ids=6 row-size=12B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=16B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=130B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=126B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=114B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=28.61GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=24B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 40.373ms - Analysis finished: 5.470ms (5.470ms) - Equivalence classes computed: 5.840ms (370.436us) - Single node plan created: 18.299ms (12.458ms) - Runtime filters computed: 18.673ms (373.772us) - Distributed plan created: 28.659ms (9.986ms) - Lineage info computed: 31.053ms (2.394ms) - Planning finished: 40.373ms (9.320ms) Query Timeline: 1s677ms - Start execution: 145.658us (145.658us) - Planning finished: 52.238ms (52.092ms) - Ready to start 33 remote fragments: 58.909ms (6.671ms) - All 33 remote fragments started: 88.921ms (30.011ms) - Rows available: 1s625ms (1s536ms) - First row fetched: 1s657ms (31.965ms) ImpalaServer: - ClientFetchWaitTimer: 32.804ms - RowMaterializationTimer: 999.820us Execution Profile 834fefb7ff3195ff:852b952ee22d9490:(Total: 1s578ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 8ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 10ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Per Node Peak Memory Usage: vb0220.halxg.cloudera.com:22000(309.14 MB) vb0206.halxg.cloudera.com:22000(276.38 MB) vb0228.halxg.cloudera.com:22000(253.46 MB) vb0230.halxg.cloudera.com:22000(288.04 MB) vb0208.halxg.cloudera.com:22000(273.76 MB) vb0234.halxg.cloudera.com:22000(258.01 MB) vb0224.halxg.cloudera.com:22000(267.73 MB) vb0222.halxg.cloudera.com:22000(276.19 MB) vb0232.halxg.cloudera.com:22000(263.17 MB) vb0214.halxg.cloudera.com:22000(263.74 MB) vb0216.halxg.cloudera.com:22000(265.40 MB) vb0218.halxg.cloudera.com:22000(268.19 MB) vb0212.halxg.cloudera.com:22000(272.56 MB) vb0226.halxg.cloudera.com:22000(291.61 MB) vb0204.halxg.cloudera.com:22000(263.24 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 1s533ms, non-child: 1.120ms, % non-child: 0.07%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 208.883us - RowsProduced: 100 (100) - TotalCpuTime: 1s601ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 1s532ms, non-child: 606.912us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0 - BytesReceived: 10.27 KB (10521) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 840.638us - FirstBatchArrivalWaitTime: 1s531ms - MergeGetNext: 421.000us - MergeGetNextBatch: 91.116us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 368.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 1s321ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1s554ms max:1s564ms mean: 1s560ms stddev:3.450ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449934) - PerHostPeakMemUsage: 272.71 MB (285955683) - PrepareTime: 145.891ms - RowsProduced: 37 (37) - TotalCpuTime: 385.512ms - TotalNetworkReceiveTime: 1s171ms - TotalNetworkSendTime: 418.535us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 379.201ms, non-child: 379.201ms, % non-child: 100.00%) - CodegenTime: 1.785ms - CompileTime: 20.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.828ms - PrepareTime: 142.564ms DataStreamSender (dst_id=14):(Total: 95.014us, non-child: 95.014us, % non-child: 100.00%) - BytesSent: 701.00 B (701) - NetworkThroughput(*): 2.48 MB/sec - OverallThroughput: 8.34 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 72.168us - ThriftTransmitTime(*): 306.849us - UncompressedRowBatchSize: 756.00 B (756) SORT_NODE (id=8):(Total: 1s319ms, non-child: 413.980us, % non-child: 0.03%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 27.00 /sec AGGREGATION_NODE (id=13):(Total: 1s319ms, non-child: 147.258ms, % non-child: 11.16%) - BuildTime: 114.295us - GetNewBlockTime: 95.662us - GetResultsTime: 61.192us - HTResizeTime: 4.336us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 27.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.590us EXCHANGE_NODE (id=12):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) - BytesReceived: 10.02 KB (10261) - ConvertRowBatchTime: 46.069us - DeserializeRowBatchTimer: 263.303us - FirstBatchArrivalWaitTime: 830.486ms - PeakMemoryUsage: 0 - RowsReturned: 554 (554) - RowsReturnedRate: 472.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 975.094ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.83 GB, max: 2.04 GB, avg: 1.91 GB, stddev: 64.79 MB completion times: min:1s202ms max:1s550ms mean: 1s361ms stddev:92.999ms execution rates: min:1.25 GB/sec max:1.58 GB/sec mean:1.41 GB/sec stddev:80.86 MB/sec num instances: 15 - AverageThreadTokens: 5.29 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 267.44 MB (280429633) - PerHostPeakMemUsage: 272.71 MB (285955683) - PrepareTime: 147.187ms - RowsProduced: 554 (554) - TotalCpuTime: 7s299ms - TotalNetworkReceiveTime: 100.297us - TotalNetworkSendTime: 20.619ms - TotalStorageWaitTime: 352.524ms CodeGen:(Total: 519.239ms, non-child: 519.239ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 101.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 279.052ms - PrepareTime: 137.379ms DataStreamSender (dst_id=12):(Total: 155.557us, non-child: 155.557us, % non-child: 100.00%) - BytesSent: 10.02 KB (10261) - NetworkThroughput(*): 1.75 MB/sec - OverallThroughput: 65.12 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 521.636us - ThriftTransmitTime(*): 19.645ms - UncompressedRowBatchSize: 15.22 KB (15588) AGGREGATION_NODE (id=7):(Total: 947.942ms, non-child: 237.713ms, % non-child: 25.08%) - GetNewBlockTime: 66.859us - GetResultsTime: 153.669us - HTResizeTime: 589.582us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.36 MB (18202618) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 554 (554) - RowsReturnedRate: 591.00 /sec - StreamingTime: 78.203ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 710.228ms, non-child: 7.090ms, % non-child: 1.00%) - BuildPartitionTime: 124.244us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.071us - GetNewBlockTime: 246.921us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.88 MB (17702906) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.273ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 50.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.235us EXCHANGE_NODE (id=11):(Total: 48.081us, non-child: 48.081us, % non-child: 100.00%) - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.051us - DeserializeRowBatchTimer: 30.287us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 703.143ms, non-child: 6.700ms, % non-child: 0.95%) - BuildPartitionTime: 88.706us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 60.682us - GetNewBlockTime: 311.768us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.79 MB (13412411) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.729ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 52.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.959us EXCHANGE_NODE (id=10):(Total: 33.872us, non-child: 33.872us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.011us - DeserializeRowBatchTimer: 41.849us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 696.449ms, non-child: 16.569ms, % non-child: 2.38%) - BuildPartitionTime: 4.604ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 678.305us - GetNewBlockTime: 490.064us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423057) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.050ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 52.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.529us EXCHANGE_NODE (id=9):(Total: 564.990us, non-child: 564.990us, % non-child: 100.00%) - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 447.449us - DeserializeRowBatchTimer: 2.810ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 679.315ms, non-child: 679.315ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 249.86 MB (262000780) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.86 MB (262000780) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.86 MB (262000780) - DecompressionTime: 779.287ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 251.80 MB (264029189) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.48M (36475001) - RowsReturned: 36.18K (36184) - RowsReturnedRate: 53.92 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 701 (701) - ScannerThreadsTotalWallClockTime: 6s294ms - MaterializeTupleTime(*): 5s031ms - ScannerThreadsSysTime: 199.430ms - ScannerThreadsUserTime: 5s685ms - ScannerThreadsVoluntaryContextSwitches: 358 (358) - TotalRawHdfsReadTime(*): 183.149ms - TotalReadThroughput: 204.84 MB/sec Filter 0: - Rows processed: 397.56K (397560) - Rows rejected: 9.32K (9318) - Rows total: 397.58K (397585) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.15K (69146) - RowGroups rejected: 0 (0) - RowGroups total: 69.15K (69146) - Rows processed: 397.56K (397560) - Rows rejected: 0 (0) - Rows total: 397.58K (397585) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.47M (36465683) - Rows rejected: 36.43M (36429498) - Rows total: 36.47M (36465683) Averaged Fragment F03:(Total: 156.722ms, non-child: 151.988ms, % non-child: 96.98%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:159.304ms max:159.304ms mean: 159.304ms stddev:0.000ns execution rates: min:558.18 KB/sec max:558.18 KB/sec mean:558.18 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.91 MB (4099664) - PrepareTime: 136.620us - RowsProduced: 1.00K (1002) - TotalCpuTime: 12.580ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 146.551ms - TotalStorageWaitTime: 3.567ms DataStreamSender (dst_id=11):(Total: 263.646us, non-child: 263.646us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 58.61 KB/sec - OverallThroughput: 451.22 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 119.105us - ThriftTransmitTime(*): 2s078ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 4.470ms, non-child: 4.470ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.998us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 224.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 4.128ms - MaterializeTupleTime(*): 84.380us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 51.191us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 157.265ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:365.375ms max:365.375ms mean: 365.375ms stddev:0.000ns execution rates: min:5.93 MB/sec max:5.93 MB/sec mean:5.93 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.02 MB (5267584) - PrepareTime: 140.199ms - RowsProduced: 365 (365) - TotalCpuTime: 372.178ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 62.554us - TotalStorageWaitTime: 4.975ms CodeGen:(Total: 343.496ms, non-child: 343.496ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 199.409ms - PrepareTime: 136.515ms DataStreamSender (dst_id=10):(Total: 107.773us, non-child: 107.773us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 12.16 MB/sec - OverallThroughput: 398.86 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 30.622us - ThriftTransmitTime(*): 3.535ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 292.889ms, non-child: 292.889ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 97.511us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 768.82 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 12.390ms - MaterializeTupleTime(*): 6.373ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 610.304us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 237.687ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:447.961ms max:447.961ms mean: 447.961ms stddev:0.000ns execution rates: min:63.14 MB/sec max:63.14 MB/sec mean:63.14 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.53 MB (5795480) - PerHostPeakMemUsage: 10.51 MB (11025440) - PrepareTime: 139.247ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 532.934ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 620.192us - TotalStorageWaitTime: 7.605ms CodeGen:(Total: 344.522ms, non-child: 344.522ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.651ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 196.168ms - PrepareTime: 136.710ms DataStreamSender (dst_id=9):(Total: 13.582ms, non-child: 13.582ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 58.46 MB/sec - OverallThroughput: 660.27 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 8.526ms - ThriftTransmitTime(*): 153.407ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 359.345ms, non-child: 359.345ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 3.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.87 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 93.757ms - MaterializeTupleTime(*): 80.284ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 83.987ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.750ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 834fefb7ff3195ff:852b952ee22d949f (host=vb0220.halxg.cloudera.com:22000):(Total: 1s327ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449968) - PerHostPeakMemUsage: 309.14 MB (324158144) - PrepareTime: 147.628ms - RowsProduced: 40 (40) - TotalCpuTime: 383.920ms - TotalNetworkReceiveTime: 1s175ms - TotalNetworkSendTime: 761.928us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.959ms, non-child: 377.959ms, % non-child: 100.00%) - CodegenTime: 1.814ms - CompileTime: 20.577ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 211.857ms - PrepareTime: 144.232ms DataStreamSender (dst_id=14):(Total: 114.206us, non-child: 114.206us, % non-child: 100.00%) - BytesSent: 758.00 B (758) - NetworkThroughput(*): 1.09 MB/sec - OverallThroughput: 6.33 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 90.612us - ThriftTransmitTime(*): 660.917us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s325ms, non-child: 376.992us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 30.00 /sec AGGREGATION_NODE (id=13):(Total: 1s324ms, non-child: 149.028ms, % non-child: 11.25%) ExecOption: Codegen Enabled - BuildTime: 101.218us - GetNewBlockTime: 89.888us - GetResultsTime: 65.649us - HTResizeTime: 4.450us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 30.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.538us EXCHANGE_NODE (id=12):(Total: 1s175ms, non-child: 172.169us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 10.58 KB - BytesReceived: 10.58 KB (10837) - ConvertRowBatchTime: 46.294us - DeserializeRowBatchTimer: 173.124us - FirstBatchArrivalWaitTime: 834.291ms - PeakMemoryUsage: 0 - RowsReturned: 590 (590) - RowsReturnedRate: 501.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d949d (host=vb0228.halxg.cloudera.com:22000):(Total: 1s326ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449920) - PerHostPeakMemUsage: 253.46 MB (265769592) - PrepareTime: 144.085ms - RowsProduced: 35 (35) - TotalCpuTime: 381.478ms - TotalNetworkReceiveTime: 1s178ms - TotalNetworkSendTime: 305.996us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 375.118ms, non-child: 375.118ms, % non-child: 100.00%) - CodegenTime: 1.794ms - CompileTime: 20.057ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.064ms - PrepareTime: 140.741ms DataStreamSender (dst_id=14):(Total: 110.965us, non-child: 110.965us, % non-child: 100.00%) - BytesSent: 655.00 B (655) - NetworkThroughput(*): 2.79 MB/sec - OverallThroughput: 5.63 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 92.552us - ThriftTransmitTime(*): 223.651us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 1s324ms, non-child: 364.183us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 26.00 /sec AGGREGATION_NODE (id=13):(Total: 1s323ms, non-child: 145.072ms, % non-child: 10.96%) ExecOption: Codegen Enabled - BuildTime: 95.563us - GetNewBlockTime: 94.740us - GetResultsTime: 38.041us - HTResizeTime: 4.305us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 26.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.546us EXCHANGE_NODE (id=12):(Total: 1s178ms, non-child: 154.718us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 648.00 B - BytesReceived: 9.52 KB (9745) - ConvertRowBatchTime: 47.011us - DeserializeRowBatchTimer: 138.358us - FirstBatchArrivalWaitTime: 837.267ms - PeakMemoryUsage: 0 - RowsReturned: 519 (519) - RowsReturnedRate: 440.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d949e (host=vb0206.halxg.cloudera.com:22000):(Total: 1s326ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 276.38 MB (289803920) - PrepareTime: 147.456ms - RowsProduced: 37 (37) - TotalCpuTime: 385.094ms - TotalNetworkReceiveTime: 1s174ms - TotalNetworkSendTime: 556.957us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.628ms, non-child: 378.628ms, % non-child: 100.00%) - CodegenTime: 1.815ms - CompileTime: 20.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.674ms - PrepareTime: 144.134ms DataStreamSender (dst_id=14):(Total: 123.927us, non-child: 123.927us, % non-child: 100.00%) - BytesSent: 691.00 B (691) - NetworkThroughput(*): 1.43 MB/sec - OverallThroughput: 5.32 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 99.825us - ThriftTransmitTime(*): 461.919us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s324ms, non-child: 730.272us, % non-child: 0.06%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 27.00 /sec AGGREGATION_NODE (id=13):(Total: 1s323ms, non-child: 148.790ms, % non-child: 11.24%) ExecOption: Codegen Enabled - BuildTime: 94.684us - GetNewBlockTime: 93.373us - GetResultsTime: 83.328us - HTResizeTime: 3.470us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 27.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.706us EXCHANGE_NODE (id=12):(Total: 1s174ms, non-child: 214.852us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 9.88 KB (10115) - ConvertRowBatchTime: 43.426us - DeserializeRowBatchTimer: 226.097us - FirstBatchArrivalWaitTime: 833.302ms - PeakMemoryUsage: 0 - RowsReturned: 547 (547) - RowsReturnedRate: 465.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d949b (host=vb0208.halxg.cloudera.com:22000):(Total: 1s325ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449944) - PerHostPeakMemUsage: 273.76 MB (287059760) - PrepareTime: 145.774ms - RowsProduced: 39 (39) - TotalCpuTime: 382.705ms - TotalNetworkReceiveTime: 1s175ms - TotalNetworkSendTime: 766.634us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.024ms, non-child: 377.024ms, % non-child: 100.00%) - CodegenTime: 1.769ms - CompileTime: 20.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.981ms - PrepareTime: 142.369ms DataStreamSender (dst_id=14):(Total: 94.720us, non-child: 94.720us, % non-child: 100.00%) - BytesSent: 737.00 B (737) - NetworkThroughput(*): 1.84 MB/sec - OverallThroughput: 7.42 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 73.726us - ThriftTransmitTime(*): 381.961us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s323ms, non-child: 353.258us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 29.00 /sec AGGREGATION_NODE (id=13):(Total: 1s322ms, non-child: 146.949ms, % non-child: 11.11%) ExecOption: Codegen Enabled - BuildTime: 228.943us - GetNewBlockTime: 87.652us - GetResultsTime: 40.653us - HTResizeTime: 5.100us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 29.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.277us EXCHANGE_NODE (id=12):(Total: 1s175ms, non-child: 184.680us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 713.00 B - BytesReceived: 10.29 KB (10538) - ConvertRowBatchTime: 52.831us - DeserializeRowBatchTimer: 337.078us - FirstBatchArrivalWaitTime: 834.447ms - PeakMemoryUsage: 0 - RowsReturned: 574 (574) - RowsReturnedRate: 488.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9498 (host=vb0222.halxg.cloudera.com:22000):(Total: 1s323ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449880) - PerHostPeakMemUsage: 276.19 MB (289603504) - PrepareTime: 140.834ms - RowsProduced: 33 (33) - TotalCpuTime: 377.286ms - TotalNetworkReceiveTime: 1s179ms - TotalNetworkSendTime: 189.960us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 371.644ms, non-child: 371.644ms, % non-child: 100.00%) - CodegenTime: 1.795ms - CompileTime: 20.748ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.114ms - PrepareTime: 137.615ms DataStreamSender (dst_id=14):(Total: 127.311us, non-child: 127.311us, % non-child: 100.00%) - BytesSent: 630.00 B (630) - NetworkThroughput(*): 3.93 MB/sec - OverallThroughput: 4.72 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 105.730us - ThriftTransmitTime(*): 152.868us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s322ms, non-child: 425.107us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 24.00 /sec AGGREGATION_NODE (id=13):(Total: 1s322ms, non-child: 142.098ms, % non-child: 10.75%) ExecOption: Codegen Enabled - BuildTime: 84.213us - GetNewBlockTime: 89.637us - GetResultsTime: 53.650us - HTResizeTime: 2.760us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 24.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.876us EXCHANGE_NODE (id=12):(Total: 1s180ms, non-child: 106.651us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 612.00 B - BytesReceived: 8.92 KB (9130) - ConvertRowBatchTime: 25.445us - DeserializeRowBatchTimer: 232.923us - FirstBatchArrivalWaitTime: 838.561ms - PeakMemoryUsage: 0 - RowsReturned: 488 (488) - RowsReturnedRate: 413.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d94a0 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s323ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450032) - PerHostPeakMemUsage: 263.24 MB (276030984) - PrepareTime: 153.734ms - RowsProduced: 43 (43) - TotalCpuTime: 398.239ms - TotalNetworkReceiveTime: 1s162ms - TotalNetworkSendTime: 402.301us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 386.780ms, non-child: 386.780ms, % non-child: 100.00%) - CodegenTime: 1.855ms - CompileTime: 20.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.985ms - PrepareTime: 150.015ms DataStreamSender (dst_id=14):(Total: 46.484us, non-child: 46.484us, % non-child: 100.00%) - BytesSent: 801.00 B (801) - NetworkThroughput(*): 2.22 MB/sec - OverallThroughput: 16.43 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 23.182us - ThriftTransmitTime(*): 343.763us - UncompressedRowBatchSize: 864.00 B (864) SORT_NODE (id=8):(Total: 1s318ms, non-child: 460.054us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 32.00 /sec AGGREGATION_NODE (id=13):(Total: 1s318ms, non-child: 155.856ms, % non-child: 11.82%) ExecOption: Codegen Enabled - BuildTime: 102.825us - GetNewBlockTime: 106.589us - GetResultsTime: 81.953us - HTResizeTime: 12.270us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 32.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.722us EXCHANGE_NODE (id=12):(Total: 1s162ms, non-child: 164.446us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 10.81 KB - BytesReceived: 11.45 KB (11722) - ConvertRowBatchTime: 40.171us - DeserializeRowBatchTimer: 432.276us - FirstBatchArrivalWaitTime: 821.023ms - PeakMemoryUsage: 0 - RowsReturned: 637 (637) - RowsReturnedRate: 547.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9499 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s322ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449848) - PerHostPeakMemUsage: 267.73 MB (280736976) - PrepareTime: 147.222ms - RowsProduced: 33 (33) - TotalCpuTime: 386.139ms - TotalNetworkReceiveTime: 1s171ms - TotalNetworkSendTime: 448.006us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.374ms, non-child: 380.374ms, % non-child: 100.00%) - CodegenTime: 1.760ms - CompileTime: 20.035ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 215.160ms - PrepareTime: 144.043ms DataStreamSender (dst_id=14):(Total: 59.875us, non-child: 59.875us, % non-child: 100.00%) - BytesSent: 622.00 B (622) - NetworkThroughput(*): 1.81 MB/sec - OverallThroughput: 9.91 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 37.825us - ThriftTransmitTime(*): 327.426us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s321ms, non-child: 474.024us, % non-child: 0.04%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 24.00 /sec AGGREGATION_NODE (id=13):(Total: 1s320ms, non-child: 148.731ms, % non-child: 11.26%) ExecOption: Codegen Enabled - BuildTime: 107.038us - GetNewBlockTime: 95.147us - GetResultsTime: 58.835us - HTResizeTime: 3.163us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 24.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.045us EXCHANGE_NODE (id=12):(Total: 1s171ms, non-child: 145.727us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 8.85 KB (9059) - ConvertRowBatchTime: 39.930us - DeserializeRowBatchTimer: 120.117us - FirstBatchArrivalWaitTime: 830.457ms - PeakMemoryUsage: 0 - RowsReturned: 484 (484) - RowsReturnedRate: 412.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9496 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s321ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449912) - PerHostPeakMemUsage: 263.74 MB (276553072) - PrepareTime: 146.403ms - RowsProduced: 37 (37) - TotalCpuTime: 383.153ms - TotalNetworkReceiveTime: 1s172ms - TotalNetworkSendTime: 358.844us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.449ms, non-child: 377.449ms, % non-child: 100.00%) - CodegenTime: 1.720ms - CompileTime: 20.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.840ms - PrepareTime: 143.250ms DataStreamSender (dst_id=14):(Total: 109.965us, non-child: 109.965us, % non-child: 100.00%) - BytesSent: 681.00 B (681) - NetworkThroughput(*): 2.90 MB/sec - OverallThroughput: 5.91 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 88.759us - ThriftTransmitTime(*): 223.725us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s320ms, non-child: 396.718us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 28.00 /sec AGGREGATION_NODE (id=13):(Total: 1s320ms, non-child: 147.609ms, % non-child: 11.18%) ExecOption: Codegen Enabled - BuildTime: 90.105us - GetNewBlockTime: 89.027us - GetResultsTime: 63.887us - HTResizeTime: 2.651us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 28.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.595us EXCHANGE_NODE (id=12):(Total: 1s172ms, non-child: 232.481us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 9.85 KB (10090) - ConvertRowBatchTime: 66.651us - DeserializeRowBatchTimer: 506.850us - FirstBatchArrivalWaitTime: 830.708ms - PeakMemoryUsage: 0 - RowsReturned: 544 (544) - RowsReturnedRate: 464.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9497 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s321ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450000) - PerHostPeakMemUsage: 263.17 MB (275953904) - PrepareTime: 142.971ms - RowsProduced: 41 (41) - TotalCpuTime: 382.037ms - TotalNetworkReceiveTime: 1s175ms - TotalNetworkSendTime: 359.375us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 375.924ms, non-child: 375.924ms, % non-child: 100.00%) - CodegenTime: 1.799ms - CompileTime: 20.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.164ms - PrepareTime: 139.619ms DataStreamSender (dst_id=14):(Total: 45.179us, non-child: 45.179us, % non-child: 100.00%) - BytesSent: 756.00 B (756) - NetworkThroughput(*): 3.26 MB/sec - OverallThroughput: 15.96 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 21.535us - ThriftTransmitTime(*): 221.281us - UncompressedRowBatchSize: 824.00 B (824) SORT_NODE (id=8):(Total: 1s320ms, non-child: 405.600us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 31.00 /sec AGGREGATION_NODE (id=13):(Total: 1s319ms, non-child: 144.529ms, % non-child: 10.95%) ExecOption: Codegen Enabled - BuildTime: 99.253us - GetNewBlockTime: 94.584us - GetResultsTime: 69.931us - HTResizeTime: 3.222us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 31.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.832us EXCHANGE_NODE (id=12):(Total: 1s175ms, non-child: 213.650us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 10.25 KB - BytesReceived: 10.84 KB (11100) - ConvertRowBatchTime: 44.685us - DeserializeRowBatchTimer: 135.083us - FirstBatchArrivalWaitTime: 833.287ms - PeakMemoryUsage: 0 - RowsReturned: 607 (607) - RowsReturnedRate: 516.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9493 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s321ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 272.56 MB (285805104) - PrepareTime: 144.230ms - RowsProduced: 39 (39) - TotalCpuTime: 379.898ms - TotalNetworkReceiveTime: 1s174ms - TotalNetworkSendTime: 370.098us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 374.187ms, non-child: 374.187ms, % non-child: 100.00%) - CodegenTime: 1.749ms - CompileTime: 20.260ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 211.728ms - PrepareTime: 140.974ms DataStreamSender (dst_id=14):(Total: 122.463us, non-child: 122.463us, % non-child: 100.00%) - BytesSent: 716.00 B (716) - NetworkThroughput(*): 2.27 MB/sec - OverallThroughput: 5.58 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 99.810us - ThriftTransmitTime(*): 300.151us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s320ms, non-child: 407.255us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 29.00 /sec AGGREGATION_NODE (id=13):(Total: 1s319ms, non-child: 145.659ms, % non-child: 11.04%) ExecOption: Codegen Enabled - BuildTime: 95.773us - GetNewBlockTime: 92.130us - GetResultsTime: 66.702us - HTResizeTime: 4.065us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 29.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.532us EXCHANGE_NODE (id=12):(Total: 1s174ms, non-child: 246.398us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 4.91 KB - BytesReceived: 10.31 KB (10559) - ConvertRowBatchTime: 58.847us - DeserializeRowBatchTimer: 137.183us - FirstBatchArrivalWaitTime: 832.710ms - PeakMemoryUsage: 0 - RowsReturned: 573 (573) - RowsReturnedRate: 488.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9495 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s319ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450080) - PerHostPeakMemUsage: 265.40 MB (278292016) - PrepareTime: 147.715ms - RowsProduced: 46 (46) - TotalCpuTime: 386.451ms - TotalNetworkReceiveTime: 1s168ms - TotalNetworkSendTime: 360.492us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.536ms, non-child: 380.536ms, % non-child: 100.00%) - CodegenTime: 1.759ms - CompileTime: 20.525ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.323ms - PrepareTime: 144.395ms DataStreamSender (dst_id=14):(Total: 117.864us, non-child: 117.864us, % non-child: 100.00%) - BytesSent: 844.00 B (844) - NetworkThroughput(*): 3.19 MB/sec - OverallThroughput: 6.83 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 90.817us - ThriftTransmitTime(*): 252.407us - UncompressedRowBatchSize: 924.00 B (924) SORT_NODE (id=8):(Total: 1s318ms, non-child: 393.859us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 34.00 /sec AGGREGATION_NODE (id=13):(Total: 1s317ms, non-child: 149.071ms, % non-child: 11.31%) ExecOption: Codegen Enabled - BuildTime: 109.429us - GetNewBlockTime: 92.919us - GetResultsTime: 68.321us - HTResizeTime: 5.458us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 34.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.483us EXCHANGE_NODE (id=12):(Total: 1s168ms, non-child: 221.565us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 11.50 KB - BytesReceived: 12.18 KB (12472) - ConvertRowBatchTime: 76.012us - DeserializeRowBatchTimer: 361.626us - FirstBatchArrivalWaitTime: 827.117ms - PeakMemoryUsage: 0 - RowsReturned: 682 (682) - RowsReturnedRate: 583.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d949c (host=vb0230.halxg.cloudera.com:22000):(Total: 1s319ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449976) - PerHostPeakMemUsage: 288.04 MB (302036056) - PrepareTime: 145.363ms - RowsProduced: 42 (42) - TotalCpuTime: 390.495ms - TotalNetworkReceiveTime: 1s169ms - TotalNetworkSendTime: 360.076us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 383.827ms, non-child: 383.827ms, % non-child: 100.00%) - CodegenTime: 1.832ms - CompileTime: 21.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 218.716ms - PrepareTime: 141.975ms DataStreamSender (dst_id=14):(Total: 45.031us, non-child: 45.031us, % non-child: 100.00%) - BytesSent: 782.00 B (782) - NetworkThroughput(*): 3.14 MB/sec - OverallThroughput: 16.56 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 21.583us - ThriftTransmitTime(*): 237.204us - UncompressedRowBatchSize: 844.00 B (844) SORT_NODE (id=8):(Total: 1s317ms, non-child: 367.411us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 31.00 /sec AGGREGATION_NODE (id=13):(Total: 1s316ms, non-child: 146.811ms, % non-child: 11.15%) ExecOption: Codegen Enabled - BuildTime: 93.431us - GetNewBlockTime: 110.693us - GetResultsTime: 61.337us - HTResizeTime: 3.289us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 31.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.378us EXCHANGE_NODE (id=12):(Total: 1s169ms, non-child: 156.837us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 11.06 KB (11328) - ConvertRowBatchTime: 36.930us - DeserializeRowBatchTimer: 376.645us - FirstBatchArrivalWaitTime: 828.364ms - PeakMemoryUsage: 0 - RowsReturned: 617 (617) - RowsReturnedRate: 527.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9494 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s317ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449872) - PerHostPeakMemUsage: 268.19 MB (281214432) - PrepareTime: 143.568ms - RowsProduced: 34 (34) - TotalCpuTime: 383.909ms - TotalNetworkReceiveTime: 1s170ms - TotalNetworkSendTime: 323.863us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.970ms, non-child: 377.970ms, % non-child: 100.00%) - CodegenTime: 1.791ms - CompileTime: 20.262ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 216.260ms - PrepareTime: 140.278ms DataStreamSender (dst_id=14):(Total: 146.526us, non-child: 146.526us, % non-child: 100.00%) - BytesSent: 628.00 B (628) - NetworkThroughput(*): 2.44 MB/sec - OverallThroughput: 4.09 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 123.192us - ThriftTransmitTime(*): 245.484us - UncompressedRowBatchSize: 684.00 B (684) SORT_NODE (id=8):(Total: 1s315ms, non-child: 372.560us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 25.00 /sec AGGREGATION_NODE (id=13):(Total: 1s315ms, non-child: 144.796ms, % non-child: 11.01%) ExecOption: Codegen Enabled - BuildTime: 85.513us - GetNewBlockTime: 91.388us - GetResultsTime: 51.404us - HTResizeTime: 3.045us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 25.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.796us EXCHANGE_NODE (id=12):(Total: 1s170ms, non-child: 193.875us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 9.14 KB (9355) - ConvertRowBatchTime: 49.896us - DeserializeRowBatchTimer: 233.142us - FirstBatchArrivalWaitTime: 829.349ms - PeakMemoryUsage: 0 - RowsReturned: 500 (500) - RowsReturnedRate: 427.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d949a (host=vb0234.halxg.cloudera.com:22000):(Total: 1s313ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449760) - PerHostPeakMemUsage: 258.01 MB (270546632) - PrepareTime: 146.618ms - RowsProduced: 25 (25) - TotalCpuTime: 393.890ms - TotalNetworkReceiveTime: 1s164ms - TotalNetworkSendTime: 455.457us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 388.239ms, non-child: 388.239ms, % non-child: 100.00%) - CodegenTime: 1.805ms - CompileTime: 20.866ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 222.937ms - PrepareTime: 143.208ms DataStreamSender (dst_id=14):(Total: 76.322us, non-child: 76.322us, % non-child: 100.00%) - BytesSent: 480.00 B (480) - NetworkThroughput(*): 1.21 MB/sec - OverallThroughput: 6.00 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 52.026us - ThriftTransmitTime(*): 377.899us - UncompressedRowBatchSize: 504.00 B (504) SORT_NODE (id=8):(Total: 1s312ms, non-child: 336.537us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 19.00 /sec AGGREGATION_NODE (id=13):(Total: 1s312ms, non-child: 147.816ms, % non-child: 11.27%) ExecOption: Codegen Enabled - BuildTime: 73.812us - GetNewBlockTime: 113.212us - GetResultsTime: 58.049us - HTResizeTime: 4.965us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 19.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.177us EXCHANGE_NODE (id=12):(Total: 1s164ms, non-child: 117.946us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 6.53 KB - BytesReceived: 6.90 KB (7065) - ConvertRowBatchTime: 26.224us - DeserializeRowBatchTimer: 126.313us - FirstBatchArrivalWaitTime: 822.663ms - PeakMemoryUsage: 0 - RowsReturned: 369 (369) - RowsReturnedRate: 316.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 834fefb7ff3195ff:852b952ee22d9492 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s312ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449952) - PerHostPeakMemUsage: 291.61 MB (305771160) - PrepareTime: 144.770ms - RowsProduced: 40 (40) - TotalCpuTime: 387.982ms - TotalNetworkReceiveTime: 1s164ms - TotalNetworkSendTime: 258.046us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 382.360ms, non-child: 382.360ms, % non-child: 100.00%) - CodegenTime: 1.713ms - CompileTime: 20.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 218.612ms - PrepareTime: 141.610ms DataStreamSender (dst_id=14):(Total: 84.383us, non-child: 84.383us, % non-child: 100.00%) - BytesSent: 740.00 B (740) - NetworkThroughput(*): 3.67 MB/sec - OverallThroughput: 8.36 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 61.348us - ThriftTransmitTime(*): 192.086us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s311ms, non-child: 345.872us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 30.00 /sec AGGREGATION_NODE (id=13):(Total: 1s311ms, non-child: 146.063ms, % non-child: 11.14%) ExecOption: Codegen Enabled - BuildTime: 252.626us - GetNewBlockTime: 93.955us - GetResultsTime: 56.142us - HTResizeTime: 2.838us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 30.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.358us EXCHANGE_NODE (id=12):(Total: 1s165ms, non-child: 150.296us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 3.59 KB - BytesReceived: 10.55 KB (10801) - ConvertRowBatchTime: 36.696us - DeserializeRowBatchTimer: 412.732us - FirstBatchArrivalWaitTime: 823.749ms - PeakMemoryUsage: 0 - RowsReturned: 588 (588) - RowsReturnedRate: 504.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 834fefb7ff3195ff:852b952ee22d94a7 (host=vb0222.halxg.cloudera.com:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Filter 0 arrival: 536ms Filter 1 arrival: 536ms Filter 2 arrival: 543ms MemoryUsage(500.000ms): 1.40 MB, 218.43 MB, 89.79 MB ThreadUsage(500.000ms): 1, 12, 4 - AverageThreadTokens: 5.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 270.92 MB (284078000) - PerHostPeakMemUsage: 276.19 MB (289603504) - PrepareTime: 151.381ms - RowsProduced: 423 (423) - TotalCpuTime: 8s081ms - TotalNetworkReceiveTime: 153.420us - TotalNetworkSendTime: 5.227ms - TotalStorageWaitTime: 370.854ms CodeGen:(Total: 521.971ms, non-child: 521.971ms, % non-child: 100.00%) - CodegenTime: 1.305ms - CompileTime: 100.653ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.691ms - PrepareTime: 141.565ms DataStreamSender (dst_id=12):(Total: 138.751us, non-child: 138.751us, % non-child: 100.00%) - BytesSent: 7.71 KB (7899) - NetworkThroughput(*): 1.89 MB/sec - OverallThroughput: 54.29 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 658.786us - ThriftTransmitTime(*): 3.978ms - UncompressedRowBatchSize: 11.62 KB (11904) AGGREGATION_NODE (id=7):(Total: 1s150ms, non-child: 246.006ms, % non-child: 21.38%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 58.680us - GetResultsTime: 134.780us - HTResizeTime: 477.430us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.74 MB (18603576) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 423 (423) - RowsReturnedRate: 367.00 /sec - StreamingTime: 69.210ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 904.464ms, non-child: 6.833ms, % non-child: 0.76%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 142.359us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 73.652us - GetNewBlockTime: 278.795us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.27 MB (18103864) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.681ms - RowsReturned: 35.67K (35672) - RowsReturnedRate: 39.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.969us EXCHANGE_NODE (id=11):(Total: 49.717us, non-child: 49.717us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.354us - DeserializeRowBatchTimer: 23.288us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 897.635ms, non-child: 6.494ms, % non-child: 0.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.519us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 60.928us - GetNewBlockTime: 324.982us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.42 MB (11972208) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.389ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 40.69 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.717us EXCHANGE_NODE (id=10):(Total: 36.020us, non-child: 36.020us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 19.391us - DeserializeRowBatchTimer: 21.781us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 891.147ms, non-child: 16.964ms, % non-child: 1.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.434ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 602.681us - GetNewBlockTime: 561.091us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18420856) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.396ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 40.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.981us EXCHANGE_NODE (id=9):(Total: 710.549us, non-child: 710.549us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 539.261us - DeserializeRowBatchTimer: 4.063ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 873.472ms, non-child: 873.472ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 130.53 MB, 253.32 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 253.32 MB (265628829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.32 MB (265628829) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.32 MB (265628829) - DecompressionTime: 783.563ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 251.07 MB (263269232) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.98M (36975520) - RowsReturned: 36.52K (36523) - RowsReturnedRate: 41.81 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 721 (721) - ScannerThreadsTotalWallClockTime: 6s891ms - MaterializeTupleTime(*): 5s612ms - ScannerThreadsSysTime: 202.962ms - ScannerThreadsUserTime: 6s263ms - ScannerThreadsVoluntaryContextSwitches: 355 (355) - TotalRawHdfsReadTime(*): 178.130ms - TotalReadThroughput: 168.88 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.63K (9627) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.27K (70273) - RowGroups rejected: 0 (0) - RowGroups total: 70.27K (70273) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 36.97M (36965893) - Rows rejected: 36.93M (36929370) - Rows total: 36.97M (36965893) Instance 834fefb7ff3195ff:852b952ee22d94a6 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s071ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Filter 0 arrival: 535ms Filter 1 arrival: 535ms Filter 2 arrival: 542ms MemoryUsage(500.000ms): 2.90 MB, 236.16 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 257.90 MB (270428400) - PerHostPeakMemUsage: 263.17 MB (275953904) - PrepareTime: 145.148ms - RowsProduced: 564 (564) - TotalCpuTime: 7s793ms - TotalNetworkReceiveTime: 99.497us - TotalNetworkSendTime: 5.181ms - TotalStorageWaitTime: 387.013ms CodeGen:(Total: 520.397ms, non-child: 520.397ms, % non-child: 100.00%) - CodegenTime: 1.485ms - CompileTime: 106.847ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.039ms - PrepareTime: 135.480ms DataStreamSender (dst_id=12):(Total: 169.273us, non-child: 169.273us, % non-child: 100.00%) - BytesSent: 10.21 KB (10457) - NetworkThroughput(*): 2.41 MB/sec - OverallThroughput: 58.91 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 514.023us - ThriftTransmitTime(*): 4.133ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 1s059ms, non-child: 314.332ms, % non-child: 29.67%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.730us - GetResultsTime: 159.896us - HTResizeTime: 715.303us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.39 MB (17184056) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 532.00 /sec - StreamingTime: 93.570ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 745.067ms, non-child: 7.129ms, % non-child: 0.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 69.951us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 41.815us - GetNewBlockTime: 164.742us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.91 MB (16684344) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.338ms - RowsReturned: 37.49K (37489) - RowsReturnedRate: 50.32 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.278us EXCHANGE_NODE (id=11):(Total: 30.865us, non-child: 30.865us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 19.298us - DeserializeRowBatchTimer: 17.512us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 32.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 737.941ms, non-child: 6.866ms, % non-child: 0.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.312us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 54.359us - GetNewBlockTime: 329.613us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.13 MB (13763888) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.964ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 52.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.052us EXCHANGE_NODE (id=10):(Total: 33.738us, non-child: 33.738us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.941us - DeserializeRowBatchTimer: 16.286us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 731.081ms, non-child: 18.943ms, % non-child: 2.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.582ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.229ms - GetNewBlockTime: 551.971us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424896) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.532ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 52.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.792us EXCHANGE_NODE (id=9):(Total: 694.478us, non-child: 694.478us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 545.859us - DeserializeRowBatchTimer: 2.286ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 711.443ms, non-child: 711.443ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 26 Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 265.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 266.22 MB (279156364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.22 MB (279156364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.22 MB (279156364) - DecompressionTime: 840.081ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 243.25 MB (255068192) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 38.86M (38856403) - RowsReturned: 38.40K (38397) - RowsReturnedRate: 53.97 K/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 719 (719) - ScannerThreadsTotalWallClockTime: 6s705ms - MaterializeTupleTime(*): 5s338ms - ScannerThreadsSysTime: 219.962ms - ScannerThreadsUserTime: 6s035ms - ScannerThreadsVoluntaryContextSwitches: 469 (469) - TotalRawHdfsReadTime(*): 192.212ms - TotalReadThroughput: 265.90 MB/sec Filter 0: - Rows processed: 425.96K (425958) - Rows rejected: 9.97K (9968) - Rows total: 425.98K (425984) Filter 1: - Files processed: 26 (26) - Files rejected: 0 (0) - Files total: 26 (26) - RowGroups processed: 73.27K (73267) - RowGroups rejected: 0 (0) - RowGroups total: 73.27K (73267) - Rows processed: 425.96K (425958) - Rows rejected: 0 (0) - Rows total: 425.98K (425984) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Filter 2: - Rows processed: 38.85M (38846435) - Rows rejected: 38.81M (38808038) - Rows total: 38.85M (38846435) Instance 834fefb7ff3195ff:852b952ee22d94a1 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s067ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Filter 0 arrival: 538ms Filter 1 arrival: 538ms Filter 2 arrival: 543ms MemoryUsage(500.000ms): 1.40 MB, 277.22 MB, 61.61 MB ThreadUsage(500.000ms): 1, 12, 3 - AverageThreadTokens: 5.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 286.34 MB (300245656) - PerHostPeakMemUsage: 291.61 MB (305771160) - PrepareTime: 148.038ms - RowsProduced: 564 (564) - TotalCpuTime: 7s950ms - TotalNetworkReceiveTime: 99.907us - TotalNetworkSendTime: 77.902ms - TotalStorageWaitTime: 363.089ms CodeGen:(Total: 524.011ms, non-child: 524.011ms, % non-child: 100.00%) - CodegenTime: 1.458ms - CompileTime: 100.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 284.817ms - PrepareTime: 137.901ms DataStreamSender (dst_id=12):(Total: 145.101us, non-child: 145.101us, % non-child: 100.00%) - BytesSent: 10.23 KB (10477) - NetworkThroughput(*): 132.90 KB/sec - OverallThroughput: 68.86 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 407.301us - ThriftTransmitTime(*): 76.984ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 982.494ms, non-child: 221.359ms, % non-child: 22.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 85.094us - GetResultsTime: 129.247us - HTResizeTime: 487.586us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.44 MB (19334056) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 574.00 /sec - StreamingTime: 83.941ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 761.135ms, non-child: 7.983ms, % non-child: 1.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 137.091us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 73.291us - GetNewBlockTime: 255.078us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.96 MB (18834344) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.125ms - RowsReturned: 37.92K (37916) - RowsReturnedRate: 49.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.702us EXCHANGE_NODE (id=11):(Total: 45.152us, non-child: 45.152us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.236us - DeserializeRowBatchTimer: 23.206us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 753.155ms, non-child: 7.408ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 45.372us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.968us - GetNewBlockTime: 198.303us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.20 MB (13845448) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.372ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 51.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.935us EXCHANGE_NODE (id=10):(Total: 22.015us, non-child: 22.015us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 10.670us - DeserializeRowBatchTimer: 14.042us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 745.751ms, non-child: 16.617ms, % non-child: 2.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.151ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.526us - GetNewBlockTime: 461.540us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.165ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 51.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.673us EXCHANGE_NODE (id=9):(Total: 504.680us, non-child: 504.680us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 379.725us - DeserializeRowBatchTimer: 4.098ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 30.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 728.629ms, non-child: 728.629ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 20 Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 177.67 MB, 266.65 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.50 - BytesRead: 266.65 MB (279605125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.65 MB (279605125) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.65 MB (279605125) - DecompressionTime: 855.217ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 268.38 MB (281411768) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 39.08M (39076470) - RowsReturned: 38.77K (38765) - RowsReturnedRate: 53.20 K/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 745 (745) - ScannerThreadsTotalWallClockTime: 6s918ms - MaterializeTupleTime(*): 5s574ms - ScannerThreadsSysTime: 197.965ms - ScannerThreadsUserTime: 6s255ms - ScannerThreadsVoluntaryContextSwitches: 253 (253) - TotalRawHdfsReadTime(*): 198.361ms - TotalReadThroughput: 177.77 MB/sec Filter 0: - Rows processed: 327.66K (327660) - Rows rejected: 7.68K (7682) - Rows total: 327.68K (327680) Filter 1: - Files processed: 20 (20) - Files rejected: 0 (0) - Files total: 20 (20) - RowGroups processed: 72.54K (72536) - RowGroups rejected: 0 (0) - RowGroups total: 72.54K (72536) - Rows processed: 327.66K (327660) - Rows rejected: 0 (0) - Rows total: 327.68K (327680) - Splits processed: 20 (20) - Splits rejected: 0 (0) - Splits total: 20 (20) Filter 2: - Rows processed: 39.07M (39068788) - Rows rejected: 39.03M (39030023) - Rows total: 39.07M (39068788) Instance 834fefb7ff3195ff:852b952ee22d94ae (host=vb0220.halxg.cloudera.com:22000):(Total: 1s062ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Filter 0 arrival: 529ms Filter 1 arrival: 529ms Filter 2 arrival: 533ms MemoryUsage(500.000ms): 0, 4.89 MB, 245.81 MB ThreadUsage(500.000ms): 1, 4, 12 - AverageThreadTokens: 5.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 303.87 MB (318632640) - PerHostPeakMemUsage: 309.14 MB (324158144) - PrepareTime: 143.911ms - RowsProduced: 564 (564) - TotalCpuTime: 7s996ms - TotalNetworkReceiveTime: 86.561us - TotalNetworkSendTime: 4.294ms - TotalStorageWaitTime: 310.491ms CodeGen:(Total: 515.524ms, non-child: 515.524ms, % non-child: 100.00%) - CodegenTime: 1.497ms - CompileTime: 103.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.568ms - PrepareTime: 134.258ms DataStreamSender (dst_id=12):(Total: 177.753us, non-child: 177.753us, % non-child: 100.00%) - BytesSent: 10.14 KB (10384) - NetworkThroughput(*): 3.00 MB/sec - OverallThroughput: 55.71 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 468.737us - ThriftTransmitTime(*): 3.299ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 1s051ms, non-child: 253.853ms, % non-child: 24.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 53.463us - GetResultsTime: 162.774us - HTResizeTime: 888.557us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.53 MB (17328024) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 536.00 /sec - StreamingTime: 84.771ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 797.700ms, non-child: 6.893ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 141.869us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.806us - GetNewBlockTime: 256.647us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.05 MB (16828312) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.214ms - RowsReturned: 35.25K (35246) - RowsReturnedRate: 44.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.496us EXCHANGE_NODE (id=11):(Total: 52.274us, non-child: 52.274us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.745us - DeserializeRowBatchTimer: 18.887us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 790.814ms, non-child: 6.548ms, % non-child: 0.83%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.321us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 35.163us - GetNewBlockTime: 302.081us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.83 MB (14501416) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.760ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 45.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.924us EXCHANGE_NODE (id=10):(Total: 34.218us, non-child: 34.218us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.285us - DeserializeRowBatchTimer: 18.984us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 784.272ms, non-child: 14.127ms, % non-child: 1.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 2.878ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 601.724us - GetNewBlockTime: 310.606us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423352) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.594ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 46.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.160us EXCHANGE_NODE (id=9):(Total: 375.966us, non-child: 375.966us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 281.669us - DeserializeRowBatchTimer: 2.506ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 40.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 769.768ms, non-child: 769.768ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 22 Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:66 BytesRead(500.000ms): 0, 249.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 249.75 MB (261886383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.75 MB (261886383) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.75 MB (261886383) - DecompressionTime: 826.362ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 22 (22) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 288.65 MB (302675216) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.51M (36514470) - RowsReturned: 36.09K (36088) - RowsReturnedRate: 46.88 K/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 756 (756) - ScannerThreadsTotalWallClockTime: 6s847ms - MaterializeTupleTime(*): 5s593ms - ScannerThreadsSysTime: 206.963ms - ScannerThreadsUserTime: 6s287ms - ScannerThreadsVoluntaryContextSwitches: 331 (331) - TotalRawHdfsReadTime(*): 187.223ms - TotalReadThroughput: 249.75 MB/sec Filter 0: - Rows processed: 360.43K (360426) - Rows rejected: 8.50K (8503) - Rows total: 360.45K (360448) Filter 1: - Files processed: 22 (22) - Files rejected: 0 (0) - Files total: 22 (22) - RowGroups processed: 68.55K (68546) - RowGroups rejected: 0 (0) - RowGroups total: 68.55K (68546) - Rows processed: 360.43K (360426) - Rows rejected: 0 (0) - Rows total: 360.45K (360448) - Splits processed: 22 (22) - Splits rejected: 0 (0) - Splits total: 22 (22) Filter 2: - Rows processed: 36.51M (36505967) - Rows rejected: 36.47M (36469879) - Rows total: 36.51M (36505967) Instance 834fefb7ff3195ff:852b952ee22d94a9 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s061ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Filter 0 arrival: 538ms Filter 1 arrival: 538ms Filter 2 arrival: 542ms MemoryUsage(500.000ms): 0, 2.90 MB, 222.99 MB ThreadUsage(500.000ms): 1, 1, 12 - AverageThreadTokens: 4.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 252.74 MB (265021128) - PerHostPeakMemUsage: 258.01 MB (270546632) - PrepareTime: 147.085ms - RowsProduced: 564 (564) - TotalCpuTime: 8s069ms - TotalNetworkReceiveTime: 70.632us - TotalNetworkSendTime: 65.646ms - TotalStorageWaitTime: 371.463ms CodeGen:(Total: 524.299ms, non-child: 524.299ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 103.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 282.302ms - PrepareTime: 137.676ms DataStreamSender (dst_id=12):(Total: 142.044us, non-child: 142.044us, % non-child: 100.00%) - BytesSent: 10.17 KB (10413) - NetworkThroughput(*): 157.57 KB/sec - OverallThroughput: 69.91 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 820.659us - ThriftTransmitTime(*): 64.535ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 989.351ms, non-child: 219.562ms, % non-child: 22.19%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 83.105us - GetResultsTime: 95.188us - HTResizeTime: 478.287us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.91 MB (18775168) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 570.00 /sec - StreamingTime: 78.029ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 769.788ms, non-child: 6.624ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.830us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.334us - GetNewBlockTime: 292.112us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.43 MB (18275456) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.072ms - RowsReturned: 35.33K (35328) - RowsReturnedRate: 45.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.240us EXCHANGE_NODE (id=11):(Total: 49.038us, non-child: 49.038us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.285us - DeserializeRowBatchTimer: 66.711us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 763.168ms, non-child: 6.838ms, % non-child: 0.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.977us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.372us - GetNewBlockTime: 366.533us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.88 MB (12459288) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.232ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 47.46 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.756us EXCHANGE_NODE (id=10):(Total: 36.174us, non-child: 36.174us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 19.852us - DeserializeRowBatchTimer: 51.615us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 756.337ms, non-child: 14.872ms, % non-child: 1.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.328ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.156us - GetNewBlockTime: 448.763us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422424) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.675ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 47.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.528us EXCHANGE_NODE (id=9):(Total: 372.906us, non-child: 372.906us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 295.900us - DeserializeRowBatchTimer: 3.694ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 41.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 741.091ms, non-child: 741.091ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 27 Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:81 BytesRead(500.000ms): 0, 219.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 250.92 MB (263105410) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.92 MB (263105410) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.92 MB (263105410) - DecompressionTime: 824.120ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 237.12 MB (248634368) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.56M (36560874) - RowsReturned: 36.22K (36221) - RowsReturnedRate: 48.88 K/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 795 (795) - ScannerThreadsTotalWallClockTime: 7s037ms - MaterializeTupleTime(*): 5s705ms - ScannerThreadsSysTime: 214.963ms - ScannerThreadsUserTime: 6s398ms - ScannerThreadsVoluntaryContextSwitches: 364 (364) - TotalRawHdfsReadTime(*): 187.757ms - TotalReadThroughput: 219.23 MB/sec Filter 0: - Rows processed: 442.34K (442341) - Rows rejected: 10.49K (10491) - Rows total: 442.37K (442368) Filter 1: - Files processed: 27 (27) - Files rejected: 0 (0) - Files total: 27 (27) - RowGroups processed: 69.48K (69481) - RowGroups rejected: 0 (0) - RowGroups total: 69.48K (69481) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Filter 2: - Rows processed: 36.55M (36550383) - Rows rejected: 36.51M (36514162) - Rows total: 36.55M (36550383) Instance 834fefb7ff3195ff:852b952ee22d94a8 (host=vb0224.halxg.cloudera.com:22000):(Total: 983.275ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Filter 0 arrival: 533ms Filter 1 arrival: 533ms Filter 2 arrival: 539ms MemoryUsage(500.000ms): 0, 165.23 MB, 113.26 MB ThreadUsage(500.000ms): 1, 12, 6 - AverageThreadTokens: 6.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 262.46 MB (275211472) - PerHostPeakMemUsage: 267.73 MB (280736976) - PrepareTime: 147.155ms - RowsProduced: 564 (564) - TotalCpuTime: 7s307ms - TotalNetworkReceiveTime: 84.609us - TotalNetworkSendTime: 4.438ms - TotalStorageWaitTime: 362.002ms CodeGen:(Total: 518.673ms, non-child: 518.673ms, % non-child: 100.00%) - CodegenTime: 1.495ms - CompileTime: 100.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 279.757ms - PrepareTime: 137.382ms DataStreamSender (dst_id=12):(Total: 190.318us, non-child: 190.318us, % non-child: 100.00%) - BytesSent: 10.15 KB (10393) - NetworkThroughput(*): 3.00 MB/sec - OverallThroughput: 52.08 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 463.908us - ThriftTransmitTime(*): 3.301ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 972.767ms, non-child: 277.564ms, % non-child: 28.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.967us - GetResultsTime: 199.063us - HTResizeTime: 566.800us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.68 MB (17485200) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 579.00 /sec - StreamingTime: 86.323ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 695.202ms, non-child: 7.604ms, % non-child: 1.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.002us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.503us - GetNewBlockTime: 272.618us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.20 MB (16985488) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.749ms - RowsReturned: 33.80K (33799) - RowsReturnedRate: 48.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.306us EXCHANGE_NODE (id=11):(Total: 49.693us, non-child: 49.693us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.185us - DeserializeRowBatchTimer: 20.172us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 687.603ms, non-child: 6.808ms, % non-child: 0.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 93.917us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.079us - GetNewBlockTime: 321.772us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.76 MB (14423776) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.849ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 50.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.063us EXCHANGE_NODE (id=10):(Total: 33.341us, non-child: 33.341us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.653us - DeserializeRowBatchTimer: 80.010us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 680.800ms, non-child: 16.572ms, % non-child: 2.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.439ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 589.711us - GetNewBlockTime: 469.041us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422624) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.403ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 50.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.169us EXCHANGE_NODE (id=9):(Total: 497.348us, non-child: 497.348us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 399.044us - DeserializeRowBatchTimer: 2.212ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 30.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 663.730ms, non-child: 663.730ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 95.25 MB, 240.35 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 240.35 MB (252026160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.35 MB (252026160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.35 MB (252026160) - DecompressionTime: 750.869ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 247.67 MB (259696880) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35069138) - RowsReturned: 34.63K (34626) - RowsReturnedRate: 52.17 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 659 (659) - ScannerThreadsTotalWallClockTime: 6s287ms - MaterializeTupleTime(*): 5s045ms - ScannerThreadsSysTime: 169.970ms - ScannerThreadsUserTime: 5s707ms - ScannerThreadsVoluntaryContextSwitches: 349 (349) - TotalRawHdfsReadTime(*): 177.926ms - TotalReadThroughput: 240.35 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.34K (9341) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 65.72K (65720) - RowGroups rejected: 0 (0) - RowGroups total: 65.72K (65720) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35059797) - Rows rejected: 35.03M (35025171) - Rows total: 35.06M (35059797) Instance 834fefb7ff3195ff:852b952ee22d94a3 (host=vb0218.halxg.cloudera.com:22000):(Total: 979.882ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Filter 0 arrival: 530ms Filter 1 arrival: 530ms Filter 2 arrival: 536ms MemoryUsage(500.000ms): 1.40 MB, 251.22 MB, 89.08 MB ThreadUsage(500.000ms): 1, 12, 5 - AverageThreadTokens: 6.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 262.92 MB (275688928) - PerHostPeakMemUsage: 268.19 MB (281214432) - PrepareTime: 145.473ms - RowsProduced: 564 (564) - TotalCpuTime: 7s418ms - TotalNetworkReceiveTime: 83.786us - TotalNetworkSendTime: 28.058ms - TotalStorageWaitTime: 371.098ms CodeGen:(Total: 516.183ms, non-child: 516.183ms, % non-child: 100.00%) - CodegenTime: 1.430ms - CompileTime: 100.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.690ms - PrepareTime: 135.901ms DataStreamSender (dst_id=12):(Total: 159.200us, non-child: 159.200us, % non-child: 100.00%) - BytesSent: 10.21 KB (10459) - NetworkThroughput(*): 375.55 KB/sec - OverallThroughput: 62.65 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 518.015us - ThriftTransmitTime(*): 27.196ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 945.791ms, non-child: 251.576ms, % non-child: 26.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.494us - GetResultsTime: 160.750us - HTResizeTime: 544.087us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.60 MB (19502624) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 596.00 /sec - StreamingTime: 71.611ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 694.215ms, non-child: 6.374ms, % non-child: 0.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.518us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.973us - GetNewBlockTime: 257.168us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.12 MB (19002912) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.687ms - RowsReturned: 35.92K (35923) - RowsReturnedRate: 51.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.292us EXCHANGE_NODE (id=11):(Total: 50.890us, non-child: 50.890us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.686us - DeserializeRowBatchTimer: 22.148us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 687.847ms, non-child: 6.368ms, % non-child: 0.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 88.829us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 56.618us - GetNewBlockTime: 330.616us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.84 MB (12417744) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.475ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 53.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.749us EXCHANGE_NODE (id=10):(Total: 32.656us, non-child: 32.656us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.863us - DeserializeRowBatchTimer: 15.541us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 681.486ms, non-child: 16.230ms, % non-child: 2.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.513ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 585.731us - GetNewBlockTime: 464.759us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423648) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.153ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 54.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.125us EXCHANGE_NODE (id=9):(Total: 508.934us, non-child: 508.934us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 412.632us - DeserializeRowBatchTimer: 2.164ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 30.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 664.746ms, non-child: 664.746ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 133.63 MB, 253.98 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 253.98 MB (266317999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.98 MB (266317999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.98 MB (266317999) - DecompressionTime: 781.870ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 248.53 MB (260600936) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.08M (37077122) - RowsReturned: 36.82K (36819) - RowsReturnedRate: 55.39 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 706 (706) - ScannerThreadsTotalWallClockTime: 6s437ms - MaterializeTupleTime(*): 5s159ms - ScannerThreadsSysTime: 193.964ms - ScannerThreadsUserTime: 5s823ms - ScannerThreadsVoluntaryContextSwitches: 320 (320) - TotalRawHdfsReadTime(*): 175.841ms - TotalReadThroughput: 169.32 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.48K (9479) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.32K (70316) - RowGroups rejected: 0 (0) - RowGroups total: 70.32K (70316) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 37.07M (37067643) - Rows rejected: 37.03M (37030824) - Rows total: 37.07M (37067643) Instance 834fefb7ff3195ff:852b952ee22d94ab (host=vb0230.halxg.cloudera.com:22000):(Total: 970.695ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Filter 0 arrival: 544ms Filter 1 arrival: 544ms Filter 2 arrival: 551ms MemoryUsage(500.000ms): 1.40 MB, 225.97 MB, 102.70 MB ThreadUsage(500.000ms): 1, 12, 5 - AverageThreadTokens: 6.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 282.77 MB (296510552) - PerHostPeakMemUsage: 288.04 MB (302036056) - PrepareTime: 149.339ms - RowsProduced: 564 (564) - TotalCpuTime: 7s597ms - TotalNetworkReceiveTime: 130.347us - TotalNetworkSendTime: 49.799ms - TotalStorageWaitTime: 365.483ms CodeGen:(Total: 528.904ms, non-child: 528.904ms, % non-child: 100.00%) - CodegenTime: 1.490ms - CompileTime: 102.105ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 286.715ms - PrepareTime: 138.893ms DataStreamSender (dst_id=12):(Total: 187.574us, non-child: 187.574us, % non-child: 100.00%) - BytesSent: 10.23 KB (10474) - NetworkThroughput(*): 212.32 KB/sec - OverallThroughput: 53.25 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 1.109ms - ThriftTransmitTime(*): 48.174ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 914.174ms, non-child: 213.968ms, % non-child: 23.41%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 102.409us - GetResultsTime: 160.182us - HTResizeTime: 567.448us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.38 MB (18220736) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 616.00 /sec - StreamingTime: 75.310ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 700.205ms, non-child: 6.771ms, % non-child: 0.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.603us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.500us - GetNewBlockTime: 246.589us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.90 MB (17721024) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.064ms - RowsReturned: 36.23K (36234) - RowsReturnedRate: 51.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.262us EXCHANGE_NODE (id=11):(Total: 46.911us, non-child: 46.911us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.259us - DeserializeRowBatchTimer: 21.138us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 693.440ms, non-child: 6.847ms, % non-child: 0.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.329us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 61.943us - GetNewBlockTime: 324.609us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.14 MB (13780824) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.534ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 53.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.817us EXCHANGE_NODE (id=10):(Total: 34.127us, non-child: 34.127us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.783us - DeserializeRowBatchTimer: 53.186us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 686.600ms, non-child: 17.318ms, % non-child: 2.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.608ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 585.156us - GetNewBlockTime: 520.052us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424480) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.440ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 54.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.176us EXCHANGE_NODE (id=9):(Total: 660.003us, non-child: 660.003us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 513.136us - DeserializeRowBatchTimer: 3.935ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 668.621ms, non-child: 668.621ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 102.60 MB, 255.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 255.51 MB (267924888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 255.51 MB (267924888) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 255.51 MB (267924888) - DecompressionTime: 823.677ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 266.08 MB (279007440) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.34M (37340464) - RowsReturned: 37.12K (37122) - RowsReturnedRate: 55.52 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 754 (754) - ScannerThreadsTotalWallClockTime: 6s628ms - MaterializeTupleTime(*): 5s301ms - ScannerThreadsSysTime: 242.956ms - ScannerThreadsUserTime: 5s967ms - ScannerThreadsVoluntaryContextSwitches: 260 (260) - TotalRawHdfsReadTime(*): 181.760ms - TotalReadThroughput: 170.34 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8854) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 70.54K (70543) - RowGroups rejected: 0 (0) - RowGroups total: 70.54K (70543) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 37.33M (37331610) - Rows rejected: 37.29M (37294488) - Rows total: 37.33M (37331610) Instance 834fefb7ff3195ff:852b952ee22d94ad (host=vb0206.halxg.cloudera.com:22000):(Total: 969.148ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Filter 1 arrival: 528ms Filter 0 arrival: 528ms Filter 2 arrival: 532ms MemoryUsage(500.000ms): 1.40 MB, 237.49 MB, 61.01 MB ThreadUsage(500.000ms): 1, 12, 3 - AverageThreadTokens: 5.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 271.11 MB (284278416) - PerHostPeakMemUsage: 276.38 MB (289803920) - PrepareTime: 143.389ms - RowsProduced: 564 (564) - TotalCpuTime: 6s619ms - TotalNetworkReceiveTime: 69.909us - TotalNetworkSendTime: 24.416ms - TotalStorageWaitTime: 337.118ms CodeGen:(Total: 513.082ms, non-child: 513.082ms, % non-child: 100.00%) - CodegenTime: 1.491ms - CompileTime: 102.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.068ms - PrepareTime: 133.813ms DataStreamSender (dst_id=12):(Total: 116.317us, non-child: 116.317us, % non-child: 100.00%) - BytesSent: 10.21 KB (10459) - NetworkThroughput(*): 439.98 KB/sec - OverallThroughput: 85.75 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 369.180us - ThriftTransmitTime(*): 23.214ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 938.979ms, non-child: 217.457ms, % non-child: 23.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 63.282us - GetResultsTime: 93.436us - HTResizeTime: 601.506us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.13 MB (16910064) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 600.00 /sec - StreamingTime: 83.668ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 721.522ms, non-child: 8.251ms, % non-child: 1.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.914us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 75.914us - GetNewBlockTime: 235.276us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.65 MB (16410352) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.150ms - RowsReturned: 34.08K (34076) - RowsReturnedRate: 47.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.957us EXCHANGE_NODE (id=11):(Total: 68.954us, non-child: 68.954us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 50.429us - DeserializeRowBatchTimer: 20.040us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 14.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 713.277ms, non-child: 6.803ms, % non-child: 0.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.782us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.149us - GetNewBlockTime: 328.440us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.83 MB (13451576) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.928ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 48.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.752us EXCHANGE_NODE (id=10):(Total: 35.085us, non-child: 35.085us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.836us - DeserializeRowBatchTimer: 16.253us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 706.481ms, non-child: 15.057ms, % non-child: 2.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.427ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 581.448us - GetNewBlockTime: 415.147us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422504) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.133ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 49.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.370us EXCHANGE_NODE (id=9):(Total: 372.099us, non-child: 372.099us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 297.148us - DeserializeRowBatchTimer: 2.170ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 41.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 691.051ms, non-child: 691.051ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 110.07 MB, 240.41 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.50 - BytesRead: 240.41 MB (252088793) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.41 MB (252088793) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.41 MB (252088793) - DecompressionTime: 734.346ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 255.35 MB (267756088) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.11M (35106723) - RowsReturned: 34.86K (34861) - RowsReturnedRate: 50.45 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 642 (642) - ScannerThreadsTotalWallClockTime: 5s613ms - MaterializeTupleTime(*): 4s430ms - ScannerThreadsSysTime: 195.965ms - ScannerThreadsUserTime: 5s037ms - ScannerThreadsVoluntaryContextSwitches: 477 (477) - TotalRawHdfsReadTime(*): 174.338ms - TotalReadThroughput: 160.27 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8845) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.55K (66548) - RowGroups rejected: 0 (0) - RowGroups total: 66.55K (66548) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.10M (35097878) - Rows rejected: 35.06M (35063017) - Rows total: 35.10M (35097878) Instance 834fefb7ff3195ff:852b952ee22d94aa (host=vb0208.halxg.cloudera.com:22000):(Total: 897.566ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Filter 0 arrival: 534ms Filter 1 arrival: 534ms Filter 2 arrival: 539ms MemoryUsage(500.000ms): 1.40 MB, 212.75 MB, 41.29 MB ThreadUsage(500.000ms): 1, 12, 2 - AverageThreadTokens: 5.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 268.49 MB (281534256) - PerHostPeakMemUsage: 273.76 MB (287059760) - PrepareTime: 149.358ms - RowsProduced: 564 (564) - TotalCpuTime: 6s757ms - TotalNetworkReceiveTime: 66.044us - TotalNetworkSendTime: 3.175ms - TotalStorageWaitTime: 344.352ms CodeGen:(Total: 519.529ms, non-child: 519.529ms, % non-child: 100.00%) - CodegenTime: 1.426ms - CompileTime: 102.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.566ms - PrepareTime: 139.611ms DataStreamSender (dst_id=12):(Total: 131.763us, non-child: 131.763us, % non-child: 100.00%) - BytesSent: 10.15 KB (10395) - NetworkThroughput(*): 3.80 MB/sec - OverallThroughput: 75.24 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 342.592us - ThriftTransmitTime(*): 2.607ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 888.610ms, non-child: 212.611ms, % non-child: 23.93%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.604us - GetResultsTime: 94.139us - HTResizeTime: 498.476us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.46 MB (18304344) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 634.00 /sec - StreamingTime: 73.418ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 675.999ms, non-child: 6.896ms, % non-child: 1.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 133.619us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 79.279us - GetNewBlockTime: 254.974us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.98 MB (17804632) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.153ms - RowsReturned: 34.75K (34748) - RowsReturnedRate: 51.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.408us EXCHANGE_NODE (id=11):(Total: 51.794us, non-child: 51.794us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.436us - DeserializeRowBatchTimer: 30.859us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 669.109ms, non-child: 6.429ms, % non-child: 0.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 92.266us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 65.719us - GetNewBlockTime: 308.516us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.71 MB (13324808) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.401ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 53.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.862us EXCHANGE_NODE (id=10):(Total: 32.795us, non-child: 32.795us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 16.438us - DeserializeRowBatchTimer: 96.276us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 662.686ms, non-child: 16.078ms, % non-child: 2.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.439ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.783us - GetNewBlockTime: 467.759us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423112) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.287ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 53.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.196us EXCHANGE_NODE (id=9):(Total: 467.965us, non-child: 467.965us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 392.452us - DeserializeRowBatchTimer: 2.384ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 32.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 646.139ms, non-child: 646.139ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 168.70 MB, 245.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 245.67 MB (257601014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 245.67 MB (257601014) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 245.67 MB (257601014) - DecompressionTime: 751.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 253.70 MB (266026448) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.83M (35826899) - RowsReturned: 35.54K (35539) - RowsReturnedRate: 55.00 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 697 (697) - ScannerThreadsTotalWallClockTime: 5s807ms - MaterializeTupleTime(*): 4s581ms - ScannerThreadsSysTime: 196.964ms - ScannerThreadsUserTime: 5s206ms - ScannerThreadsVoluntaryContextSwitches: 370 (370) - TotalRawHdfsReadTime(*): 177.957ms - TotalReadThroughput: 163.78 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.64K (9639) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.33K (68331) - RowGroups rejected: 0 (0) - RowGroups total: 68.33K (68331) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.82M (35817260) - Rows rejected: 35.78M (35781721) - Rows total: 35.82M (35817260) Instance 834fefb7ff3195ff:852b952ee22d94a2 (host=vb0212.halxg.cloudera.com:22000):(Total: 896.727ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Filter 0 arrival: 530ms Filter 1 arrival: 530ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 1.40 MB, 248.40 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 267.30 MB (280279600) - PerHostPeakMemUsage: 272.56 MB (285805104) - PrepareTime: 148.158ms - RowsProduced: 564 (564) - TotalCpuTime: 7s455ms - TotalNetworkReceiveTime: 124.633us - TotalNetworkSendTime: 20.127ms - TotalStorageWaitTime: 315.423ms CodeGen:(Total: 515.966ms, non-child: 515.966ms, % non-child: 100.00%) - CodegenTime: 1.498ms - CompileTime: 100.870ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 275.767ms - PrepareTime: 138.272ms DataStreamSender (dst_id=12):(Total: 109.362us, non-child: 109.362us, % non-child: 100.00%) - BytesSent: 10.17 KB (10419) - NetworkThroughput(*): 525.46 KB/sec - OverallThroughput: 90.86 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 486.101us - ThriftTransmitTime(*): 19.363ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 870.413ms, non-child: 210.889ms, % non-child: 24.23%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.480us - GetResultsTime: 90.449us - HTResizeTime: 476.163us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.48 MB (18331576) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 647.00 /sec - StreamingTime: 73.487ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 659.523ms, non-child: 7.331ms, % non-child: 1.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 141.009us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 76.922us - GetNewBlockTime: 283.720us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.01 MB (17831864) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.290ms - RowsReturned: 34.89K (34892) - RowsReturnedRate: 52.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.112us EXCHANGE_NODE (id=11):(Total: 49.844us, non-child: 49.844us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 36.081us - DeserializeRowBatchTimer: 19.981us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 652.198ms, non-child: 6.453ms, % non-child: 0.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.609us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.011us - GetNewBlockTime: 316.910us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.82 MB (12390288) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.445ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 54.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.159us EXCHANGE_NODE (id=10):(Total: 38.039us, non-child: 38.039us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 22.286us - DeserializeRowBatchTimer: 106.057us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 645.751ms, non-child: 16.410ms, % non-child: 2.54%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.811ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 582.874us - GetNewBlockTime: 463.366us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422416) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.019ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 55.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.561us EXCHANGE_NODE (id=9):(Total: 954.568us, non-child: 954.568us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 801.659us - DeserializeRowBatchTimer: 2.223ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 16.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 628.386ms, non-child: 628.386ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 190.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 246.45 MB (258419939) - BytesReadDataNodeCache: 0 - BytesReadLocal: 246.45 MB (258419939) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 246.45 MB (258419939) - DecompressionTime: 775.464ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 253.05 MB (265347232) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.95M (35950586) - RowsReturned: 35.71K (35706) - RowsReturnedRate: 56.82 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 907 (907) - ScannerThreadsTotalWallClockTime: 6s495ms - MaterializeTupleTime(*): 5s251ms - ScannerThreadsSysTime: 187.967ms - ScannerThreadsUserTime: 5s919ms - ScannerThreadsVoluntaryContextSwitches: 336 (336) - TotalRawHdfsReadTime(*): 177.067ms - TotalReadThroughput: 190.71 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.58K (9580) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.72K (68725) - RowGroups rejected: 0 (0) - RowGroups total: 68.72K (68725) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.94M (35941006) - Rows rejected: 35.91M (35905300) - Rows total: 35.94M (35941006) Instance 834fefb7ff3195ff:852b952ee22d94a4 (host=vb0216.halxg.cloudera.com:22000):(Total: 895.235ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Filter 0 arrival: 529ms Filter 1 arrival: 529ms Filter 2 arrival: 536ms MemoryUsage(500.000ms): 0, 2.90 MB, 161.56 MB ThreadUsage(500.000ms): 1, 1, 8 - AverageThreadTokens: 3.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 260.13 MB (272766512) - PerHostPeakMemUsage: 265.40 MB (278292016) - PrepareTime: 143.929ms - RowsProduced: 564 (564) - TotalCpuTime: 6s598ms - TotalNetworkReceiveTime: 137.557us - TotalNetworkSendTime: 3.295ms - TotalStorageWaitTime: 367.747ms CodeGen:(Total: 514.212ms, non-child: 514.212ms, % non-child: 100.00%) - CodegenTime: 1.506ms - CompileTime: 100.417ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.606ms - PrepareTime: 134.165ms DataStreamSender (dst_id=12):(Total: 126.515us, non-child: 126.515us, % non-child: 100.00%) - BytesSent: 10.21 KB (10456) - NetworkThroughput(*): 3.64 MB/sec - OverallThroughput: 78.82 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 306.037us - ThriftTransmitTime(*): 2.736ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 885.999ms, non-child: 234.090ms, % non-child: 26.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.127us - GetResultsTime: 387.275us - HTResizeTime: 596.973us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.90 MB (18770496) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 636.00 /sec - StreamingTime: 63.640ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 651.909ms, non-child: 6.140ms, % non-child: 0.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.137us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.516us - GetNewBlockTime: 262.503us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.42 MB (18270784) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.496ms - RowsReturned: 34.17K (34170) - RowsReturnedRate: 52.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.690us EXCHANGE_NODE (id=11):(Total: 51.479us, non-child: 51.479us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.974us - DeserializeRowBatchTimer: 18.790us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 645.774ms, non-child: 6.194ms, % non-child: 0.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.282us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.172us - GetNewBlockTime: 313.848us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.52 MB (14180456) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.235ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 54.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.074us EXCHANGE_NODE (id=10):(Total: 33.456us, non-child: 33.456us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.891us - DeserializeRowBatchTimer: 15.499us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 639.585ms, non-child: 18.708ms, % non-child: 2.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.570ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.312ms - GetNewBlockTime: 483.412us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.044ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 54.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.441us EXCHANGE_NODE (id=9):(Total: 690.402us, non-child: 690.402us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 531.964us - DeserializeRowBatchTimer: 2.280ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 620.186ms, non-child: 620.186ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 241.20 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 241.20 MB (252912121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.20 MB (252912121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.20 MB (252912121) - DecompressionTime: 723.822ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 245.84 MB (257779096) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.22M (35216777) - RowsReturned: 34.94K (34935) - RowsReturnedRate: 56.33 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 572 (572) - ScannerThreadsTotalWallClockTime: 5s670ms - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 169.968ms - ScannerThreadsUserTime: 5s091ms - ScannerThreadsVoluntaryContextSwitches: 254 (254) - TotalRawHdfsReadTime(*): 194.856ms - TotalReadThroughput: 241.20 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.71K (8711) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.65K (66653) - RowGroups rejected: 0 (0) - RowGroups total: 66.65K (66653) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.21M (35208066) - Rows rejected: 35.17M (35173131) - Rows total: 35.21M (35208066) Instance 834fefb7ff3195ff:852b952ee22d94ac (host=vb0228.halxg.cloudera.com:22000):(Total: 895.017ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Filter 0 arrival: 532ms Filter 1 arrival: 532ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 1.40 MB, 198.92 MB, 24.41 MB ThreadUsage(500.000ms): 1, 12, 1 - AverageThreadTokens: 4.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 248.19 MB (260244088) - PerHostPeakMemUsage: 253.46 MB (265769592) - PrepareTime: 147.826ms - RowsProduced: 564 (564) - TotalCpuTime: 6s582ms - TotalNetworkReceiveTime: 97.507us - TotalNetworkSendTime: 8.956ms - TotalStorageWaitTime: 359.099ms CodeGen:(Total: 517.090ms, non-child: 517.090ms, % non-child: 100.00%) - CodegenTime: 1.462ms - CompileTime: 100.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.220ms - PrepareTime: 137.914ms DataStreamSender (dst_id=12):(Total: 162.002us, non-child: 162.002us, % non-child: 100.00%) - BytesSent: 10.15 KB (10398) - NetworkThroughput(*): 1.27 MB/sec - OverallThroughput: 61.21 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 370.000us - ThriftTransmitTime(*): 7.820ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 879.775ms, non-child: 213.932ms, % non-child: 24.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60.317us - GetResultsTime: 171.590us - HTResizeTime: 552.880us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.87 MB (18737448) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 641.00 /sec - StreamingTime: 76.549ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 665.842ms, non-child: 6.693ms, % non-child: 1.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.877us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 70.990us - GetNewBlockTime: 266.867us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.39 MB (18237736) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.974ms - RowsReturned: 35.14K (35143) - RowsReturnedRate: 52.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.039us EXCHANGE_NODE (id=11):(Total: 48.167us, non-child: 48.167us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.346us - DeserializeRowBatchTimer: 19.437us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 659.154ms, non-child: 6.809ms, % non-child: 1.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 94.290us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 72.010us - GetNewBlockTime: 300.845us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.11 MB (13750872) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.714ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 54.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.836us EXCHANGE_NODE (id=10):(Total: 34.791us, non-child: 34.791us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.075us - DeserializeRowBatchTimer: 84.439us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 652.351ms, non-child: 15.508ms, % non-child: 2.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.002ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.357us - GetNewBlockTime: 456.547us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423808) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.750ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 55.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.399us EXCHANGE_NODE (id=9):(Total: 487.587us, non-child: 487.587us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 378.119us - DeserializeRowBatchTimer: 2.334ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 636.355ms, non-child: 636.355ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 154.27 MB, 247.46 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 247.46 MB (259475640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 247.46 MB (259475640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 247.46 MB (259475640) - DecompressionTime: 726.696ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 232.66 MB (243956824) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.13M (36127075) - RowsReturned: 36.05K (36045) - RowsReturnedRate: 56.64 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 589 (589) - ScannerThreadsTotalWallClockTime: 5s656ms - MaterializeTupleTime(*): 4s449ms - ScannerThreadsSysTime: 175.966ms - ScannerThreadsUserTime: 5s075ms - ScannerThreadsVoluntaryContextSwitches: 398 (398) - TotalRawHdfsReadTime(*): 179.316ms - TotalReadThroughput: 164.97 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.24K (9240) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.21K (69208) - RowGroups rejected: 0 (0) - RowGroups total: 69.21K (69208) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.12M (36117835) - Rows rejected: 36.08M (36081790) - Rows total: 36.12M (36117835) Instance 834fefb7ff3195ff:852b952ee22d94af (host=vb0204.halxg.cloudera.com:22000):(Total: 893.578ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Filter 0 arrival: 536ms Filter 1 arrival: 536ms Filter 2 arrival: 544ms MemoryUsage(500.000ms): 0, 2.90 MB, 130.70 MB ThreadUsage(500.000ms): 1, 1, 7 - AverageThreadTokens: 3.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 257.97 MB (270497288) - PerHostPeakMemUsage: 263.24 MB (276030984) - PrepareTime: 148.790ms - RowsProduced: 564 (564) - TotalCpuTime: 6s690ms - TotalNetworkReceiveTime: 97.344us - TotalNetworkSendTime: 4.132ms - TotalStorageWaitTime: 327.015ms CodeGen:(Total: 520.978ms, non-child: 520.978ms, % non-child: 100.00%) - CodegenTime: 1.468ms - CompileTime: 101.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 279.541ms - PrepareTime: 138.946ms DataStreamSender (dst_id=12):(Total: 224.773us, non-child: 224.773us, % non-child: 100.00%) - BytesSent: 10.22 KB (10465) - NetworkThroughput(*): 2.83 MB/sec - OverallThroughput: 44.40 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 377.516us - ThriftTransmitTime(*): 3.522ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 881.837ms, non-child: 214.505ms, % non-child: 24.32%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.278us - GetResultsTime: 128.589us - HTResizeTime: 771.451us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.81 MB (18679776) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 639.00 /sec - StreamingTime: 75.253ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 667.332ms, non-child: 7.710ms, % non-child: 1.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 66.178us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 62.897us - GetNewBlockTime: 159.256us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.34 MB (18180064) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.834ms - RowsReturned: 34.02K (34024) - RowsReturnedRate: 50.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.200us EXCHANGE_NODE (id=11):(Total: 28.705us, non-child: 28.705us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 18.409us - DeserializeRowBatchTimer: 112.259us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 34.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 659.626ms, non-child: 6.874ms, % non-child: 1.04%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 99.921us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 60.803us - GetNewBlockTime: 299.516us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.86 MB (14536080) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.988ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 52.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.896us EXCHANGE_NODE (id=10):(Total: 36.612us, non-child: 36.612us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.779us - DeserializeRowBatchTimer: 19.769us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 652.758ms, non-child: 19.110ms, % non-child: 2.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 6.439ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 589.589us - GetNewBlockTime: 781.330us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18421608) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.090ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 53.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.457us EXCHANGE_NODE (id=9):(Total: 676.152us, non-child: 676.152us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 558.658us - DeserializeRowBatchTimer: 3.640ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 22.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 632.971ms, non-child: 632.971ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 240.34 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 240.34 MB (252012000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.34 MB (252012000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.34 MB (252012000) - DecompressionTime: 749.176ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 242.94 MB (254745384) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35071902) - RowsReturned: 34.83K (34833) - RowsReturnedRate: 55.03 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 672 (672) - ScannerThreadsTotalWallClockTime: 5s719ms - MaterializeTupleTime(*): 4s511ms - ScannerThreadsSysTime: 193.965ms - ScannerThreadsUserTime: 5s141ms - ScannerThreadsVoluntaryContextSwitches: 433 (433) - TotalRawHdfsReadTime(*): 169.843ms - TotalReadThroughput: 240.34 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.09K (9094) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 67.12K (67125) - RowGroups rejected: 0 (0) - RowGroups total: 67.12K (67125) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35062808) - Rows rejected: 35.03M (35027975) - Rows total: 35.06M (35062808) Instance 834fefb7ff3195ff:852b952ee22d94a5 (host=vb0214.halxg.cloudera.com:22000):(Total: 819.612ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Filter 0 arrival: 532ms Filter 1 arrival: 532ms Filter 2 arrival: 538ms MemoryUsage(500.000ms): 0, 216.33 MB, 35.64 MB ThreadUsage(500.000ms): 1, 12, 3 - AverageThreadTokens: 5.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 258.47 MB (271027568) - PerHostPeakMemUsage: 263.74 MB (276553072) - PrepareTime: 148.822ms - RowsProduced: 564 (564) - TotalCpuTime: 6s574ms - TotalNetworkReceiveTime: 102.715us - TotalNetworkSendTime: 4.637ms - TotalStorageWaitTime: 335.620ms CodeGen:(Total: 517.773ms, non-child: 517.773ms, % non-child: 100.00%) - CodegenTime: 1.403ms - CompileTime: 100.355ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.440ms - PrepareTime: 138.902ms DataStreamSender (dst_id=12):(Total: 152.621us, non-child: 152.621us, % non-child: 100.00%) - BytesSent: 10.12 KB (10368) - NetworkThroughput(*): 2.60 MB/sec - OverallThroughput: 64.79 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 612.529us - ThriftTransmitTime(*): 3.808ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 807.512ms, non-child: 263.994ms, % non-child: 32.69%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.867us - GetResultsTime: 137.683us - HTResizeTime: 620.792us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.09 MB (16872128) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 698.00 /sec - StreamingTime: 84.266ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 543.517ms, non-child: 7.117ms, % non-child: 1.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 132.712us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 89.677us - GetNewBlockTime: 217.473us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.61 MB (16372416) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.269ms - RowsReturned: 35.41K (35415) - RowsReturnedRate: 65.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.584us EXCHANGE_NODE (id=11):(Total: 47.746us, non-child: 47.746us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.055us - DeserializeRowBatchTimer: 19.883us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 536.404ms, non-child: 6.761ms, % non-child: 1.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.876us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.939us - GetNewBlockTime: 309.937us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.81 MB (12387504) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.652ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 67.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.800us EXCHANGE_NODE (id=10):(Total: 35.014us, non-child: 35.014us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.427us - DeserializeRowBatchTimer: 18.010us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 529.650ms, non-child: 16.017ms, % non-child: 3.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.447ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 579.713us - GetNewBlockTime: 495.585us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423712) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.076ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 68.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.907us EXCHANGE_NODE (id=9):(Total: 501.221us, non-child: 501.221us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 384.514us - DeserializeRowBatchTimer: 2.168ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 30.74 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 513.130ms, non-child: 513.130ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 28 Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 102.65 MB, 249.72 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.50 - BytesRead: 249.72 MB (261851037) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.72 MB (261851037) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.72 MB (261851037) - DecompressionTime: 742.196ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 242.67 MB (254462744) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.35M (36354601) - RowsReturned: 36.29K (36294) - RowsReturnedRate: 70.73 K/sec - ScanRangesComplete: 28 (28) - ScannerThreadsInvoluntaryContextSwitches: 587 (587) - ScannerThreadsTotalWallClockTime: 5s696ms - MaterializeTupleTime(*): 4s462ms - ScannerThreadsSysTime: 220.962ms - ScannerThreadsUserTime: 5s081ms - ScannerThreadsVoluntaryContextSwitches: 404 (404) - TotalRawHdfsReadTime(*): 194.649ms - TotalReadThroughput: 249.72 MB/sec Filter 0: - Rows processed: 458.72K (458724) - Rows rejected: 10.72K (10721) - Rows total: 458.75K (458752) Filter 1: - Files processed: 28 (28) - Files rejected: 0 (0) - Files total: 28 (28) - RowGroups processed: 69.92K (69924) - RowGroups rejected: 0 (0) - RowGroups total: 69.92K (69924) - Rows processed: 458.72K (458724) - Rows rejected: 0 (0) - Rows total: 458.75K (458752) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Filter 2: - Rows processed: 36.34M (36343880) - Rows rejected: 36.31M (36307586) - Rows total: 36.34M (36343880) Fragment F03: Instance 834fefb7ff3195ff:852b952ee22d94b0 (host=vb0234.halxg.cloudera.com:22000):(Total: 156.722ms, non-child: 151.988ms, % non-child: 96.98%) Hdfs split stats (:<# splits>/): 5:1/88.92 KB MemoryUsage(500.000ms): 248.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.91 MB (4099664) - PrepareTime: 136.620us - RowsProduced: 1.00K (1002) - TotalCpuTime: 12.580ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 146.551ms - TotalStorageWaitTime: 3.567ms DataStreamSender (dst_id=11):(Total: 263.646us, non-child: 263.646us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 58.61 KB/sec - OverallThroughput: 451.22 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 119.105us - ThriftTransmitTime(*): 2s078ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 4.470ms, non-child: 4.470ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.998us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 224.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 4.128ms - MaterializeTupleTime(*): 84.380us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 51.191us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 834fefb7ff3195ff:852b952ee22d94b1 (host=vb0226.halxg.cloudera.com:22000):(Total: 157.265ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/2.17 MB MemoryUsage(500.000ms): 128.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.02 MB (5267584) - PrepareTime: 140.199ms - RowsProduced: 365 (365) - TotalCpuTime: 372.178ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 62.554us - TotalStorageWaitTime: 4.975ms CodeGen:(Total: 343.496ms, non-child: 343.496ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 199.409ms - PrepareTime: 136.515ms DataStreamSender (dst_id=10):(Total: 107.773us, non-child: 107.773us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 12.16 MB/sec - OverallThroughput: 398.86 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 30.622us - ThriftTransmitTime(*): 3.535ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 292.889ms, non-child: 292.889ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 97.511us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 768.82 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 12.390ms - MaterializeTupleTime(*): 6.373ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 610.304us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 834fefb7ff3195ff:852b952ee22d94b2 (host=vb0230.halxg.cloudera.com:22000):(Total: 237.687ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/28.28 MB MemoryUsage(500.000ms): 38.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.53 MB (5795480) - PerHostPeakMemUsage: 10.51 MB (11025440) - PrepareTime: 139.247ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 532.934ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 620.192us - TotalStorageWaitTime: 7.605ms CodeGen:(Total: 344.522ms, non-child: 344.522ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.651ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 196.168ms - PrepareTime: 136.710ms DataStreamSender (dst_id=9):(Total: 13.582ms, non-child: 13.582ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 58.46 MB/sec - OverallThroughput: 660.27 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 8.526ms - ThriftTransmitTime(*): 153.407ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 359.345ms, non-child: 359.345ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 3.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.87 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 93.757ms - MaterializeTupleTime(*): 80.284ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 83.987ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.750ms - TotalReadThroughput: 0.00 /sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 504.25us | 0ns | 504.25us | 564 | 100 | | 08:TOP-N | 15 | 406.67us | 0ns | 855.11us | 564 | 100 | | 13:AGGREGATE | 15 | 148.07ms | 0ns | 163.23ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 239.44us | 0ns | 362.44us | 8.32K | 3.83K | | 07:AGGREGATE | 15 | 212.73ms | 0ns | 224.35ms | 8.32K | 3.83K | | 06:HASH JOIN | 15 | 6.84ms | 0ns | 7.62ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 70.72us | 0ns | 384.12us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 3.95ms | 0ns | 3.95ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 6.59ms | 0ns | 7.62ms | 542.77K | 4.27K | | |--10:EXCHANGE | 15 | 32.46us | 0ns | 40.49us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 298.36ms | 0ns | 298.36ms | 365 | 114 | | 04:HASH JOIN | 15 | 16.09ms | 0ns | 19.07ms | 542.77K | 68.35K | | |--09:EXCHANGE | 15 | 517.50us | 0ns | 662.58us | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 381.31ms | 0ns | 381.31ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 661.44ms | 0ns | 788.05ms | 542.77K | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=2446072c3555a01d:8df23dc4d2484290): Summary: Session ID: e94726d9f3b8962b:9028c41b63f248b4 Session Type: BEESWAX Start Time: 2016-04-21 10:56:12.809909000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:46264 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=12B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.17KB | tuple-ids=6 row-size=12B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=16B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=130B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=126B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=114B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=28.61GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=24B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 26.603ms - Analysis finished: 6.304ms (6.304ms) - Equivalence classes computed: 6.712ms (407.592us) - Single node plan created: 15.756ms (9.044ms) - Runtime filters computed: 16.125ms (369.186us) - Distributed plan created: 20.379ms (4.253ms) - Lineage info computed: 21.629ms (1.250ms) - Planning finished: 26.603ms (4.974ms) Query Timeline: 1s563ms - Start execution: 268.488us (268.488us) - Planning finished: 36.865ms (36.596ms) - Ready to start 33 remote fragments: 42.858ms (5.992ms) - All 33 remote fragments started: 76.511ms (33.653ms) - Rows available: 1s493ms (1s416ms) - First row fetched: 1s545ms (52.503ms) ImpalaServer: - ClientFetchWaitTimer: 53.242ms - RowMaterializationTimer: 1.027ms Execution Profile 2446072c3555a01d:8df23dc4d2484290:(Total: 1s458ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 10ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Per Node Peak Memory Usage: vb0220.halxg.cloudera.com:22000(278.69 MB) vb0206.halxg.cloudera.com:22000(275.85 MB) vb0228.halxg.cloudera.com:22000(288.14 MB) vb0230.halxg.cloudera.com:22000(289.79 MB) vb0208.halxg.cloudera.com:22000(278.50 MB) vb0234.halxg.cloudera.com:22000(277.48 MB) vb0224.halxg.cloudera.com:22000(244.29 MB) vb0222.halxg.cloudera.com:22000(274.48 MB) vb0232.halxg.cloudera.com:22000(296.48 MB) vb0214.halxg.cloudera.com:22000(255.09 MB) vb0216.halxg.cloudera.com:22000(271.53 MB) vb0218.halxg.cloudera.com:22000(275.57 MB) vb0212.halxg.cloudera.com:22000(269.10 MB) vb0226.halxg.cloudera.com:22000(286.20 MB) vb0204.halxg.cloudera.com:22000(266.67 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 1s412ms, non-child: 1.151ms, % non-child: 0.08%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 177.095us - RowsProduced: 100 (100) - TotalCpuTime: 1s505ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 143 (143) - BlocksRecycled: 17 (17) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 1s411ms, non-child: 504.247us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 10.22 KB (10466) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 465.530us - FirstBatchArrivalWaitTime: 1s410ms - MergeGetNext: 401.095us - MergeGetNextBatch: 88.453us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 399.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 1s205ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1s437ms max:1s447ms mean: 1s443ms stddev:3.367ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450009) - PerHostPeakMemUsage: 275.19 MB (288559564) - PrepareTime: 146.696ms - RowsProduced: 37 (37) - TotalCpuTime: 384.902ms - TotalNetworkReceiveTime: 1s055ms - TotalNetworkSendTime: 413.592us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.663ms, non-child: 378.663ms, % non-child: 100.00%) - CodegenTime: 1.841ms - CompileTime: 20.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.654ms - PrepareTime: 143.261ms DataStreamSender (dst_id=14):(Total: 100.811us, non-child: 100.811us, % non-child: 100.00%) - BytesSent: 697.00 B (697) - NetworkThroughput(*): 2.48 MB/sec - OverallThroughput: 7.79 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 76.707us - ThriftTransmitTime(*): 289.745us - UncompressedRowBatchSize: 756.00 B (756) SORT_NODE (id=8):(Total: 1s204ms, non-child: 406.672us, % non-child: 0.03%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec AGGREGATION_NODE (id=13):(Total: 1s203ms, non-child: 148.069ms, % non-child: 12.30%) - BuildTime: 127.885us - GetNewBlockTime: 97.978us - GetResultsTime: 52.125us - HTResizeTime: 4.270us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.483us EXCHANGE_NODE (id=12):(Total: 1s055ms, non-child: 1s055ms, % non-child: 100.00%) - BytesReceived: 10.02 KB (10256) - ConvertRowBatchTime: 65.741us - DeserializeRowBatchTimer: 275.747us - FirstBatchArrivalWaitTime: 738.120ms - PeakMemoryUsage: 0 - RowsReturned: 554 (554) - RowsReturnedRate: 525.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 915.399ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.83 GB, max: 2.04 GB, avg: 1.91 GB, stddev: 64.79 MB completion times: min:1s108ms max:1s417ms mean: 1s302ms stddev:86.100ms execution rates: min:1.29 GB/sec max:1.73 GB/sec mean:1.47 GB/sec stddev:112.31 MB/sec num instances: 15 - AverageThreadTokens: 5.86 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 269.92 MB (283029145) - PerHostPeakMemUsage: 275.19 MB (288559564) - PrepareTime: 148.116ms - RowsProduced: 554 (554) - TotalCpuTime: 7s216ms - TotalNetworkReceiveTime: 107.488us - TotalNetworkSendTime: 4.456ms - TotalStorageWaitTime: 310.539ms CodeGen:(Total: 520.866ms, non-child: 520.866ms, % non-child: 100.00%) - CodegenTime: 1.485ms - CompileTime: 101.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 280.078ms - PrepareTime: 138.290ms DataStreamSender (dst_id=12):(Total: 163.126us, non-child: 163.126us, % non-child: 100.00%) - BytesSent: 10.02 KB (10256) - NetworkThroughput(*): 2.76 MB/sec - OverallThroughput: 61.69 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 530.138us - ThriftTransmitTime(*): 3.596ms - UncompressedRowBatchSize: 15.22 KB (15588) AGGREGATION_NODE (id=7):(Total: 904.193ms, non-child: 212.727ms, % non-child: 23.53%) - GetNewBlockTime: 64.325us - GetResultsTime: 130.556us - HTResizeTime: 534.852us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.89 MB (19807611) - PinTime: 0.000ns - ReductionFactorEstimate: 1.46 - ReductionFactorThresholdToExpand: 0.07 - RowsPassedThrough: 0 (0) - RowsReturned: 554 (554) - RowsReturnedRate: 619.00 /sec - StreamingTime: 74.321ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 691.465ms, non-child: 6.842ms, % non-child: 0.99%) - BuildPartitionTime: 125.620us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.883us - GetNewBlockTime: 319.886us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.41 MB (19307899) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.979ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 52.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.229us EXCHANGE_NODE (id=11):(Total: 70.719us, non-child: 70.719us, % non-child: 100.00%) - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 33.330us - DeserializeRowBatchTimer: 21.851us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 684.628ms, non-child: 6.586ms, % non-child: 0.96%) - BuildPartitionTime: 85.042us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 57.315us - GetNewBlockTime: 324.852us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.57 MB (14225028) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.674ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 53.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.856us EXCHANGE_NODE (id=10):(Total: 32.463us, non-child: 32.463us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.242us - DeserializeRowBatchTimer: 49.723us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 678.048ms, non-child: 16.087ms, % non-child: 2.37%) - BuildPartitionTime: 4.535ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 649.770us - GetNewBlockTime: 499.133us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423057) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.761ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 54.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.213us EXCHANGE_NODE (id=9):(Total: 517.496us, non-child: 517.496us, % non-child: 100.00%) - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 419.686us - DeserializeRowBatchTimer: 2.279ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 661.443ms, non-child: 661.443ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 249.86 MB (262000780) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.86 MB (262000780) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.86 MB (262000780) - DecompressionTime: 779.579ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 254.21 MB (266560635) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.48M (36475001) - RowsReturned: 36.18K (36184) - RowsReturnedRate: 55.83 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 741 (741) - ScannerThreadsTotalWallClockTime: 6s212ms - MaterializeTupleTime(*): 4s985ms - ScannerThreadsSysTime: 199.364ms - ScannerThreadsUserTime: 5s647ms - ScannerThreadsVoluntaryContextSwitches: 385 (385) - TotalRawHdfsReadTime(*): 187.841ms - TotalReadThroughput: 210.95 MB/sec Filter 0: - Rows processed: 397.56K (397560) - Rows rejected: 9.32K (9318) - Rows total: 397.58K (397585) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.15K (69146) - RowGroups rejected: 0 (0) - RowGroups total: 69.15K (69146) - Rows processed: 397.56K (397560) - Rows rejected: 0 (0) - Rows total: 397.58K (397585) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.47M (36465683) - Rows rejected: 36.43M (36429498) - Rows total: 36.47M (36465683) Averaged Fragment F03:(Total: 164.799ms, non-child: 160.669ms, % non-child: 97.49%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:166.366ms max:166.366ms mean: 166.366ms stddev:0.000ns execution rates: min:534.49 KB/sec max:534.49 KB/sec mean:534.49 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.91 MB (4099664) - PrepareTime: 89.924us - RowsProduced: 1.00K (1002) - TotalCpuTime: 9.757ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 156.534ms - TotalStorageWaitTime: 3.355ms DataStreamSender (dst_id=11):(Total: 183.523us, non-child: 183.523us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 57.81 KB/sec - OverallThroughput: 648.21 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 64.034us - ThriftTransmitTime(*): 2s106ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.946ms, non-child: 3.946ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.358us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 2.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 253.93 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.699ms - MaterializeTupleTime(*): 46.244us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 39.928us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 164.642ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:375.475ms max:375.475ms mean: 375.475ms stddev:0.000ns execution rates: min:5.77 MB/sec max:5.77 MB/sec mean:5.77 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.03 MB (5271680) - PrepareTime: 138.246ms - RowsProduced: 365 (365) - TotalCpuTime: 389.989ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 79.386us - TotalStorageWaitTime: 6.663ms CodeGen:(Total: 343.987ms, non-child: 343.987ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.358ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 201.813ms - PrepareTime: 134.850ms DataStreamSender (dst_id=10):(Total: 110.879us, non-child: 110.879us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 11.69 MB/sec - OverallThroughput: 387.69 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 33.122us - ThriftTransmitTime(*): 3.675ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 298.363ms, non-child: 298.363ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 193.057us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 506.42 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.22 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 21.748ms - MaterializeTupleTime(*): 13.324ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.997ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 926.528us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 249.095ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:462.073ms max:462.073ms mean: 462.073ms stddev:0.000ns execution rates: min:61.21 MB/sec max:61.21 MB/sec mean:61.21 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.42 MB (10929888) - PrepareTime: 142.566ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 550.574ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 840.461us - TotalStorageWaitTime: 11.720ms CodeGen:(Total: 352.059ms, non-child: 352.059ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 200.743ms - PrepareTime: 139.919ms DataStreamSender (dst_id=9):(Total: 6.170ms, non-child: 6.170ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 61.03 MB/sec - OverallThroughput: 1.42 GB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 4.574ms - ThriftTransmitTime(*): 146.941ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 381.312ms, non-child: 381.312ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 3.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 734.81 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 40.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 101.456ms - MaterializeTupleTime(*): 82.233ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 86.986ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 3.325ms - TotalReadThroughput: 4.89 MB/sec Fragment F04: Instance 2446072c3555a01d:8df23dc4d248429f (host=vb0220.halxg.cloudera.com:22000):(Total: 1s238ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450048) - PerHostPeakMemUsage: 278.69 MB (292223472) - PrepareTime: 128.446ms - RowsProduced: 40 (40) - TotalCpuTime: 336.600ms - TotalNetworkReceiveTime: 1s106ms - TotalNetworkSendTime: 895.025us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 331.428ms, non-child: 331.428ms, % non-child: 100.00%) - CodegenTime: 1.642ms - CompileTime: 17.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 187.212ms - PrepareTime: 125.389ms DataStreamSender (dst_id=14):(Total: 92.705us, non-child: 92.705us, % non-child: 100.00%) - BytesSent: 761.00 B (761) - NetworkThroughput(*): 1.43 MB/sec - OverallThroughput: 7.83 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 75.183us - ThriftTransmitTime(*): 507.534us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s236ms, non-child: 323.628us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 32.00 /sec AGGREGATION_NODE (id=13):(Total: 1s235ms, non-child: 129.235ms, % non-child: 10.46%) ExecOption: Codegen Enabled - BuildTime: 60.319us - GetNewBlockTime: 80.668us - GetResultsTime: 30.787us - HTResizeTime: 2.091us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 32.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.372us EXCHANGE_NODE (id=12):(Total: 1s106ms, non-child: 362.437us, % non-child: 0.03%) BytesReceived(500.000ms): 0, 0, 3.58 KB - BytesReceived: 10.60 KB (10856) - ConvertRowBatchTime: 118.093us - DeserializeRowBatchTimer: 281.523us - FirstBatchArrivalWaitTime: 787.815ms - PeakMemoryUsage: 0 - RowsReturned: 590 (590) - RowsReturnedRate: 533.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d248429e (host=vb0206.halxg.cloudera.com:22000):(Total: 1s209ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450000) - PerHostPeakMemUsage: 275.85 MB (289254400) - PrepareTime: 149.011ms - RowsProduced: 37 (37) - TotalCpuTime: 387.187ms - TotalNetworkReceiveTime: 1s056ms - TotalNetworkSendTime: 287.693us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.363ms, non-child: 380.363ms, % non-child: 100.00%) - CodegenTime: 1.812ms - CompileTime: 20.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.651ms - PrepareTime: 145.642ms DataStreamSender (dst_id=14):(Total: 130.330us, non-child: 130.330us, % non-child: 100.00%) - BytesSent: 695.00 B (695) - NetworkThroughput(*): 3.13 MB/sec - OverallThroughput: 5.09 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 107.590us - ThriftTransmitTime(*): 211.522us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s208ms, non-child: 388.555us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec AGGREGATION_NODE (id=13):(Total: 1s208ms, non-child: 151.288ms, % non-child: 12.52%) ExecOption: Codegen Enabled - BuildTime: 544.633us - GetNewBlockTime: 99.204us - GetResultsTime: 64.479us - HTResizeTime: 3.296us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.392us EXCHANGE_NODE (id=12):(Total: 1s056ms, non-child: 158.934us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 9.19 KB - BytesReceived: 9.86 KB (10094) - ConvertRowBatchTime: 40.112us - DeserializeRowBatchTimer: 434.175us - FirstBatchArrivalWaitTime: 738.371ms - PeakMemoryUsage: 0 - RowsReturned: 547 (547) - RowsReturnedRate: 517.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d248429b (host=vb0208.halxg.cloudera.com:22000):(Total: 1s208ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450032) - PerHostPeakMemUsage: 278.50 MB (292024536) - PrepareTime: 146.340ms - RowsProduced: 39 (39) - TotalCpuTime: 383.093ms - TotalNetworkReceiveTime: 1s058ms - TotalNetworkSendTime: 483.869us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.233ms, non-child: 377.233ms, % non-child: 100.00%) - CodegenTime: 1.798ms - CompileTime: 20.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.594ms - PrepareTime: 142.883ms DataStreamSender (dst_id=14):(Total: 120.516us, non-child: 120.516us, % non-child: 100.00%) - BytesSent: 724.00 B (724) - NetworkThroughput(*): 1.68 MB/sec - OverallThroughput: 5.73 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 98.254us - ThriftTransmitTime(*): 410.816us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s206ms, non-child: 396.131us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 32.00 /sec AGGREGATION_NODE (id=13):(Total: 1s206ms, non-child: 147.561ms, % non-child: 12.24%) ExecOption: Codegen Enabled - BuildTime: 101.385us - GetNewBlockTime: 97.465us - GetResultsTime: 49.096us - HTResizeTime: 4.581us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 32.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.298us EXCHANGE_NODE (id=12):(Total: 1s058ms, non-child: 224.884us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 10.32 KB (10567) - ConvertRowBatchTime: 58.103us - DeserializeRowBatchTimer: 270.470us - FirstBatchArrivalWaitTime: 740.468ms - PeakMemoryUsage: 0 - RowsReturned: 574 (574) - RowsReturnedRate: 542.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d248429a (host=vb0234.halxg.cloudera.com:22000):(Total: 1s207ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.29 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449808) - PerHostPeakMemUsage: 277.48 MB (290963408) - PrepareTime: 146.945ms - RowsProduced: 25 (25) - TotalCpuTime: 385.008ms - TotalNetworkReceiveTime: 1s057ms - TotalNetworkSendTime: 283.813us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.606ms, non-child: 378.606ms, % non-child: 100.00%) - CodegenTime: 1.732ms - CompileTime: 20.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.256ms - PrepareTime: 143.613ms DataStreamSender (dst_id=14):(Total: 138.378us, non-child: 138.378us, % non-child: 100.00%) - BytesSent: 482.00 B (482) - NetworkThroughput(*): 2.09 MB/sec - OverallThroughput: 3.32 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 110.784us - ThriftTransmitTime(*): 220.172us - UncompressedRowBatchSize: 504.00 B (504) SORT_NODE (id=8):(Total: 1s206ms, non-child: 376.207us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 20.00 /sec AGGREGATION_NODE (id=13):(Total: 1s205ms, non-child: 148.725ms, % non-child: 12.33%) ExecOption: Codegen Enabled - BuildTime: 211.250us - GetNewBlockTime: 97.792us - GetResultsTime: 51.635us - HTResizeTime: 4.108us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 20.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.539us EXCHANGE_NODE (id=12):(Total: 1s057ms, non-child: 246.436us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 1.87 KB - BytesReceived: 6.90 KB (7069) - ConvertRowBatchTime: 54.697us - DeserializeRowBatchTimer: 152.352us - FirstBatchArrivalWaitTime: 739.464ms - PeakMemoryUsage: 0 - RowsReturned: 369 (369) - RowsReturnedRate: 349.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d248429d (host=vb0228.halxg.cloudera.com:22000):(Total: 1s206ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449968) - PerHostPeakMemUsage: 288.14 MB (302139992) - PrepareTime: 143.913ms - RowsProduced: 35 (35) - TotalCpuTime: 382.790ms - TotalNetworkReceiveTime: 1s059ms - TotalNetworkSendTime: 606.945us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.712ms, non-child: 377.712ms, % non-child: 100.00%) - CodegenTime: 1.783ms - CompileTime: 20.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 215.031ms - PrepareTime: 140.553ms DataStreamSender (dst_id=14):(Total: 105.074us, non-child: 105.074us, % non-child: 100.00%) - BytesSent: 656.00 B (656) - NetworkThroughput(*): 2.94 MB/sec - OverallThroughput: 5.95 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 86.832us - ThriftTransmitTime(*): 212.527us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 1s205ms, non-child: 283.766us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 29.00 /sec AGGREGATION_NODE (id=13):(Total: 1s205ms, non-child: 144.915ms, % non-child: 12.03%) ExecOption: Codegen Enabled - BuildTime: 54.199us - GetNewBlockTime: 94.763us - GetResultsTime: 29.371us - HTResizeTime: 2.245us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 29.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.186us EXCHANGE_NODE (id=12):(Total: 1s060ms, non-child: 277.533us, % non-child: 0.03%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 9.53 KB (9762) - ConvertRowBatchTime: 110.373us - DeserializeRowBatchTimer: 277.765us - FirstBatchArrivalWaitTime: 741.752ms - PeakMemoryUsage: 0 - RowsReturned: 519 (519) - RowsReturnedRate: 489.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484299 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s206ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 244.29 MB (256159976) - PrepareTime: 149.075ms - RowsProduced: 33 (33) - TotalCpuTime: 387.665ms - TotalNetworkReceiveTime: 1s053ms - TotalNetworkSendTime: 591.364us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 381.155ms, non-child: 381.155ms, % non-child: 100.00%) - CodegenTime: 2.078ms - CompileTime: 20.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.288ms - PrepareTime: 145.525ms DataStreamSender (dst_id=14):(Total: 99.835us, non-child: 99.835us, % non-child: 100.00%) - BytesSent: 622.00 B (622) - NetworkThroughput(*): 1.24 MB/sec - OverallThroughput: 5.94 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 78.245us - ThriftTransmitTime(*): 478.758us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s204ms, non-child: 389.487us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 27.00 /sec AGGREGATION_NODE (id=13):(Total: 1s204ms, non-child: 150.707ms, % non-child: 12.51%) ExecOption: Codegen Enabled - BuildTime: 82.515us - GetNewBlockTime: 96.875us - GetResultsTime: 64.774us - HTResizeTime: 14.863us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 27.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.484us EXCHANGE_NODE (id=12):(Total: 1s053ms, non-child: 298.524us, % non-child: 0.03%) BytesReceived(500.000ms): 0, 0, 4.82 KB - BytesReceived: 8.84 KB (9057) - ConvertRowBatchTime: 107.894us - DeserializeRowBatchTimer: 115.544us - FirstBatchArrivalWaitTime: 736.070ms - PeakMemoryUsage: 0 - RowsReturned: 484 (484) - RowsReturnedRate: 459.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484298 (host=vb0222.halxg.cloudera.com:22000):(Total: 1s205ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 274.48 MB (287812240) - PrepareTime: 146.857ms - RowsProduced: 33 (33) - TotalCpuTime: 383.591ms - TotalNetworkReceiveTime: 1s056ms - TotalNetworkSendTime: 331.852us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.241ms, non-child: 378.241ms, % non-child: 100.00%) - CodegenTime: 1.713ms - CompileTime: 20.084ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.330ms - PrepareTime: 143.578ms DataStreamSender (dst_id=14):(Total: 104.352us, non-child: 104.352us, % non-child: 100.00%) - BytesSent: 611.00 B (611) - NetworkThroughput(*): 2.33 MB/sec - OverallThroughput: 5.58 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 84.291us - ThriftTransmitTime(*): 249.954us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s204ms, non-child: 338.946us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 27.00 /sec AGGREGATION_NODE (id=13):(Total: 1s204ms, non-child: 147.866ms, % non-child: 12.28%) ExecOption: Codegen Enabled - BuildTime: 88.423us - GetNewBlockTime: 93.107us - GetResultsTime: 31.361us - HTResizeTime: 4.800us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 27.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.359us EXCHANGE_NODE (id=12):(Total: 1s056ms, non-child: 211.669us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 8.91 KB (9119) - ConvertRowBatchTime: 49.256us - DeserializeRowBatchTimer: 122.412us - FirstBatchArrivalWaitTime: 738.714ms - PeakMemoryUsage: 0 - RowsReturned: 488 (488) - RowsReturnedRate: 462.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484296 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s205ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450000) - PerHostPeakMemUsage: 255.09 MB (267484296) - PrepareTime: 146.900ms - RowsProduced: 37 (37) - TotalCpuTime: 382.675ms - TotalNetworkReceiveTime: 1s055ms - TotalNetworkSendTime: 304.608us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.121ms, non-child: 377.121ms, % non-child: 100.00%) - CodegenTime: 1.799ms - CompileTime: 20.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 211.739ms - PrepareTime: 143.594ms DataStreamSender (dst_id=14):(Total: 98.608us, non-child: 98.608us, % non-child: 100.00%) - BytesSent: 666.00 B (666) - NetworkThroughput(*): 3.15 MB/sec - OverallThroughput: 6.44 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 76.217us - ThriftTransmitTime(*): 201.819us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s204ms, non-child: 339.000us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec AGGREGATION_NODE (id=13):(Total: 1s203ms, non-child: 147.991ms, % non-child: 12.29%) ExecOption: Codegen Enabled - BuildTime: 79.476us - GetNewBlockTime: 89.877us - GetResultsTime: 69.443us - HTResizeTime: 3.074us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 30.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.249us EXCHANGE_NODE (id=12):(Total: 1s055ms, non-child: 167.021us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 9.17 KB - BytesReceived: 9.85 KB (10082) - ConvertRowBatchTime: 40.716us - DeserializeRowBatchTimer: 139.500us - FirstBatchArrivalWaitTime: 738.997ms - PeakMemoryUsage: 0 - RowsReturned: 544 (544) - RowsReturnedRate: 515.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d24842a0 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s203ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450096) - PerHostPeakMemUsage: 266.67 MB (279620392) - PrepareTime: 152.237ms - RowsProduced: 43 (43) - TotalCpuTime: 396.483ms - TotalNetworkReceiveTime: 1s046ms - TotalNetworkSendTime: 315.337us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 387.213ms, non-child: 387.213ms, % non-child: 100.00%) - CodegenTime: 1.712ms - CompileTime: 20.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 217.302ms - PrepareTime: 148.424ms DataStreamSender (dst_id=14):(Total: 44.748us, non-child: 44.748us, % non-child: 100.00%) - BytesSent: 787.00 B (787) - NetworkThroughput(*): 2.90 MB/sec - OverallThroughput: 16.77 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 22.056us - ThriftTransmitTime(*): 258.882us - UncompressedRowBatchSize: 864.00 B (864) SORT_NODE (id=8):(Total: 1s201ms, non-child: 855.107us, % non-child: 0.07%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 35.00 /sec AGGREGATION_NODE (id=13):(Total: 1s200ms, non-child: 154.178ms, % non-child: 12.84%) ExecOption: Codegen Enabled - BuildTime: 105.688us - GetNewBlockTime: 115.839us - GetResultsTime: 81.374us - HTResizeTime: 3.486us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 35.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.492us EXCHANGE_NODE (id=12):(Total: 1s046ms, non-child: 223.962us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 3.86 KB - BytesReceived: 11.45 KB (11720) - ConvertRowBatchTime: 64.056us - DeserializeRowBatchTimer: 517.855us - FirstBatchArrivalWaitTime: 727.751ms - PeakMemoryUsage: 0 - RowsReturned: 637 (637) - RowsReturnedRate: 608.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484293 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s203ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450032) - PerHostPeakMemUsage: 269.10 MB (282170384) - PrepareTime: 143.330ms - RowsProduced: 39 (39) - TotalCpuTime: 380.067ms - TotalNetworkReceiveTime: 1s057ms - TotalNetworkSendTime: 377.189us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 374.497ms, non-child: 374.497ms, % non-child: 100.00%) - CodegenTime: 1.728ms - CompileTime: 20.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.155ms - PrepareTime: 140.117ms DataStreamSender (dst_id=14):(Total: 149.969us, non-child: 149.969us, % non-child: 100.00%) - BytesSent: 737.00 B (737) - NetworkThroughput(*): 2.51 MB/sec - OverallThroughput: 4.69 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 125.978us - ThriftTransmitTime(*): 280.448us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s202ms, non-child: 354.677us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 32.00 /sec AGGREGATION_NODE (id=13):(Total: 1s202ms, non-child: 144.779ms, % non-child: 12.04%) ExecOption: Codegen Enabled - BuildTime: 98.223us - GetNewBlockTime: 89.816us - GetResultsTime: 61.961us - HTResizeTime: 3.372us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 32.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.636us EXCHANGE_NODE (id=12):(Total: 1s057ms, non-child: 246.913us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 10.28 KB (10524) - ConvertRowBatchTime: 56.037us - DeserializeRowBatchTimer: 652.365us - FirstBatchArrivalWaitTime: 740.953ms - PeakMemoryUsage: 0 - RowsReturned: 573 (573) - RowsReturnedRate: 541.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484295 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s201ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.29 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450144) - PerHostPeakMemUsage: 271.53 MB (284720640) - PrepareTime: 161.836ms - RowsProduced: 46 (46) - TotalCpuTime: 402.070ms - TotalNetworkReceiveTime: 1s036ms - TotalNetworkSendTime: 362.074us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 395.875ms, non-child: 395.875ms, % non-child: 100.00%) - CodegenTime: 1.840ms - CompileTime: 20.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 215.581ms - PrepareTime: 158.403ms DataStreamSender (dst_id=14):(Total: 119.872us, non-child: 119.872us, % non-child: 100.00%) - BytesSent: 829.00 B (829) - NetworkThroughput(*): 3.00 MB/sec - OverallThroughput: 6.60 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 96.064us - ThriftTransmitTime(*): 263.716us - UncompressedRowBatchSize: 924.00 B (924) SORT_NODE (id=8):(Total: 1s200ms, non-child: 408.279us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 38.00 /sec AGGREGATION_NODE (id=13):(Total: 1s199ms, non-child: 163.234ms, % non-child: 13.60%) ExecOption: Codegen Enabled - BuildTime: 104.096us - GetNewBlockTime: 101.222us - GetResultsTime: 61.713us - HTResizeTime: 3.078us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 38.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.804us EXCHANGE_NODE (id=12):(Total: 1s036ms, non-child: 207.654us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 3.29 KB - BytesReceived: 12.18 KB (12469) - ConvertRowBatchTime: 54.985us - DeserializeRowBatchTimer: 126.486us - FirstBatchArrivalWaitTime: 719.874ms - PeakMemoryUsage: 0 - RowsReturned: 682 (682) - RowsReturnedRate: 657.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484297 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s201ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.29 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450064) - PerHostPeakMemUsage: 296.48 MB (310883824) - PrepareTime: 146.294ms - RowsProduced: 41 (41) - TotalCpuTime: 387.282ms - TotalNetworkReceiveTime: 1s052ms - TotalNetworkSendTime: 349.675us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.643ms, non-child: 380.643ms, % non-child: 100.00%) - CodegenTime: 2.731ms - CompileTime: 20.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 216.673ms - PrepareTime: 141.965ms DataStreamSender (dst_id=14):(Total: 50.798us, non-child: 50.798us, % non-child: 100.00%) - BytesSent: 745.00 B (745) - NetworkThroughput(*): 2.68 MB/sec - OverallThroughput: 13.99 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 15.587us - ThriftTransmitTime(*): 265.468us - UncompressedRowBatchSize: 824.00 B (824) SORT_NODE (id=8):(Total: 1s199ms, non-child: 528.358us, % non-child: 0.04%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 34.00 /sec AGGREGATION_NODE (id=13):(Total: 1s199ms, non-child: 147.136ms, % non-child: 12.27%) ExecOption: Codegen Enabled - BuildTime: 96.678us - GetNewBlockTime: 96.718us - GetResultsTime: 37.714us - HTResizeTime: 3.228us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 34.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.489us EXCHANGE_NODE (id=12):(Total: 1s052ms, non-child: 244.055us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 2.93 KB - BytesReceived: 10.81 KB (11071) - ConvertRowBatchTime: 65.424us - DeserializeRowBatchTimer: 134.253us - FirstBatchArrivalWaitTime: 735.209ms - PeakMemoryUsage: 0 - RowsReturned: 607 (607) - RowsReturnedRate: 576.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484294 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s198ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449952) - PerHostPeakMemUsage: 275.57 MB (288960192) - PrepareTime: 148.634ms - RowsProduced: 34 (34) - TotalCpuTime: 391.065ms - TotalNetworkReceiveTime: 1s046ms - TotalNetworkSendTime: 342.448us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 384.705ms, non-child: 384.705ms, % non-child: 100.00%) - CodegenTime: 1.736ms - CompileTime: 20.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 217.839ms - PrepareTime: 145.350ms DataStreamSender (dst_id=14):(Total: 126.459us, non-child: 126.459us, % non-child: 100.00%) - BytesSent: 632.00 B (632) - NetworkThroughput(*): 2.33 MB/sec - OverallThroughput: 4.77 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 89.273us - ThriftTransmitTime(*): 258.601us - UncompressedRowBatchSize: 684.00 B (684) SORT_NODE (id=8):(Total: 1s196ms, non-child: 400.720us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 28.00 /sec AGGREGATION_NODE (id=13):(Total: 1s196ms, non-child: 150.198ms, % non-child: 12.55%) ExecOption: Codegen Enabled - BuildTime: 88.731us - GetNewBlockTime: 102.436us - GetResultsTime: 49.027us - HTResizeTime: 3.817us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 28.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.410us EXCHANGE_NODE (id=12):(Total: 1s046ms, non-child: 279.035us, % non-child: 0.03%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 9.14 KB (9358) - ConvertRowBatchTime: 60.152us - DeserializeRowBatchTimer: 389.728us - FirstBatchArrivalWaitTime: 729.605ms - PeakMemoryUsage: 0 - RowsReturned: 500 (500) - RowsReturnedRate: 477.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d248429c (host=vb0230.halxg.cloudera.com:22000):(Total: 1s197ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450080) - PerHostPeakMemUsage: 289.79 MB (303869664) - PrepareTime: 146.799ms - RowsProduced: 42 (42) - TotalCpuTime: 394.814ms - TotalNetworkReceiveTime: 1s047ms - TotalNetworkSendTime: 279.152us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 388.944ms, non-child: 388.944ms, % non-child: 100.00%) - CodegenTime: 1.739ms - CompileTime: 20.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 223.451ms - PrepareTime: 143.468ms DataStreamSender (dst_id=14):(Total: 47.189us, non-child: 47.189us, % non-child: 100.00%) - BytesSent: 779.00 B (779) - NetworkThroughput(*): 3.53 MB/sec - OverallThroughput: 15.74 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 22.548us - ThriftTransmitTime(*): 210.388us - UncompressedRowBatchSize: 844.00 B (844) SORT_NODE (id=8):(Total: 1s196ms, non-child: 392.744us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 35.00 /sec AGGREGATION_NODE (id=13):(Total: 1s195ms, non-child: 148.087ms, % non-child: 12.38%) ExecOption: Codegen Enabled - BuildTime: 98.352us - GetNewBlockTime: 109.743us - GetResultsTime: 67.255us - HTResizeTime: 3.564us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 35.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.246us EXCHANGE_NODE (id=12):(Total: 1s047ms, non-child: 213.507us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 11.04 KB (11304) - ConvertRowBatchTime: 56.249us - DeserializeRowBatchTimer: 362.316us - FirstBatchArrivalWaitTime: 729.509ms - PeakMemoryUsage: 0 - RowsReturned: 617 (617) - RowsReturnedRate: 588.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 2446072c3555a01d:8df23dc4d2484292 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s190ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450048) - PerHostPeakMemUsage: 286.20 MB (300106056) - PrepareTime: 143.831ms - RowsProduced: 40 (40) - TotalCpuTime: 393.139ms - TotalNetworkReceiveTime: 1s043ms - TotalNetworkSendTime: 392.838us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 386.211ms, non-child: 386.211ms, % non-child: 100.00%) - CodegenTime: 1.776ms - CompileTime: 23.829ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 220.702ms - PrepareTime: 140.413ms DataStreamSender (dst_id=14):(Total: 83.333us, non-child: 83.333us, % non-child: 100.00%) - BytesSent: 740.00 B (740) - NetworkThroughput(*): 2.24 MB/sec - OverallThroughput: 8.47 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 61.714us - ThriftTransmitTime(*): 315.577us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s188ms, non-child: 324.472us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 33.00 /sec AGGREGATION_NODE (id=13):(Total: 1s188ms, non-child: 145.136ms, % non-child: 12.21%) ExecOption: Codegen Enabled - BuildTime: 104.311us - GetNewBlockTime: 104.156us - GetResultsTime: 31.899us - HTResizeTime: 4.455us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 33.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.297us EXCHANGE_NODE (id=12):(Total: 1s043ms, non-child: 229.080us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 10.54 KB (10789) - ConvertRowBatchTime: 49.974us - DeserializeRowBatchTimer: 159.465us - FirstBatchArrivalWaitTime: 727.247ms - PeakMemoryUsage: 0 - RowsReturned: 588 (588) - RowsReturnedRate: 563.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 2446072c3555a01d:8df23dc4d24842ad (host=vb0206.halxg.cloudera.com:22000):(Total: 1s033ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Filter 0 arrival: 525ms Filter 1 arrival: 525ms Filter 2 arrival: 530ms MemoryUsage(500.000ms): 1.90 MB, 250.71 MB, 18.21 MB ThreadUsage(500.000ms): 1, 10, 1 - AverageThreadTokens: 4.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 270.58 MB (283728896) - PerHostPeakMemUsage: 275.85 MB (289254400) - PrepareTime: 144.034ms - RowsProduced: 564 (564) - TotalCpuTime: 6s809ms - TotalNetworkReceiveTime: 109.332us - TotalNetworkSendTime: 5.109ms - TotalStorageWaitTime: 284.160ms CodeGen:(Total: 511.911ms, non-child: 511.911ms, % non-child: 100.00%) - CodegenTime: 1.390ms - CompileTime: 100.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.085ms - PrepareTime: 134.641ms DataStreamSender (dst_id=12):(Total: 129.002us, non-child: 129.002us, % non-child: 100.00%) - BytesSent: 10.21 KB (10457) - NetworkThroughput(*): 2.35 MB/sec - OverallThroughput: 77.31 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 514.576us - ThriftTransmitTime(*): 4.245ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 1s021ms, non-child: 206.584ms, % non-child: 20.22%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 69.031us - GetResultsTime: 103.290us - HTResizeTime: 552.199us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 23.89 MB (25051888) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 551.00 /sec - StreamingTime: 71.113ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 815.233ms, non-child: 6.296ms, % non-child: 0.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 130.098us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.811us - GetNewBlockTime: 218.887us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 23.41 MB (24552176) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.658ms - RowsReturned: 34.08K (34076) - RowsReturnedRate: 41.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.860us EXCHANGE_NODE (id=11):(Total: 49.450us, non-child: 49.450us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.549us - DeserializeRowBatchTimer: 21.187us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 808.941ms, non-child: 5.992ms, % non-child: 0.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 100.016us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.427us - GetNewBlockTime: 319.043us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.45 MB (15155976) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.435ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 43.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.525us EXCHANGE_NODE (id=10):(Total: 40.495us, non-child: 40.495us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 24.446us - DeserializeRowBatchTimer: 16.198us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 802.955ms, non-child: 14.407ms, % non-child: 1.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.862ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 596.910us - GetNewBlockTime: 474.610us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422504) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.486ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 43.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.723us EXCHANGE_NODE (id=9):(Total: 492.577us, non-child: 492.577us, % non-child: 100.00%) BytesReceived(500.000ms): 174.35 KB, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 358.364us - DeserializeRowBatchTimer: 1.933ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 31.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 788.054ms, non-child: 788.054ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 240.41 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 240.41 MB (252088793) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.41 MB (252088793) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.41 MB (252088793) - DecompressionTime: 731.217ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 256.18 MB (268623696) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.11M (35106723) - RowsReturned: 34.86K (34861) - RowsReturnedRate: 44.24 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 702 (702) - ScannerThreadsTotalWallClockTime: 5s668ms - MaterializeTupleTime(*): 4s529ms - ScannerThreadsSysTime: 188.968ms - ScannerThreadsUserTime: 5s150ms - ScannerThreadsVoluntaryContextSwitches: 335 (335) - TotalRawHdfsReadTime(*): 176.911ms - TotalReadThroughput: 240.41 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8845) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.55K (66548) - RowGroups rejected: 0 (0) - RowGroups total: 66.55K (66548) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.10M (35097878) - Rows rejected: 35.06M (35063017) - Rows total: 35.10M (35097878) Instance 2446072c3555a01d:8df23dc4d24842a8 (host=vb0224.halxg.cloudera.com:22000):(Total: 994.238ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Filter 0 arrival: 533ms Filter 1 arrival: 533ms Filter 2 arrival: 539ms MemoryUsage(500.000ms): 1.40 MB, 211.06 MB, 34.36 MB ThreadUsage(500.000ms): 1, 12, 2 - AverageThreadTokens: 5.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 239.02 MB (250634472) - PerHostPeakMemUsage: 244.29 MB (256159976) - PrepareTime: 148.477ms - RowsProduced: 564 (564) - TotalCpuTime: 7s048ms - TotalNetworkReceiveTime: 72.198us - TotalNetworkSendTime: 4.327ms - TotalStorageWaitTime: 284.959ms CodeGen:(Total: 518.612ms, non-child: 518.612ms, % non-child: 100.00%) - CodegenTime: 1.472ms - CompileTime: 100.899ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.032ms - PrepareTime: 138.631ms DataStreamSender (dst_id=12):(Total: 217.685us, non-child: 217.685us, % non-child: 100.00%) - BytesSent: 10.17 KB (10412) - NetworkThroughput(*): 2.74 MB/sec - OverallThroughput: 45.61 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 460.084us - ThriftTransmitTime(*): 3.617ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 982.933ms, non-child: 205.933ms, % non-child: 20.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.316us - GetResultsTime: 129.923us - HTResizeTime: 545.670us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.57 MB (17377832) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 573.00 /sec - StreamingTime: 67.305ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 776.999ms, non-child: 6.563ms, % non-child: 0.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.290us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.632us - GetNewBlockTime: 251.801us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.10 MB (16878120) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.755ms - RowsReturned: 33.80K (33799) - RowsReturnedRate: 43.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.342us EXCHANGE_NODE (id=11):(Total: 47.705us, non-child: 47.705us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 34.650us - DeserializeRowBatchTimer: 19.544us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 770.442ms, non-child: 7.309ms, % non-child: 0.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 88.293us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.608us - GetNewBlockTime: 296.541us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.81 MB (14476952) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.349ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 44.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.072us EXCHANGE_NODE (id=10):(Total: 32.421us, non-child: 32.421us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 16.951us - DeserializeRowBatchTimer: 22.829us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.26 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 763.140ms, non-child: 16.443ms, % non-child: 2.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.981ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 612.143us - GetNewBlockTime: 465.266us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422624) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.704ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 45.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.399us EXCHANGE_NODE (id=9):(Total: 573.336us, non-child: 573.336us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 488.527us - DeserializeRowBatchTimer: 2.237ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 746.123ms, non-child: 746.123ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 180.94 MB, 240.35 MB - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 240.35 MB (252026160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.35 MB (252026160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.35 MB (252026160) - DecompressionTime: 753.488ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 224.65 MB (235559840) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35069138) - RowsReturned: 34.63K (34626) - RowsReturnedRate: 46.41 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 694 (694) - ScannerThreadsTotalWallClockTime: 5s942ms - MaterializeTupleTime(*): 4s770ms - ScannerThreadsSysTime: 204.963ms - ScannerThreadsUserTime: 5s394ms - ScannerThreadsVoluntaryContextSwitches: 333 (333) - TotalRawHdfsReadTime(*): 184.536ms - TotalReadThroughput: 160.23 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.34K (9341) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 65.72K (65720) - RowGroups rejected: 0 (0) - RowGroups total: 65.72K (65720) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35059797) - Rows rejected: 35.03M (35025171) - Rows total: 35.06M (35059797) Instance 2446072c3555a01d:8df23dc4d24842a7 (host=vb0222.halxg.cloudera.com:22000):(Total: 988.694ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Filter 0 arrival: 534ms Filter 1 arrival: 534ms Filter 2 arrival: 538ms MemoryUsage(500.000ms): 2.90 MB, 228.29 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 269.21 MB (282286736) - PerHostPeakMemUsage: 274.48 MB (287812240) - PrepareTime: 151.430ms - RowsProduced: 423 (423) - TotalCpuTime: 7s668ms - TotalNetworkReceiveTime: 85.397us - TotalNetworkSendTime: 4.053ms - TotalStorageWaitTime: 305.561ms CodeGen:(Total: 520.007ms, non-child: 520.007ms, % non-child: 100.00%) - CodegenTime: 1.450ms - CompileTime: 100.797ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.656ms - PrepareTime: 141.514ms DataStreamSender (dst_id=12):(Total: 147.916us, non-child: 147.916us, % non-child: 100.00%) - BytesSent: 7.67 KB (7858) - NetworkThroughput(*): 2.23 MB/sec - OverallThroughput: 50.66 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 739.020us - ThriftTransmitTime(*): 3.356ms - UncompressedRowBatchSize: 11.62 KB (11904) AGGREGATION_NODE (id=7):(Total: 977.651ms, non-child: 218.869ms, % non-child: 22.39%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.211us - GetResultsTime: 111.269us - HTResizeTime: 469.593us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.43 MB (19321440) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 423 (423) - RowsReturnedRate: 432.00 /sec - StreamingTime: 76.160ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 758.781ms, non-child: 6.772ms, % non-child: 0.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 137.579us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.103us - GetNewBlockTime: 576.567us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.95 MB (18821728) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.032ms - RowsReturned: 35.67K (35672) - RowsReturnedRate: 47.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.984us EXCHANGE_NODE (id=11):(Total: 49.167us, non-child: 49.167us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.666us - DeserializeRowBatchTimer: 18.971us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 752.014ms, non-child: 6.615ms, % non-child: 0.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.479us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 41.840us - GetNewBlockTime: 354.108us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.76 MB (13384256) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.490ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 48.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.673us EXCHANGE_NODE (id=10):(Total: 34.793us, non-child: 34.793us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.516us - DeserializeRowBatchTimer: 16.210us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 745.405ms, non-child: 14.474ms, % non-child: 1.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 2.906ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 594.641us - GetNewBlockTime: 397.202us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18420856) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.658ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 49.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.818us EXCHANGE_NODE (id=9):(Total: 362.766us, non-child: 362.766us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 272.780us - DeserializeRowBatchTimer: 2.283ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 730.568ms, non-child: 730.568ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 253.32 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 253.32 MB (265628829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.32 MB (265628829) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.32 MB (265628829) - DecompressionTime: 815.276ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 253.55 MB (265869744) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.98M (36975520) - RowsReturned: 36.52K (36523) - RowsReturnedRate: 49.99 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 805 (805) - ScannerThreadsTotalWallClockTime: 6s591ms - MaterializeTupleTime(*): 5s332ms - ScannerThreadsSysTime: 194.965ms - ScannerThreadsUserTime: 6s039ms - ScannerThreadsVoluntaryContextSwitches: 670 (670) - TotalRawHdfsReadTime(*): 177.686ms - TotalReadThroughput: 253.32 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.63K (9627) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.27K (70273) - RowGroups rejected: 0 (0) - RowGroups total: 70.27K (70273) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 36.97M (36965893) - Rows rejected: 36.93M (36929370) - Rows total: 36.97M (36965893) Instance 2446072c3555a01d:8df23dc4d24842a5 (host=vb0214.halxg.cloudera.com:22000):(Total: 987.134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Filter 0 arrival: 537ms Filter 1 arrival: 537ms Filter 2 arrival: 543ms MemoryUsage(500.000ms): 1.41 MB, 193.26 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 249.76 MB (261893248) - PerHostPeakMemUsage: 255.09 MB (267484296) - PrepareTime: 147.130ms - RowsProduced: 564 (564) - TotalCpuTime: 7s856ms - TotalNetworkReceiveTime: 87.435us - TotalNetworkSendTime: 5.818ms - TotalStorageWaitTime: 368.072ms CodeGen:(Total: 521.650ms, non-child: 521.650ms, % non-child: 100.00%) - CodegenTime: 1.500ms - CompileTime: 102.703ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 280.585ms - PrepareTime: 137.288ms DataStreamSender (dst_id=12):(Total: 160.169us, non-child: 160.169us, % non-child: 100.00%) - BytesSent: 10.11 KB (10352) - NetworkThroughput(*): 2.18 MB/sec - OverallThroughput: 61.64 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 613.327us - ThriftTransmitTime(*): 4.521ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 973.688ms, non-child: 210.761ms, % non-child: 21.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.901us - GetResultsTime: 140.903us - HTResizeTime: 574.546us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.47 MB (17270120) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 579.00 /sec - StreamingTime: 73.740ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 762.927ms, non-child: 7.059ms, % non-child: 0.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.225us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.136us - GetNewBlockTime: 292.527us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.99 MB (16770408) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.106ms - RowsReturned: 35.41K (35415) - RowsReturnedRate: 46.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.564us EXCHANGE_NODE (id=11):(Total: 54.897us, non-child: 54.897us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 39.599us - DeserializeRowBatchTimer: 22.122us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 755.874ms, non-child: 6.329ms, % non-child: 0.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 66.488us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 65.355us - GetNewBlockTime: 532.111us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.22 MB (13858208) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.439ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 48.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.633us EXCHANGE_NODE (id=10):(Total: 23.789us, non-child: 23.789us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 9.850us - DeserializeRowBatchTimer: 27.031us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 15.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 749.550ms, non-child: 15.971ms, % non-child: 2.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.678ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 582.290us - GetNewBlockTime: 442.993us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423712) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.387ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 48.42 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.070us EXCHANGE_NODE (id=9):(Total: 519.515us, non-child: 519.515us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 419.659us - DeserializeRowBatchTimer: 2.709ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 733.060ms, non-child: 733.060ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 28 Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 166.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 249.72 MB (261851037) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.72 MB (261851037) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.72 MB (261851037) - DecompressionTime: 825.371ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 234.24 MB (245621976) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.35M (36354601) - RowsReturned: 36.29K (36294) - RowsReturnedRate: 49.51 K/sec - ScanRangesComplete: 28 (28) - ScannerThreadsInvoluntaryContextSwitches: 810 (810) - ScannerThreadsTotalWallClockTime: 6s836ms - MaterializeTupleTime(*): 5s493ms - ScannerThreadsSysTime: 192.964ms - ScannerThreadsUserTime: 6s212ms - ScannerThreadsVoluntaryContextSwitches: 312 (312) - TotalRawHdfsReadTime(*): 203.058ms - TotalReadThroughput: 166.05 MB/sec Filter 0: - Rows processed: 458.72K (458724) - Rows rejected: 10.72K (10721) - Rows total: 458.75K (458752) Filter 1: - Files processed: 28 (28) - Files rejected: 0 (0) - Files total: 28 (28) - RowGroups processed: 69.92K (69924) - RowGroups rejected: 0 (0) - RowGroups total: 69.92K (69924) - Rows processed: 458.72K (458724) - Rows rejected: 0 (0) - Rows total: 458.75K (458752) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Filter 2: - Rows processed: 36.34M (36343880) - Rows rejected: 36.31M (36307586) - Rows total: 36.34M (36343880) Instance 2446072c3555a01d:8df23dc4d24842a4 (host=vb0216.halxg.cloudera.com:22000):(Total: 983.922ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Filter 0 arrival: 548ms Filter 1 arrival: 548ms Filter 2 arrival: 554ms MemoryUsage(500.000ms): 1.40 MB, 227.43 MB, 73.59 MB ThreadUsage(500.000ms): 1, 12, 4 - AverageThreadTokens: 5.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 266.26 MB (279195136) - PerHostPeakMemUsage: 271.53 MB (284720640) - PrepareTime: 162.132ms - RowsProduced: 564 (564) - TotalCpuTime: 7s413ms - TotalNetworkReceiveTime: 119.863us - TotalNetworkSendTime: 3.920ms - TotalStorageWaitTime: 312.323ms CodeGen:(Total: 533.166ms, non-child: 533.166ms, % non-child: 100.00%) - CodegenTime: 1.554ms - CompileTime: 100.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 279.571ms - PrepareTime: 152.025ms DataStreamSender (dst_id=12):(Total: 165.049us, non-child: 165.049us, % non-child: 100.00%) - BytesSent: 10.23 KB (10471) - NetworkThroughput(*): 3.14 MB/sec - OverallThroughput: 60.50 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 367.251us - ThriftTransmitTime(*): 3.179ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 973.688ms, non-child: 222.067ms, % non-child: 22.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 73.577us - GetResultsTime: 127.989us - HTResizeTime: 579.941us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.51 MB (19406880) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 579.00 /sec - StreamingTime: 70.282ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 751.620ms, non-child: 6.798ms, % non-child: 0.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.638us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 73.611us - GetNewBlockTime: 251.784us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.03 MB (18907168) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.791ms - RowsReturned: 34.17K (34170) - RowsReturnedRate: 45.46 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.716us EXCHANGE_NODE (id=11):(Total: 51.154us, non-child: 51.154us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.074us - DeserializeRowBatchTimer: 19.337us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 744.836ms, non-child: 6.426ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.119us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.044us - GetNewBlockTime: 319.172us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.37 MB (12968968) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.245ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 46.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.014us EXCHANGE_NODE (id=10):(Total: 33.674us, non-child: 33.674us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.858us - DeserializeRowBatchTimer: 19.081us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 738.416ms, non-child: 15.739ms, % non-child: 2.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.746ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.739us - GetNewBlockTime: 445.219us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.381ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 47.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.578us EXCHANGE_NODE (id=9):(Total: 578.157us, non-child: 578.157us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 446.000us - DeserializeRowBatchTimer: 2.098ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 722.098ms, non-child: 722.098ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 143.24 MB, 241.20 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 241.20 MB (252912121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.20 MB (252912121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.20 MB (252912121) - DecompressionTime: 763.841ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 248.14 MB (260189856) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.22M (35216777) - RowsReturned: 34.94K (34935) - RowsReturnedRate: 48.38 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 685 (685) - ScannerThreadsTotalWallClockTime: 6s343ms - MaterializeTupleTime(*): 5s135ms - ScannerThreadsSysTime: 230.960ms - ScannerThreadsUserTime: 5s753ms - ScannerThreadsVoluntaryContextSwitches: 292 (292) - TotalRawHdfsReadTime(*): 178.339ms - TotalReadThroughput: 160.80 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.71K (8711) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.65K (66653) - RowGroups rejected: 0 (0) - RowGroups total: 66.65K (66653) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.21M (35208066) - Rows rejected: 35.17M (35173131) - Rows total: 35.21M (35208066) Instance 2446072c3555a01d:8df23dc4d24842a6 (host=vb0232.halxg.cloudera.com:22000):(Total: 978.108ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Filter 0 arrival: 531ms Filter 1 arrival: 531ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 1.40 MB, 250.68 MB, 36.04 MB ThreadUsage(500.000ms): 1, 12, 2 - AverageThreadTokens: 5.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 291.21 MB (305358320) - PerHostPeakMemUsage: 296.48 MB (310883824) - PrepareTime: 146.676ms - RowsProduced: 564 (564) - TotalCpuTime: 6s987ms - TotalNetworkReceiveTime: 109.023us - TotalNetworkSendTime: 4.208ms - TotalStorageWaitTime: 369.222ms CodeGen:(Total: 517.424ms, non-child: 517.424ms, % non-child: 100.00%) - CodegenTime: 1.533ms - CompileTime: 101.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.092ms - PrepareTime: 136.926ms DataStreamSender (dst_id=12):(Total: 180.358us, non-child: 180.358us, % non-child: 100.00%) - BytesSent: 10.20 KB (10444) - NetworkThroughput(*): 2.97 MB/sec - OverallThroughput: 55.22 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 517.267us - ThriftTransmitTime(*): 3.348ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 967.479ms, non-child: 211.902ms, % non-child: 21.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.107us - GetResultsTime: 149.880us - HTResizeTime: 487.952us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.98 MB (18851792) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 582.00 /sec - StreamingTime: 75.171ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 755.577ms, non-child: 7.082ms, % non-child: 0.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 126.964us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.558us - GetNewBlockTime: 266.950us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.50 MB (18352080) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.934ms - RowsReturned: 37.49K (37489) - RowsReturnedRate: 49.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.263us EXCHANGE_NODE (id=11):(Total: 51.377us, non-child: 51.377us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.583us - DeserializeRowBatchTimer: 29.463us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 748.500ms, non-child: 6.798ms, % non-child: 0.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.518us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.441us - GetNewBlockTime: 340.096us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.58 MB (14243096) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.809ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 51.30 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.274us EXCHANGE_NODE (id=10):(Total: 33.217us, non-child: 33.217us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.198us - DeserializeRowBatchTimer: 15.721us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 741.708ms, non-child: 15.431ms, % non-child: 2.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.224ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 588.498us - GetNewBlockTime: 447.324us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424896) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.610ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 51.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.452us EXCHANGE_NODE (id=9):(Total: 520.188us, non-child: 520.188us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 399.194us - DeserializeRowBatchTimer: 2.284ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 725.756ms, non-child: 725.756ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 26 Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 191.52 MB, 266.22 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 266.22 MB (279156364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.22 MB (279156364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.22 MB (279156364) - DecompressionTime: 795.963ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 276.82 MB (290266328) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 38.86M (38856403) - RowsReturned: 38.40K (38397) - RowsReturnedRate: 52.91 K/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 778 (778) - ScannerThreadsTotalWallClockTime: 5s981ms - MaterializeTupleTime(*): 4s679ms - ScannerThreadsSysTime: 205.964ms - ScannerThreadsUserTime: 5s355ms - ScannerThreadsVoluntaryContextSwitches: 319 (319) - TotalRawHdfsReadTime(*): 204.966ms - TotalReadThroughput: 177.48 MB/sec Filter 0: - Rows processed: 425.96K (425958) - Rows rejected: 9.97K (9968) - Rows total: 425.98K (425984) Filter 1: - Files processed: 26 (26) - Files rejected: 0 (0) - Files total: 26 (26) - RowGroups processed: 73.27K (73267) - RowGroups rejected: 0 (0) - RowGroups total: 73.27K (73267) - Rows processed: 425.96K (425958) - Rows rejected: 0 (0) - Rows total: 425.98K (425984) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Filter 2: - Rows processed: 38.85M (38846435) - Rows rejected: 38.81M (38808038) - Rows total: 38.85M (38846435) Instance 2446072c3555a01d:8df23dc4d24842a1 (host=vb0226.halxg.cloudera.com:22000):(Total: 962.497ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Filter 0 arrival: 545ms Filter 1 arrival: 545ms Filter 2 arrival: 552ms MemoryUsage(500.000ms): 0, 2.90 MB, 222.14 MB ThreadUsage(500.000ms): 1, 1, 10 - AverageThreadTokens: 4.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 280.93 MB (294580552) - PerHostPeakMemUsage: 286.20 MB (300106056) - PrepareTime: 147.441ms - RowsProduced: 564 (564) - TotalCpuTime: 7s632ms - TotalNetworkReceiveTime: 68.074us - TotalNetworkSendTime: 5.008ms - TotalStorageWaitTime: 301.686ms CodeGen:(Total: 531.567ms, non-child: 531.567ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 100.599ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 292.786ms - PrepareTime: 137.068ms DataStreamSender (dst_id=12):(Total: 146.830us, non-child: 146.830us, % non-child: 100.00%) - BytesSent: 10.24 KB (10486) - NetworkThroughput(*): 2.71 MB/sec - OverallThroughput: 68.11 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 474.518us - ThriftTransmitTime(*): 3.690ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 951.113ms, non-child: 212.533ms, % non-child: 22.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 83.631us - GetResultsTime: 99.628us - HTResizeTime: 560.205us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 24.07 MB (25234016) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 592.00 /sec - StreamingTime: 76.412ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 738.579ms, non-child: 7.621ms, % non-child: 1.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 126.729us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 80.788us - GetNewBlockTime: 261.046us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 23.59 MB (24734304) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.329ms - RowsReturned: 37.92K (37916) - RowsReturnedRate: 51.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.982us EXCHANGE_NODE (id=11):(Total: 44.591us, non-child: 44.591us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 33.674us - DeserializeRowBatchTimer: 19.738us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 730.963ms, non-child: 7.393ms, % non-child: 1.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 46.817us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 60.988us - GetNewBlockTime: 198.240us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.81 MB (15531448) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.980ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 53.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.960us EXCHANGE_NODE (id=10):(Total: 21.116us, non-child: 21.116us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 10.005us - DeserializeRowBatchTimer: 44.265us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 17.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 723.574ms, non-child: 16.663ms, % non-child: 2.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.709ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 588.952us - GetNewBlockTime: 482.576us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.794ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 53.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.833us EXCHANGE_NODE (id=9):(Total: 628.129us, non-child: 628.129us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 538.875us - DeserializeRowBatchTimer: 3.729ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 706.282ms, non-child: 706.282ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 20 Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 266.65 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 266.65 MB (279605125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.65 MB (279605125) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.65 MB (279605125) - DecompressionTime: 826.361ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 255.96 MB (268393672) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 39.08M (39076470) - RowsReturned: 38.77K (38765) - RowsReturnedRate: 54.88 K/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 715 (715) - ScannerThreadsTotalWallClockTime: 6s561ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 187.966ms - ScannerThreadsUserTime: 6s013ms - ScannerThreadsVoluntaryContextSwitches: 289 (289) - TotalRawHdfsReadTime(*): 199.947ms - TotalReadThroughput: 266.65 MB/sec Filter 0: - Rows processed: 327.66K (327660) - Rows rejected: 7.68K (7682) - Rows total: 327.68K (327680) Filter 1: - Files processed: 20 (20) - Files rejected: 0 (0) - Files total: 20 (20) - RowGroups processed: 72.54K (72536) - RowGroups rejected: 0 (0) - RowGroups total: 72.54K (72536) - Rows processed: 327.66K (327660) - Rows rejected: 0 (0) - Rows total: 327.68K (327680) - Splits processed: 20 (20) - Splits rejected: 0 (0) - Splits total: 20 (20) Filter 2: - Rows processed: 39.07M (39068788) - Rows rejected: 39.03M (39030023) - Rows total: 39.07M (39068788) Instance 2446072c3555a01d:8df23dc4d24842ae (host=vb0220.halxg.cloudera.com:22000):(Total: 933.370ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Filter 0 arrival: 524ms Filter 1 arrival: 524ms Filter 2 arrival: 531ms MemoryUsage(500.000ms): 1.40 MB, 222.49 MB, 34.80 MB ThreadUsage(500.000ms): 1, 12, 2 - AverageThreadTokens: 5.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 273.42 MB (286697968) - PerHostPeakMemUsage: 278.69 MB (292223472) - PrepareTime: 142.895ms - RowsProduced: 564 (564) - TotalCpuTime: 6s774ms - TotalNetworkReceiveTime: 420.891us - TotalNetworkSendTime: 4.595ms - TotalStorageWaitTime: 243.409ms CodeGen:(Total: 510.527ms, non-child: 510.527ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 100.813ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 275.064ms - PrepareTime: 133.504ms DataStreamSender (dst_id=12):(Total: 133.680us, non-child: 133.680us, % non-child: 100.00%) - BytesSent: 10.15 KB (10390) - NetworkThroughput(*): 2.52 MB/sec - OverallThroughput: 74.12 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 431.489us - ThriftTransmitTime(*): 3.930ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 922.592ms, non-child: 197.648ms, % non-child: 21.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 54.836us - GetResultsTime: 107.993us - HTResizeTime: 340.894us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.44 MB (17242104) - PinTime: 0.000ns - ReductionFactorEstimate: 21.88 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 611.00 /sec - StreamingTime: 64.360ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 724.943ms, non-child: 6.246ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 136.358us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 82.683us - GetNewBlockTime: 179.852us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.97 MB (16742392) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.696ms - RowsReturned: 35.25K (35246) - RowsReturnedRate: 48.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.371us EXCHANGE_NODE (id=11):(Total: 384.120us, non-child: 384.120us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 17.574us - DeserializeRowBatchTimer: 18.189us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 2.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 718.699ms, non-child: 6.021ms, % non-child: 0.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.528us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 73.426us - GetNewBlockTime: 323.268us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.31 MB (12904232) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.394ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 50.21 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.121us EXCHANGE_NODE (id=10):(Total: 33.068us, non-child: 33.068us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.864us - DeserializeRowBatchTimer: 64.569us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 712.684ms, non-child: 16.206ms, % non-child: 2.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.663ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 583.760us - GetNewBlockTime: 414.830us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423352) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.264ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 50.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.365us EXCHANGE_NODE (id=9):(Total: 616.050us, non-child: 616.050us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 529.810us - DeserializeRowBatchTimer: 2.216ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 25.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 695.862ms, non-child: 695.862ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 22 Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:66 BytesRead(500.000ms): 0, 183.40 MB, 249.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 249.75 MB (261886383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.75 MB (261886383) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.75 MB (261886383) - DecompressionTime: 735.997ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 22 (22) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 259.27 MB (271864992) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.51M (36514470) - RowsReturned: 36.09K (36088) - RowsReturnedRate: 51.86 K/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 626 (626) - ScannerThreadsTotalWallClockTime: 5s691ms - MaterializeTupleTime(*): 4s599ms - ScannerThreadsSysTime: 169.970ms - ScannerThreadsUserTime: 5s235ms - ScannerThreadsVoluntaryContextSwitches: 288 (288) - TotalRawHdfsReadTime(*): 152.982ms - TotalReadThroughput: 166.50 MB/sec Filter 0: - Rows processed: 360.43K (360426) - Rows rejected: 8.50K (8503) - Rows total: 360.45K (360448) Filter 1: - Files processed: 22 (22) - Files rejected: 0 (0) - Files total: 22 (22) - RowGroups processed: 68.55K (68546) - RowGroups rejected: 0 (0) - RowGroups total: 68.55K (68546) - Rows processed: 360.43K (360426) - Rows rejected: 0 (0) - Rows total: 360.45K (360448) - Splits processed: 22 (22) - Splits rejected: 0 (0) - Splits total: 22 (22) Filter 2: - Rows processed: 36.51M (36505967) - Rows rejected: 36.47M (36469879) - Rows total: 36.51M (36505967) Instance 2446072c3555a01d:8df23dc4d24842ac (host=vb0228.halxg.cloudera.com:22000):(Total: 916.607ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Filter 0 arrival: 531ms Filter 1 arrival: 531ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 2.90 MB, 197.44 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 282.87 MB (296614488) - PerHostPeakMemUsage: 288.14 MB (302139992) - PrepareTime: 147.877ms - RowsProduced: 564 (564) - TotalCpuTime: 7s870ms - TotalNetworkReceiveTime: 61.359us - TotalNetworkSendTime: 4.598ms - TotalStorageWaitTime: 279.946ms CodeGen:(Total: 517.914ms, non-child: 517.914ms, % non-child: 100.00%) - CodegenTime: 1.492ms - CompileTime: 100.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.364ms - PrepareTime: 138.235ms DataStreamSender (dst_id=12):(Total: 187.819us, non-child: 187.819us, % non-child: 100.00%) - BytesSent: 10.14 KB (10384) - NetworkThroughput(*): 2.72 MB/sec - OverallThroughput: 52.73 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 414.566us - ThriftTransmitTime(*): 3.642ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 905.450ms, non-child: 219.281ms, % non-child: 24.22%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.333us - GetResultsTime: 173.257us - HTResizeTime: 605.695us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.31 MB (16051648) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 622.00 /sec - StreamingTime: 80.961ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 686.168ms, non-child: 6.729ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 129.231us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 70.706us - GetNewBlockTime: 639.569us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.83 MB (15551936) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.029ms - RowsReturned: 35.14K (35143) - RowsReturnedRate: 51.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.041us EXCHANGE_NODE (id=11):(Total: 47.487us, non-child: 47.487us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.142us - DeserializeRowBatchTimer: 20.007us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 679.442ms, non-child: 6.375ms, % non-child: 0.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.190us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.374us - GetNewBlockTime: 305.774us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.55 MB (14207336) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.607ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 53.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.929us EXCHANGE_NODE (id=10):(Total: 33.938us, non-child: 33.938us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.607us - DeserializeRowBatchTimer: 17.372us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 673.072ms, non-child: 16.606ms, % non-child: 2.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.782ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 585.224us - GetNewBlockTime: 501.073us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423808) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.148ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 53.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.847us EXCHANGE_NODE (id=9):(Total: 521.510us, non-child: 521.510us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 442.502us - DeserializeRowBatchTimer: 1.885ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 655.944ms, non-child: 655.944ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 243.13 MB - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 247.46 MB (259475640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 247.46 MB (259475640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 247.46 MB (259475640) - DecompressionTime: 796.148ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 268.86 MB (281923352) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.13M (36127075) - RowsReturned: 36.05K (36045) - RowsReturnedRate: 54.95 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 733 (733) - ScannerThreadsTotalWallClockTime: 6s838ms - MaterializeTupleTime(*): 5s619ms - ScannerThreadsSysTime: 192.966ms - ScannerThreadsUserTime: 6s318ms - ScannerThreadsVoluntaryContextSwitches: 409 (409) - TotalRawHdfsReadTime(*): 175.311ms - TotalReadThroughput: 243.13 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.24K (9240) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.21K (69208) - RowGroups rejected: 0 (0) - RowGroups total: 69.21K (69208) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.12M (36117835) - Rows rejected: 36.08M (36081790) - Rows total: 36.12M (36117835) Instance 2446072c3555a01d:8df23dc4d24842ab (host=vb0230.halxg.cloudera.com:22000):(Total: 890.438ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Filter 0 arrival: 548ms Filter 1 arrival: 548ms Filter 2 arrival: 553ms MemoryUsage(500.000ms): 2.20 MB, 269.89 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 284.52 MB (298344160) - PerHostPeakMemUsage: 289.79 MB (303869664) - PrepareTime: 146.244ms - RowsProduced: 564 (564) - TotalCpuTime: 7s361ms - TotalNetworkReceiveTime: 71.530us - TotalNetworkSendTime: 4.277ms - TotalStorageWaitTime: 292.534ms CodeGen:(Total: 534.264ms, non-child: 534.264ms, % non-child: 100.00%) - CodegenTime: 1.408ms - CompileTime: 104.871ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 291.841ms - PrepareTime: 136.458ms DataStreamSender (dst_id=12):(Total: 189.962us, non-child: 189.962us, % non-child: 100.00%) - BytesSent: 10.21 KB (10455) - NetworkThroughput(*): 2.84 MB/sec - OverallThroughput: 52.49 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 900.462us - ThriftTransmitTime(*): 3.515ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 879.027ms, non-child: 211.515ms, % non-child: 24.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.678us - GetResultsTime: 167.181us - HTResizeTime: 652.193us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.55 MB (18402920) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 641.00 /sec - StreamingTime: 74.863ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 667.511ms, non-child: 6.704ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 130.073us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.830us - GetNewBlockTime: 253.282us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.07 MB (17903208) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.870ms - RowsReturned: 36.23K (36234) - RowsReturnedRate: 54.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.001us EXCHANGE_NODE (id=11):(Total: 47.114us, non-child: 47.114us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.316us - DeserializeRowBatchTimer: 22.603us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 21.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 660.811ms, non-child: 6.310ms, % non-child: 0.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 101.530us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 37.053us - GetNewBlockTime: 340.068us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.61 MB (14271824) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.569ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 56.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.025us EXCHANGE_NODE (id=10):(Total: 35.162us, non-child: 35.162us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.305us - DeserializeRowBatchTimer: 14.119us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 654.507ms, non-child: 15.264ms, % non-child: 2.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.327ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 604.037us - GetNewBlockTime: 921.925us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424480) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.731ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 56.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.353us EXCHANGE_NODE (id=9):(Total: 357.820us, non-child: 357.820us, % non-child: 100.00%) BytesReceived(500.000ms): 296.18 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 281.386us - DeserializeRowBatchTimer: 2.629ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 43.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 638.884ms, non-child: 638.884ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 235.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 255.51 MB (267924888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 255.51 MB (267924888) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 255.51 MB (267924888) - DecompressionTime: 808.082ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 269.56 MB (282656760) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.34M (37340464) - RowsReturned: 37.12K (37122) - RowsReturnedRate: 58.10 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 691 (691) - ScannerThreadsTotalWallClockTime: 6s349ms - MaterializeTupleTime(*): 5s108ms - ScannerThreadsSysTime: 228.961ms - ScannerThreadsUserTime: 5s763ms - ScannerThreadsVoluntaryContextSwitches: 262 (262) - TotalRawHdfsReadTime(*): 200.593ms - TotalReadThroughput: 235.91 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8854) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 70.54K (70543) - RowGroups rejected: 0 (0) - RowGroups total: 70.54K (70543) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 37.33M (37331610) - Rows rejected: 37.29M (37294488) - Rows total: 37.33M (37331610) Instance 2446072c3555a01d:8df23dc4d24842a2 (host=vb0212.halxg.cloudera.com:22000):(Total: 889.971ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Filter 0 arrival: 528ms Filter 1 arrival: 528ms Filter 2 arrival: 533ms MemoryUsage(500.000ms): 0, 143.02 MB, 184.89 MB ThreadUsage(500.000ms): 1, 12, 10 - AverageThreadTokens: 7.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 263.83 MB (276644880) - PerHostPeakMemUsage: 269.10 MB (282170384) - PrepareTime: 143.712ms - RowsProduced: 564 (564) - TotalCpuTime: 7s531ms - TotalNetworkReceiveTime: 82.665us - TotalNetworkSendTime: 4.742ms - TotalStorageWaitTime: 324.632ms CodeGen:(Total: 513.644ms, non-child: 513.644ms, % non-child: 100.00%) - CodegenTime: 1.399ms - CompileTime: 102.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.740ms - PrepareTime: 133.856ms DataStreamSender (dst_id=12):(Total: 208.689us, non-child: 208.689us, % non-child: 100.00%) - BytesSent: 10.19 KB (10432) - NetworkThroughput(*): 2.90 MB/sec - OverallThroughput: 47.67 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 758.892us - ThriftTransmitTime(*): 3.434ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 878.462ms, non-child: 212.190ms, % non-child: 24.15%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 77.178us - GetResultsTime: 162.214us - HTResizeTime: 466.944us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.91 MB (19831504) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 642.00 /sec - StreamingTime: 78.462ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 666.271ms, non-child: 6.688ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.492us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.697us - GetNewBlockTime: 288.312us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.44 MB (19331792) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.743ms - RowsReturned: 34.89K (34892) - RowsReturnedRate: 52.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.260us EXCHANGE_NODE (id=11):(Total: 47.885us, non-child: 47.885us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.769us - DeserializeRowBatchTimer: 33.449us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 659.587ms, non-child: 6.459ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 50.163us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 38.161us - GetNewBlockTime: 256.394us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.76 MB (13381008) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.464ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 54.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.442us EXCHANGE_NODE (id=10):(Total: 26.837us, non-child: 26.837us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 13.333us - DeserializeRowBatchTimer: 91.382us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 653.134ms, non-child: 15.243ms, % non-child: 2.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.862ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 579.407us - GetNewBlockTime: 393.723us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422416) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.703ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 54.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.098us EXCHANGE_NODE (id=9):(Total: 417.989us, non-child: 417.989us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 322.913us - DeserializeRowBatchTimer: 1.962ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 36.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 637.472ms, non-child: 637.472ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 78.60 MB, 246.45 MB - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 246.45 MB (258419939) - BytesReadDataNodeCache: 0 - BytesReadLocal: 246.45 MB (258419939) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 246.45 MB (258419939) - DecompressionTime: 784.253ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 249.57 MB (261689136) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.95M (35950586) - RowsReturned: 35.71K (35706) - RowsReturnedRate: 56.01 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 748 (748) - ScannerThreadsTotalWallClockTime: 6s571ms - MaterializeTupleTime(*): 5s330ms - ScannerThreadsSysTime: 200.963ms - ScannerThreadsUserTime: 5s998ms - ScannerThreadsVoluntaryContextSwitches: 393 (393) - TotalRawHdfsReadTime(*): 184.764ms - TotalReadThroughput: 246.45 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.58K (9580) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.72K (68725) - RowGroups rejected: 0 (0) - RowGroups total: 68.72K (68725) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.94M (35941006) - Rows rejected: 35.91M (35905300) - Rows total: 35.94M (35941006) Instance 2446072c3555a01d:8df23dc4d24842aa (host=vb0208.halxg.cloudera.com:22000):(Total: 849.251ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Filter 0 arrival: 528ms Filter 1 arrival: 528ms Filter 2 arrival: 532ms MemoryUsage(500.000ms): 2.90 MB, 219.85 MB ThreadUsage(500.000ms): 1, 11 - AverageThreadTokens: 6.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 273.23 MB (286499032) - PerHostPeakMemUsage: 278.50 MB (292024536) - PrepareTime: 145.512ms - RowsProduced: 564 (564) - TotalCpuTime: 7s204ms - TotalNetworkReceiveTime: 59.323us - TotalNetworkSendTime: 3.662ms - TotalStorageWaitTime: 302.629ms CodeGen:(Total: 514.436ms, non-child: 514.436ms, % non-child: 100.00%) - CodegenTime: 1.538ms - CompileTime: 100.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.747ms - PrepareTime: 135.556ms DataStreamSender (dst_id=12):(Total: 152.250us, non-child: 152.250us, % non-child: 100.00%) - BytesSent: 10.17 KB (10409) - NetworkThroughput(*): 3.36 MB/sec - OverallThroughput: 65.20 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 463.549us - ThriftTransmitTime(*): 2.957ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 838.738ms, non-child: 214.259ms, % non-child: 25.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.590us - GetResultsTime: 157.149us - HTResizeTime: 672.436us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 24.18 MB (25352600) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 672.00 /sec - StreamingTime: 79.134ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 624.478ms, non-child: 7.382ms, % non-child: 1.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 136.924us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.166us - GetNewBlockTime: 244.409us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 23.70 MB (24852888) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.410ms - RowsReturned: 34.75K (34748) - RowsReturnedRate: 55.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.232us EXCHANGE_NODE (id=11):(Total: 53.127us, non-child: 53.127us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.824us - DeserializeRowBatchTimer: 19.663us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 617.102ms, non-child: 7.623ms, % non-child: 1.24%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 102.625us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 36.764us - GetNewBlockTime: 318.229us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.59 MB (15293776) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.594ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 57.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.973us EXCHANGE_NODE (id=10):(Total: 31.261us, non-child: 31.261us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.330us - DeserializeRowBatchTimer: 16.504us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 609.486ms, non-child: 14.903ms, % non-child: 2.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 2.936ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 585.793us - GetNewBlockTime: 674.379us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423112) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.463ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 58.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.264us EXCHANGE_NODE (id=9):(Total: 340.916us, non-child: 340.916us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 277.224us - DeserializeRowBatchTimer: 2.032ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 45.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 594.241ms, non-child: 594.241ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 245.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 245.67 MB (257601014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 245.67 MB (257601014) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 245.67 MB (257601014) - DecompressionTime: 777.031ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 258.65 MB (271213424) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.83M (35826899) - RowsReturned: 35.54K (35539) - RowsReturnedRate: 59.80 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 894 (894) - ScannerThreadsTotalWallClockTime: 6s263ms - MaterializeTupleTime(*): 5s046ms - ScannerThreadsSysTime: 181.965ms - ScannerThreadsUserTime: 5s698ms - ScannerThreadsVoluntaryContextSwitches: 479 (479) - TotalRawHdfsReadTime(*): 179.946ms - TotalReadThroughput: 245.67 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.64K (9639) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.33K (68331) - RowGroups rejected: 0 (0) - RowGroups total: 68.33K (68331) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.82M (35817260) - Rows rejected: 35.78M (35781721) - Rows total: 35.82M (35817260) Instance 2446072c3555a01d:8df23dc4d24842a3 (host=vb0218.halxg.cloudera.com:22000):(Total: 805.170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Filter 0 arrival: 532ms Filter 1 arrival: 532ms Filter 2 arrival: 538ms MemoryUsage(500.000ms): 2.10 MB, 226.49 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 270.30 MB (283434688) - PerHostPeakMemUsage: 275.57 MB (288960192) - PrepareTime: 146.308ms - RowsProduced: 564 (564) - TotalCpuTime: 7s018ms - TotalNetworkReceiveTime: 57.882us - TotalNetworkSendTime: 3.946ms - TotalStorageWaitTime: 343.979ms CodeGen:(Total: 517.992ms, non-child: 517.992ms, % non-child: 100.00%) - CodegenTime: 1.507ms - CompileTime: 101.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.759ms - PrepareTime: 136.632ms DataStreamSender (dst_id=12):(Total: 124.096us, non-child: 124.096us, % non-child: 100.00%) - BytesSent: 10.22 KB (10464) - NetworkThroughput(*): 3.09 MB/sec - OverallThroughput: 80.42 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 446.948us - ThriftTransmitTime(*): 3.227ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 795.189ms, non-child: 206.098ms, % non-child: 25.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56.441us - GetResultsTime: 95.744us - HTResizeTime: 496.807us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.80 MB (18668640) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 709.00 /sec - StreamingTime: 68.838ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 589.091ms, non-child: 6.907ms, % non-child: 1.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.191us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.028us - GetNewBlockTime: 290.589us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.33 MB (18168928) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.064ms - RowsReturned: 35.92K (35923) - RowsReturnedRate: 60.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.289us EXCHANGE_NODE (id=11):(Total: 52.995us, non-child: 52.995us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.586us - DeserializeRowBatchTimer: 20.160us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 18.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 582.190ms, non-child: 6.330ms, % non-child: 1.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.577us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 60.828us - GetNewBlockTime: 336.232us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.47 MB (13079616) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.645ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 63.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.732us EXCHANGE_NODE (id=10):(Total: 36.588us, non-child: 36.588us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 20.650us - DeserializeRowBatchTimer: 173.868us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 575.866ms, non-child: 16.180ms, % non-child: 2.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.990ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 596.609us - GetNewBlockTime: 445.910us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423648) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.484ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 63.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.072us EXCHANGE_NODE (id=9):(Total: 517.332us, non-child: 517.332us, % non-child: 100.00%) BytesReceived(500.000ms): 261.27 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 448.890us - DeserializeRowBatchTimer: 1.938ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 559.167ms, non-child: 559.167ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 235.86 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 253.98 MB (266317999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.98 MB (266317999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.98 MB (266317999) - DecompressionTime: 785.208ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 254.74 MB (267117464) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.08M (37077122) - RowsReturned: 36.82K (36819) - RowsReturnedRate: 65.85 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 945 (945) - ScannerThreadsTotalWallClockTime: 6s158ms - MaterializeTupleTime(*): 4s883ms - ScannerThreadsSysTime: 201.964ms - ScannerThreadsUserTime: 5s543ms - ScannerThreadsVoluntaryContextSwitches: 294 (294) - TotalRawHdfsReadTime(*): 199.493ms - TotalReadThroughput: 235.86 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.48K (9479) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.32K (70316) - RowGroups rejected: 0 (0) - RowGroups total: 70.32K (70316) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 37.07M (37067643) - Rows rejected: 37.03M (37030824) - Rows total: 37.07M (37067643) Instance 2446072c3555a01d:8df23dc4d24842af (host=vb0204.halxg.cloudera.com:22000):(Total: 793.904ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Filter 0 arrival: 545ms Filter 1 arrival: 545ms Filter 2 arrival: 552ms MemoryUsage(500.000ms): 1.40 MB, 225.97 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 261.39 MB (274086696) - PerHostPeakMemUsage: 266.67 MB (279620392) - PrepareTime: 153.850ms - RowsProduced: 564 (564) - TotalCpuTime: 6s661ms - TotalNetworkReceiveTime: 81.385us - TotalNetworkSendTime: 5.023ms - TotalStorageWaitTime: 328.948ms CodeGen:(Total: 530.279ms, non-child: 530.279ms, % non-child: 100.00%) - CodegenTime: 1.693ms - CompileTime: 102.073ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 283.338ms - PrepareTime: 143.806ms DataStreamSender (dst_id=12):(Total: 130.037us, non-child: 130.037us, % non-child: 100.00%) - BytesSent: 10.20 KB (10445) - NetworkThroughput(*): 2.32 MB/sec - OverallThroughput: 76.60 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 314.290us - ThriftTransmitTime(*): 4.289ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 780.807ms, non-child: 224.346ms, % non-child: 28.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 53.226us - GetResultsTime: 92.340us - HTResizeTime: 444.446us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.73 MB (19639616) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 722.00 /sec - StreamingTime: 80.765ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 556.460ms, non-child: 7.051ms, % non-child: 1.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 64.619us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 40.928us - GetNewBlockTime: 543.767us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139904) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.294ms - RowsReturned: 34.02K (34024) - RowsReturnedRate: 61.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.499us EXCHANGE_NODE (id=11):(Total: 29.881us, non-child: 29.881us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 19.587us - DeserializeRowBatchTimer: 19.539us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 33.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 549.415ms, non-child: 6.482ms, % non-child: 1.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.709us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 66.744us - GetNewBlockTime: 315.932us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.07 MB (13707040) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.579ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 63.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.729us EXCHANGE_NODE (id=10):(Total: 37.169us, non-child: 37.169us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 19.611us - DeserializeRowBatchTimer: 187.672us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 542.938ms, non-child: 18.707ms, % non-child: 3.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.843ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 851.738us - GetNewBlockTime: 496.035us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18421608) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.963ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 64.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.188us EXCHANGE_NODE (id=9):(Total: 653.592us, non-child: 653.592us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 550.915us - DeserializeRowBatchTimer: 2.166ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 523.577ms, non-child: 523.577ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 182.76 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 240.34 MB (252012000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.34 MB (252012000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.34 MB (252012000) - DecompressionTime: 743.553ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 245.20 MB (257111424) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35071902) - RowsReturned: 34.83K (34833) - RowsReturnedRate: 66.53 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 641 (641) - ScannerThreadsTotalWallClockTime: 5s791ms - MaterializeTupleTime(*): 4s581ms - ScannerThreadsSysTime: 204.964ms - ScannerThreadsUserTime: 5s198ms - ScannerThreadsVoluntaryContextSwitches: 543 (543) - TotalRawHdfsReadTime(*): 186.963ms - TotalReadThroughput: 182.76 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.09K (9094) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 67.12K (67125) - RowGroups rejected: 0 (0) - RowGroups total: 67.12K (67125) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35062808) - Rows rejected: 35.03M (35027975) - Rows total: 35.06M (35062808) Instance 2446072c3555a01d:8df23dc4d24842a9 (host=vb0234.halxg.cloudera.com:22000):(Total: 723.735ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Filter 0 arrival: 534ms Filter 1 arrival: 534ms Filter 2 arrival: 541ms MemoryUsage(500.000ms): 1.40 MB, 243.35 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 272.21 MB (285437904) - PerHostPeakMemUsage: 277.48 MB (290963408) - PrepareTime: 148.024ms - RowsProduced: 564 (564) - TotalCpuTime: 6s412ms - TotalNetworkReceiveTime: 125.969us - TotalNetworkSendTime: 3.555ms - TotalStorageWaitTime: 316.021ms CodeGen:(Total: 519.590ms, non-child: 519.590ms, % non-child: 100.00%) - CodegenTime: 1.526ms - CompileTime: 102.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.509ms - PrepareTime: 138.203ms DataStreamSender (dst_id=12):(Total: 173.353us, non-child: 173.353us, % non-child: 100.00%) - BytesSent: 10.14 KB (10382) - NetworkThroughput(*): 3.30 MB/sec - OverallThroughput: 57.11 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 535.835us - ThriftTransmitTime(*): 2.997ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 714.255ms, non-child: 216.918ms, % non-child: 30.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.836us - GetResultsTime: 139.587us - HTResizeTime: 573.272us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.51 MB (19411176) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 789.00 /sec - StreamingTime: 77.250ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 497.336ms, non-child: 6.731ms, % non-child: 1.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.892us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 70.582us - GetNewBlockTime: 238.960us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.04 MB (18911464) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.979ms - RowsReturned: 35.33K (35328) - RowsReturnedRate: 71.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.037us EXCHANGE_NODE (id=11):(Total: 49.837us, non-child: 49.837us, % non-child: 100.00%) BytesReceived(500.000ms): 8.12 KB, 8.12 KB - BytesReceived: 8.12 KB (8316) - ConvertRowBatchTime: 35.362us - DeserializeRowBatchTimer: 23.807us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 490.611ms, non-child: 6.325ms, % non-child: 1.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 87.578us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.685us - GetNewBlockTime: 317.574us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.13 MB (16911696) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.517ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 73.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.750us EXCHANGE_NODE (id=10):(Total: 33.421us, non-child: 33.421us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.114us - DeserializeRowBatchTimer: 19.031us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 484.293ms, non-child: 19.074ms, % non-child: 3.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.511ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.212ms - GetNewBlockTime: 483.932us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422424) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.631ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 74.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.148us EXCHANGE_NODE (id=9):(Total: 662.580us, non-child: 662.580us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 518.259us - DeserializeRowBatchTimer: 2.088ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 23.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 464.556ms, non-child: 464.556ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 27 Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:81 BytesRead(500.000ms): 0, 183.04 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 250.92 MB (263105410) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.92 MB (263105410) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.92 MB (263105410) - DecompressionTime: 751.900ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.79 MB (270307864) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.56M (36560874) - RowsReturned: 36.22K (36221) - RowsReturnedRate: 77.97 K/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 659 (659) - ScannerThreadsTotalWallClockTime: 5s603ms - MaterializeTupleTime(*): 4s380ms - ScannerThreadsSysTime: 201.964ms - ScannerThreadsUserTime: 5s037ms - ScannerThreadsVoluntaryContextSwitches: 567 (567) - TotalRawHdfsReadTime(*): 212.126ms - TotalReadThroughput: 183.04 MB/sec Filter 0: - Rows processed: 442.34K (442341) - Rows rejected: 10.49K (10491) - Rows total: 442.37K (442368) Filter 1: - Files processed: 27 (27) - Files rejected: 0 (0) - Files total: 27 (27) - RowGroups processed: 69.48K (69481) - RowGroups rejected: 0 (0) - RowGroups total: 69.48K (69481) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Filter 2: - Rows processed: 36.55M (36550383) - Rows rejected: 36.51M (36514162) - Rows total: 36.55M (36550383) Fragment F03: Instance 2446072c3555a01d:8df23dc4d24842b0 (host=vb0234.halxg.cloudera.com:22000):(Total: 164.799ms, non-child: 160.669ms, % non-child: 97.49%) Hdfs split stats (:<# splits>/): 5:1/88.92 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.91 MB (4099664) - PrepareTime: 89.924us - RowsProduced: 1.00K (1002) - TotalCpuTime: 9.757ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 156.534ms - TotalStorageWaitTime: 3.355ms DataStreamSender (dst_id=11):(Total: 183.523us, non-child: 183.523us, % non-child: 100.00%) - BytesSent: 121.82 KB (124740) - NetworkThroughput(*): 57.81 KB/sec - OverallThroughput: 648.21 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 64.034us - ThriftTransmitTime(*): 2s106ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 3.946ms, non-child: 3.946ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.358us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 2.25 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 253.93 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.699ms - MaterializeTupleTime(*): 46.244us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 39.928us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 2446072c3555a01d:8df23dc4d24842b1 (host=vb0226.halxg.cloudera.com:22000):(Total: 164.642ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/2.17 MB MemoryUsage(500.000ms): 0 ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.03 MB (5271680) - PrepareTime: 138.246ms - RowsProduced: 365 (365) - TotalCpuTime: 389.989ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 79.386us - TotalStorageWaitTime: 6.663ms CodeGen:(Total: 343.987ms, non-child: 343.987ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.358ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 201.813ms - PrepareTime: 134.850ms DataStreamSender (dst_id=10):(Total: 110.879us, non-child: 110.879us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 11.69 MB/sec - OverallThroughput: 387.69 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 33.122us - ThriftTransmitTime(*): 3.675ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 298.363ms, non-child: 298.363ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 193.057us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 506.42 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.22 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 21.748ms - MaterializeTupleTime(*): 13.324ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.997ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 926.528us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 2446072c3555a01d:8df23dc4d24842b2 (host=vb0230.halxg.cloudera.com:22000):(Total: 249.095ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/28.28 MB MemoryUsage(500.000ms): 5.15 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.42 MB (10929888) - PrepareTime: 142.566ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 550.574ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 840.461us - TotalStorageWaitTime: 11.720ms CodeGen:(Total: 352.059ms, non-child: 352.059ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 200.743ms - PrepareTime: 139.919ms DataStreamSender (dst_id=9):(Total: 6.170ms, non-child: 6.170ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 61.03 MB/sec - OverallThroughput: 1.42 GB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 4.574ms - ThriftTransmitTime(*): 146.941ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 381.312ms, non-child: 381.312ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 2.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 3.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 734.81 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 40.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 101.456ms - MaterializeTupleTime(*): 82.233ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 86.986ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 3.325ms - TotalReadThroughput: 4.89 MB/sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 14:MERGING-EXCHANGE | 1 | 567.79us | 0ns | 567.79us | 564 | 100 | | 08:TOP-N | 15 | 358.25us | 0ns | 416.54us | 564 | 100 | | 13:AGGREGATE | 15 | 145.75ms | 0ns | 152.60ms | 564 | 3.83K | | 12:EXCHANGE | 15 | 236.91us | 0ns | 504.95us | 8.32K | 3.83K | | 07:AGGREGATE | 15 | 213.89ms | 0ns | 225.32ms | 8.32K | 3.83K | | 06:HASH JOIN | 15 | 6.89ms | 0ns | 7.53ms | 530.08K | 4.27K | | |--11:EXCHANGE | 15 | 46.83us | 0ns | 52.55us | 15.03K | 1.00K | | | 03:SCAN HDFS | 1 | 4.77ms | 0ns | 4.77ms | 1.00K | 1.00K | | 05:HASH JOIN | 15 | 6.67ms | 0ns | 7.33ms | 542.77K | 4.27K | | |--10:EXCHANGE | 15 | 33.45us | 0ns | 45.16us | 5.47K | 114 | | | 02:SCAN HDFS | 1 | 304.49ms | 0ns | 304.49ms | 365 | 114 | | 04:HASH JOIN | 15 | 17.07ms | 0ns | 22.10ms | 542.77K | 68.35K | | |--09:EXCHANGE | 15 | 542.78us | 0ns | 739.38us | 231.09K | 38 | | | 00:SCAN HDFS | 1 | 365.40ms | 0ns | 365.40ms | 15.41K | 38 | | 01:SCAN HDFS | 15 | 644.28ms | 0ns | 739.11ms | 542.77K | 547.13M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=3846c6b477d7d4bf:1d465c4a3debf4a3): Summary: Session ID: f44ff1bdad1ab62a:820986ab40d2cea0 Session Type: BEESWAX Start Time: 2016-04-21 10:56:14.461701000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build 74b45794d2a0f4a459f604ddbc4964685437b0ff) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:46269 Default Db: tpcds_1000_parquet Sql Statement: select * from (select i_manufact_id, sum(ss_sales_price) sum_sales -- avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales from item, store_sales, date_dim, store where ss_item_sk = i_item_sk and ss_sold_date_sk = d_date_sk and ss_store_sk = s_store_sk and d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11) and ((i_category in ('Books', 'Children', 'Electronics') and i_class in ('personal', 'portable', 'reference', 'self-help') and i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) or (i_category in ('Women', 'Music', 'Men') and i_class in ('accessories', 'classical', 'fragrances', 'pants') and i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) and ss_sold_date_sk between 2451911 and 2452275 -- partition key filter group by i_manufact_id, d_qoy ) tmp1 -- where -- case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1 order by -- avg_quarterly_sales, sum_sales, i_manufact_id limit 100 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=284.01MB VCores=4 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum_sales ASC, i_manufact_id ASC | limit: 100 | hosts=15 per-host-mem=unavailable | tuple-ids=6 row-size=12B cardinality=100 | 08:TOP-N [LIMIT=100] | order by: sum_sales ASC, i_manufact_id ASC | hosts=15 per-host-mem=1.17KB | tuple-ids=6 row-size=12B cardinality=100 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 12:EXCHANGE [HASH(i_manufact_id,d_qoy)] | hosts=15 per-host-mem=0B | tuple-ids=4 row-size=16B cardinality=3828 | 07:AGGREGATE [STREAMING] | output: sum(ss_sales_price) | group by: i_manufact_id, d_qoy | hosts=15 per-host-mem=10.00MB | tuple-ids=4 row-size=16B cardinality=3828 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | hosts=15 per-host-mem=4.31KB | tuple-ids=1,0,2,3 row-size=130B cardinality=4272 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=4B cardinality=1002 | | | 03:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=88.92KB | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=3 row-size=4B cardinality=1002 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF001 <- d_date_sk | hosts=15 per-host-mem=1.47KB | tuple-ids=1,0,2 row-size=126B cardinality=4272 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=12B cardinality=114 | | | 02:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_month_seq IN (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11), tpcds_1000_parquet.date_dim.d_date_sk >= 2451911, tpcds_1000_parquet.date_dim.d_date_sk <= 2452275 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=12B cardinality=114 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF002 <- i_item_sk | hosts=15 per-host-mem=3.67KB | tuple-ids=1,0 row-size=114B cardinality=68346 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=0 row-size=90B cardinality=38 | | | 00:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=28.28MB | predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1'))) | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=200.00MB | tuple-ids=0 row-size=90B cardinality=38 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=364/1824 files=364 size=28.61GB runtime filters: RF000 -> ss_store_sk, RF001 -> ss_sold_date_sk, RF002 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=15 per-host-mem=264.00MB tuple-ids=1 row-size=24B cardinality=547125024 ---------------- Estimated Per-Host Mem: 297805251 Estimated Per-Host VCores: 4 Request Pool: default-pool Planner Timeline: 38.019ms - Analysis finished: 5.589ms (5.589ms) - Equivalence classes computed: 5.992ms (402.289us) - Single node plan created: 15.056ms (9.064ms) - Runtime filters computed: 15.439ms (383.642us) - Distributed plan created: 26.772ms (11.332ms) - Lineage info computed: 29.060ms (2.287ms) - Planning finished: 38.019ms (8.959ms) Query Timeline: 1s537ms - Start execution: 138.743us (138.743us) - Planning finished: 49.678ms (49.539ms) - Ready to start 33 remote fragments: 55.965ms (6.286ms) - All 33 remote fragments started: 82.317ms (26.352ms) - Rows available: 1s460ms (1s378ms) - First row fetched: 1s498ms (38.564ms) ImpalaServer: - ClientFetchWaitTimer: 39.335ms - RowMaterializationTimer: 1.166ms Execution Profile 3846c6b477d7d4bf:1d465c4a3debf4a3:(Total: 1s414ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Fragment start latencies: Count: 33, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 8ms, 90th %-ile: 8ms, 95th %-ile: 8ms, 99.9th %-ile: 16ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter ------------------------------------------------------------ 2 4 1 15 LOCAL false 1 5 1 15 LOCAL true 0 6 1 15 LOCAL false Per Node Peak Memory Usage: vb0220.halxg.cloudera.com:22000(270.09 MB) vb0206.halxg.cloudera.com:22000(301.84 MB) vb0228.halxg.cloudera.com:22000(268.03 MB) vb0230.halxg.cloudera.com:22000(299.12 MB) vb0208.halxg.cloudera.com:22000(272.47 MB) vb0234.halxg.cloudera.com:22000(259.64 MB) vb0224.halxg.cloudera.com:22000(257.34 MB) vb0222.halxg.cloudera.com:22000(301.71 MB) vb0232.halxg.cloudera.com:22000(293.90 MB) vb0214.halxg.cloudera.com:22000(267.04 MB) vb0216.halxg.cloudera.com:22000(278.93 MB) vb0218.halxg.cloudera.com:22000(274.44 MB) vb0212.halxg.cloudera.com:22000(272.21 MB) vb0226.halxg.cloudera.com:22000(306.33 MB) vb0204.halxg.cloudera.com:22000(256.38 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F05:(Total: 1s375ms, non-child: 1.194ms, % non-child: 0.09%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.41 KB (74144) - PerHostPeakMemUsage: 0 - PrepareTime: 183.227us - RowsProduced: 100 (100) - TotalCpuTime: 1s445ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=14):(Total: 1s374ms, non-child: 567.789us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 10.26 KB (10505) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 191.322us - FirstBatchArrivalWaitTime: 1s374ms - MergeGetNext: 428.400us - MergeGetNextBatch: 130.854us - PeakMemoryUsage: 0 - RowsReturned: 564 (564) - RowsReturnedRate: 410.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1s392ms max:1s402ms mean: 1s397ms stddev:3.352ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450009) - PerHostPeakMemUsage: 278.63 MB (292166675) - PrepareTime: 144.277ms - RowsProduced: 37 (37) - TotalCpuTime: 382.753ms - TotalNetworkReceiveTime: 1s013ms - TotalNetworkSendTime: 372.257us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 143 (143) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 375.205ms, non-child: 375.205ms, % non-child: 100.00%) - CodegenTime: 1.777ms - CompileTime: 20.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.311ms - PrepareTime: 140.953ms DataStreamSender (dst_id=14):(Total: 99.606us, non-child: 99.606us, % non-child: 100.00%) - BytesSent: 700.00 B (700) - NetworkThroughput(*): 3.20 MB/sec - OverallThroughput: 8.28 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 77.233us - ThriftTransmitTime(*): 216.486us - UncompressedRowBatchSize: 756.00 B (756) SORT_NODE (id=8):(Total: 1s159ms, non-child: 358.246us, % non-child: 0.03%) - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec AGGREGATION_NODE (id=13):(Total: 1s158ms, non-child: 145.745ms, % non-child: 12.58%) - BuildTime: 111.530us - GetNewBlockTime: 101.245us - GetResultsTime: 69.293us - HTResizeTime: 2.973us - HashBuckets: 15.02K (15018) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.536us EXCHANGE_NODE (id=12):(Total: 1s013ms, non-child: 1s013ms, % non-child: 100.00%) - BytesReceived: 10.02 KB (10263) - ConvertRowBatchTime: 57.382us - DeserializeRowBatchTimer: 193.378us - FirstBatchArrivalWaitTime: 854.102ms - PeakMemoryUsage: 0 - RowsReturned: 554 (554) - RowsReturnedRate: 547.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 900.434ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.83 GB, max: 2.04 GB, avg: 1.91 GB, stddev: 64.79 MB completion times: min:1s225ms max:1s385ms mean: 1s288ms stddev:49.067ms execution rates: min:1.35 GB/sec max:1.58 GB/sec mean:1.48 GB/sec stddev:69.09 MB/sec num instances: 15 - AverageThreadTokens: 6.24 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 273.36 MB (286640625) - PerHostPeakMemUsage: 278.63 MB (292166675) - PrepareTime: 147.394ms - RowsProduced: 554 (554) - TotalCpuTime: 7s062ms - TotalNetworkReceiveTime: 75.264us - TotalNetworkSendTime: 4.380ms - TotalStorageWaitTime: 302.182ms CodeGen:(Total: 522.148ms, non-child: 522.148ms, % non-child: 100.00%) - CodegenTime: 1.503ms - CompileTime: 102.135ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 281.282ms - PrepareTime: 137.667ms DataStreamSender (dst_id=12):(Total: 179.051us, non-child: 179.051us, % non-child: 100.00%) - BytesSent: 10.02 KB (10263) - NetworkThroughput(*): 2.90 MB/sec - OverallThroughput: 56.27 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 530.695us - ThriftTransmitTime(*): 3.447ms - UncompressedRowBatchSize: 15.22 KB (15588) AGGREGATION_NODE (id=7):(Total: 889.320ms, non-child: 213.886ms, % non-child: 24.05%) - GetNewBlockTime: 64.485us - GetResultsTime: 169.338us - HTResizeTime: 530.831us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.33 MB (18175371) - PinTime: 0.000ns - ReductionFactorEstimate: 2.94 - ReductionFactorThresholdToExpand: 0.15 - RowsPassedThrough: 0 (0) - RowsReturned: 554 (554) - RowsReturnedRate: 624.00 /sec - StreamingTime: 76.142ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 675.434ms, non-child: 6.889ms, % non-child: 1.02%) - BuildPartitionTime: 145.247us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.381us - GetNewBlockTime: 280.050us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.86 MB (17675659) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.115ms - RowsReturned: 35.34K (35338) - RowsReturnedRate: 52.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.172us EXCHANGE_NODE (id=11):(Total: 46.833us, non-child: 46.833us, % non-child: 100.00%) - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 33.569us - DeserializeRowBatchTimer: 30.434us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 668.550ms, non-child: 6.666ms, % non-child: 1.00%) - BuildPartitionTime: 89.126us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 61.945us - GetNewBlockTime: 315.669us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.91 MB (14588337) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.668ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 54.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.988us EXCHANGE_NODE (id=10):(Total: 33.453us, non-child: 33.453us, % non-child: 100.00%) - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.699us - DeserializeRowBatchTimer: 31.348us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 661.889ms, non-child: 17.068ms, % non-child: 2.58%) - BuildPartitionTime: 4.836ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 799.774us - GetNewBlockTime: 499.190us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423057) - PinTime: 0.000ns - ProbeRows: 36.18K (36184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.997ms - RowsReturned: 36.18K (36184) - RowsReturnedRate: 54.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.574us EXCHANGE_NODE (id=9):(Total: 542.783us, non-child: 542.783us, % non-child: 100.00%) - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 452.620us - DeserializeRowBatchTimer: 2.346ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 30.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 644.278ms, non-child: 644.278ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 9.70 - BytesRead: 249.86 MB (262000780) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.86 MB (262000780) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.86 MB (262000780) - DecompressionTime: 765.625ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 257.04 MB (269527178) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.48M (36475001) - RowsReturned: 36.18K (36184) - RowsReturnedRate: 56.47 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 685 (685) - ScannerThreadsTotalWallClockTime: 6s062ms - MaterializeTupleTime(*): 4s866ms - ScannerThreadsSysTime: 199.564ms - ScannerThreadsUserTime: 5s512ms - ScannerThreadsVoluntaryContextSwitches: 362 (362) - TotalRawHdfsReadTime(*): 181.070ms - TotalReadThroughput: 202.35 MB/sec Filter 0: - Rows processed: 397.56K (397560) - Rows rejected: 9.32K (9318) - Rows total: 397.58K (397585) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.15K (69146) - RowGroups rejected: 0 (0) - RowGroups total: 69.15K (69146) - Rows processed: 397.56K (397560) - Rows rejected: 0 (0) - Rows total: 397.58K (397585) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.47M (36465683) - Rows rejected: 36.43M (36429498) - Rows total: 36.47M (36465683) Averaged Fragment F03:(Total: 152.379ms, non-child: 147.375ms, % non-child: 96.72%) split sizes: min: 88.92 KB, max: 88.92 KB, avg: 88.92 KB, stddev: 0 completion times: min:154.219ms max:154.219ms mean: 154.219ms stddev:0.000ns execution rates: min:576.59 KB/sec max:576.59 KB/sec mean:576.59 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.82 MB (4009632) - PrepareTime: 121.624us - RowsProduced: 1.00K (1002) - TotalCpuTime: 11.658ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 142.632ms - TotalStorageWaitTime: 3.995ms DataStreamSender (dst_id=11):(Total: 235.239us, non-child: 235.239us, % non-child: 100.00%) - BytesSent: 150.63 KB (154245) - NetworkThroughput(*): 75.04 KB/sec - OverallThroughput: 625.32 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 70.439us - ThriftTransmitTime(*): 2s007ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 4.769ms, non-child: 4.769ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.342us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 210.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.486ms - MaterializeTupleTime(*): 46.922us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 48.786us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 168.018ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:383.021ms max:383.021ms mean: 383.021ms stddev:0.000ns execution rates: min:5.66 MB/sec max:5.66 MB/sec mean:5.66 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.23 MB (5479064) - PrepareTime: 140.954ms - RowsProduced: 365 (365) - TotalCpuTime: 397.233ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.219us - TotalStorageWaitTime: 7.686ms CodeGen:(Total: 350.855ms, non-child: 350.855ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 205.734ms - PrepareTime: 137.500ms DataStreamSender (dst_id=10):(Total: 120.124us, non-child: 120.124us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 14.45 MB/sec - OverallThroughput: 357.85 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 34.232us - ThriftTransmitTime(*): 2.974ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 304.486ms, non-child: 304.486ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 186.133us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 406.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 22.464ms - MaterializeTupleTime(*): 12.830ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.997ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 1.153ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 239.856ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 28.28 MB, max: 28.28 MB, avg: 28.28 MB, stddev: 0 completion times: min:453.835ms max:453.835ms mean: 453.835ms stddev:0.000ns execution rates: min:62.32 MB/sec max:62.32 MB/sec mean:62.32 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.42 MB (10929888) - PrepareTime: 139.727ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 538.186ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 804.901us - TotalStorageWaitTime: 9.341ms CodeGen:(Total: 350.080ms, non-child: 350.080ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 201.461ms - PrepareTime: 137.200ms DataStreamSender (dst_id=9):(Total: 10.181ms, non-child: 10.181ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 63.40 MB/sec - OverallThroughput: 880.84 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 7.967ms - ThriftTransmitTime(*): 141.464ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 365.395ms, non-child: 365.395ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.185ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 977.63 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.16 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 94.937ms - MaterializeTupleTime(*): 79.357ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 84.987ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 2.499ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 3846c6b477d7d4bf:1d465c4a3debf4b2 (host=vb0220.halxg.cloudera.com:22000):(Total: 1s195ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450048) - PerHostPeakMemUsage: 270.09 MB (283213256) - PrepareTime: 130.670ms - RowsProduced: 40 (40) - TotalCpuTime: 338.199ms - TotalNetworkReceiveTime: 1s060ms - TotalNetworkSendTime: 368.551us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 143 (143) - BlocksRecycled: 17 (17) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 332.345ms, non-child: 332.345ms, % non-child: 100.00%) - CodegenTime: 1.603ms - CompileTime: 17.793ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 185.767ms - PrepareTime: 127.717ms DataStreamSender (dst_id=14):(Total: 134.553us, non-child: 134.553us, % non-child: 100.00%) - BytesSent: 736.00 B (736) - NetworkThroughput(*): 2.40 MB/sec - OverallThroughput: 5.22 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 116.147us - ThriftTransmitTime(*): 292.540us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s193ms, non-child: 391.803us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 33.00 /sec AGGREGATION_NODE (id=13):(Total: 1s193ms, non-child: 132.223ms, % non-child: 11.08%) ExecOption: Codegen Enabled - BuildTime: 100.884us - GetNewBlockTime: 83.949us - GetResultsTime: 60.294us - HTResizeTime: 3.256us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 33.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.324us EXCHANGE_NODE (id=12):(Total: 1s060ms, non-child: 242.505us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 10.58 KB (10834) - ConvertRowBatchTime: 54.535us - DeserializeRowBatchTimer: 111.624us - FirstBatchArrivalWaitTime: 900.700ms - PeakMemoryUsage: 0 - RowsReturned: 590 (590) - RowsReturnedRate: 556.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4b0 (host=vb0228.halxg.cloudera.com:22000):(Total: 1s193ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449968) - PerHostPeakMemUsage: 268.03 MB (281051672) - PrepareTime: 129.337ms - RowsProduced: 35 (35) - TotalCpuTime: 336.531ms - TotalNetworkReceiveTime: 1s061ms - TotalNetworkSendTime: 525.271us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 331.768ms, non-child: 331.768ms, % non-child: 100.00%) - CodegenTime: 1.565ms - CompileTime: 17.528ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 186.736ms - PrepareTime: 126.348ms DataStreamSender (dst_id=14):(Total: 95.869us, non-child: 95.869us, % non-child: 100.00%) - BytesSent: 648.00 B (648) - NetworkThroughput(*): 3.94 MB/sec - OverallThroughput: 6.45 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 78.439us - ThriftTransmitTime(*): 156.967us - UncompressedRowBatchSize: 704.00 B (704) SORT_NODE (id=8):(Total: 1s192ms, non-child: 264.097us, % non-child: 0.02%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 35 (35) - RowsReturnedRate: 29.00 /sec AGGREGATION_NODE (id=13):(Total: 1s191ms, non-child: 130.354ms, % non-child: 10.94%) ExecOption: Codegen Enabled - BuildTime: 87.817us - GetNewBlockTime: 88.137us - GetResultsTime: 29.993us - HTResizeTime: 2.611us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 29.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.212us EXCHANGE_NODE (id=12):(Total: 1s061ms, non-child: 178.761us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 7.58 KB - BytesReceived: 9.50 KB (9730) - ConvertRowBatchTime: 46.650us - DeserializeRowBatchTimer: 144.940us - FirstBatchArrivalWaitTime: 901.442ms - PeakMemoryUsage: 0 - RowsReturned: 519 (519) - RowsReturnedRate: 488.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4b1 (host=vb0206.halxg.cloudera.com:22000):(Total: 1s164ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.29 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450000) - PerHostPeakMemUsage: 301.84 MB (316504752) - PrepareTime: 147.377ms - RowsProduced: 37 (37) - TotalCpuTime: 385.011ms - TotalNetworkReceiveTime: 1s013ms - TotalNetworkSendTime: 389.788us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.727ms, non-child: 378.727ms, % non-child: 100.00%) - CodegenTime: 1.837ms - CompileTime: 20.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.046ms - PrepareTime: 143.991ms DataStreamSender (dst_id=14):(Total: 96.163us, non-child: 96.163us, % non-child: 100.00%) - BytesSent: 693.00 B (693) - NetworkThroughput(*): 1.99 MB/sec - OverallThroughput: 6.87 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 76.594us - ThriftTransmitTime(*): 332.695us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s163ms, non-child: 338.235us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec AGGREGATION_NODE (id=13):(Total: 1s162ms, non-child: 149.034ms, % non-child: 12.81%) ExecOption: Codegen Enabled - BuildTime: 91.772us - GetNewBlockTime: 95.917us - GetResultsTime: 32.470us - HTResizeTime: 3.720us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.548us EXCHANGE_NODE (id=12):(Total: 1s013ms, non-child: 231.212us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 2.54 KB - BytesReceived: 9.87 KB (10106) - ConvertRowBatchTime: 55.492us - DeserializeRowBatchTimer: 129.270us - FirstBatchArrivalWaitTime: 853.853ms - PeakMemoryUsage: 0 - RowsReturned: 547 (547) - RowsReturnedRate: 539.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4b3 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s164ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450096) - PerHostPeakMemUsage: 256.38 MB (268833808) - PrepareTime: 150.658ms - RowsProduced: 43 (43) - TotalCpuTime: 390.914ms - TotalNetworkReceiveTime: 1s008ms - TotalNetworkSendTime: 284.670us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 381.646ms, non-child: 381.646ms, % non-child: 100.00%) - CodegenTime: 2.053ms - CompileTime: 20.234ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.661ms - PrepareTime: 146.550ms DataStreamSender (dst_id=14):(Total: 46.166us, non-child: 46.166us, % non-child: 100.00%) - BytesSent: 784.00 B (784) - NetworkThroughput(*): 3.46 MB/sec - OverallThroughput: 16.20 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 25.017us - ThriftTransmitTime(*): 215.999us - UncompressedRowBatchSize: 864.00 B (864) SORT_NODE (id=8):(Total: 1s162ms, non-child: 416.539us, % non-child: 0.04%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 43 (43) - RowsReturnedRate: 37.00 /sec AGGREGATION_NODE (id=13):(Total: 1s161ms, non-child: 152.595ms, % non-child: 13.14%) ExecOption: Codegen Enabled - BuildTime: 69.151us - GetNewBlockTime: 124.312us - GetResultsTime: 72.638us - HTResizeTime: 1.866us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 37.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.892us EXCHANGE_NODE (id=12):(Total: 1s009ms, non-child: 217.079us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 11.47 KB (11741) - ConvertRowBatchTime: 58.211us - DeserializeRowBatchTimer: 533.183us - FirstBatchArrivalWaitTime: 848.865ms - PeakMemoryUsage: 0 - RowsReturned: 637 (637) - RowsReturnedRate: 631.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4ac (host=vb0224.halxg.cloudera.com:22000):(Total: 1s161ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 257.34 MB (269836616) - PrepareTime: 145.495ms - RowsProduced: 33 (33) - TotalCpuTime: 382.822ms - TotalNetworkReceiveTime: 1s012ms - TotalNetworkSendTime: 664.875us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 376.984ms, non-child: 376.984ms, % non-child: 100.00%) - CodegenTime: 1.745ms - CompileTime: 20.107ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.488ms - PrepareTime: 142.247ms DataStreamSender (dst_id=14):(Total: 104.131us, non-child: 104.131us, % non-child: 100.00%) - BytesSent: 629.00 B (629) - NetworkThroughput(*): 3.13 MB/sec - OverallThroughput: 5.76 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 87.292us - ThriftTransmitTime(*): 191.499us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s160ms, non-child: 315.954us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 28.00 /sec AGGREGATION_NODE (id=13):(Total: 1s159ms, non-child: 146.721ms, % non-child: 12.65%) ExecOption: Codegen Enabled - BuildTime: 53.539us - GetNewBlockTime: 108.866us - GetResultsTime: 320.501us - HTResizeTime: 1.498us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 28.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.727us EXCHANGE_NODE (id=12):(Total: 1s012ms, non-child: 168.846us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 8.84 KB (9053) - ConvertRowBatchTime: 42.401us - DeserializeRowBatchTimer: 301.403us - FirstBatchArrivalWaitTime: 854.280ms - PeakMemoryUsage: 0 - RowsReturned: 484 (484) - RowsReturnedRate: 477.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4ab (host=vb0222.halxg.cloudera.com:22000):(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449936) - PerHostPeakMemUsage: 301.71 MB (316361752) - PrepareTime: 146.901ms - RowsProduced: 33 (33) - TotalCpuTime: 384.497ms - TotalNetworkReceiveTime: 1s009ms - TotalNetworkSendTime: 317.381us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 378.929ms, non-child: 378.929ms, % non-child: 100.00%) - CodegenTime: 1.716ms - CompileTime: 20.060ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.031ms - PrepareTime: 143.648ms DataStreamSender (dst_id=14):(Total: 91.982us, non-child: 91.982us, % non-child: 100.00%) - BytesSent: 621.00 B (621) - NetworkThroughput(*): 2.68 MB/sec - OverallThroughput: 6.44 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 72.750us - ThriftTransmitTime(*): 221.264us - UncompressedRowBatchSize: 664.00 B (664) SORT_NODE (id=8):(Total: 1s158ms, non-child: 328.464us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 33 (33) - RowsReturnedRate: 28.00 /sec AGGREGATION_NODE (id=13):(Total: 1s157ms, non-child: 147.872ms, % non-child: 12.77%) ExecOption: Codegen Enabled - BuildTime: 85.246us - GetNewBlockTime: 95.666us - GetResultsTime: 31.090us - HTResizeTime: 3.425us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 28.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.823us EXCHANGE_NODE (id=12):(Total: 1s010ms, non-child: 223.709us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 6.50 KB - BytesReceived: 8.91 KB (9125) - ConvertRowBatchTime: 57.227us - DeserializeRowBatchTimer: 127.289us - FirstBatchArrivalWaitTime: 851.593ms - PeakMemoryUsage: 0 - RowsReturned: 488 (488) - RowsReturnedRate: 483.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4a9 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s158ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450000) - PerHostPeakMemUsage: 267.04 MB (280011728) - PrepareTime: 147.645ms - RowsProduced: 37 (37) - TotalCpuTime: 386.401ms - TotalNetworkReceiveTime: 1s007ms - TotalNetworkSendTime: 267.411us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.460ms, non-child: 380.460ms, % non-child: 100.00%) - CodegenTime: 1.717ms - CompileTime: 20.380ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.489ms - PrepareTime: 144.408ms DataStreamSender (dst_id=14):(Total: 119.556us, non-child: 119.556us, % non-child: 100.00%) - BytesSent: 690.00 B (690) - NetworkThroughput(*): 3.66 MB/sec - OverallThroughput: 5.50 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 95.725us - ThriftTransmitTime(*): 179.686us - UncompressedRowBatchSize: 744.00 B (744) SORT_NODE (id=8):(Total: 1s157ms, non-child: 400.142us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec AGGREGATION_NODE (id=13):(Total: 1s156ms, non-child: 148.996ms, % non-child: 12.88%) ExecOption: Codegen Enabled - BuildTime: 93.540us - GetNewBlockTime: 92.429us - GetResultsTime: 61.303us - HTResizeTime: 2.928us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 31.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.536us EXCHANGE_NODE (id=12):(Total: 1s007ms, non-child: 171.867us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 491.00 B - BytesReceived: 9.86 KB (10099) - ConvertRowBatchTime: 44.346us - DeserializeRowBatchTimer: 137.630us - FirstBatchArrivalWaitTime: 849.441ms - PeakMemoryUsage: 0 - RowsReturned: 544 (544) - RowsReturnedRate: 539.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4a6 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s158ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450032) - PerHostPeakMemUsage: 272.21 MB (285435376) - PrepareTime: 145.899ms - RowsProduced: 39 (39) - TotalCpuTime: 383.569ms - TotalNetworkReceiveTime: 1s009ms - TotalNetworkSendTime: 353.741us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 140 (140) - BlocksRecycled: 20 (20) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 377.262ms, non-child: 377.262ms, % non-child: 100.00%) - CodegenTime: 1.746ms - CompileTime: 20.217ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 213.236ms - PrepareTime: 142.588ms DataStreamSender (dst_id=14):(Total: 134.979us, non-child: 134.979us, % non-child: 100.00%) - BytesSent: 733.00 B (733) - NetworkThroughput(*): 2.75 MB/sec - OverallThroughput: 5.18 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 111.779us - ThriftTransmitTime(*): 253.925us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s157ms, non-child: 363.680us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 33.00 /sec AGGREGATION_NODE (id=13):(Total: 1s157ms, non-child: 147.647ms, % non-child: 12.76%) ExecOption: Codegen Enabled - BuildTime: 97.812us - GetNewBlockTime: 98.724us - GetResultsTime: 62.578us - HTResizeTime: 3.179us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 33.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.477us EXCHANGE_NODE (id=12):(Total: 1s009ms, non-child: 247.843us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 10.30 KB (10549) - ConvertRowBatchTime: 62.452us - DeserializeRowBatchTimer: 345.281us - FirstBatchArrivalWaitTime: 851.358ms - PeakMemoryUsage: 0 - RowsReturned: 573 (573) - RowsReturnedRate: 567.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4aa (host=vb0232.halxg.cloudera.com:22000):(Total: 1s158ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450064) - PerHostPeakMemUsage: 293.90 MB (308174536) - PrepareTime: 148.685ms - RowsProduced: 41 (41) - TotalCpuTime: 388.461ms - TotalNetworkReceiveTime: 1s006ms - TotalNetworkSendTime: 600.201us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 382.886ms, non-child: 382.886ms, % non-child: 100.00%) - CodegenTime: 1.737ms - CompileTime: 20.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 215.499ms - PrepareTime: 145.420ms DataStreamSender (dst_id=14):(Total: 38.580us, non-child: 38.580us, % non-child: 100.00%) - BytesSent: 756.00 B (756) - NetworkThroughput(*): 2.97 MB/sec - OverallThroughput: 18.69 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 18.359us - ThriftTransmitTime(*): 243.082us - UncompressedRowBatchSize: 824.00 B (824) SORT_NODE (id=8):(Total: 1s156ms, non-child: 345.263us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 41 (41) - RowsReturnedRate: 35.00 /sec AGGREGATION_NODE (id=13):(Total: 1s156ms, non-child: 150.049ms, % non-child: 12.97%) ExecOption: Codegen Enabled - BuildTime: 141.967us - GetNewBlockTime: 87.304us - GetResultsTime: 48.670us - HTResizeTime: 1.885us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 35.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.045us EXCHANGE_NODE (id=12):(Total: 1s006ms, non-child: 209.905us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 10.84 KB (11102) - ConvertRowBatchTime: 56.697us - DeserializeRowBatchTimer: 102.855us - FirstBatchArrivalWaitTime: 848.161ms - PeakMemoryUsage: 0 - RowsReturned: 607 (607) - RowsReturnedRate: 603.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4a7 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s158ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449952) - PerHostPeakMemUsage: 274.44 MB (287771760) - PrepareTime: 143.164ms - RowsProduced: 34 (34) - TotalCpuTime: 384.038ms - TotalNetworkReceiveTime: 1s010ms - TotalNetworkSendTime: 336.375us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 376.741ms, non-child: 376.741ms, % non-child: 100.00%) - CodegenTime: 1.775ms - CompileTime: 20.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 215.286ms - PrepareTime: 139.846ms DataStreamSender (dst_id=14):(Total: 131.423us, non-child: 131.423us, % non-child: 100.00%) - BytesSent: 628.00 B (628) - NetworkThroughput(*): 2.98 MB/sec - OverallThroughput: 4.56 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 91.261us - ThriftTransmitTime(*): 200.676us - UncompressedRowBatchSize: 684.00 B (684) SORT_NODE (id=8):(Total: 1s156ms, non-child: 395.838us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 34 (34) - RowsReturnedRate: 29.00 /sec AGGREGATION_NODE (id=13):(Total: 1s156ms, non-child: 145.701ms, % non-child: 12.60%) ExecOption: Codegen Enabled - BuildTime: 287.283us - GetNewBlockTime: 95.802us - GetResultsTime: 50.663us - HTResizeTime: 2.798us - HashBuckets: 12.29K (12288) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 34 (34) - RowsReturnedRate: 29.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.366us EXCHANGE_NODE (id=12):(Total: 1s010ms, non-child: 233.202us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 4.18 KB - BytesReceived: 9.14 KB (9363) - ConvertRowBatchTime: 56.858us - DeserializeRowBatchTimer: 131.625us - FirstBatchArrivalWaitTime: 852.379ms - PeakMemoryUsage: 0 - RowsReturned: 500 (500) - RowsReturnedRate: 494.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4ae (host=vb0208.halxg.cloudera.com:22000):(Total: 1s155ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450032) - PerHostPeakMemUsage: 272.47 MB (285710512) - PrepareTime: 141.634ms - RowsProduced: 39 (39) - TotalCpuTime: 385.956ms - TotalNetworkReceiveTime: 1s011ms - TotalNetworkSendTime: 229.041us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 380.370ms, non-child: 380.370ms, % non-child: 100.00%) - CodegenTime: 1.685ms - CompileTime: 28.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 212.425ms - PrepareTime: 138.524ms DataStreamSender (dst_id=14):(Total: 97.526us, non-child: 97.526us, % non-child: 100.00%) - BytesSent: 720.00 B (720) - NetworkThroughput(*): 4.30 MB/sec - OverallThroughput: 7.04 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 75.159us - ThriftTransmitTime(*): 159.582us - UncompressedRowBatchSize: 784.00 B (784) SORT_NODE (id=8):(Total: 1s154ms, non-child: 333.217us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 39 (39) - RowsReturnedRate: 33.00 /sec AGGREGATION_NODE (id=13):(Total: 1s154ms, non-child: 143.094ms, % non-child: 12.40%) ExecOption: Codegen Enabled - BuildTime: 90.331us - GetNewBlockTime: 89.406us - GetResultsTime: 64.736us - HTResizeTime: 4.168us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 33.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.423us EXCHANGE_NODE (id=12):(Total: 1s011ms, non-child: 165.279us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 8.21 KB - BytesReceived: 10.32 KB (10569) - ConvertRowBatchTime: 37.397us - DeserializeRowBatchTimer: 188.745us - FirstBatchArrivalWaitTime: 851.820ms - PeakMemoryUsage: 0 - RowsReturned: 574 (574) - RowsReturnedRate: 567.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4af (host=vb0230.halxg.cloudera.com:22000):(Total: 1s151ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450080) - PerHostPeakMemUsage: 299.12 MB (313646544) - PrepareTime: 143.571ms - RowsProduced: 42 (42) - TotalCpuTime: 392.716ms - TotalNetworkReceiveTime: 1s004ms - TotalNetworkSendTime: 306.810us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 387.199ms, non-child: 387.199ms, % non-child: 100.00%) - CodegenTime: 1.780ms - CompileTime: 24.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 221.364ms - PrepareTime: 140.278ms DataStreamSender (dst_id=14):(Total: 37.712us, non-child: 37.712us, % non-child: 100.00%) - BytesSent: 778.00 B (778) - NetworkThroughput(*): 3.68 MB/sec - OverallThroughput: 19.67 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 18.694us - ThriftTransmitTime(*): 201.500us - UncompressedRowBatchSize: 844.00 B (844) SORT_NODE (id=8):(Total: 1s150ms, non-child: 310.307us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 42 (42) - RowsReturnedRate: 36.00 /sec AGGREGATION_NODE (id=13):(Total: 1s149ms, non-child: 144.833ms, % non-child: 12.60%) ExecOption: Codegen Enabled - BuildTime: 95.446us - GetNewBlockTime: 124.277us - GetResultsTime: 39.453us - HTResizeTime: 2.652us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 36.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.288us EXCHANGE_NODE (id=12):(Total: 1s004ms, non-child: 374.773us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 3.54 KB - BytesReceived: 11.05 KB (11316) - ConvertRowBatchTime: 129.821us - DeserializeRowBatchTimer: 169.774us - FirstBatchArrivalWaitTime: 845.361ms - PeakMemoryUsage: 0 - RowsReturned: 617 (617) - RowsReturnedRate: 613.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4a8 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s145ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450144) - PerHostPeakMemUsage: 278.93 MB (292484216) - PrepareTime: 148.654ms - RowsProduced: 46 (46) - TotalCpuTime: 398.224ms - TotalNetworkReceiveTime: 993.557ms - TotalNetworkSendTime: 304.826us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 392.232ms, non-child: 392.232ms, % non-child: 100.00%) - CodegenTime: 2.093ms - CompileTime: 20.361ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 225.612ms - PrepareTime: 144.995ms DataStreamSender (dst_id=14):(Total: 116.623us, non-child: 116.623us, % non-child: 100.00%) - BytesSent: 853.00 B (853) - NetworkThroughput(*): 4.26 MB/sec - OverallThroughput: 6.98 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 92.558us - ThriftTransmitTime(*): 190.978us - UncompressedRowBatchSize: 924.00 B (924) SORT_NODE (id=8):(Total: 1s143ms, non-child: 398.814us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 46 (46) - RowsReturnedRate: 40.00 /sec AGGREGATION_NODE (id=13):(Total: 1s143ms, non-child: 149.901ms, % non-child: 13.11%) ExecOption: Codegen Enabled - BuildTime: 102.015us - GetNewBlockTime: 107.003us - GetResultsTime: 60.192us - HTResizeTime: 4.208us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 40.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.645us EXCHANGE_NODE (id=12):(Total: 993.656ms, non-child: 504.953us, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 12.20 KB (12496) - ConvertRowBatchTime: 59.140us - DeserializeRowBatchTimer: 121.415us - FirstBatchArrivalWaitTime: 835.355ms - PeakMemoryUsage: 0 - RowsReturned: 682 (682) - RowsReturnedRate: 686.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4a5 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s144ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.27 MB, 2.27 MB, 2.33 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2450048) - PerHostPeakMemUsage: 306.33 MB (321207808) - PrepareTime: 145.677ms - RowsProduced: 40 (40) - TotalCpuTime: 395.525ms - TotalNetworkReceiveTime: 995.659ms - TotalNetworkSendTime: 390.822us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 389.408ms, non-child: 389.408ms, % non-child: 100.00%) - CodegenTime: 1.824ms - CompileTime: 19.984ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 225.930ms - PrepareTime: 142.191ms DataStreamSender (dst_id=14):(Total: 116.619us, non-child: 116.619us, % non-child: 100.00%) - BytesSent: 743.00 B (743) - NetworkThroughput(*): 2.84 MB/sec - OverallThroughput: 6.08 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 92.128us - ThriftTransmitTime(*): 249.448us - UncompressedRowBatchSize: 804.00 B (804) SORT_NODE (id=8):(Total: 1s143ms, non-child: 378.676us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 40 (40) - RowsReturnedRate: 34.00 /sec AGGREGATION_NODE (id=13):(Total: 1s142ms, non-child: 147.061ms, % non-child: 12.87%) ExecOption: Codegen Enabled - BuildTime: 210.842us - GetNewBlockTime: 118.034us - GetResultsTime: 52.325us - HTResizeTime: 3.880us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 35.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.469us EXCHANGE_NODE (id=12):(Total: 995.771ms, non-child: 211.361us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 9.13 KB - BytesReceived: 10.56 KB (10812) - ConvertRowBatchTime: 55.438us - DeserializeRowBatchTimer: 202.550us - FirstBatchArrivalWaitTime: 837.896ms - PeakMemoryUsage: 0 - RowsReturned: 588 (588) - RowsReturnedRate: 590.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 3846c6b477d7d4bf:1d465c4a3debf4ad (host=vb0234.halxg.cloudera.com:22000):(Total: 1s140ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.27 MB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.34 MB (2449808) - PerHostPeakMemUsage: 259.64 MB (272255792) - PrepareTime: 148.790ms - RowsProduced: 25 (25) - TotalCpuTime: 408.437ms - TotalNetworkReceiveTime: 988.157ms - TotalNetworkSendTime: 244.105us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 144 (144) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.64 GB (86585704448) - PeakMemoryUsage: 1.31 MB (1376256) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 381.117ms, non-child: 381.117ms, % non-child: 100.00%) - CodegenTime: 1.771ms - CompileTime: 20.383ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 333 (333) - NumInstructions: 3.51K (3511) - OptimizationTime: 214.094ms - PrepareTime: 145.547ms DataStreamSender (dst_id=14):(Total: 132.216us, non-child: 132.216us, % non-child: 100.00%) - BytesSent: 493.00 B (493) - NetworkThroughput(*): 2.99 MB/sec - OverallThroughput: 3.56 MB/sec - PeakMemoryUsage: 8.00 KB (8192) - SerializeBatchTime: 106.597us - ThriftTransmitTime(*): 157.452us - UncompressedRowBatchSize: 504.00 B (504) SORT_NODE (id=8):(Total: 1s138ms, non-child: 392.665us, % non-child: 0.03%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 25 (25) - RowsReturnedRate: 21.00 /sec AGGREGATION_NODE (id=13):(Total: 1s138ms, non-child: 150.087ms, % non-child: 13.18%) ExecOption: Codegen Enabled - BuildTime: 65.308us - GetNewBlockTime: 108.862us - GetResultsTime: 52.490us - HTResizeTime: 2.533us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.32 MB (2428928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 25 (25) - RowsReturnedRate: 21.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.276us EXCHANGE_NODE (id=12):(Total: 988.242ms, non-child: 172.356us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 6.89 KB (7055) - ConvertRowBatchTime: 44.067us - DeserializeRowBatchTimer: 153.086us - FirstBatchArrivalWaitTime: 829.031ms - PeakMemoryUsage: 0 - RowsReturned: 369 (369) - RowsReturnedRate: 373.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 3846c6b477d7d4bf:1d465c4a3debf4b9 (host=vb0232.halxg.cloudera.com:22000):(Total: 997.568ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Filter 0 arrival: 537ms Filter 1 arrival: 537ms Filter 2 arrival: 546ms MemoryUsage(500.000ms): 0, 104.66 MB, 237.52 MB ThreadUsage(500.000ms): 1, 12, 12 - AverageThreadTokens: 8.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 288.63 MB (302649032) - PerHostPeakMemUsage: 293.90 MB (308174536) - PrepareTime: 147.806ms - RowsProduced: 564 (564) - TotalCpuTime: 8s319ms - TotalNetworkReceiveTime: 82.764us - TotalNetworkSendTime: 5.377ms - TotalStorageWaitTime: 367.537ms CodeGen:(Total: 521.714ms, non-child: 521.714ms, % non-child: 100.00%) - CodegenTime: 1.550ms - CompileTime: 102.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 280.709ms - PrepareTime: 137.949ms DataStreamSender (dst_id=12):(Total: 191.905us, non-child: 191.905us, % non-child: 100.00%) - BytesSent: 10.19 KB (10437) - NetworkThroughput(*): 2.41 MB/sec - OverallThroughput: 51.87 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 456.399us - ThriftTransmitTime(*): 4.125ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 984.942ms, non-child: 217.844ms, % non-child: 22.12%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60.480us - GetResultsTime: 149.594us - HTResizeTime: 561.884us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.07 MB (15803136) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 572.00 /sec - StreamingTime: 80.209ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 767.098ms, non-child: 7.500ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.893us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 122.447us - GetNewBlockTime: 268.870us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.59 MB (15303424) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.563ms - RowsReturned: 37.49K (37489) - RowsReturnedRate: 48.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.250us EXCHANGE_NODE (id=11):(Total: 52.554us, non-child: 52.554us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.296us - DeserializeRowBatchTimer: 19.910us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 759.603ms, non-child: 6.560ms, % non-child: 0.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.827us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 55.253us - GetNewBlockTime: 328.081us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.57 MB (15278848) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.688ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 50.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.989us EXCHANGE_NODE (id=10):(Total: 32.887us, non-child: 32.887us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.458us - DeserializeRowBatchTimer: 9.837us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 753.049ms, non-child: 22.095ms, % non-child: 2.93%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 7.122ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.166ms - GetNewBlockTime: 518.619us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424896) - PinTime: 0.000ns - ProbeRows: 38.40K (38397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.049ms - RowsReturned: 38.40K (38397) - RowsReturnedRate: 50.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.477us EXCHANGE_NODE (id=9):(Total: 739.377us, non-child: 739.377us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 633.817us - DeserializeRowBatchTimer: 2.001ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 20.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 730.214ms, non-child: 730.214ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 26 Hdfs split stats (:<# splits>/): 9:1/160.01 MB 8:3/258.84 MB 2:4/186.78 MB 0:2/321.55 MB 5:6/507.69 MB 10:6/399.33 MB 6:2/153.04 MB 4:2/93.45 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:0% 3:0% 4:0% 5:50% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 25.81 MB, 240.63 MB - AverageHdfsReadThreadConcurrency: 2.50 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 266.22 MB (279156364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.22 MB (279156364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.22 MB (279156364) - DecompressionTime: 870.705ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 274.41 MB (287744168) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 38.86M (38856403) - RowsReturned: 38.40K (38397) - RowsReturnedRate: 52.58 K/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 845 (845) - ScannerThreadsTotalWallClockTime: 7s281ms - MaterializeTupleTime(*): 5s894ms - ScannerThreadsSysTime: 248.958ms - ScannerThreadsUserTime: 6s609ms - ScannerThreadsVoluntaryContextSwitches: 402 (402) - TotalRawHdfsReadTime(*): 210.777ms - TotalReadThroughput: 240.63 MB/sec Filter 0: - Rows processed: 425.96K (425958) - Rows rejected: 9.97K (9968) - Rows total: 425.98K (425984) Filter 1: - Files processed: 26 (26) - Files rejected: 0 (0) - Files total: 26 (26) - RowGroups processed: 73.27K (73267) - RowGroups rejected: 0 (0) - RowGroups total: 73.27K (73267) - Rows processed: 425.96K (425958) - Rows rejected: 0 (0) - Rows total: 425.98K (425984) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Filter 2: - Rows processed: 38.85M (38846435) - Rows rejected: 38.81M (38808038) - Rows total: 38.85M (38846435) Instance 3846c6b477d7d4bf:1d465c4a3debf4c1 (host=vb0220.halxg.cloudera.com:22000):(Total: 980.447ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Filter 0 arrival: 529ms Filter 1 arrival: 529ms Filter 2 arrival: 536ms MemoryUsage(500.000ms): 0, 219.63 MB, 129.26 MB ThreadUsage(500.000ms): 1, 12, 6 - AverageThreadTokens: 6.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 264.82 MB (277687752) - PerHostPeakMemUsage: 270.09 MB (283213256) - PrepareTime: 143.767ms - RowsProduced: 564 (564) - TotalCpuTime: 7s352ms - TotalNetworkReceiveTime: 100.631us - TotalNetworkSendTime: 5.051ms - TotalStorageWaitTime: 317.254ms CodeGen:(Total: 515.152ms, non-child: 515.152ms, % non-child: 100.00%) - CodegenTime: 1.383ms - CompileTime: 101.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.629ms - PrepareTime: 134.596ms DataStreamSender (dst_id=12):(Total: 222.065us, non-child: 222.065us, % non-child: 100.00%) - BytesSent: 10.15 KB (10389) - NetworkThroughput(*): 2.55 MB/sec - OverallThroughput: 44.62 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 786.126us - ThriftTransmitTime(*): 3.880ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 968.842ms, non-child: 197.689ms, % non-child: 20.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 51.597us - GetResultsTime: 138.802us - HTResizeTime: 469.663us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.49 MB (19392704) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 582.00 /sec - StreamingTime: 63.452ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 771.153ms, non-child: 5.963ms, % non-child: 0.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 125.131us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 84.667us - GetNewBlockTime: 244.863us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.02 MB (18892992) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.500ms - RowsReturned: 35.25K (35246) - RowsReturnedRate: 45.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.221us EXCHANGE_NODE (id=11):(Total: 45.060us, non-child: 45.060us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 33.907us - DeserializeRowBatchTimer: 19.804us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 765.194ms, non-child: 7.332ms, % non-child: 0.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 92.132us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.450us - GetNewBlockTime: 349.280us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.52 MB (14181344) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.354ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 47.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.905us EXCHANGE_NODE (id=10):(Total: 35.224us, non-child: 35.224us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.201us - DeserializeRowBatchTimer: 36.507us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 757.868ms, non-child: 18.035ms, % non-child: 2.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.744ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.196ms - GetNewBlockTime: 494.634us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423352) - PinTime: 0.000ns - ProbeRows: 36.09K (36088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.043ms - RowsReturned: 36.09K (36088) - RowsReturnedRate: 47.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.762us EXCHANGE_NODE (id=9):(Total: 719.714us, non-child: 719.714us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 591.490us - DeserializeRowBatchTimer: 2.002ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 739.112ms, non-child: 739.112ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 22 Hdfs split stats (:<# splits>/): 1:1/161.27 MB 2:1/106.19 MB 4:3/199.39 MB 9:2/153.13 MB 10:2/207.51 MB 0:2/153.21 MB 7:5/520.43 MB 8:1/106.46 MB 6:3/139.86 MB 5:2/207.42 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:66 BytesRead(500.000ms): 132.13 MB, 249.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 249.75 MB (261886383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.75 MB (261886383) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.75 MB (261886383) - DecompressionTime: 759.580ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 22 (22) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 250.68 MB (262857416) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.51M (36514470) - RowsReturned: 36.09K (36088) - RowsReturnedRate: 48.83 K/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 683 (683) - ScannerThreadsTotalWallClockTime: 6s291ms - MaterializeTupleTime(*): 5s100ms - ScannerThreadsSysTime: 189.967ms - ScannerThreadsUserTime: 5s744ms - ScannerThreadsVoluntaryContextSwitches: 230 (230) - TotalRawHdfsReadTime(*): 182.778ms - TotalReadThroughput: 249.75 MB/sec Filter 0: - Rows processed: 360.43K (360426) - Rows rejected: 8.50K (8503) - Rows total: 360.45K (360448) Filter 1: - Files processed: 22 (22) - Files rejected: 0 (0) - Files total: 22 (22) - RowGroups processed: 68.55K (68546) - RowGroups rejected: 0 (0) - RowGroups total: 68.55K (68546) - Rows processed: 360.43K (360426) - Rows rejected: 0 (0) - Rows total: 360.45K (360448) - Splits processed: 22 (22) - Splits rejected: 0 (0) - Splits total: 22 (22) Filter 2: - Rows processed: 36.51M (36505967) - Rows rejected: 36.47M (36469879) - Rows total: 36.51M (36505967) Instance 3846c6b477d7d4bf:1d465c4a3debf4bb (host=vb0224.halxg.cloudera.com:22000):(Total: 976.006ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Filter 0 arrival: 530ms Filter 1 arrival: 530ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 1.40 MB, 233.52 MB, 100.82 MB ThreadUsage(500.000ms): 1, 12, 5 - AverageThreadTokens: 6.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 252.07 MB (264311112) - PerHostPeakMemUsage: 257.34 MB (269836616) - PrepareTime: 146.981ms - RowsProduced: 564 (564) - TotalCpuTime: 7s479ms - TotalNetworkReceiveTime: 83.902us - TotalNetworkSendTime: 4.476ms - TotalStorageWaitTime: 281.964ms CodeGen:(Total: 516.360ms, non-child: 516.360ms, % non-child: 100.00%) - CodegenTime: 1.512ms - CompileTime: 100.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.551ms - PrepareTime: 137.211ms DataStreamSender (dst_id=12):(Total: 198.577us, non-child: 198.577us, % non-child: 100.00%) - BytesSent: 10.16 KB (10403) - NetworkThroughput(*): 3.04 MB/sec - OverallThroughput: 49.96 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 488.696us - ThriftTransmitTime(*): 3.264ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 964.409ms, non-child: 215.455ms, % non-child: 22.34%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.276us - GetResultsTime: 162.053us - HTResizeTime: 543.434us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.47 MB (19364616) - PinTime: 0.000ns - ReductionFactorEstimate: 22.67 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 584.00 /sec - StreamingTime: 78.134ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 748.953ms, non-child: 6.807ms, % non-child: 0.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 136.614us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.742us - GetNewBlockTime: 248.364us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.99 MB (18864904) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.059ms - RowsReturned: 33.80K (33799) - RowsReturnedRate: 45.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.215us EXCHANGE_NODE (id=11):(Total: 48.506us, non-child: 48.506us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.479us - DeserializeRowBatchTimer: 41.530us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 742.150ms, non-child: 6.948ms, % non-child: 0.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 57.614us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.063us - GetNewBlockTime: 339.634us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.04 MB (16824024) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.079ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 46.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.980us EXCHANGE_NODE (id=10):(Total: 21.473us, non-child: 21.473us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 8.557us - DeserializeRowBatchTimer: 65.563us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 17.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 735.207ms, non-child: 16.803ms, % non-child: 2.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.407ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 586.116us - GetNewBlockTime: 519.798us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422624) - PinTime: 0.000ns - ProbeRows: 34.63K (34626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.097ms - RowsReturned: 34.63K (34626) - RowsReturnedRate: 47.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.030us EXCHANGE_NODE (id=9):(Total: 620.489us, non-child: 620.489us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 519.751us - DeserializeRowBatchTimer: 2.021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 717.782ms, non-child: 717.782ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 4:1/46.64 MB 7:2/266.38 MB 1:3/199.19 MB 6:2/152.93 MB 9:2/93.39 MB 3:5/292.39 MB 8:4/360.10 MB 2:3/254.57 MB 10:1/105.77 MB 0:1/106.51 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 117.47 MB, 240.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 240.35 MB (252026160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.35 MB (252026160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.35 MB (252026160) - DecompressionTime: 746.415ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 235.08 MB (246500008) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35069138) - RowsReturned: 34.63K (34626) - RowsReturnedRate: 48.24 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 712 (712) - ScannerThreadsTotalWallClockTime: 6s389ms - MaterializeTupleTime(*): 5s236ms - ScannerThreadsSysTime: 173.967ms - ScannerThreadsUserTime: 5s885ms - ScannerThreadsVoluntaryContextSwitches: 471 (471) - TotalRawHdfsReadTime(*): 177.672ms - TotalReadThroughput: 160.23 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.34K (9341) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 65.72K (65720) - RowGroups rejected: 0 (0) - RowGroups total: 65.72K (65720) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35059797) - Rows rejected: 35.03M (35025171) - Rows total: 35.06M (35059797) Instance 3846c6b477d7d4bf:1d465c4a3debf4bd (host=vb0208.halxg.cloudera.com:22000):(Total: 952.548ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Filter 0 arrival: 534ms Filter 1 arrival: 534ms Filter 2 arrival: 540ms MemoryUsage(500.000ms): 1.40 MB, 199.94 MB, 103.92 KB ThreadUsage(500.000ms): 1, 12, 1 - AverageThreadTokens: 4.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 267.21 MB (280185008) - PerHostPeakMemUsage: 272.47 MB (285710512) - PrepareTime: 146.227ms - RowsProduced: 564 (564) - TotalCpuTime: 6s833ms - TotalNetworkReceiveTime: 68.631us - TotalNetworkSendTime: 4.842ms - TotalStorageWaitTime: 296.976ms CodeGen:(Total: 518.382ms, non-child: 518.382ms, % non-child: 100.00%) - CodegenTime: 1.781ms - CompileTime: 100.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 280.591ms - PrepareTime: 135.966ms DataStreamSender (dst_id=12):(Total: 191.976us, non-child: 191.976us, % non-child: 100.00%) - BytesSent: 10.17 KB (10415) - NetworkThroughput(*): 2.62 MB/sec - OverallThroughput: 51.74 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 316.808us - ThriftTransmitTime(*): 3.796ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 941.276ms, non-child: 222.831ms, % non-child: 23.67%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 57.923us - GetResultsTime: 170.842us - HTResizeTime: 714.970us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.28 MB (17066360) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 599.00 /sec - StreamingTime: 86.920ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 718.444ms, non-child: 7.433ms, % non-child: 1.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.210us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.641us - GetNewBlockTime: 283.465us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.80 MB (16566648) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.500ms - RowsReturned: 34.75K (34748) - RowsReturnedRate: 48.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.079us EXCHANGE_NODE (id=11):(Total: 45.308us, non-child: 45.308us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 33.528us - DeserializeRowBatchTimer: 23.349us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 22.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 711.016ms, non-child: 6.952ms, % non-child: 0.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.081us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.633us - GetNewBlockTime: 246.183us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.81 MB (15528200) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.880ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 49.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.924us EXCHANGE_NODE (id=10):(Total: 34.093us, non-child: 34.093us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.056us - DeserializeRowBatchTimer: 40.740us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 704.070ms, non-child: 17.387ms, % non-child: 2.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.184ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 598.273us - GetNewBlockTime: 490.867us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423112) - PinTime: 0.000ns - ProbeRows: 35.54K (35539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.572ms - RowsReturned: 35.54K (35539) - RowsReturnedRate: 50.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.317us EXCHANGE_NODE (id=9):(Total: 564.196us, non-child: 564.196us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 477.803us - DeserializeRowBatchTimer: 3.704ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 27.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 686.118ms, non-child: 686.118ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 2:1/105.91 MB 0:2/93.18 MB 6:2/93.48 MB 8:3/253.85 MB 5:2/93.27 MB 7:3/313.05 MB 10:3/258.85 MB 9:1/160.63 MB 1:5/293.25 MB 4:3/253.47 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 181.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 245.67 MB (257601014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 245.67 MB (257601014) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 245.67 MB (257601014) - DecompressionTime: 749.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 252.15 MB (264394680) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.83M (35826899) - RowsReturned: 35.54K (35539) - RowsReturnedRate: 51.80 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 607 (607) - ScannerThreadsTotalWallClockTime: 5s778ms - MaterializeTupleTime(*): 4s595ms - ScannerThreadsSysTime: 174.968ms - ScannerThreadsUserTime: 5s260ms - ScannerThreadsVoluntaryContextSwitches: 491 (491) - TotalRawHdfsReadTime(*): 183.638ms - TotalReadThroughput: 181.62 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.64K (9639) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.33K (68331) - RowGroups rejected: 0 (0) - RowGroups total: 68.33K (68331) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.82M (35817260) - Rows rejected: 35.78M (35781721) - Rows total: 35.82M (35817260) Instance 3846c6b477d7d4bf:1d465c4a3debf4bf (host=vb0228.halxg.cloudera.com:22000):(Total: 900.611ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Filter 0 arrival: 529ms Filter 1 arrival: 529ms Filter 2 arrival: 535ms MemoryUsage(500.000ms): 1.40 MB, 192.92 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 262.76 MB (275526168) - PerHostPeakMemUsage: 268.03 MB (281051672) - PrepareTime: 144.762ms - RowsProduced: 564 (564) - TotalCpuTime: 7s065ms - TotalNetworkReceiveTime: 95.571us - TotalNetworkSendTime: 4.332ms - TotalStorageWaitTime: 286.744ms CodeGen:(Total: 514.108ms, non-child: 514.108ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 99.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.772ms - PrepareTime: 135.467ms DataStreamSender (dst_id=12):(Total: 194.633us, non-child: 194.633us, % non-child: 100.00%) - BytesSent: 10.14 KB (10382) - NetworkThroughput(*): 3.07 MB/sec - OverallThroughput: 50.87 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 455.019us - ThriftTransmitTime(*): 3.230ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 889.602ms, non-child: 212.670ms, % non-child: 23.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61.953us - GetResultsTime: 169.174us - HTResizeTime: 439.446us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 22.06 MB (23128784) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 633.00 /sec - StreamingTime: 76.628ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 676.931ms, non-child: 7.274ms, % non-child: 1.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.065us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 71.790us - GetNewBlockTime: 290.980us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.58 MB (22629072) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.413ms - RowsReturned: 35.14K (35143) - RowsReturnedRate: 51.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.003us EXCHANGE_NODE (id=11):(Total: 49.167us, non-child: 49.167us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.797us - DeserializeRowBatchTimer: 21.101us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 669.662ms, non-child: 6.828ms, % non-child: 1.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 101.194us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.605us - GetNewBlockTime: 297.458us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.93 MB (15653568) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.737ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 53.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.922us EXCHANGE_NODE (id=10):(Total: 32.290us, non-child: 32.290us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.306us - DeserializeRowBatchTimer: 9.571us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 662.840ms, non-child: 15.157ms, % non-child: 2.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.299ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 578.495us - GetNewBlockTime: 432.524us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423808) - PinTime: 0.000ns - ProbeRows: 36.05K (36045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.484ms - RowsReturned: 36.05K (36045) - RowsReturnedRate: 54.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.370us EXCHANGE_NODE (id=9):(Total: 513.698us, non-child: 513.698us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 405.198us - DeserializeRowBatchTimer: 2.122ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 29.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 647.169ms, non-child: 647.169ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 6:1/46.44 MB 8:2/153.01 MB 4:3/318.82 MB 0:2/93.54 MB 10:4/414.64 MB 7:4/474.82 MB 1:2/93.30 MB 9:4/186.68 MB 2:2/153.10 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 160.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 247.46 MB (259475640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 247.46 MB (259475640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 247.46 MB (259475640) - DecompressionTime: 736.368ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 240.19 MB (251854232) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.13M (36127075) - RowsReturned: 36.05K (36045) - RowsReturnedRate: 55.70 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 717 (717) - ScannerThreadsTotalWallClockTime: 6s055ms - MaterializeTupleTime(*): 4s909ms - ScannerThreadsSysTime: 176.967ms - ScannerThreadsUserTime: 5s533ms - ScannerThreadsVoluntaryContextSwitches: 367 (367) - TotalRawHdfsReadTime(*): 163.749ms - TotalReadThroughput: 160.62 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.24K (9240) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 69.21K (69208) - RowGroups rejected: 0 (0) - RowGroups total: 69.21K (69208) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 36.12M (36117835) - Rows rejected: 36.08M (36081790) - Rows total: 36.12M (36117835) Instance 3846c6b477d7d4bf:1d465c4a3debf4b8 (host=vb0214.halxg.cloudera.com:22000):(Total: 899.254ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Filter 0 arrival: 537ms Filter 1 arrival: 537ms Filter 2 arrival: 541ms MemoryUsage(500.000ms): 1.40 MB, 199.20 MB, 59.54 MB ThreadUsage(500.000ms): 1, 12, 3 - AverageThreadTokens: 5.33 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 261.77 MB (274486224) - PerHostPeakMemUsage: 267.04 MB (280011728) - PrepareTime: 148.947ms - RowsProduced: 564 (564) - TotalCpuTime: 7s375ms - TotalNetworkReceiveTime: 46.742us - TotalNetworkSendTime: 4.377ms - TotalStorageWaitTime: 320.407ms CodeGen:(Total: 520.846ms, non-child: 520.846ms, % non-child: 100.00%) - CodegenTime: 1.567ms - CompileTime: 101.109ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 279.734ms - PrepareTime: 138.941ms DataStreamSender (dst_id=12):(Total: 119.664us, non-child: 119.664us, % non-child: 100.00%) - BytesSent: 10.13 KB (10374) - NetworkThroughput(*): 2.93 MB/sec - OverallThroughput: 82.68 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 416.578us - ThriftTransmitTime(*): 3.381ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 887.972ms, non-child: 216.388ms, % non-child: 24.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64.456us - GetResultsTime: 99.548us - HTResizeTime: 528.457us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.31 MB (17105944) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 635.00 /sec - StreamingTime: 78.150ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 671.584ms, non-child: 7.200ms, % non-child: 1.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 134.937us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 73.001us - GetNewBlockTime: 290.578us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.84 MB (16606232) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.057ms - RowsReturned: 35.41K (35415) - RowsReturnedRate: 52.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.072us EXCHANGE_NODE (id=11):(Total: 52.113us, non-child: 52.113us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 36.816us - DeserializeRowBatchTimer: 23.485us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 664.389ms, non-child: 6.754ms, % non-child: 1.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.151us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 65.873us - GetNewBlockTime: 325.486us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.19 MB (13829912) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.501ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 54.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.852us EXCHANGE_NODE (id=10):(Total: 35.713us, non-child: 35.713us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.333us - DeserializeRowBatchTimer: 15.238us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 657.641ms, non-child: 15.150ms, % non-child: 2.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.315ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 591.663us - GetNewBlockTime: 466.380us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423712) - PinTime: 0.000ns - ProbeRows: 36.29K (36294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.958ms - RowsReturned: 36.29K (36294) - RowsReturnedRate: 55.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.936us EXCHANGE_NODE (id=9):(Total: 347.746us, non-child: 347.746us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 297.725us - DeserializeRowBatchTimer: 2.150ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 44.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 642.143ms, non-child: 642.143ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 28 Hdfs split stats (:<# splits>/): 4:2/93.22 MB 3:2/93.58 MB 10:2/206.96 MB 5:4/187.07 MB 7:3/140.35 MB 2:3/199.42 MB 8:5/406.99 MB 1:1/106.19 MB 0:4/305.42 MB 9:2/208.24 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 87.40 MB, 249.72 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.50 - BytesRead: 249.72 MB (261851037) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.72 MB (261851037) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.72 MB (261851037) - DecompressionTime: 778.846ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 241.05 MB (252754104) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.35M (36354601) - RowsReturned: 36.29K (36294) - RowsReturnedRate: 56.52 K/sec - ScanRangesComplete: 28 (28) - ScannerThreadsInvoluntaryContextSwitches: 737 (737) - ScannerThreadsTotalWallClockTime: 6s398ms - MaterializeTupleTime(*): 5s161ms - ScannerThreadsSysTime: 235.959ms - ScannerThreadsUserTime: 5s792ms - ScannerThreadsVoluntaryContextSwitches: 343 (343) - TotalRawHdfsReadTime(*): 186.742ms - TotalReadThroughput: 166.48 MB/sec Filter 0: - Rows processed: 458.72K (458724) - Rows rejected: 10.72K (10721) - Rows total: 458.75K (458752) Filter 1: - Files processed: 28 (28) - Files rejected: 0 (0) - Files total: 28 (28) - RowGroups processed: 69.92K (69924) - RowGroups rejected: 0 (0) - RowGroups total: 69.92K (69924) - Rows processed: 458.72K (458724) - Rows rejected: 0 (0) - Rows total: 458.75K (458752) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Filter 2: - Rows processed: 36.34M (36343880) - Rows rejected: 36.31M (36307586) - Rows total: 36.34M (36343880) Instance 3846c6b477d7d4bf:1d465c4a3debf4bc (host=vb0234.halxg.cloudera.com:22000):(Total: 892.024ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Filter 0 arrival: 541ms Filter 1 arrival: 541ms Filter 2 arrival: 546ms MemoryUsage(500.000ms): 0, 149.79 MB, 156.59 MB ThreadUsage(500.000ms): 1, 12, 7 - AverageThreadTokens: 6.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 254.37 MB (266730288) - PerHostPeakMemUsage: 259.64 MB (272255792) - PrepareTime: 148.833ms - RowsProduced: 564 (564) - TotalCpuTime: 7s051ms - TotalNetworkReceiveTime: 58.760us - TotalNetworkSendTime: 4.840ms - TotalStorageWaitTime: 298.351ms CodeGen:(Total: 526.923ms, non-child: 526.923ms, % non-child: 100.00%) - CodegenTime: 1.543ms - CompileTime: 104.137ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 282.250ms - PrepareTime: 139.329ms DataStreamSender (dst_id=12):(Total: 181.787us, non-child: 181.787us, % non-child: 100.00%) - BytesSent: 10.15 KB (10391) - NetworkThroughput(*): 2.72 MB/sec - OverallThroughput: 54.51 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 423.436us - ThriftTransmitTime(*): 3.649ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 880.088ms, non-child: 225.318ms, % non-child: 25.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 70.721us - GetResultsTime: 169.617us - HTResizeTime: 601.715us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.51 MB (18360984) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 640.00 /sec - StreamingTime: 84.905ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 654.770ms, non-child: 6.906ms, % non-child: 1.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 127.184us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 76.451us - GetNewBlockTime: 253.728us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.03 MB (17861272) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.372ms - RowsReturned: 35.33K (35328) - RowsReturnedRate: 53.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.062us EXCHANGE_NODE (id=11):(Total: 49.015us, non-child: 49.015us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.436us - DeserializeRowBatchTimer: 26.201us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 647.869ms, non-child: 6.538ms, % non-child: 1.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.519us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 62.340us - GetNewBlockTime: 318.714us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.59 MB (15301168) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.015ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 55.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.751us EXCHANGE_NODE (id=10):(Total: 32.756us, non-child: 32.756us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 16.312us - DeserializeRowBatchTimer: 32.734us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 641.336ms, non-child: 17.006ms, % non-child: 2.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.619ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 602.754us - GetNewBlockTime: 450.144us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422424) - PinTime: 0.000ns - ProbeRows: 36.22K (36221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.568ms - RowsReturned: 36.22K (36221) - RowsReturnedRate: 56.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.441us EXCHANGE_NODE (id=9):(Total: 416.645us, non-child: 416.645us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 348.339us - DeserializeRowBatchTimer: 2.103ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 36.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 623.913ms, non-child: 623.913ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 27 Hdfs split stats (:<# splits>/): 8:1/46.60 MB 7:1/160.62 MB 3:4/305.54 MB 10:2/266.86 MB 1:3/253.71 MB 2:3/140.00 MB 0:2/152.51 MB 6:1/46.67 MB 4:3/199.19 MB 9:2/93.50 MB 5:5/292.99 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:81 BytesRead(500.000ms): 86.85 MB, 250.92 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.50 - BytesRead: 250.92 MB (263105410) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.92 MB (263105410) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.92 MB (263105410) - DecompressionTime: 780.035ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 240.97 MB (252680184) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.56M (36560874) - RowsReturned: 36.22K (36221) - RowsReturnedRate: 58.05 K/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 741 (741) - ScannerThreadsTotalWallClockTime: 6s055ms - MaterializeTupleTime(*): 4s832ms - ScannerThreadsSysTime: 209.963ms - ScannerThreadsUserTime: 5s485ms - ScannerThreadsVoluntaryContextSwitches: 435 (435) - TotalRawHdfsReadTime(*): 174.909ms - TotalReadThroughput: 250.92 MB/sec Filter 0: - Rows processed: 442.34K (442341) - Rows rejected: 10.49K (10491) - Rows total: 442.37K (442368) Filter 1: - Files processed: 27 (27) - Files rejected: 0 (0) - Files total: 27 (27) - RowGroups processed: 69.48K (69481) - RowGroups rejected: 0 (0) - RowGroups total: 69.48K (69481) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Filter 2: - Rows processed: 36.55M (36550383) - Rows rejected: 36.51M (36514162) - Rows total: 36.55M (36550383) Instance 3846c6b477d7d4bf:1d465c4a3debf4b4 (host=vb0226.halxg.cloudera.com:22000):(Total: 889.823ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Filter 0 arrival: 548ms Filter 1 arrival: 548ms Filter 2 arrival: 553ms MemoryUsage(500.000ms): 1.40 MB, 218.52 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 301.06 MB (315682304) - PerHostPeakMemUsage: 306.33 MB (321207808) - PrepareTime: 146.928ms - RowsProduced: 564 (564) - TotalCpuTime: 7s049ms - TotalNetworkReceiveTime: 46.846us - TotalNetworkSendTime: 4.402ms - TotalStorageWaitTime: 310.122ms CodeGen:(Total: 533.502ms, non-child: 533.502ms, % non-child: 100.00%) - CodegenTime: 1.476ms - CompileTime: 102.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 293.206ms - PrepareTime: 137.025ms DataStreamSender (dst_id=12):(Total: 207.957us, non-child: 207.957us, % non-child: 100.00%) - BytesSent: 10.26 KB (10507) - NetworkThroughput(*): 3.08 MB/sec - OverallThroughput: 48.18 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 750.663us - ThriftTransmitTime(*): 3.257ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 878.291ms, non-child: 219.293ms, % non-child: 24.97%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.718us - GetResultsTime: 167.146us - HTResizeTime: 484.961us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.59 MB (19492912) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 642.00 /sec - StreamingTime: 81.913ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 658.998ms, non-child: 7.526ms, % non-child: 1.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 128.981us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 74.584us - GetNewBlockTime: 277.539us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.11 MB (18993200) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.624ms - RowsReturned: 37.92K (37916) - RowsReturnedRate: 57.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.889us EXCHANGE_NODE (id=11):(Total: 50.248us, non-child: 50.248us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.485us - DeserializeRowBatchTimer: 20.018us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 651.478ms, non-child: 6.806ms, % non-child: 1.04%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.825us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.268us - GetNewBlockTime: 330.871us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.39 MB (15084184) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.874ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 59.50 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.597us EXCHANGE_NODE (id=10):(Total: 34.172us, non-child: 34.172us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.201us - DeserializeRowBatchTimer: 14.730us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 644.677ms, non-child: 15.974ms, % non-child: 2.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 3.390ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 590.008us - GetNewBlockTime: 456.090us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 38.77K (38765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.899ms - RowsReturned: 38.77K (38765) - RowsReturnedRate: 60.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.048us EXCHANGE_NODE (id=9):(Total: 364.983us, non-child: 364.983us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 312.636us - DeserializeRowBatchTimer: 2.380ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.21 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 628.337ms, non-child: 628.337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 20 Hdfs split stats (:<# splits>/): 8:1/46.46 MB 9:2/212.35 MB 3:1/105.93 MB 5:2/152.19 MB 4:4/533.42 MB 7:2/207.67 MB 0:2/320.57 MB 10:2/152.57 MB 1:2/152.67 MB 6:2/207.71 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 198.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 266.65 MB (279605125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.65 MB (279605125) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.65 MB (279605125) - DecompressionTime: 806.773ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 281.47 MB (295138136) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 39.08M (39076470) - RowsReturned: 38.77K (38765) - RowsReturnedRate: 61.69 K/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 682 (682) - ScannerThreadsTotalWallClockTime: 6s057ms - MaterializeTupleTime(*): 4s833ms - ScannerThreadsSysTime: 179.968ms - ScannerThreadsUserTime: 5s520ms - ScannerThreadsVoluntaryContextSwitches: 217 (217) - TotalRawHdfsReadTime(*): 184.413ms - TotalReadThroughput: 198.83 MB/sec Filter 0: - Rows processed: 327.66K (327660) - Rows rejected: 7.68K (7682) - Rows total: 327.68K (327680) Filter 1: - Files processed: 20 (20) - Files rejected: 0 (0) - Files total: 20 (20) - RowGroups processed: 72.54K (72536) - RowGroups rejected: 0 (0) - RowGroups total: 72.54K (72536) - Rows processed: 327.66K (327660) - Rows rejected: 0 (0) - Rows total: 327.68K (327680) - Splits processed: 20 (20) - Splits rejected: 0 (0) - Splits total: 20 (20) Filter 2: - Rows processed: 39.07M (39068788) - Rows rejected: 39.03M (39030023) - Rows total: 39.07M (39068788) Instance 3846c6b477d7d4bf:1d465c4a3debf4b7 (host=vb0216.halxg.cloudera.com:22000):(Total: 880.604ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Filter 0 arrival: 543ms Filter 1 arrival: 543ms Filter 2 arrival: 549ms MemoryUsage(500.000ms): 0, 150.80 MB, 155.07 MB ThreadUsage(500.000ms): 1, 12, 7 - AverageThreadTokens: 6.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 273.67 MB (286958712) - PerHostPeakMemUsage: 278.93 MB (292484216) - PrepareTime: 148.316ms - RowsProduced: 564 (564) - TotalCpuTime: 6s681ms - TotalNetworkReceiveTime: 84.113us - TotalNetworkSendTime: 4.963ms - TotalStorageWaitTime: 293.762ms CodeGen:(Total: 527.039ms, non-child: 527.039ms, % non-child: 100.00%) - CodegenTime: 1.440ms - CompileTime: 101.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 285.629ms - PrepareTime: 139.325ms DataStreamSender (dst_id=12):(Total: 169.626us, non-child: 169.626us, % non-child: 100.00%) - BytesSent: 10.24 KB (10485) - NetworkThroughput(*): 2.50 MB/sec - OverallThroughput: 58.95 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 923.901us - ThriftTransmitTime(*): 3.994ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 867.645ms, non-child: 206.179ms, % non-child: 23.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 78.340us - GetResultsTime: 168.774us - HTResizeTime: 523.256us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.14 MB (16919800) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 650.00 /sec - StreamingTime: 66.728ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 661.465ms, non-child: 5.968ms, % non-child: 0.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 455.110us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 50.317us - GetNewBlockTime: 272.757us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.66 MB (16420088) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.549ms - RowsReturned: 34.17K (34170) - RowsReturnedRate: 51.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.427us EXCHANGE_NODE (id=11):(Total: 47.793us, non-child: 47.793us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 34.522us - DeserializeRowBatchTimer: 35.929us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 655.503ms, non-child: 5.785ms, % non-child: 0.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 93.594us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 61.543us - GetNewBlockTime: 332.843us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.56 MB (13172584) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.311ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 53.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.327us EXCHANGE_NODE (id=10):(Total: 40.946us, non-child: 40.946us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 22.323us - DeserializeRowBatchTimer: 15.482us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 8.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 649.724ms, non-child: 17.565ms, % non-child: 2.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.005ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 920.940us - GetNewBlockTime: 472.642us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423208) - PinTime: 0.000ns - ProbeRows: 34.94K (34935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.278ms - RowsReturned: 34.94K (34935) - RowsReturnedRate: 53.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.473us EXCHANGE_NODE (id=9):(Total: 579.351us, non-child: 579.351us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 481.894us - DeserializeRowBatchTimer: 3.248ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 26.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 631.580ms, non-child: 631.580ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 2:1/46.62 MB 9:2/207.33 MB 4:3/139.98 MB 6:1/46.89 MB 3:2/206.77 MB 7:2/153.05 MB 1:3/199.17 MB 0:2/152.75 MB 8:5/525.66 MB 10:2/207.65 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 88.85 MB, 241.20 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.50 - BytesRead: 241.20 MB (252912121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.20 MB (252912121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.20 MB (252912121) - DecompressionTime: 731.848ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 254.25 MB (266598184) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.22M (35216777) - RowsReturned: 34.94K (34935) - RowsReturnedRate: 55.31 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 603 (603) - ScannerThreadsTotalWallClockTime: 5s685ms - MaterializeTupleTime(*): 4s543ms - ScannerThreadsSysTime: 187.967ms - ScannerThreadsUserTime: 5s166ms - ScannerThreadsVoluntaryContextSwitches: 230 (230) - TotalRawHdfsReadTime(*): 162.815ms - TotalReadThroughput: 241.20 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.71K (8711) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.65K (66653) - RowGroups rejected: 0 (0) - RowGroups total: 66.65K (66653) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.21M (35208066) - Rows rejected: 35.17M (35173131) - Rows total: 35.21M (35208066) Instance 3846c6b477d7d4bf:1d465c4a3debf4c2 (host=vb0204.halxg.cloudera.com:22000):(Total: 867.205ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Filter 0 arrival: 547ms Filter 1 arrival: 547ms Filter 2 arrival: 554ms MemoryUsage(500.000ms): 0, 181.24 MB, 78.74 MB ThreadUsage(500.000ms): 1, 12, 5 - AverageThreadTokens: 6.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 251.10 MB (263300112) - PerHostPeakMemUsage: 256.38 MB (268833808) - PrepareTime: 150.981ms - RowsProduced: 564 (564) - TotalCpuTime: 6s669ms - TotalNetworkReceiveTime: 144.420us - TotalNetworkSendTime: 3.306ms - TotalStorageWaitTime: 333.243ms CodeGen:(Total: 532.219ms, non-child: 532.219ms, % non-child: 100.00%) - CodegenTime: 1.636ms - CompileTime: 107.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 282.476ms - PrepareTime: 141.083ms DataStreamSender (dst_id=12):(Total: 154.197us, non-child: 154.197us, % non-child: 100.00%) - BytesSent: 10.24 KB (10481) - NetworkThroughput(*): 3.41 MB/sec - OverallThroughput: 64.82 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 412.510us - ThriftTransmitTime(*): 2.930ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 856.686ms, non-child: 208.561ms, % non-child: 24.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.788us - GetResultsTime: 106.549us - HTResizeTime: 329.121us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.88 MB (18745120) - PinTime: 0.000ns - ReductionFactorEstimate: 21.47 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 658.00 /sec - StreamingTime: 66.906ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 648.125ms, non-child: 6.417ms, % non-child: 0.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 152.502us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 73.345us - GetNewBlockTime: 261.389us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.40 MB (18245408) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.655ms - RowsReturned: 34.02K (34024) - RowsReturnedRate: 52.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.289us EXCHANGE_NODE (id=11):(Total: 50.392us, non-child: 50.392us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 34.049us - DeserializeRowBatchTimer: 114.619us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 19.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 641.713ms, non-child: 6.090ms, % non-child: 0.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.258us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 63.263us - GetNewBlockTime: 272.057us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.42 MB (13023200) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.229ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 54.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.230us EXCHANGE_NODE (id=10):(Total: 24.396us, non-child: 24.396us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 11.191us - DeserializeRowBatchTimer: 99.525us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 635.629ms, non-child: 17.745ms, % non-child: 2.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.982ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.006ms - GetNewBlockTime: 515.769us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18421608) - PinTime: 0.000ns - ProbeRows: 34.83K (34833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.383ms - RowsReturned: 34.83K (34833) - RowsReturnedRate: 54.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.460us EXCHANGE_NODE (id=9):(Total: 719.141us, non-child: 719.141us, % non-child: 100.00%) BytesReceived(500.000ms): 612.24 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 552.736us - DeserializeRowBatchTimer: 2.267ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 21.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 617.164ms, non-child: 617.164ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 7:1/46.61 MB 6:2/212.03 MB 5:2/93.57 MB 10:4/305.68 MB 4:2/207.36 MB 0:2/152.95 MB 9:4/186.67 MB 8:2/207.48 MB 1:3/313.21 MB 2:2/152.19 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 110.66 MB, 240.34 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 240.34 MB (252012000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.34 MB (252012000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.34 MB (252012000) - DecompressionTime: 740.987ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 236.93 MB (248439720) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.07M (35071902) - RowsReturned: 34.83K (34833) - RowsReturnedRate: 56.44 K/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 776 (776) - ScannerThreadsTotalWallClockTime: 5s724ms - MaterializeTupleTime(*): 4s523ms - ScannerThreadsSysTime: 183.967ms - ScannerThreadsUserTime: 5s159ms - ScannerThreadsVoluntaryContextSwitches: 300 (300) - TotalRawHdfsReadTime(*): 183.978ms - TotalReadThroughput: 240.34 MB/sec Filter 0: - Rows processed: 393.19K (393192) - Rows rejected: 9.09K (9094) - Rows total: 393.22K (393216) Filter 1: - Files processed: 24 (24) - Files rejected: 0 (0) - Files total: 24 (24) - RowGroups processed: 67.12K (67125) - RowGroups rejected: 0 (0) - RowGroups total: 67.12K (67125) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Filter 2: - Rows processed: 35.06M (35062808) - Rows rejected: 35.03M (35027975) - Rows total: 35.06M (35062808) Instance 3846c6b477d7d4bf:1d465c4a3debf4b5 (host=vb0212.halxg.cloudera.com:22000):(Total: 866.011ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Filter 0 arrival: 532ms Filter 1 arrival: 532ms Filter 2 arrival: 539ms MemoryUsage(500.000ms): 1.90 MB, 245.74 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 266.94 MB (279909872) - PerHostPeakMemUsage: 272.21 MB (285435376) - PrepareTime: 148.135ms - RowsProduced: 564 (564) - TotalCpuTime: 6s990ms - TotalNetworkReceiveTime: 82.465us - TotalNetworkSendTime: 4.034ms - TotalStorageWaitTime: 309.528ms CodeGen:(Total: 518.309ms, non-child: 518.309ms, % non-child: 100.00%) - CodegenTime: 1.443ms - CompileTime: 101.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.978ms - PrepareTime: 138.231ms DataStreamSender (dst_id=12):(Total: 188.126us, non-child: 188.126us, % non-child: 100.00%) - BytesSent: 10.17 KB (10411) - NetworkThroughput(*): 2.98 MB/sec - OverallThroughput: 52.78 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 527.149us - ThriftTransmitTime(*): 3.332ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 855.248ms, non-child: 207.372ms, % non-child: 24.25%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 69.537us - GetResultsTime: 173.131us - HTResizeTime: 480.107us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.51 MB (17312600) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 659.00 /sec - StreamingTime: 69.181ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 647.876ms, non-child: 6.481ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 66.705us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 37.473us - GetNewBlockTime: 179.121us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.03 MB (16812888) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.623ms - RowsReturned: 34.89K (34892) - RowsReturnedRate: 53.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.174us EXCHANGE_NODE (id=11):(Total: 38.264us, non-child: 38.264us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 28.839us - DeserializeRowBatchTimer: 21.405us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 26.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 641.398ms, non-child: 6.442ms, % non-child: 1.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 90.393us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 55.456us - GetNewBlockTime: 328.917us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.30 MB (12895096) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.364ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 55.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.986us EXCHANGE_NODE (id=10):(Total: 34.072us, non-child: 34.072us, % non-child: 100.00%) BytesReceived(500.000ms): 2.93 KB, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 18.319us - DeserializeRowBatchTimer: 11.364us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 634.962ms, non-child: 17.824ms, % non-child: 2.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.908ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.197ms - GetNewBlockTime: 585.274us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422416) - PinTime: 0.000ns - ProbeRows: 35.71K (35706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.301ms - RowsReturned: 35.71K (35706) - RowsReturnedRate: 56.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.117us EXCHANGE_NODE (id=9):(Total: 605.898us, non-child: 605.898us, % non-child: 100.00%) BytesReceived(500.000ms): 174.35 KB, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 504.259us - DeserializeRowBatchTimer: 1.947ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 25.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 616.531ms, non-child: 616.531ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 9:1/160.62 MB 8:3/259.11 MB 6:4/245.93 MB 0:3/140.02 MB 2:1/46.74 MB 4:2/207.25 MB 1:1/46.73 MB 10:5/351.76 MB 3:3/313.68 MB 5:2/153.14 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 207.34 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 246.45 MB (258419939) - BytesReadDataNodeCache: 0 - BytesReadLocal: 246.45 MB (258419939) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 246.45 MB (258419939) - DecompressionTime: 760.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 251.17 MB (263374680) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.95M (35950586) - RowsReturned: 35.71K (35706) - RowsReturnedRate: 57.91 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 704 (704) - ScannerThreadsTotalWallClockTime: 6s036ms - MaterializeTupleTime(*): 4s832ms - ScannerThreadsSysTime: 183.968ms - ScannerThreadsUserTime: 5s487ms - ScannerThreadsVoluntaryContextSwitches: 368 (368) - TotalRawHdfsReadTime(*): 194.719ms - TotalReadThroughput: 207.34 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.58K (9580) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 68.72K (68725) - RowGroups rejected: 0 (0) - RowGroups total: 68.72K (68725) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 35.94M (35941006) - Rows rejected: 35.91M (35905300) - Rows total: 35.94M (35941006) Instance 3846c6b477d7d4bf:1d465c4a3debf4c0 (host=vb0206.halxg.cloudera.com:22000):(Total: 862.829ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Filter 0 arrival: 530ms Filter 1 arrival: 530ms Filter 2 arrival: 537ms MemoryUsage(500.000ms): 1.40 MB, 249.45 MB, 18.66 KB ThreadUsage(500.000ms): 1, 12, 1 - AverageThreadTokens: 4.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 296.57 MB (310979248) - PerHostPeakMemUsage: 301.84 MB (316504752) - PrepareTime: 148.852ms - RowsProduced: 564 (564) - TotalCpuTime: 6s943ms - TotalNetworkReceiveTime: 60.937us - TotalNetworkSendTime: 4.034ms - TotalStorageWaitTime: 255.963ms CodeGen:(Total: 516.721ms, non-child: 516.721ms, % non-child: 100.00%) - CodegenTime: 1.417ms - CompileTime: 100.195ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 276.187ms - PrepareTime: 139.281ms DataStreamSender (dst_id=12):(Total: 214.118us, non-child: 214.118us, % non-child: 100.00%) - BytesSent: 10.20 KB (10448) - NetworkThroughput(*): 3.26 MB/sec - OverallThroughput: 46.54 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 490.953us - ThriftTransmitTime(*): 3.056ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 852.543ms, non-child: 214.012ms, % non-child: 25.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50.861us - GetResultsTime: 509.927us - HTResizeTime: 638.294us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.69 MB (16448408) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 661.00 /sec - StreamingTime: 74.533ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 638.531ms, non-child: 6.902ms, % non-child: 1.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 129.699us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 84.265us - GetNewBlockTime: 592.715us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.21 MB (15948696) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.266ms - RowsReturned: 34.08K (34076) - RowsReturnedRate: 53.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.624us EXCHANGE_NODE (id=11):(Total: 49.156us, non-child: 49.156us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.650us - DeserializeRowBatchTimer: 20.663us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 631.633ms, non-child: 6.230ms, % non-child: 0.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 88.267us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 76.814us - GetNewBlockTime: 293.085us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.20 MB (13843656) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.550ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 55.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.596us EXCHANGE_NODE (id=10):(Total: 31.462us, non-child: 31.462us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.292us - DeserializeRowBatchTimer: 12.308us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 625.409ms, non-child: 17.814ms, % non-child: 2.85%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 5.434ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 1.188ms - GetNewBlockTime: 472.432us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18422504) - PinTime: 0.000ns - ProbeRows: 34.86K (34861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.664ms - RowsReturned: 34.86K (34861) - RowsReturnedRate: 55.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.542us EXCHANGE_NODE (id=9):(Total: 619.722us, non-child: 619.722us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 537.570us - DeserializeRowBatchTimer: 1.925ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 24.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 606.975ms, non-child: 606.975ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 10:1/46.61 MB 8:1/46.87 MB 2:2/152.85 MB 5:2/93.57 MB 9:3/199.34 MB 6:2/320.71 MB 3:3/199.75 MB 1:4/413.66 MB 4:3/253.92 MB 7:2/152.35 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 168.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 240.41 MB (252088793) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.41 MB (252088793) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.41 MB (252088793) - DecompressionTime: 730.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 282.64 MB (296366032) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.11M (35106723) - RowsReturned: 34.86K (34861) - RowsReturnedRate: 57.43 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 633 (633) - ScannerThreadsTotalWallClockTime: 5s941ms - MaterializeTupleTime(*): 4s827ms - ScannerThreadsSysTime: 225.959ms - ScannerThreadsUserTime: 5s417ms - ScannerThreadsVoluntaryContextSwitches: 411 (411) - TotalRawHdfsReadTime(*): 172.296ms - TotalReadThroughput: 168.08 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8845) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 66.55K (66548) - RowGroups rejected: 0 (0) - RowGroups total: 66.55K (66548) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 35.10M (35097878) - Rows rejected: 35.06M (35063017) - Rows total: 35.10M (35097878) Instance 3846c6b477d7d4bf:1d465c4a3debf4be (host=vb0230.halxg.cloudera.com:22000):(Total: 857.512ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Filter 0 arrival: 552ms Filter 1 arrival: 552ms Filter 2 arrival: 558ms MemoryUsage(500.000ms): 1.40 MB, 228.12 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 293.85 MB (308121040) - PerHostPeakMemUsage: 299.12 MB (313646544) - PrepareTime: 149.175ms - RowsProduced: 564 (564) - TotalCpuTime: 6s523ms - TotalNetworkReceiveTime: 70.377us - TotalNetworkSendTime: 4.022ms - TotalStorageWaitTime: 269.399ms CodeGen:(Total: 537.970ms, non-child: 537.970ms, % non-child: 100.00%) - CodegenTime: 1.546ms - CompileTime: 105.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 292.047ms - PrepareTime: 139.077ms DataStreamSender (dst_id=12):(Total: 191.573us, non-child: 191.573us, % non-child: 100.00%) - BytesSent: 10.22 KB (10466) - NetworkThroughput(*): 3.16 MB/sec - OverallThroughput: 52.10 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 778.107us - ThriftTransmitTime(*): 3.162ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 846.903ms, non-child: 213.243ms, % non-child: 25.18%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.236us - GetResultsTime: 158.204us - HTResizeTime: 500.119us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.52 MB (19416184) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 665.00 /sec - StreamingTime: 74.270ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 633.659ms, non-child: 6.884ms, % non-child: 1.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 66.456us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 75.855us - GetNewBlockTime: 210.862us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.04 MB (18916472) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.048ms - RowsReturned: 36.23K (36234) - RowsReturnedRate: 57.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.297us EXCHANGE_NODE (id=11):(Total: 25.824us, non-child: 25.824us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 18.222us - DeserializeRowBatchTimer: 22.151us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 38.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 626.779ms, non-child: 6.909ms, % non-child: 1.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 89.949us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 67.300us - GetNewBlockTime: 324.511us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.82 MB (16591152) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.834ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 59.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.951us EXCHANGE_NODE (id=10):(Total: 32.800us, non-child: 32.800us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.128us - DeserializeRowBatchTimer: 10.659us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 11.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 619.876ms, non-child: 16.936ms, % non-child: 2.73%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.835ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 588.646us - GetNewBlockTime: 514.998us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18424480) - PinTime: 0.000ns - ProbeRows: 37.12K (37122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.545ms - RowsReturned: 37.12K (37122) - RowsReturnedRate: 59.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.522us EXCHANGE_NODE (id=9):(Total: 532.845us, non-child: 532.845us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 446.215us - DeserializeRowBatchTimer: 3.180ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 28.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 602.407ms, non-child: 602.407ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 5:1/160.55 MB 2:3/313.49 MB 1:1/46.39 MB 0:1/46.62 MB 4:2/152.67 MB 3:1/105.35 MB 7:4/360.75 MB 8:1/46.43 MB 10:1/160.79 MB 9:4/360.27 MB 6:4/246.26 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:69 BytesRead(500.000ms): 0, 199.10 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 255.51 MB (267924888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 255.51 MB (267924888) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 255.51 MB (267924888) - DecompressionTime: 759.866ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 278.09 MB (291600424) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.34M (37340464) - RowsReturned: 37.12K (37122) - RowsReturnedRate: 61.62 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 618 (618) - ScannerThreadsTotalWallClockTime: 5s520ms - MaterializeTupleTime(*): 4s360ms - ScannerThreadsSysTime: 207.963ms - ScannerThreadsUserTime: 4s995ms - ScannerThreadsVoluntaryContextSwitches: 328 (328) - TotalRawHdfsReadTime(*): 180.981ms - TotalReadThroughput: 199.10 MB/sec Filter 0: - Rows processed: 376.81K (376809) - Rows rejected: 8.85K (8854) - Rows total: 376.83K (376832) Filter 1: - Files processed: 23 (23) - Files rejected: 0 (0) - Files total: 23 (23) - RowGroups processed: 70.54K (70543) - RowGroups rejected: 0 (0) - RowGroups total: 70.54K (70543) - Rows processed: 376.81K (376809) - Rows rejected: 0 (0) - Rows total: 376.83K (376832) - Splits processed: 23 (23) - Splits rejected: 0 (0) - Splits total: 23 (23) Filter 2: - Rows processed: 37.33M (37331610) - Rows rejected: 37.29M (37294488) - Rows total: 37.33M (37331610) Instance 3846c6b477d7d4bf:1d465c4a3debf4b6 (host=vb0218.halxg.cloudera.com:22000):(Total: 843.376ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Filter 0 arrival: 529ms Filter 1 arrival: 529ms Filter 2 arrival: 535ms MemoryUsage(500.000ms): 1.40 MB, 235.52 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 269.17 MB (282246256) - PerHostPeakMemUsage: 274.44 MB (287771760) - PrepareTime: 145.196ms - RowsProduced: 564 (564) - TotalCpuTime: 7s082ms - TotalNetworkReceiveTime: 58.455us - TotalNetworkSendTime: 2.875ms - TotalStorageWaitTime: 296.699ms CodeGen:(Total: 515.486ms, non-child: 515.486ms, % non-child: 100.00%) - CodegenTime: 1.447ms - CompileTime: 101.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 277.244ms - PrepareTime: 135.314ms DataStreamSender (dst_id=12):(Total: 134.708us, non-child: 134.708us, % non-child: 100.00%) - BytesSent: 10.22 KB (10462) - NetworkThroughput(*): 4.01 MB/sec - OverallThroughput: 74.07 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 399.027us - ThriftTransmitTime(*): 2.487ms - UncompressedRowBatchSize: 15.48 KB (15852) AGGREGATION_NODE (id=7):(Total: 834.682ms, non-child: 216.018ms, % non-child: 25.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 73.514us - GetResultsTime: 92.363us - HTResizeTime: 463.540us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.99 MB (15715064) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 564 (564) - RowsReturnedRate: 675.00 /sec - StreamingTime: 81.548ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 618.664ms, non-child: 7.079ms, % non-child: 1.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 142.996us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.530us - GetNewBlockTime: 252.756us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.51 MB (15215352) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.327ms - RowsReturned: 35.92K (35923) - RowsReturnedRate: 58.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.258us EXCHANGE_NODE (id=11):(Total: 49.105us, non-child: 49.105us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 34.952us - DeserializeRowBatchTimer: 22.752us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 611.591ms, non-child: 6.748ms, % non-child: 1.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 88.688us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 65.558us - GetNewBlockTime: 322.258us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.94 MB (13567336) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.727ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 60.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.193us EXCHANGE_NODE (id=10):(Total: 34.356us, non-child: 34.356us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 17.873us - DeserializeRowBatchTimer: 83.219us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 604.849ms, non-child: 15.711ms, % non-child: 2.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 4.361ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 581.849us - GetNewBlockTime: 445.096us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18423648) - PinTime: 0.000ns - ProbeRows: 36.82K (36819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.874ms - RowsReturned: 36.82K (36819) - RowsReturnedRate: 60.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.501us EXCHANGE_NODE (id=9):(Total: 474.237us, non-child: 474.237us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 404.795us - DeserializeRowBatchTimer: 2.077ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 32.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 588.663ms, non-child: 588.663ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 4:2/211.98 MB 2:2/152.74 MB 7:3/313.69 MB 6:7/387.01 MB 5:3/139.65 MB 9:2/153.40 MB 0:1/160.58 MB 10:4/305.14 MB 8:1/160.74 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 154.53 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 253.98 MB (266317999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.98 MB (266317999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.98 MB (266317999) - DecompressionTime: 769.300ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 254.55 MB (266918584) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 37.08M (37077122) - RowsReturned: 36.82K (36819) - RowsReturnedRate: 62.55 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 666 (666) - ScannerThreadsTotalWallClockTime: 6s139ms - MaterializeTupleTime(*): 4s943ms - ScannerThreadsSysTime: 222.960ms - ScannerThreadsUserTime: 5s578ms - ScannerThreadsVoluntaryContextSwitches: 383 (383) - TotalRawHdfsReadTime(*): 181.758ms - TotalReadThroughput: 154.53 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.48K (9479) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.32K (70316) - RowGroups rejected: 0 (0) - RowGroups total: 70.32K (70316) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 37.07M (37067643) - Rows rejected: 37.03M (37030824) - Rows total: 37.07M (37067643) Instance 3846c6b477d7d4bf:1d465c4a3debf4ba (host=vb0222.halxg.cloudera.com:22000):(Total: 840.693ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Filter 0 arrival: 532ms Filter 1 arrival: 532ms Filter 2 arrival: 535ms MemoryUsage(500.000ms): 1.40 MB, 219.89 MB ThreadUsage(500.000ms): 1, 12 - AverageThreadTokens: 6.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 296.44 MB (310836248) - PerHostPeakMemUsage: 301.71 MB (316361752) - PrepareTime: 146.008ms - RowsProduced: 423 (423) - TotalCpuTime: 6s524ms - TotalNetworkReceiveTime: 44.356us - TotalNetworkSendTime: 4.776ms - TotalStorageWaitTime: 294.780ms CodeGen:(Total: 517.486ms, non-child: 517.486ms, % non-child: 100.00%) - CodegenTime: 1.445ms - CompileTime: 101.990ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 360 (360) - NumInstructions: 6.35K (6347) - OptimizationTime: 278.226ms - PrepareTime: 136.210ms DataStreamSender (dst_id=12):(Total: 124.855us, non-child: 124.855us, % non-child: 100.00%) - BytesSent: 7.71 KB (7899) - NetworkThroughput(*): 1.81 MB/sec - OverallThroughput: 60.33 MB/sec - PeakMemoryUsage: 139.92 KB (143280) - SerializeBatchTime: 335.062us - ThriftTransmitTime(*): 4.169ms - UncompressedRowBatchSize: 11.62 KB (11904) AGGREGATION_NODE (id=7):(Total: 830.670ms, non-child: 215.411ms, % non-child: 25.93%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.878us - GetResultsTime: 104.347us - HTResizeTime: 683.507us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.51 MB (18357952) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 423 (423) - RowsReturnedRate: 509.00 /sec - StreamingTime: 78.659ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=6):(Total: 615.259ms, non-child: 6.992ms, % non-child: 1.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 130.227us - BuildRows: 1.00K (1002) - BuildRowsPartitioned: 1.00K (1002) - BuildTime: 72.611us - GetNewBlockTime: 272.771us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.03 MB (17858240) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.163ms - RowsReturned: 35.67K (35672) - RowsReturnedRate: 57.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.727us EXCHANGE_NODE (id=11):(Total: 49.994us, non-child: 49.994us, % non-child: 100.00%) BytesReceived(500.000ms): 10.04 KB, 10.04 KB - BytesReceived: 10.04 KB (10283) - ConvertRowBatchTime: 35.562us - DeserializeRowBatchTimer: 23.594us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.00K (1002) - RowsReturnedRate: 20.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 608.272ms, non-child: 7.072ms, % non-child: 1.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 91.407us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 36.760us - GetNewBlockTime: 325.665us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.40 MB (14050792) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.875ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 60.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.628us EXCHANGE_NODE (id=10):(Total: 45.164us, non-child: 45.164us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 2.93 KB - BytesReceived: 2.93 KB (3005) - ConvertRowBatchTime: 28.943us - DeserializeRowBatchTimer: 12.745us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 8.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 601.206ms, non-child: 14.817ms, % non-child: 2.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Published - BuildPartitionTime: 2.927ms - BuildRows: 15.41K (15406) - BuildRowsPartitioned: 15.41K (15406) - BuildTime: 601.976us - GetNewBlockTime: 652.584us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.57 MB (18420856) - PinTime: 0.000ns - ProbeRows: 36.52K (36523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.244ms - RowsReturned: 36.52K (36523) - RowsReturnedRate: 60.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.618us EXCHANGE_NODE (id=9):(Total: 323.705us, non-child: 323.705us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 612.24 KB - BytesReceived: 612.24 KB (626935) - ConvertRowBatchTime: 275.081us - DeserializeRowBatchTimer: 2.055ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.41K (15406) - RowsReturnedRate: 47.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 586.065ms, non-child: 586.065ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 8:1/106.28 MB 2:1/46.66 MB 1:3/253.71 MB 4:4/419.92 MB 9:2/266.12 MB 5:3/140.34 MB 6:5/233.28 MB 7:3/313.45 MB 0:3/200.01 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:75 BytesRead(500.000ms): 0, 215.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 253.32 MB (265628829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.32 MB (265628829) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.32 MB (265628829) - DecompressionTime: 763.390ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 281.99 MB (295687120) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 36.98M (36975520) - RowsReturned: 36.52K (36523) - RowsReturnedRate: 62.32 K/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 565 (565) - ScannerThreadsTotalWallClockTime: 5s582ms - MaterializeTupleTime(*): 4s405ms - ScannerThreadsSysTime: 189.967ms - ScannerThreadsUserTime: 5s054ms - ScannerThreadsVoluntaryContextSwitches: 467 (467) - TotalRawHdfsReadTime(*): 174.829ms - TotalReadThroughput: 215.63 MB/sec Filter 0: - Rows processed: 409.57K (409575) - Rows rejected: 9.63K (9627) - Rows total: 409.60K (409600) Filter 1: - Files processed: 25 (25) - Files rejected: 0 (0) - Files total: 25 (25) - RowGroups processed: 70.27K (70273) - RowGroups rejected: 0 (0) - RowGroups total: 70.27K (70273) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Filter 2: - Rows processed: 36.97M (36965893) - Rows rejected: 36.93M (36929370) - Rows total: 36.97M (36965893) Fragment F03: Instance 3846c6b477d7d4bf:1d465c4a3debf4c3 (host=vb0234.halxg.cloudera.com:22000):(Total: 152.379ms, non-child: 147.375ms, % non-child: 96.72%) Hdfs split stats (:<# splits>/): 5:1/88.92 KB MemoryUsage(500.000ms): 248.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 392.00 KB (401408) - PerHostPeakMemUsage: 3.82 MB (4009632) - PrepareTime: 121.624us - RowsProduced: 1.00K (1002) - TotalCpuTime: 11.658ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 142.632ms - TotalStorageWaitTime: 3.995ms DataStreamSender (dst_id=11):(Total: 235.239us, non-child: 235.239us, % non-child: 100.00%) - BytesSent: 150.63 KB (154245) - NetworkThroughput(*): 75.04 KB/sec - OverallThroughput: 625.32 MB/sec - PeakMemoryUsage: 240.00 KB (245760) - SerializeBatchTime: 70.439us - ThriftTransmitTime(*): 2s007ms - UncompressedRowBatchSize: 176.19 KB (180420) HDFS_SCAN_NODE (id=3):(Total: 4.769ms, non-child: 4.769ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/88.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 94.12 KB (96380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.12 KB (96380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.12 KB (96380) - DecompressionTime: 1.342us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 144.00 KB (147456) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 1.00K (1002) - RowsReturnedRate: 210.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.486ms - MaterializeTupleTime(*): 46.922us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 48.786us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 3846c6b477d7d4bf:1d465c4a3debf4c4 (host=vb0226.halxg.cloudera.com:22000):(Total: 168.018ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/2.17 MB MemoryUsage(500.000ms): 128.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.36 MB (1421872) - PerHostPeakMemUsage: 5.23 MB (5479064) - PrepareTime: 140.954ms - RowsProduced: 365 (365) - TotalCpuTime: 397.233ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.219us - TotalStorageWaitTime: 7.686ms CodeGen:(Total: 350.855ms, non-child: 350.855ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 351 (351) - NumInstructions: 3.21K (3208) - OptimizationTime: 205.734ms - PrepareTime: 137.500ms DataStreamSender (dst_id=10):(Total: 120.124us, non-child: 120.124us, % non-child: 100.00%) - BytesSent: 44.02 KB (45075) - NetworkThroughput(*): 14.45 MB/sec - OverallThroughput: 357.85 MB/sec - PeakMemoryUsage: 120.00 KB (122880) - SerializeBatchTime: 34.232us - ThriftTransmitTime(*): 2.974ms - UncompressedRowBatchSize: 106.99 KB (109560) HDFS_SCAN_NODE (id=2):(Total: 304.486ms, non-child: 304.486ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 480.48 KB (492007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 480.48 KB (492007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480.48 KB (492007) - DecompressionTime: 186.133us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.23 MB (1290800) - PerReadThreadRawHdfsThroughput: 406.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 1.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 22.464ms - MaterializeTupleTime(*): 12.830ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.997ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 1.153ms - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 3846c6b477d7d4bf:1d465c4a3debf4c5 (host=vb0230.halxg.cloudera.com:22000):(Total: 239.856ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/28.28 MB MemoryUsage(500.000ms): 38.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.47 MB (5738128) - PerHostPeakMemUsage: 10.42 MB (10929888) - PrepareTime: 139.727ms - RowsProduced: 15.41K (15406) - TotalCpuTime: 538.186ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 804.901us - TotalStorageWaitTime: 9.341ms CodeGen:(Total: 350.080ms, non-child: 350.080ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.50 MB (1569044) - NumFunctions: 338 (338) - NumInstructions: 2.83K (2831) - OptimizationTime: 201.461ms - PrepareTime: 137.200ms DataStreamSender (dst_id=9):(Total: 10.181ms, non-child: 10.181ms, % non-child: 100.00%) - BytesSent: 8.97 MB (9404025) - NetworkThroughput(*): 63.40 MB/sec - OverallThroughput: 880.84 MB/sec - PeakMemoryUsage: 30.00 KB (30720) - SerializeBatchTime: 7.967ms - ThriftTransmitTime(*): 141.464ms - UncompressedRowBatchSize: 21.44 MB (22481115) HDFS_SCAN_NODE (id=0):(Total: 365.395ms, non-child: 365.395ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/28.28 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 MB (2562655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 MB (2562655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 MB (2562655) - DecompressionTime: 4.185ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.44 MB (5699216) - PerReadThreadRawHdfsThroughput: 977.63 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 15.41K (15406) - RowsReturnedRate: 42.16 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 94.937ms - MaterializeTupleTime(*): 79.357ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 84.987ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 2.499ms - TotalReadThroughput: 0.00 /sec ================================================================================