Query (id=fc4ea6bd635e13eb:76b88c150865e7a2) Summary Session ID: 284f89cb19954f67:7cbb9121d899b788 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-02-22 17:20:50.455384000 End Time: 2016-02-22 17:36:45.781965000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 DEBUG (build 22f71f3e82151c1064bf2983dd3e9025c4cce5b3) User: jenkins Connected User: jenkins Delegated User: Network Address: 172.26.26.3:39515 Default Db: tpcds_10_decimal_parquet Sql Statement: /* Mem: 145 MB. Coordinator: impala-stress-cdh570-3.vpc.cloudera.com. */ select i_item_desc, i_category, i_class, i_current_price, sum(ss_ext_sales_price) as itemrevenue, sum(ss_ext_sales_price)*100/sum(sum(ss_ext_sales_price)) over (partition by i_class) as revenueratio from store_sales, item, date_dim where ss_item_sk = i_item_sk and i_category in ('Jewelry', 'Sports', 'Books') and ss_sold_date_sk = d_date_sk and ss_sold_date_sk between 2451911 and 2451941 and d_date between '2001-01-01' and '2001-01-31' -- original uses interval and the group by i_item_id, i_item_desc, i_category, i_class, i_current_price order by i_category, i_class, i_item_id, i_item_desc, revenueratio limit 1000; Coordinator: impala-stress-cdh570-3.vpc.cloudera.com:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=152043520,RUNTIME_FILTER_MODE=2 Plan: ---------------- Estimated Per-Host Requirements: Memory=177.76MB VCores=2 14:MERGING-EXCHANGE [UNPARTITIONED] | order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ss_ext_sales_price) * 100 / sum(sum(ss_ext_sales_price)) ASC | limit: 1000 | hosts=4 per-host-mem=unavailable | tuple-ids=5 row-size=230B cardinality=1000 | 08:TOP-N [LIMIT=1000] | order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ss_ext_sales_price) * 100 / sum(sum(ss_ext_sales_price)) ASC | hosts=4 per-host-mem=224.51KB | tuple-ids=5 row-size=230B cardinality=1000 | 07:ANALYTIC | functions: sum(sum(ss_ext_sales_price)) | partition by: i_class | hosts=4 per-host-mem=0B | tuple-ids=7,6 row-size=230B cardinality=78749 | 06:SORT | order by: i_class ASC NULLS FIRST | hosts=4 per-host-mem=32.00MB | tuple-ids=7 row-size=214B cardinality=78749 | 13:AGGREGATE [FINALIZE] | output: sum:merge(ss_ext_sales_price) | group by: i_item_id, i_item_desc, i_category, i_class, i_current_price | hosts=4 per-host-mem=17.67MB | tuple-ids=3 row-size=214B cardinality=78749 | 12:EXCHANGE [HASH(i_class)] | hosts=4 per-host-mem=0B | tuple-ids=3 row-size=214B cardinality=78749 | 05:AGGREGATE [STREAMING] | output: sum(ss_ext_sales_price) | group by: i_item_id, i_item_desc, i_category, i_class, i_current_price | hosts=4 per-host-mem=17.67MB | tuple-ids=3 row-size=214B cardinality=78749 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF000 <- d_date_sk | hosts=4 per-host-mem=266.80KB | tuple-ids=0,1,2 row-size=260B cardinality=78749 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=34B cardinality=7305 | | | 02:SCAN HDFS [tpcds_10_decimal_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: tpcds_10_decimal_parquet.date_dim.d_date_sk >= 2451911, tpcds_10_decimal_parquet.date_dim.d_date_sk <= 2451941, d_date >= '2001-01-01', d_date <= '2001-01-31' | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=2 row-size=34B cardinality=7305 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF001 <- i_item_sk | hosts=4 per-host-mem=1.50MB | tuple-ids=0,1 row-size=226B cardinality=78749 | |--10:EXCHANGE [HASH(i_item_sk)] | | hosts=1 per-host-mem=0B | | tuple-ids=1 row-size=206B cardinality=27818 | | | 01:SCAN HDFS [tpcds_10_decimal_parquet.item, RANDOM] | partitions=1/1 files=1 size=9.75MB | predicates: i_category IN ('Jewelry', 'Sports', 'Books') | table stats: 102000 rows total | column stats: all | hosts=1 per-host-mem=144.00MB | tuple-ids=1 row-size=206B cardinality=27818 | 09:EXCHANGE [HASH(ss_item_sk)] | hosts=4 per-host-mem=0B | tuple-ids=0 row-size=20B cardinality=288747 | 00:SCAN HDFS [tpcds_10_decimal_parquet.store_sales, RANDOM] partitions=31/1824 files=31 size=18.33MB runtime filters: RF000 -> ss_sold_date_sk, RF001 -> ss_item_sk table stats: 28800991 rows total column stats: all hosts=4 per-host-mem=32.00MB tuple-ids=0 row-size=20B cardinality=288747 ---------------- Estimated Per-Host Mem: 186397710 Estimated Per-Host VCores: 2 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 14:MERGING-EXCHANGE 1 1s995ms 1s995ms 1.02K 1.00K 0 -1.00 B UNPARTITIONED 08:TOP-N 4 5s790ms 14s320ms 4.00K 1.00K 528.00 KB 224.51 KB 07:ANALYTIC 4 1s814ms 2s828ms 15.09K 78.75K 8.03 MB 0 06:SORT 4 1s244ms 1s629ms 15.09K 78.75K 24.02 MB 32.00 MB 13:AGGREGATE 4 1m1s 1m18s 15.09K 78.75K 2.74 MB 17.67 MB FINALIZE 12:EXCHANGE 4 1.436ms 2.046ms 15.09K 78.75K 0 0 HASH(i_class) 05:AGGREGATE 4 1m1s 1m19s 15.09K 78.75K 1.63 MB 17.67 MB STREAMING 04:HASH JOIN 4 11s825ms 21s337ms 84.86K 78.75K 2.03 MB 266.80 KB INNER JOIN, BROADCAST |--11:EXCHANGE 4 33.882us 36.521us 31 7.30K 0 0 BROADCAST | 02:SCAN HDFS 1 42s410ms 42s410ms 31 7.30K 2.93 MB 32.00 MB tpcds_10_decimal_parquet.da... 03:HASH JOIN 4 8s599ms 13s740ms 84.86K 78.75K 10.27 MB 1.50 MB INNER JOIN, PARTITIONED |--10:EXCHANGE 4 64.816ms 159.518ms 30.29K 27.82K 0 0 HASH(i_item_sk) | 01:SCAN HDFS 1 4m39s 4m39s 30.29K 27.82K 16.41 MB 144.00 MB tpcds_10_decimal_parquet.item 09:EXCHANGE 4 5s308ms 19s202ms 208.22K 288.75K 0 0 HASH(ss_item_sk) 00:SCAN HDFS 4 8m32s 14m39s 210.27K 288.75K 2.42 MB 32.00 MB tpcds_10_decimal_parquet.st... Planner Timeline Analysis finished: 462159171 Equivalence classes computed: 463165099 Single node plan created: 1630625206 Runtime filters computed: 1630752179 Distributed plan created: 2442422083 Lineage info computed: 2443591038 Planning finished: 3525274403 Query Timeline Start execution: 154172 Planning finished: 3753999300 Ready to start 14 remote fragments: 4449683279 All 14 remote fragments started: 5438658382 First dynamic filter received: 222254360001 Rows available: 943867323924 First row fetched: 945259387629 Unregister query: 955307249015 ImpalaServer - ClientFetchWaitTimer: 8516824215 - InactiveTotalTime: 0 - RowMaterializationTimer: 865015262 - TotalTime: 0 Execution Profile fc4ea6bd635e13eb:76b88c150865e7a2 Number of filters: 2 Filter routing table: ID Src. Node Dst. Node Destinations Pending Broadcast Partition filter First arrived Completed -------------------------------------------------------------------------------------------------------- 1 3 0 4 4 false false N/A N/A 0 4 0 4 1 true true N/A N/A Fragment start latencies: Count: 14, 25th %-ile: 171ms, 50th %-ile: 183ms, 75th %-ile: 340ms, 90th %-ile: 374ms, 95th %-ile: 374ms, 99.9th %-ile: 612ms Final filter table: ID Src. Node Dst. Node Destinations Pending Broadcast Partition filter First arrived Completed -------------------------------------------------------------------------------------------------------- 1 3 0 4 0 false false 4m50s 4m52s 0 4 0 4 0 true true 3m42s 3m42s Per Node Peak Memory Usage: impala-stress-cdh570-5.vpc.cloudera.com:22000(42.91 MB) impala-stress-cdh570-4.vpc.cloudera.com:22000(42.75 MB) impala-stress-cdh570-2.vpc.cloudera.com:22000(41.64 MB) impala-stress-cdh570-3.vpc.cloudera.com:22000(59.26 MB) - FiltersReceived: 5 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 941828079251 Coordinator Fragment F05 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 974120 - PerHostPeakMemUsage: 0 - PrepareTime: 9340093 - RowsProduced: 1000 - TotalCpuTime: 943296198582 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 940486496896 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 25 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 33554432 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=14) - BytesReceived: 502792 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 3166081 - FirstBatchArrivalWaitTime: 938152084587 - InactiveTotalTime: 938152090200 - MergeGetNext: 1710841 - MergeGetNextBatch: 0 - PeakMemoryUsage: 0 - RowsReturned: 1024 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 940147193126 Averaged Fragment F04 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:15m27s max:15m39s mean: 15m31s stddev:4s680ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 4 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34139368 - PerHostPeakMemUsage: 48904880 - PrepareTime: 60933408451 - RowsProduced: 1000 - TotalCpuTime: 302568392001 - TotalNetworkReceiveTime: 628487239924 - TotalNetworkSendTime: 111388103 - TotalStorageWaitTime: 0 - TotalTime: 700530367639 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 25 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 33554432 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 5239469081 - CompileTime: 15882633144 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 213668233459 - PrepareTime: 51354292102 - TotalTime: 281962492029 DataStreamSender (dst_id=14) - BytesSent: 125698 - InactiveTotalTime: 0 - NetworkThroughput(*): 3355471 - OverallThroughput: 14150176 - PeakMemoryUsage: 1256 - SerializeBatchTime: 163220593 - ThriftTransmitTime(*): 55785953 - TotalTime: 163323694 - UncompressedRowBatchSize: 237485 SORT_NODE (id=8) - InactiveTotalTime: 0 - PeakMemoryUsage: 540672 - RowsReturned: 1000 - RowsReturnedRate: 1 - TotalTime: 699077375408 ANALYTIC_EVAL_NODE (id=7) - EvaluationTime: 951947079 - GetNewBlockTime: 137170001 - InactiveTotalTime: 0 - PeakMemoryUsage: 8421376 - PinTime: 0 - RowsReturned: 3772 - RowsReturnedRate: 5 - TotalTime: 693286967861 - UnpinTime: 0 SORT_NODE (id=6) - InMemorySortTime: 291144814 - InactiveTotalTime: 0 - InitialRunsCreated: 1 - PeakMemoryUsage: 25182208 - RowsReturned: 3772 - RowsReturnedRate: 5 - SortDataSize: 823981 - TotalMergesPerformed: 0 - TotalTime: 691472490615 AGGREGATION_NODE (id=13) - BuildTime: 957053731 - GetNewBlockTime: 604460118 - GetResultsTime: 34895895 - HTResizeTime: 6998226 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2871982 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3772 - RowsReturnedRate: 5 - SpilledPartitions: 0 - TotalTime: 690228402397 - UnpinTime: 21121 EXCHANGE_NODE (id=12) - BytesReceived: 489109 - ConvertRowBatchTime: 986770 - DeserializeRowBatchTimer: 298192263 - FirstBatchArrivalWaitTime: 626548149891 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 3772 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 628488440901 Averaged Fragment F02 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:15m22s max:15m22s mean: 15m22s stddev:224.632ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 4 - AverageThreadTokens: 1.0 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 14011200 - PerHostPeakMemUsage: 48904880 - PrepareTime: 67620183554 - RowsProduced: 3772 - TotalCpuTime: 228360656308 - TotalNetworkReceiveTime: 693406211784 - TotalNetworkSendTime: 513148132 - TotalStorageWaitTime: 0 - TotalTime: 786095521527 CodeGen - CodegenTime: 2352268792 - CompileTime: 9366276656 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 125032130753 - PrepareTime: 57932263634 - TotalTime: 193792373255 DataStreamSender (dst_id=12) - BytesSent: 489109 - InactiveTotalTime: 0 - NetworkThroughput(*): 618661 - OverallThroughput: 397911 - PeakMemoryUsage: 251712 - SerializeBatchTime: 174640330 - ThriftTransmitTime(*): 1160428254 - TotalTime: 1314246768 - UncompressedRowBatchSize: 839158 AGGREGATION_NODE (id=5) - GetNewBlockTime: 660678633 - GetResultsTime: 71417927 - HTResizeTime: 48402901 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 1 - PartitionsCreated: 16 - PeakMemoryUsage: 1699740 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3772 - RowsReturnedRate: 4 - StreamingTime: 3220683827 - TotalTime: 780667184406 - UnpinTime: 0 HASH_JOIN_NODE (id=4) - BuildPartitionTime: 20273 - BuildRows: 31 - BuildRowsPartitioned: 31 - BuildTime: 79749 - GetNewBlockTime: 100666387 - HashBuckets: 74 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 22 - LocalTime: 11825418058 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2125824 - PinTime: 0 - ProbeRows: 21216 - ProbeRowsPartitioned: 0 - ProbeTime: 9515276 - RowsReturned: 21216 - RowsReturnedRate: 29 - SpilledPartitions: 0 - TotalTime: 718905561789 - UnpinTime: 18171 EXCHANGE_NODE (id=11) - BytesReceived: 605 - ConvertRowBatchTime: 9389 - DeserializeRowBatchTimer: 29405 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 31 - RowsReturnedRate: 917890 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 33882 HASH_JOIN_NODE (id=3) - BuildPartitionTime: 634338412 - BuildRows: 7573 - BuildRowsPartitioned: 7573 - BuildTime: 117370573 - GetNewBlockTime: 88755260 - HashBuckets: 16384 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - LocalTime: 8599182726 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10772480 - PinTime: 0 - ProbeRows: 52056 - ProbeRowsPartitioned: 0 - ProbeTime: 234550414 - RowsReturned: 21216 - RowsReturnedRate: 29 - SpilledPartitions: 0 - TotalTime: 707080109849 - UnpinTime: 19016 EXCHANGE_NODE (id=10) - BytesReceived: 950369 - ConvertRowBatchTime: 1756588 - DeserializeRowBatchTimer: 610887794 - FirstBatchArrivalWaitTime: 30612353870 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 7573 - RowsReturnedRate: 123 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 67704857614 EXCHANGE_NODE (id=9) - BytesReceived: 731983 - ConvertRowBatchTime: 5023599234 - DeserializeRowBatchTimer: 5446252016 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 52056 - RowsReturnedRate: 82 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 630776069507 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 24 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 26231968 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Averaged Fragment F03 split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:1m15s max:1m15s mean: 1m15s stddev:0.000ns execution rates: min:29.57 KB/sec max:29.57 KB/sec mean:29.57 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.64 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3094568 - PerHostPeakMemUsage: 17595312 - PrepareTime: 113434482 - RowsProduced: 31 - TotalCpuTime: 63596674683 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29925543600 - TotalStorageWaitTime: 22580865340 - TotalTime: 43167238245 DataStreamSender (dst_id=11) - BytesSent: 2420 - InactiveTotalTime: 0 - NetworkThroughput(*): 30 - OverallThroughput: 12308 - PeakMemoryUsage: 16384 - SerializeBatchTime: 125552604 - ThriftTransmitTime(*): 80304397985 - TotalTime: 196610062 - UncompressedRowBatchSize: 5720 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 841643 - BytesReadDataNodeCache: 0 - BytesReadLocal: 841643 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 841643 - DecompressionTime: 4464028351 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3069992 - PerReadThreadRawHdfsThroughput: 1153912490 - RemoteScanRanges: 0 - RowsRead: 73049 - RowsReturned: 31 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 590 - ScannerThreadsTotalWallClockTime: 41786299316 - MaterializeTupleTime(*): 9183641223 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 124981000 - ScannerThreadsVoluntaryContextSwitches: 151 - TotalRawHdfsReadTime(*): 729382 - TotalReadThroughput: 20335 - TotalTime: 42410764596 Averaged Fragment F01 split sizes: min: 9.75 MB, max: 9.75 MB, avg: 9.75 MB, stddev: 0 completion times: min:4m44s max:4m44s mean: 4m44s stddev:0.000ns execution rates: min:35.14 KB/sec max:35.14 KB/sec mean:35.14 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.9959183673469387 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17591200 - PerHostPeakMemUsage: 62134888 - PrepareTime: 61444838 - RowsProduced: 30294 - TotalCpuTime: 331125787837 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 847407565 - TotalStorageWaitTime: 232473308883 - TotalTime: 282235084265 DataStreamSender (dst_id=10) - BytesSent: 3801478 - InactiveTotalTime: 0 - NetworkThroughput(*): 950502 - OverallThroughput: 1884100 - PeakMemoryUsage: 252288 - SerializeBatchTime: 619947606 - ThriftTransmitTime(*): 3999441375 - TotalTime: 2017661630 - UncompressedRowBatchSize: 6487176 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.05122950819672131 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 6894186 - BytesReadDataNodeCache: 0 - BytesReadLocal: 6894186 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6894186 - DecompressionTime: 4627654298 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 6 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 17203240 - PerReadThreadRawHdfsThroughput: 557218 - RemoteScanRanges: 0 - RowsRead: 102000 - RowsReturned: 30294 - RowsReturnedRate: 108 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 752 - ScannerThreadsTotalWallClockTime: 281258916645 - MaterializeTupleTime(*): 34597429869 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 427934000 - ScannerThreadsVoluntaryContextSwitches: 297 - TotalRawHdfsReadTime(*): 12372509005 - TotalReadThroughput: 27839 - TotalTime: 279405218194 Averaged Fragment F00 split sizes: min: 4.45 MB, max: 4.91 MB, avg: 4.58 MB, stddev: 194.55 KB completion times: min:1m30s max:15m20s mean: 9m36s stddev:5m34s execution rates: min:4.94 KB/sec max:50.42 KB/sec mean:17.92 KB/sec stddev:18.88 KB/sec num instances: 4 - AverageThreadTokens: 1.9641293511444888 - BloomFilterBytes: 1572864 - InactiveTotalTime: 0 - PeakMemoryUsage: 1544290 - PerHostPeakMemUsage: 45915350 - PrepareTime: 33194106 - RowsProduced: 52567 - TotalCpuTime: 567121496484 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 55571614779 - TotalStorageWaitTime: 529170882489 - TotalTime: 570312743882 DataStreamSender (dst_id=9) - BytesSent: 739140 - InactiveTotalTime: 0 - NetworkThroughput(*): 4283 - OverallThroughput: 13317 - PeakMemoryUsage: 136512 - SerializeBatchTime: 667381054 - ThriftTransmitTime(*): 176939238269 - TotalTime: 57188248791 - UncompressedRowBatchSize: 1472215 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.001819723971014073 - AverageScannerThreadConcurrency: 0.9737716895675859 - BytesRead: 1601695 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1601695 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1601695 - DecompressionTime: 221507 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 7 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1388146 - PerReadThreadRawHdfsThroughput: 719850814 - RemoteScanRanges: 0 - RowsRead: 72186 - RowsReturned: 52567 - RowsReturnedRate: 7022 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 142 - ScannerThreadsTotalWallClockTime: 566765391500 - MaterializeTupleTime(*): 32156613355 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 99984250 - ScannerThreadsVoluntaryContextSwitches: 222 - TotalRawHdfsReadTime(*): 208121104 - TotalReadThroughput: 6702 - TotalTime: 512002923669 Filter 0 - Files processed: 0 - Files rejected: 0 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 152 - RowGroups rejected: 0 - RowGroups total: 193 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 3 - Splits rejected: 0 - Splits total: 7 - TotalTime: 0 Filter 1 - InactiveTotalTime: 0 - Rows processed: 68818 - Rows rejected: 19619 - Rows total: 68819 - TotalTime: 0 Fragment F04 Instance fc4ea6bd635e13eb:76b88c150865e7a4 (host=impala-stress-cdh570-2.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34133224 - PerHostPeakMemUsage: 43665288 - PrepareTime: 43831116871 - RowsProduced: 1000 - TotalCpuTime: 264843439078 - TotalNetworkReceiveTime: 665015958426 - TotalNetworkSendTime: 193856302 - TotalStorageWaitTime: 0 - TotalTime: 717794075532 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 25 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 33554432 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 1317227250 - CompileTime: 14296724456 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 197085597815 - PrepareTime: 40190736634 - TotalTime: 252363093374 DataStreamSender (dst_id=14) - BytesSent: 127709 - InactiveTotalTime: 0 - NetworkThroughput(*): 1198160 - OverallThroughput: 54527840 - PeakMemoryUsage: 1256 - SerializeBatchTime: 2248060 - ThriftTransmitTime(*): 106587581 - TotalTime: 2342088 - UncompressedRowBatchSize: 236396 SORT_NODE (id=8) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - PeakMemoryUsage: 540672 - RowsReturned: 1000 - RowsReturnedRate: 1 - TotalTime: 717139426794 ANALYTIC_EVAL_NODE (id=7) - EvaluationTime: 1321780602 - GetNewBlockTime: 78560 - InactiveTotalTime: 0 - PeakMemoryUsage: 8421376 - PinTime: 0 - RowsReturned: 3370 - RowsReturnedRate: 4 - TotalTime: 713602851530 - UnpinTime: 0 SORT_NODE (id=6) ExecOption: Codegen Enabled - InMemorySortTime: 219889607 - InactiveTotalTime: 0 - InitialRunsCreated: 1 - PeakMemoryUsage: 25182208 - RowsReturned: 3370 - RowsReturnedRate: 4 - SortDataSize: 729306 - TotalMergesPerformed: 0 - TotalTime: 712185757341 AGGREGATION_NODE (id=13) ExecOption: Codegen Enabled - BuildTime: 1423050937 - GetNewBlockTime: 580440801 - GetResultsTime: 135662415 - HTResizeTime: 429122 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2864696 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3370 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 710555785803 - UnpinTime: 23262 EXCHANGE_NODE (id=12) - BytesReceived: 434152 - ConvertRowBatchTime: 689697 - DeserializeRowBatchTimer: 5645083 - FirstBatchArrivalWaitTime: 662653470212 - InactiveTotalTime: 665015783717 - PeakMemoryUsage: 0 - RowsReturned: 3370 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 665016818096 Instance fc4ea6bd635e13eb:76b88c150865e7a6 (host=impala-stress-cdh570-4.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34141416 - PerHostPeakMemUsage: 44824936 - PrepareTime: 62137941963 - RowsProduced: 1000 - TotalCpuTime: 315377430724 - TotalNetworkReceiveTime: 623538460072 - TotalNetworkSendTime: 58611742 - TotalStorageWaitTime: 0 - TotalTime: 703971405784 CodeGen - CodegenTime: 5856138315 - CompileTime: 13544563052 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 220096304718 - PrepareTime: 53029823023 - TotalTime: 288606885339 DataStreamSender (dst_id=14) - BytesSent: 125780 - InactiveTotalTime: 0 - NetworkThroughput(*): 3185688 - OverallThroughput: 710779 - PeakMemoryUsage: 1256 - SerializeBatchTime: 176874232 - ThriftTransmitTime(*): 39482830 - TotalTime: 176960682 - UncompressedRowBatchSize: 239259 SORT_NODE (id=8) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - PeakMemoryUsage: 540672 - RowsReturned: 1000 - RowsReturnedRate: 1 - TotalTime: 702433422416 ANALYTIC_EVAL_NODE (id=7) - EvaluationTime: 715889134 - GetNewBlockTime: 309746439 - InactiveTotalTime: 0 - PeakMemoryUsage: 8421376 - PinTime: 0 - RowsReturned: 3498 - RowsReturnedRate: 5 - TotalTime: 688112476343 - UnpinTime: 0 SORT_NODE (id=6) ExecOption: Codegen Enabled - InMemorySortTime: 191705271 - InactiveTotalTime: 0 - InitialRunsCreated: 1 - PeakMemoryUsage: 25182208 - RowsReturned: 3498 - RowsReturnedRate: 5 - SortDataSize: 766607 - TotalMergesPerformed: 0 - TotalTime: 686690437276 AGGREGATION_NODE (id=13) ExecOption: Codegen Enabled - BuildTime: 581656431 - GetNewBlockTime: 1093431269 - GetResultsTime: 1176620 - HTResizeTime: 444313 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2874160 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3498 - RowsReturnedRate: 5 - SpilledPartitions: 0 - TotalTime: 685540315600 - UnpinTime: 21152 EXCHANGE_NODE (id=12) - BytesReceived: 453937 - ConvertRowBatchTime: 1442284 - DeserializeRowBatchTimer: 408558398 - FirstBatchArrivalWaitTime: 621101065074 - InactiveTotalTime: 623538095273 - PeakMemoryUsage: 0 - RowsReturned: 3498 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 623540142256 Instance fc4ea6bd635e13eb:76b88c150865e7a5 (host=impala-stress-cdh570-3.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34141416 - PerHostPeakMemUsage: 62134888 - PrepareTime: 77017956771 - RowsProduced: 1000 - TotalCpuTime: 318293479273 - TotalNetworkReceiveTime: 608895353618 - TotalNetworkSendTime: 83712656 - TotalStorageWaitTime: 0 - TotalTime: 696059101731 CodeGen - CodegenTime: 11302794193 - CompileTime: 12061063974 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 217866067320 - PrepareTime: 61095161949 - TotalTime: 292353331575 DataStreamSender (dst_id=14) - BytesSent: 119868 - InactiveTotalTime: 0 - NetworkThroughput(*): 2046957 - OverallThroughput: 345809 - PeakMemoryUsage: 1256 - SerializeBatchTime: 346475826 - ThriftTransmitTime(*): 58559102 - TotalTime: 346630081 - UncompressedRowBatchSize: 236289 SORT_NODE (id=8) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - PeakMemoryUsage: 540672 - RowsReturned: 1000 - RowsReturnedRate: 1 - TotalTime: 693296645757 ANALYTIC_EVAL_NODE (id=7) - EvaluationTime: 585057999 - GetNewBlockTime: 238774719 - InactiveTotalTime: 0 - PeakMemoryUsage: 8421376 - PinTime: 0 - RowsReturned: 4102 - RowsReturnedRate: 5 - TotalTime: 690956846623 - UnpinTime: 0 SORT_NODE (id=6) ExecOption: Codegen Enabled - InMemorySortTime: 248284955 - InactiveTotalTime: 0 - InitialRunsCreated: 1 - PeakMemoryUsage: 25182208 - RowsReturned: 4102 - RowsReturnedRate: 5 - SortDataSize: 894448 - TotalMergesPerformed: 0 - TotalTime: 688128143103 AGGREGATION_NODE (id=13) ExecOption: Codegen Enabled - BuildTime: 1039799526 - GetNewBlockTime: 437099332 - GetResultsTime: 1318502 - HTResizeTime: 26803750 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2874696 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 4102 - RowsReturnedRate: 5 - SpilledPartitions: 0 - TotalTime: 687171632297 - UnpinTime: 22417 EXCHANGE_NODE (id=12) - BytesReceived: 530095 - ConvertRowBatchTime: 814856 - DeserializeRowBatchTimer: 774884564 - FirstBatchArrivalWaitTime: 608895209815 - InactiveTotalTime: 608895212550 - PeakMemoryUsage: 0 - RowsReturned: 4102 - RowsReturnedRate: 6 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 608896353501 Instance fc4ea6bd635e13eb:76b88c150865e7a7 (host=impala-stress-cdh570-5.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34141416 - PerHostPeakMemUsage: 44994408 - PrepareTime: 60746618201 - RowsProduced: 1000 - TotalCpuTime: 311759218932 - TotalNetworkReceiveTime: 616499187582 - TotalNetworkSendTime: 109371714 - TotalStorageWaitTime: 0 - TotalTime: 684296887511 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 25 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 33554432 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2481716567 - CompileTime: 23628181095 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 219624963983 - PrepareTime: 51101446803 - TotalTime: 294526657828 DataStreamSender (dst_id=14) - BytesSent: 129435 - InactiveTotalTime: 0 - NetworkThroughput(*): 6991082 - OverallThroughput: 1016277 - PeakMemoryUsage: 1256 - SerializeBatchTime: 127284255 - ThriftTransmitTime(*): 18514300 - TotalTime: 127361927 - UncompressedRowBatchSize: 237996 SORT_NODE (id=8) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - PeakMemoryUsage: 540672 - RowsReturned: 1000 - RowsReturnedRate: 1 - TotalTime: 683440006665 ANALYTIC_EVAL_NODE (id=7) - EvaluationTime: 1185060583 - GetNewBlockTime: 80286 - InactiveTotalTime: 0 - PeakMemoryUsage: 8421376 - PinTime: 0 - RowsReturned: 4119 - RowsReturnedRate: 6 - TotalTime: 680475696950 - UnpinTime: 0 SORT_NODE (id=6) ExecOption: Codegen Enabled - InMemorySortTime: 504699423 - InactiveTotalTime: 0 - InitialRunsCreated: 1 - PeakMemoryUsage: 25182208 - RowsReturned: 4119 - RowsReturnedRate: 6 - SortDataSize: 905565 - TotalMergesPerformed: 0 - TotalTime: 678885624742 AGGREGATION_NODE (id=13) ExecOption: Codegen Enabled - BuildTime: 783708030 - GetNewBlockTime: 306869072 - GetResultsTime: 1426045 - HTResizeTime: 315719 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2874376 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 4119 - RowsReturnedRate: 6 - SpilledPartitions: 0 - TotalTime: 677645875891 - UnpinTime: 17653 EXCHANGE_NODE (id=12) - BytesReceived: 538255 - ConvertRowBatchTime: 1000245 - DeserializeRowBatchTimer: 3681009 - FirstBatchArrivalWaitTime: 613542854465 - InactiveTotalTime: 616498925057 - PeakMemoryUsage: 0 - RowsReturned: 4119 - RowsReturnedRate: 6 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 616500449751 Fragment F02 Instance fc4ea6bd635e13eb:76b88c150865e7aa (host=impala-stress-cdh570-4.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 14028608 - PerHostPeakMemUsage: 44824936 - PrepareTime: 61090446785 - RowsProduced: 3853 - TotalCpuTime: 226281894434 - TotalNetworkReceiveTime: 696069049031 - TotalNetworkSendTime: 312507513 - TotalStorageWaitTime: 0 - TotalTime: 792461492018 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 107 - BlocksRecycled: 24 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 47185920 - PeakMemoryUsage: 26231968 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 3215079959 - CompileTime: 16721289150 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 111829186388 - PrepareTime: 52310860134 - TotalTime: 182955028761 DataStreamSender (dst_id=12) - BytesSent: 495901 - InactiveTotalTime: 0 - NetworkThroughput(*): 706544 - OverallThroughput: 343107 - PeakMemoryUsage: 251712 - SerializeBatchTime: 473297515 - ThriftTransmitTime(*): 701868288 - TotalTime: 1445322055 - UncompressedRowBatchSize: 852147 AGGREGATION_NODE (id=5) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 883106073 - GetResultsTime: 6620734 - HTResizeTime: 261062 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 1 - PartitionsCreated: 16 - PeakMemoryUsage: 1695648 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3853 - RowsReturnedRate: 4 - StreamingTime: 1917446324 - TotalTime: 788137714737 - UnpinTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 14907 - BuildRows: 31 - BuildRowsPartitioned: 31 - BuildTime: 64212 - GetNewBlockTime: 70108664 - HashBuckets: 74 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 22 - LocalTime: 8699665934 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2125824 - PinTime: 0 - ProbeRows: 21946 - ProbeRowsPartitioned: 0 - ProbeTime: 2161725 - RowsReturned: 21946 - RowsReturnedRate: 30 - SpilledPartitions: 0 - TotalTime: 729147767569 - UnpinTime: 18698 EXCHANGE_NODE (id=11) - BytesReceived: 605 - ConvertRowBatchTime: 9053 - DeserializeRowBatchTimer: 24562 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 31 - RowsReturnedRate: 948882 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 32670 HASH_JOIN_NODE (id=3) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 829203221 - BuildRows: 7612 - BuildRowsPartitioned: 7612 - BuildTime: 95534434 - GetNewBlockTime: 328342 - HashBuckets: 16384 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - LocalTime: 5454048395 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10772480 - PinTime: 0 - ProbeRows: 52656 - ProbeRowsPartitioned: 0 - ProbeTime: 200947772 - RowsReturned: 21946 - RowsReturnedRate: 30 - SpilledPartitions: 0 - TotalTime: 720448068965 - UnpinTime: 17322 EXCHANGE_NODE (id=10) - BytesReceived: 952292 - ConvertRowBatchTime: 1804520 - DeserializeRowBatchTimer: 1283790148 - FirstBatchArrivalWaitTime: 45528084463 - InactiveTotalTime: 82581844460 - PeakMemoryUsage: 0 - RowsReturned: 7612 - RowsReturnedRate: 92 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 82584729191 EXCHANGE_NODE (id=9) - BytesReceived: 741130 - ConvertRowBatchTime: 18913010401 - DeserializeRowBatchTimer: 9023308192 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 613207235211 - PeakMemoryUsage: 0 - RowsReturned: 52656 - RowsReturnedRate: 83 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 632409291379 Instance fc4ea6bd635e13eb:76b88c150865e7a8 (host=impala-stress-cdh570-2.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 14029472 - PerHostPeakMemUsage: 43665288 - PrepareTime: 54990475101 - RowsProduced: 3711 - TotalCpuTime: 200179120586 - TotalNetworkReceiveTime: 720353236879 - TotalNetworkSendTime: 1468772652 - TotalStorageWaitTime: 0 - TotalTime: 791284893252 CodeGen - CodegenTime: 2136624060 - CompileTime: 5212655374 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 123344257033 - PrepareTime: 47010876444 - TotalTime: 178083123069 DataStreamSender (dst_id=12) - BytesSent: 482049 - InactiveTotalTime: 0 - NetworkThroughput(*): 179080 - OverallThroughput: 274230 - PeakMemoryUsage: 251712 - SerializeBatchTime: 128479316 - ThriftTransmitTime(*): 2691804099 - TotalTime: 1757827039 - UncompressedRowBatchSize: 826174 AGGREGATION_NODE (id=5) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 298951068 - GetResultsTime: 3933461 - HTResizeTime: 251571 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 1 - PartitionsCreated: 16 - PeakMemoryUsage: 1695648 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3711 - RowsReturnedRate: 4 - StreamingTime: 1865806482 - TotalTime: 786413038686 - UnpinTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 28544 - BuildRows: 31 - BuildRowsPartitioned: 31 - BuildTime: 84812 - GetNewBlockTime: 316487326 - HashBuckets: 74 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 22 - LocalTime: 9424837024 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2125824 - PinTime: 0 - ProbeRows: 21130 - ProbeRowsPartitioned: 0 - ProbeTime: 2058721 - RowsReturned: 21130 - RowsReturnedRate: 28 - SpilledPartitions: 0 - TotalTime: 735107514970 - UnpinTime: 18505 EXCHANGE_NODE (id=11) - BytesReceived: 605 - ConvertRowBatchTime: 9138 - DeserializeRowBatchTimer: 33956 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 31 - RowsReturnedRate: 890446 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 34814 HASH_JOIN_NODE (id=3) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 40308760 - BuildRows: 7521 - BuildRowsPartitioned: 7521 - BuildTime: 10319290 - GetNewBlockTime: 34326374 - HashBuckets: 16384 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - LocalTime: 4826982097 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10772480 - PinTime: 0 - ProbeRows: 52789 - ProbeRowsPartitioned: 0 - ProbeTime: 66718123 - RowsReturned: 21130 - RowsReturnedRate: 29 - SpilledPartitions: 0 - TotalTime: 725682643132 - UnpinTime: 17005 EXCHANGE_NODE (id=10) - BytesReceived: 943441 - ConvertRowBatchTime: 1685508 - DeserializeRowBatchTimer: 46855456 - FirstBatchArrivalWaitTime: 50567731464 - InactiveTotalTime: 88228470040 - PeakMemoryUsage: 0 - RowsReturned: 7521 - RowsReturnedRate: 85 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 88231048117 EXCHANGE_NODE (id=9) - BytesReceived: 743117 - ConvertRowBatchTime: 499609456 - DeserializeRowBatchTimer: 1297543394 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 632014574824 - PeakMemoryUsage: 0 - RowsReturned: 52789 - RowsReturnedRate: 83 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 632624612918 Instance fc4ea6bd635e13eb:76b88c150865e7ab (host=impala-stress-cdh570-5.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 13982304 - PerHostPeakMemUsage: 44994408 - PrepareTime: 77568999676 - RowsProduced: 3771 - TotalCpuTime: 235528493415 - TotalNetworkReceiveTime: 686815955327 - TotalNetworkSendTime: 236571227 - TotalStorageWaitTime: 0 - TotalTime: 790701311317 CodeGen - CodegenTime: 2469595469 - CompileTime: 8943431736 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 121043029598 - PrepareTime: 69889709416 - TotalTime: 200718046497 DataStreamSender (dst_id=12) - BytesSent: 489700 - InactiveTotalTime: 0 - NetworkThroughput(*): 886179 - OverallThroughput: 559688 - PeakMemoryUsage: 251712 - SerializeBatchTime: 10044582 - ThriftTransmitTime(*): 552596620 - TotalTime: 874951378 - UncompressedRowBatchSize: 839998 AGGREGATION_NODE (id=5) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1106748438 - GetResultsTime: 273729085 - HTResizeTime: 101720773 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 1 - PartitionsCreated: 16 - PeakMemoryUsage: 1695648 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3771 - RowsReturnedRate: 4 - StreamingTime: 6757627607 - TotalTime: 784536387191 - UnpinTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 16605 - BuildRows: 31 - BuildRowsPartitioned: 31 - BuildTime: 107983 - GetNewBlockTime: 165822 - HashBuckets: 74 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 22 - LocalTime: 7839912538 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2125824 - PinTime: 0 - ProbeRows: 20968 - ProbeRowsPartitioned: 0 - ProbeTime: 2411652 - RowsReturned: 20968 - RowsReturnedRate: 29 - SpilledPartitions: 0 - TotalTime: 705190079708 - UnpinTime: 17507 EXCHANGE_NODE (id=11) - BytesReceived: 605 - ConvertRowBatchTime: 9044 - DeserializeRowBatchTimer: 33038 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 31 - RowsReturnedRate: 983408 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31523 HASH_JOIN_NODE (id=3) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1253062448 - BuildRows: 7550 - BuildRowsPartitioned: 7550 - BuildTime: 11055526 - GetNewBlockTime: 319686658 - HashBuckets: 16384 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - LocalTime: 10375405423 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10772480 - PinTime: 0 - ProbeRows: 51215 - ProbeRowsPartitioned: 0 - ProbeTime: 459813415 - RowsReturned: 20968 - RowsReturnedRate: 30 - SpilledPartitions: 0 - TotalTime: 697350135647 - UnpinTime: 20711 EXCHANGE_NODE (id=10) - BytesReceived: 948397 - ConvertRowBatchTime: 1880845 - DeserializeRowBatchTimer: 104872166 - FirstBatchArrivalWaitTime: 24689988923 - InactiveTotalTime: 60744828280 - PeakMemoryUsage: 0 - RowsReturned: 7550 - RowsReturnedRate: 123 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 60904346641 EXCHANGE_NODE (id=9) - BytesReceived: 720326 - ConvertRowBatchTime: 155650805 - DeserializeRowBatchTimer: 6644024588 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 625478044858 - PeakMemoryUsage: 0 - RowsReturned: 51215 - RowsReturnedRate: 81 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 626070383583 Instance fc4ea6bd635e13eb:76b88c150865e7a9 (host=impala-stress-cdh570-3.vpc.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 14004416 - PerHostPeakMemUsage: 62134888 - PrepareTime: 76830812655 - RowsProduced: 3754 - TotalCpuTime: 251453116797 - TotalNetworkReceiveTime: 670386605899 - TotalNetworkSendTime: 34741139 - TotalStorageWaitTime: 0 - TotalTime: 769934389523 CodeGen - CodegenTime: 1587775680 - CompileTime: 6587730366 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1939944 - OptimizationTime: 143912049995 - PrepareTime: 62517608542 - TotalTime: 213413294696 DataStreamSender (dst_id=12) - BytesSent: 488789 - InactiveTotalTime: 0 - NetworkThroughput(*): 702844 - OverallThroughput: 414619 - PeakMemoryUsage: 251712 - SerializeBatchTime: 86739908 - ThriftTransmitTime(*): 695444012 - TotalTime: 1178886603 - UncompressedRowBatchSize: 838315 AGGREGATION_NODE (id=5) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 353908956 - GetResultsTime: 1388428 - HTResizeTime: 91378199 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 1 - PartitionsCreated: 16 - PeakMemoryUsage: 1712016 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3754 - RowsReturnedRate: 4 - StreamingTime: 2341854895 - TotalTime: 763581597011 - UnpinTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 21039 - BuildRows: 31 - BuildRowsPartitioned: 31 - BuildTime: 61991 - GetNewBlockTime: 15903737 - HashBuckets: 74 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 22 - LocalTime: 21337256736 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2125824 - PinTime: 0 - ProbeRows: 20821 - ProbeRowsPartitioned: 0 - ProbeTime: 31429006 - RowsReturned: 20821 - RowsReturnedRate: 29 - SpilledPartitions: 0 - TotalTime: 706176884909 - UnpinTime: 17977 EXCHANGE_NODE (id=11) - BytesReceived: 605 - ConvertRowBatchTime: 10324 - DeserializeRowBatchTimer: 26065 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 31 - RowsReturnedRate: 848826 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 36521 HASH_JOIN_NODE (id=3) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Runtime-Filter Produced - BuildPartitionTime: 414779222 - BuildRows: 7611 - BuildRowsPartitioned: 7611 - BuildTime: 352573042 - GetNewBlockTime: 679666 - HashBuckets: 16384 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - LocalTime: 13740294991 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10772480 - PinTime: 0 - ProbeRows: 51565 - ProbeRowsPartitioned: 0 - ProbeTime: 210722347 - RowsReturned: 20821 - RowsReturnedRate: 30 - SpilledPartitions: 0 - TotalTime: 684839591652 - UnpinTime: 21028 EXCHANGE_NODE (id=10) - BytesReceived: 957348 - ConvertRowBatchTime: 1655480 - DeserializeRowBatchTimer: 1008033409 - FirstBatchArrivalWaitTime: 1663610630 - InactiveTotalTime: 39005020893 - PeakMemoryUsage: 0 - RowsReturned: 7611 - RowsReturnedRate: 194 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 39099306510 EXCHANGE_NODE (id=9) - BytesReceived: 723362 - ConvertRowBatchTime: 526126275 - DeserializeRowBatchTimer: 4820131890 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 631171603798 - PeakMemoryUsage: 0 - RowsReturned: 51565 - RowsReturnedRate: 81 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 631999990151 Fragment F03 Instance fc4ea6bd635e13eb:76b88c150865e7ac (host=impala-stress-cdh570-3.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/2.17 MB - AverageThreadTokens: 1.64 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3094568 - PerHostPeakMemUsage: 17595312 - PrepareTime: 113434482 - RowsProduced: 31 - TotalCpuTime: 63596674683 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29925543600 - TotalStorageWaitTime: 22580865340 - TotalTime: 43167238245 DataStreamSender (dst_id=11) - BytesSent: 2420 - InactiveTotalTime: 0 - NetworkThroughput(*): 30 - OverallThroughput: 12308 - PeakMemoryUsage: 16384 - SerializeBatchTime: 125552604 - ThriftTransmitTime(*): 80304397985 - TotalTime: 196610062 - UncompressedRowBatchSize: 5720 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 841643 - BytesReadDataNodeCache: 0 - BytesReadLocal: 841643 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 841643 - DecompressionTime: 4464028351 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3069992 - PerReadThreadRawHdfsThroughput: 1153912490 - RemoteScanRanges: 0 - RowsRead: 73049 - RowsReturned: 31 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 590 - ScannerThreadsTotalWallClockTime: 41786299316 - MaterializeTupleTime(*): 9183641223 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 124981000 - ScannerThreadsVoluntaryContextSwitches: 151 - TotalRawHdfsReadTime(*): 729382 - TotalReadThroughput: 20335 - TotalTime: 42410764596 Fragment F01 Instance fc4ea6bd635e13eb:76b88c150865e7ad (host=impala-stress-cdh570-3.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/9.75 MB - AverageThreadTokens: 1.9959183673469387 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17591200 - PerHostPeakMemUsage: 62134888 - PrepareTime: 61444838 - RowsProduced: 30294 - TotalCpuTime: 331125787837 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 847407565 - TotalStorageWaitTime: 232473308883 - TotalTime: 282235084265 DataStreamSender (dst_id=10) - BytesSent: 3801478 - InactiveTotalTime: 0 - NetworkThroughput(*): 950502 - OverallThroughput: 1884100 - PeakMemoryUsage: 252288 - SerializeBatchTime: 619947606 - ThriftTransmitTime(*): 3999441375 - TotalTime: 2017661630 - UncompressedRowBatchSize: 6487176 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/9.75 MB Hdfs Read Thread Concurrency Bucket: 0:94.88% 1:5.123% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:6 - AverageHdfsReadThreadConcurrency: 0.05122950819672131 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 6894186 - BytesReadDataNodeCache: 0 - BytesReadLocal: 6894186 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6894186 - DecompressionTime: 4627654298 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 6 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 17203240 - PerReadThreadRawHdfsThroughput: 557218 - RemoteScanRanges: 0 - RowsRead: 102000 - RowsReturned: 30294 - RowsReturnedRate: 108 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 752 - ScannerThreadsTotalWallClockTime: 281258916645 - MaterializeTupleTime(*): 34597429869 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 427934000 - ScannerThreadsVoluntaryContextSwitches: 297 - TotalRawHdfsReadTime(*): 12372509005 - TotalReadThroughput: 27839 - TotalTime: 279405218194 Fragment F00 Instance fc4ea6bd635e13eb:76b88c150865e7af (host=impala-stress-cdh570-3.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:8/4.45 MB Filter 0 arrival: 3m37s Filter 1 arrival: 4m47s - AverageThreadTokens: 1.994128009395185 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 537096 - PerHostPeakMemUsage: 62134888 - PrepareTime: 70438205 - RowsProduced: 32930 - TotalCpuTime: 914603517880 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 37743290707 - TotalStorageWaitTime: 903971538105 - TotalTime: 915784481251 DataStreamSender (dst_id=9) - BytesSent: 463347 - InactiveTotalTime: 0 - NetworkThroughput(*): 3792 - OverallThroughput: 13041 - PeakMemoryUsage: 136512 - SerializeBatchTime: 294994444 - ThriftTransmitTime(*): 122188561983 - TotalTime: 35528644466 - UncompressedRowBatchSize: 922244 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): 0:8/4.45 MB Runtime filters: Only following filters arrived: , waited 161ms Hdfs Read Thread Concurrency Bucket: 0:99.88% 1:0.1181% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 - AverageHdfsReadThreadConcurrency: 0.0011813349084465446 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1602195 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1602195 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1602195 - DecompressionTime: 158638 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 8 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 387592 - PerReadThreadRawHdfsThroughput: 1995646 - RemoteScanRanges: 0 - RowsRead: 69398 - RowsReturned: 32930 - RowsReturnedRate: 37 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 118 - ScannerThreadsTotalWallClockTime: 914603523390 - MaterializeTupleTime(*): 3754586369 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 99984000 - ScannerThreadsVoluntaryContextSwitches: 115 - TotalRawHdfsReadTime(*): 802845117 - TotalReadThroughput: 1883 - TotalTime: 879419609907 Filter 0 - Files processed: 0 - Files rejected: 0 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 291 - RowGroups rejected: 0 - RowGroups total: 309 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 5 - Splits rejected: 0 - Splits total: 8 - TotalTime: 0 Filter 1 - InactiveTotalTime: 0 - Rows processed: 69398 - Rows rejected: 36468 - Rows total: 69398 - TotalTime: 0 Instance fc4ea6bd635e13eb:76b88c150865e7b0 (host=impala-stress-cdh570-4.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:9/4.91 MB Filter 0 arrival: 3m38s Filter 1 arrival: 4m47s - AverageThreadTokens: 1.997566909975669 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 525768 - PerHostPeakMemUsage: 44824936 - PrepareTime: 23206387 - RowsProduced: 40983 - TotalCpuTime: 848799150646 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36609067703 - TotalStorageWaitTime: 836517453864 - TotalTime: 850254614435 DataStreamSender (dst_id=9) - BytesSent: 576977 - InactiveTotalTime: 0 - NetworkThroughput(*): 5307 - OverallThroughput: 15742 - PeakMemoryUsage: 136512 - SerializeBatchTime: 20154661 - ThriftTransmitTime(*): 108715414445 - TotalTime: 36650131331 - UncompressedRowBatchSize: 1147776 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): 0:9/4.91 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:18 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1784444 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1784444 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1784444 - DecompressionTime: 197310 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 9 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 389256 - PerReadThreadRawHdfsThroughput: 92471318 - RemoteScanRanges: 0 - RowsRead: 76754 - RowsReturned: 40983 - RowsReturnedRate: 50 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 212 - ScannerThreadsTotalWallClockTime: 848799166821 - MaterializeTupleTime(*): 4822208769 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 112982000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 19297270 - TotalReadThroughput: 2109 - TotalTime: 812400920284 Filter 0 - Files processed: 0 - Files rejected: 0 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 270 - RowGroups rejected: 0 - RowGroups total: 288 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 6 - Splits rejected: 0 - Splits total: 9 - TotalTime: 0 Filter 1 - InactiveTotalTime: 0 - Rows processed: 76754 - Rows rejected: 35771 - Rows total: 76754 - TotalTime: 0 Instance fc4ea6bd635e13eb:76b88c150865e7b1 (host=impala-stress-cdh570-5.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:6/4.50 MB Filter 0 arrival: 3m38s Filter 1 arrival: 4m50s - AverageThreadTokens: 1.995 - BloomFilterBytes: 2097152 - InactiveTotalTime: 0 - PeakMemoryUsage: 2707632 - PerHostPeakMemUsage: 44994408 - PrepareTime: 30827111 - RowsProduced: 66476 - TotalCpuTime: 428727932667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 72387375371 - TotalStorageWaitTime: 366230846811 - TotalTime: 430620026109 DataStreamSender (dst_id=9) - BytesSent: 934388 - InactiveTotalTime: 0 - NetworkThroughput(*): 4010 - OverallThroughput: 12384 - PeakMemoryUsage: 136512 - SerializeBatchTime: 1243231840 - ThriftTransmitTime(*): 232992034888 - TotalTime: 75445842238 - UncompressedRowBatchSize: 1861728 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 6 Hdfs split stats (:<# splits>/): 0:6/4.50 MB Runtime filters: Only following filters arrived: , waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:12 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.998745294855709 - BytesRead: 1414053 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1414053 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1414053 - DecompressionTime: 324054 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 6 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2538352 - PerReadThreadRawHdfsThroughput: 2621092142 - RemoteScanRanges: 0 - RowsRead: 72713 - RowsReturned: 66476 - RowsReturnedRate: 187 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 160 - ScannerThreadsTotalWallClockTime: 428727943090 - MaterializeTupleTime(*): 57926661713 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 95985000 - ScannerThreadsVoluntaryContextSwitches: 244 - TotalRawHdfsReadTime(*): 539490 - TotalReadThroughput: 3523 - TotalTime: 353678979043 Filter 0 - Files processed: 0 - Files rejected: 0 - Files total: 6 - InactiveTotalTime: 0 - RowGroups processed: 49 - RowGroups rejected: 0 - RowGroups total: 106 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 1 - Splits rejected: 0 - Splits total: 6 - TotalTime: 0 Filter 1 - InactiveTotalTime: 0 - Rows processed: 59241 - Rows rejected: 6237 - Rows total: 59242 - TotalTime: 0 Instance fc4ea6bd635e13eb:76b88c150865e7ae (host=impala-stress-cdh570-2.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:8/4.48 MB - AverageThreadTokens: 1.8698224852071006 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2406664 - PerHostPeakMemUsage: 31707168 - PrepareTime: 8304722 - RowsProduced: 69882 - TotalCpuTime: 76355384743 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 75546725335 - TotalStorageWaitTime: 9963691176 - TotalTime: 84591853735 DataStreamSender (dst_id=9) - BytesSent: 981850 - InactiveTotalTime: 0 - NetworkThroughput(*): 4026 - OverallThroughput: 12102 - PeakMemoryUsage: 136512 - SerializeBatchTime: 1111143274 - ThriftTransmitTime(*): 243860941760 - TotalTime: 81128377131 - UncompressedRowBatchSize: 1957112 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): 0:8/4.48 MB Runtime filters: Only following filters arrived: , waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.39% 1:0.6098% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 - AverageHdfsReadThreadConcurrency: 0.006097560975609756 - AverageScannerThreadConcurrency: 0.8963414634146342 - BytesRead: 1606089 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1606089 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1606089 - DecompressionTime: 206029 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 8 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2237384 - PerReadThreadRawHdfsThroughput: 163844150 - RemoteScanRanges: 0 - RowsRead: 69882 - RowsReturned: 69882 - RowsReturnedRate: 27817 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 80 - ScannerThreadsTotalWallClockTime: 74930932702 - MaterializeTupleTime(*): 62122996572 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 90986000 - ScannerThreadsVoluntaryContextSwitches: 324 - TotalRawHdfsReadTime(*): 9802541 - TotalReadThroughput: 19296 - TotalTime: 2512185444 Filter 0 - Files processed: 0 - Files rejected: 0 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 72 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 8 - TotalTime: 0 Filter 1 - InactiveTotalTime: 0 - Rows processed: 69882 - Rows rejected: 0 - Rows total: 69882 - TotalTime: 0