impalad /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query 3c493c3c7086695a:3a7abec5758a298e Plan Query Text plan Summary Profile Download Thrift Profile Query (id=3c493c3c7086695a:3a7abec5758a298e): Summary: Session ID: e745316c9b954827:e503b8099aedf1ac Session Type: BEESWAX Start Time: 2016-04-28 20:15:31.629048000 End Time: 2016-04-28 20:17:49.994180000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build e06b0824c11873be9a74f68ce536cd447cca423e) User: root Connected User: root Delegated User: Network Address: ::ffff:172.28.196.197:34944 Default Db: tpcds_1000_parquet Sql Statement: select count(*) from store_sales where ss_item_sk = 10 Coordinator: impala-s3-scale-2.vpc.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=98.00MB VCores=1 03:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=32 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] | hosts=32 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 01:AGGREGATE | output: count(*) | hosts=32 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=1 | 00:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=1824/1824 files=1824 size=189.24GB predicates: ss_item_sk = 10 table stats: 2879987999 rows total column stats: all hosts=32 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=9467 ---------------- Estimated Per-Host Mem: 102760448 Estimated Per-Host VCores: 1 Request Pool: root.root Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- 03:AGGREGATE 1 271.051ms 271.051ms 1 1 140.00 KB -1.00 B FINALIZE 02:EXCHANGE 1 0.000ns 0.000ns 32 1 0 -1.00 B UNPARTITIONED 01:AGGREGATE 32 195.188ms 240.995ms 32 1 2.97 MB 10.00 MB 00:SCAN HDFS 32 1m17s 2m16s 7.69K 9.47K 212.13 MB 88.00 MB tpcds_1000_parquet.store_sales Planner Timeline: 25.722ms - Analysis finished: 14.348ms (14.348ms) - Equivalence classes computed: 14.510ms (161.539us) - Single node plan created: 22.302ms (7.792ms) - Runtime filters computed: 22.346ms (43.537us) - Distributed plan created: 23.190ms (843.730us) - Lineage info computed: 23.623ms (432.816us) - Planning finished: 25.722ms (2.099ms) Query Timeline: 2m18s - Start execution: 0.000ns (0.000ns) - Planning finished: 54.010ms (54.010ms) - Submit for admission: 60.011ms (6.001ms) - Completed admission: 61.011ms (1.000ms) - Ready to start 32 remote fragments: 337.063ms (276.052ms) - All 32 remote fragments started: 498.094ms (161.030ms) - Rows available: 2m17s (2m17s) - First row fetched: 2m18s (823.105ms) - Unregister query: 2m18s (3.000ms) ImpalaServer: - ClientFetchWaitTimer: 823.105ms - RowMaterializationTimer: 0.000ns Execution Profile 3c493c3c7086695a:3a7abec5758a298e:(Total: 2m17s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ---------------------------------------------------------------------------------------------- Fragment start latencies: Count: 32, 25th %-ile: 14ms, 50th %-ile: 15ms, 75th %-ile: 16ms, 90th %-ile: 18ms, 95th %-ile: 18ms, 99.9th %-ile: 19ms Per Node Peak Memory Usage: impala-s3-scale-6.vpc.cloudera.com:22000(212.17 MB) impala-s3-scale-12.vpc.cloudera.com:22000(85.64 MB) impala-s3-scale-18.vpc.cloudera.com:22000(198.83 MB) impala-s3-scale-25.vpc.cloudera.com:22000(54.00 MB) impala-s3-scale-23.vpc.cloudera.com:22000(87.44 MB) impala-s3-scale-19.vpc.cloudera.com:22000(109.22 MB) impala-s3-scale-26.vpc.cloudera.com:22000(94.59 MB) impala-s3-scale-15.vpc.cloudera.com:22000(119.10 MB) impala-s3-scale-10.vpc.cloudera.com:22000(112.75 MB) impala-s3-scale-4.vpc.cloudera.com:22000(106.34 MB) impala-s3-scale-33.vpc.cloudera.com:22000(88.96 MB) impala-s3-scale-22.vpc.cloudera.com:22000(87.66 MB) impala-s3-scale-21.vpc.cloudera.com:22000(170.77 MB) impala-s3-scale-16.vpc.cloudera.com:22000(52.26 MB) impala-s3-scale-13.vpc.cloudera.com:22000(110.20 MB) impala-s3-scale-24.vpc.cloudera.com:22000(79.06 MB) impala-s3-scale-9.vpc.cloudera.com:22000(126.17 MB) impala-s3-scale-28.vpc.cloudera.com:22000(146.15 MB) impala-s3-scale-8.vpc.cloudera.com:22000(78.72 MB) impala-s3-scale-29.vpc.cloudera.com:22000(86.60 MB) impala-s3-scale-30.vpc.cloudera.com:22000(129.43 MB) impala-s3-scale-5.vpc.cloudera.com:22000(85.65 MB) impala-s3-scale-7.vpc.cloudera.com:22000(138.17 MB) impala-s3-scale-1.vpc.cloudera.com:22000(129.52 MB) impala-s3-scale-31.vpc.cloudera.com:22000(94.59 MB) impala-s3-scale-20.vpc.cloudera.com:22000(145.63 MB) impala-s3-scale-27.vpc.cloudera.com:22000(203.37 MB) impala-s3-scale-17.vpc.cloudera.com:22000(122.21 MB) impala-s3-scale-32.vpc.cloudera.com:22000(86.59 MB) impala-s3-scale-14.vpc.cloudera.com:22000(199.99 MB) impala-s3-scale-3.vpc.cloudera.com:22000(87.49 MB) impala-s3-scale-2.vpc.cloudera.com:22000(105.42 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 2m17s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.00 KB, 31.50 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 71.01 KB, 121.51 KB, 139.51 KB, 141.01 KB, 144.01 KB, 144.01 KB, 144.01 KB, 144.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 148.02 KB (151568) - PerHostPeakMemUsage: 0 - PrepareTime: 271.051ms - RowsProduced: 1 (1) - TotalCpuTime: 1s541ms - TotalNetworkReceiveTime: 2m16s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 553.104ms, non-child: 553.104ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 244 (244) - NumInstructions: 2.39K (2392) - OptimizationTime: 224.042ms - PrepareTime: 270.051ms AGGREGATION_NODE (id=3):(Total: 2m17s, non-child: 271.051ms, % non-child: 0.20%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 140.00 KB (143360) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=2):(Total: 2m16s, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(4s000ms): 0, 58.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 160.00 B, 204.00 B, 406.00 B, 478.00 B, 484.00 B, 496.00 B, 496.00 B, 496.00 B, 496.00 B - BytesReceived: 512.00 B (512) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 1.000ms - FirstBatchArrivalWaitTime: 5s150ms - PeakMemoryUsage: 0 - RowsReturned: 32 (32) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1m17s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 5.01 GB, max: 11.63 GB, avg: 5.91 GB, stddev: 1.08 GB completion times: min:5s442ms max:2m17s mean: 1m17s stddev:48s312ms execution rates: min:47.64 MB/sec max:1.06 GB/sec mean:324.41 MB/sec stddev:406.41 MB/sec num instances: 32 - AverageThreadTokens: 5.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 116.71 MB (122377476) - PerHostPeakMemUsage: 116.71 MB (122377860) - PrepareTime: 170.500ms - RowsProduced: 1 (1) - TotalCpuTime: 3m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 593.751us - TotalStorageWaitTime: 3m21s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 445.938ms, non-child: 445.938ms, % non-child: 100.00%) - CodegenTime: 156.247us - CompileTime: 60.093ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.000ms - PrepareTime: 169.406ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m17s, non-child: 195.188ms, % non-child: 0.25%) - BuildTime: 23.218ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.07 MB (2169558) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 2.22 - AverageScannerThreadConcurrency: 5.16 - BytesRead: 657.46 MB (689391985) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 116.67 MB (122340612) - PerReadThreadRawHdfsThroughput: 19.56 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 90.00M (89999624) - RowsReturned: 240 (240) - RowsReturnedRate: 13.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 95 (95) - ScannerThreadsTotalWallClockTime: 3m25s - MaterializeTupleTime(*): 3s194ms - ScannerThreadsSysTime: 146.535ms - ScannerThreadsUserTime: 3s258ms - ScannerThreadsVoluntaryContextSwitches: 404 (404) - TotalRawHdfsReadTime(*): 34s882ms - TotalReadThroughput: 34.80 MB/sec Fragment F00: Instance 3c493c3c7086695a:3a7abec5758a29ac (host=impala-s3-scale-2.vpc.cloudera.com:22000):(Total: 2m16s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/11.63 GB MemoryUsage(4s000ms): 56.99 MB, 30.88 MB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 8.83 MB, 11.06 MB, 11.18 MB, 12.06 MB, 11.06 MB, 11.18 MB, 10.31 MB, 10.93 MB ThreadUsage(4s000ms): 10, 7, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 105.41 MB (110527072) - PerHostPeakMemUsage: 105.42 MB (110539360) - PrepareTime: 168.031ms - RowsProduced: 1 (1) - TotalCpuTime: 4m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4m43s CodeGen:(Total: 441.083ms, non-child: 441.083ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.040ms - PrepareTime: 166.031ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 193.036ms, % non-child: 0.14%) ExecOption: Codegen Enabled - BuildTime: 23.004ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2068304) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2m16s, non-child: 2m16s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/11.63 GB Hdfs Read Thread Concurrency Bucket: 0:82.05% 1:13.92% 2:0.3663% 3:0.3663% 4:3.297% File Formats: PARQUET/NONE:57 BytesRead(4s000ms): 151.03 MB, 519.60 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.77 MB, 576.78 MB, 657.59 MB, 779.69 MB, 894.45 MB, 1013.11 MB, 1.11 GB, 1.23 GB, 1.35 GB, 1.46 GB - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 2.13 - BytesRead: 1.54 GB (1648238444) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 127 (127) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 105.37 MB (110490208) - PerReadThreadRawHdfsThroughput: 29.08 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 209.74M (209744386) - RowsReturned: 539 (539) - RowsReturnedRate: 3.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 138 (138) - ScannerThreadsTotalWallClockTime: 4m50s - MaterializeTupleTime(*): 6s737ms - ScannerThreadsSysTime: 181.967ms - ScannerThreadsUserTime: 6s861ms - ScannerThreadsVoluntaryContextSwitches: 607 (607) - TotalRawHdfsReadTime(*): 54s057ms - TotalReadThroughput: 11.45 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a9 (host=impala-s3-scale-25.vpc.cloudera.com:22000):(Total: 1m58s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.97 GB MemoryUsage(2s000ms): 27.50 MB, 25.74 MB, 32.22 MB, 36.62 MB, 33.72 MB, 24.20 MB, 24.48 MB, 22.06 MB, 20.09 MB, 24.10 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 20.09 MB, 13.36 MB, 6.64 MB, 2.15 MB, 692.24 KB, 188.00 KB ThreadUsage(2s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 3, 3, 2, 2 - AverageThreadTokens: 4.81 - BloomFilterBytes: 0 - PeakMemoryUsage: 54.00 MB (56621416) - PerHostPeakMemUsage: 54.00 MB (56621416) - PrepareTime: 188.003ms - RowsProduced: 1 (1) - TotalCpuTime: 7m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 7m29s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 470.008ms, non-child: 470.008ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 61.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 222.004ms - PrepareTime: 187.003ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m58s, non-child: 206.003ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 17.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.97 MB (3116320) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m58s, non-child: 1m58s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.97 GB Hdfs Read Thread Concurrency Bucket: 0:89.41% 1:4.661% 2:2.542% 3:3.39% 4:0% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 23.02 MB, 104.90 MB, 190.15 MB, 294.64 MB, 395.12 MB, 487.86 MB, 546.44 MB, 593.67 MB, 604.08 MB, 618.30 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 625.05 MB, 635.82 MB, 643.34 MB, 647.27 MB, 647.78 MB, 647.95 MB - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 3.83 - BytesRead: 654.13 MB (685907820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 53.96 MB (56584552) - PerReadThreadRawHdfsThroughput: 28.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 89.61M (89613825) - RowsReturned: 266 (266) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 43 (43) - ScannerThreadsTotalWallClockTime: 7m32s - MaterializeTupleTime(*): 2s880ms - ScannerThreadsSysTime: 117.979ms - ScannerThreadsUserTime: 2s984ms - ScannerThreadsVoluntaryContextSwitches: 381 (381) - TotalRawHdfsReadTime(*): 22s609ms - TotalReadThroughput: 5.47 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a2 (host=impala-s3-scale-33.vpc.cloudera.com:22000):(Total: 1m52s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.19 GB MemoryUsage(2s000ms): 43.45 MB, 57.58 MB, 54.78 MB, 47.39 MB, 27.61 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 10.97 MB, 2.00 MB, 2.00 MB, 2.00 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 3.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 88.96 MB (93282384) - PerHostPeakMemUsage: 88.96 MB (93282384) - PrepareTime: 172.014ms - RowsProduced: 1 (1) - TotalCpuTime: 4m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4m15s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 452.037ms, non-child: 452.037ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 60.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 220.018ms - PrepareTime: 172.014ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m52s, non-child: 191.015ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 17.001ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072448) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m51s, non-child: 1m51s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.19 GB Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:0% 2:1.786% 3:0.8929% 4:4.464% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 52.62 MB, 214.65 MB, 325.06 MB, 510.33 MB, 668.77 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 670.30 MB, 672.27 MB, 678.17 MB, 678.17 MB, 678.17 MB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 2.30 - BytesRead: 678.80 MB (711774042) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 85 (85) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 88.93 MB (93245520) - PerReadThreadRawHdfsThroughput: 22.77 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 92.97M (92965218) - RowsReturned: 294 (294) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 61 (61) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 3s125ms - ScannerThreadsSysTime: 131.978ms - ScannerThreadsUserTime: 3s195ms - ScannerThreadsVoluntaryContextSwitches: 383 (383) - TotalRawHdfsReadTime(*): 29s805ms - TotalReadThroughput: 6.05 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299f (host=impala-s3-scale-16.vpc.cloudera.com:22000):(Total: 1m51s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.18 GB MemoryUsage(2s000ms): 30.75 MB, 29.83 MB, 25.89 MB, 23.66 MB, 14.75 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 15.28 MB, 26.06 MB, 26.67 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.69 MB, 13.09 MB, 14.04 MB ThreadUsage(2s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4 - AverageThreadTokens: 5.96 - BloomFilterBytes: 0 - PeakMemoryUsage: 52.26 MB (54799896) - PerHostPeakMemUsage: 52.26 MB (54799896) - PrepareTime: 166.001ms - RowsProduced: 1 (1) - TotalCpuTime: 9m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 9m9s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.002ms, non-child: 436.002ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 211.001ms - PrepareTime: 165.001ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m51s, non-child: 193.001ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 25.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070064) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m50s, non-child: 1m50s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.18 GB Hdfs Read Thread Concurrency Bucket: 0:90.09% 1:4.505% 2:3.153% 3:0.9009% 4:1.351% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 33.74 MB, 135.28 MB, 231.41 MB, 301.79 MB, 331.02 MB, 331.02 MB, 331.02 MB, 331.02 MB, 331.02 MB, 331.02 MB, 337.69 MB, 411.30 MB, 498.26 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 529.27 MB, 536.50 MB, 543.94 MB, 553.69 MB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 567.65 MB (595220956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 77 (77) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 52.23 MB (54763032) - PerReadThreadRawHdfsThroughput: 26.46 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.99M (77988305) - RowsReturned: 228 (228) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 41 (41) - ScannerThreadsTotalWallClockTime: 9m11s - MaterializeTupleTime(*): 2s635ms - ScannerThreadsSysTime: 114.980ms - ScannerThreadsUserTime: 2s696ms - ScannerThreadsVoluntaryContextSwitches: 331 (331) - TotalRawHdfsReadTime(*): 21s455ms - TotalReadThroughput: 5.11 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2999 (host=impala-s3-scale-8.vpc.cloudera.com:22000):(Total: 1m49s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.90 GB MemoryUsage(2s000ms): 32.99 MB, 44.30 MB, 55.90 MB, 37.08 MB, 14.69 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 4.23 MB, 2.15 MB, 4.12 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3 - AverageThreadTokens: 4.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 78.72 MB (82541448) - PerHostPeakMemUsage: 78.72 MB (82541448) - PrepareTime: 164.997ms - RowsProduced: 1 (1) - TotalCpuTime: 5m55s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 5m52s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 435.992ms, non-child: 435.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.996ms - PrepareTime: 163.997ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m49s, non-child: 188.996ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 20.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2073440) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.90 GB Hdfs Read Thread Concurrency Bucket: 0:92.73% 1:1.364% 2:0.4545% 3:0.9091% 4:4.545% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 57.08 MB, 188.46 MB, 331.91 MB, 532.75 MB, 629.87 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 633.53 MB, 636.67 MB, 639.77 MB, 641.35 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 3.25 - BytesRead: 646.66 MB (678069386) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 78.68 MB (82504584) - PerReadThreadRawHdfsThroughput: 21.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 88.62M (88616920) - RowsReturned: 182 (182) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 62 (62) - ScannerThreadsTotalWallClockTime: 5m55s - MaterializeTupleTime(*): 3s027ms - ScannerThreadsSysTime: 136.976ms - ScannerThreadsUserTime: 3s088ms - ScannerThreadsVoluntaryContextSwitches: 374 (374) - TotalRawHdfsReadTime(*): 29s877ms - TotalReadThroughput: 5.87 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2992 (host=impala-s3-scale-31.vpc.cloudera.com:22000):(Total: 1m49s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.53 GB MemoryUsage(2s000ms): 37.58 MB, 59.43 MB, 55.02 MB, 19.34 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB, 9.00 MB ThreadUsage(2s000ms): 8, 8, 8, 4, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.59 MB (99187728) - PerHostPeakMemUsage: 94.59 MB (99187728) - PrepareTime: 163.987ms - RowsProduced: 1 (1) - TotalCpuTime: 2m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.941us - TotalStorageWaitTime: 2m26s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 433.965ms, non-child: 433.965ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 210.983ms - PrepareTime: 162.987ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m49s, non-child: 183.985ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 16.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071816) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.53 GB Hdfs Read Thread Concurrency Bucket: 0:94.06% 1:0.4566% 2:0.4566% 3:0% 4:5.023% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 43.26 MB, 196.52 MB, 357.57 MB, 566.79 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB, 597.05 MB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 1.38 - BytesRead: 604.92 MB (634308919) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 78 (78) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 94.56 MB (99150864) - PerReadThreadRawHdfsThroughput: 21.21 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 83.14M (83139542) - RowsReturned: 231 (231) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 92 (92) - ScannerThreadsTotalWallClockTime: 2m29s - MaterializeTupleTime(*): 2s875ms - ScannerThreadsSysTime: 130.977ms - ScannerThreadsUserTime: 2s939ms - ScannerThreadsVoluntaryContextSwitches: 365 (365) - TotalRawHdfsReadTime(*): 28s516ms - TotalReadThroughput: 5.45 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2994 (host=impala-s3-scale-20.vpc.cloudera.com:22000):(Total: 1m49s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.51 GB MemoryUsage(2s000ms): 40.42 MB, 99.20 MB, 86.18 MB, 22.28 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.15 MB, 9.08 MB, 9.00 MB ThreadUsage(2s000ms): 9, 12, 12, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 3.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 145.63 MB (152699512) - PerHostPeakMemUsage: 145.63 MB (152699512) - PrepareTime: 165.003ms - RowsProduced: 1 (1) - TotalCpuTime: 4m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 4m22s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 435.009ms, non-child: 435.009ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 211.004ms - PrepareTime: 165.003ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m49s, non-child: 193.004ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 25.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2074504) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.51 GB Hdfs Read Thread Concurrency Bucket: 0:94.06% 1:0.9132% 2:0% 3:0% 4:5.023% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 66.32 MB, 312.06 MB, 550.01 MB, 698.01 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 699.97 MB, 704.64 MB - AverageHdfsReadThreadConcurrency: 0.35 - AverageScannerThreadConcurrency: 2.45 - BytesRead: 714.02 MB (748706561) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 145.59 MB (152662648) - PerReadThreadRawHdfsThroughput: 17.36 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 97.99M (97991381) - RowsReturned: 288 (288) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 110 (110) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 3s545ms - ScannerThreadsSysTime: 144.972ms - ScannerThreadsUserTime: 3s626ms - ScannerThreadsVoluntaryContextSwitches: 409 (409) - TotalRawHdfsReadTime(*): 41s135ms - TotalReadThroughput: 6.45 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29ab (host=impala-s3-scale-12.vpc.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.53 GB MemoryUsage(2s000ms): 40.03 MB, 56.76 MB, 48.84 MB, 17.87 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB ThreadUsage(2s000ms): 6, 8, 8, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 85.64 MB (89800008) - PerHostPeakMemUsage: 85.64 MB (89800008) - PrepareTime: 165.995ms - RowsProduced: 1 (1) - TotalCpuTime: 2m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2m24s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 459.988ms, non-child: 459.988ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 233.994ms - PrepareTime: 165.995ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m48s, non-child: 195.995ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 28.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2074000) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m48s, non-child: 1m48s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.53 GB Hdfs Read Thread Concurrency Bucket: 0:93.55% 1:0.9217% 2:0.4608% 3:0.9217% 4:4.147% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 46.73 MB, 191.41 MB, 390.81 MB, 581.16 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB, 605.39 MB - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.34 - BytesRead: 605.95 MB (635382417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 79 (79) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 85.60 MB (89763144) - PerReadThreadRawHdfsThroughput: 20.76 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 83.21M (83212186) - RowsReturned: 263 (263) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 146 (146) - ScannerThreadsTotalWallClockTime: 2m27s - MaterializeTupleTime(*): 2s888ms - ScannerThreadsSysTime: 150.973ms - ScannerThreadsUserTime: 2s952ms - ScannerThreadsVoluntaryContextSwitches: 370 (370) - TotalRawHdfsReadTime(*): 29s182ms - TotalReadThroughput: 5.55 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299d (host=impala-s3-scale-9.vpc.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.05 GB MemoryUsage(2s000ms): 67.72 MB, 84.62 MB, 77.23 MB, 8.53 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 692.26 KB, 188.00 KB ThreadUsage(2s000ms): 9, 12, 11, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 3.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 126.17 MB (132298632) - PerHostPeakMemUsage: 126.17 MB (132298632) - PrepareTime: 166.988ms - RowsProduced: 1 (1) - TotalCpuTime: 4m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4m18s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 438.968ms, non-child: 438.968ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.984ms - PrepareTime: 165.988ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m48s, non-child: 187.986ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 19.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071104) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m48s, non-child: 1m48s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.05 GB Hdfs Read Thread Concurrency Bucket: 0:94.47% 1:0% 2:0.4608% 3:0% 4:5.069% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 90.30 MB, 306.37 MB, 562.39 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.14 MB, 658.74 MB, 658.74 MB - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 2.41 - BytesRead: 664.98 MB (697285874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 86 (86) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 126.13 MB (132261768) - PerReadThreadRawHdfsThroughput: 18.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 90.95M (90950451) - RowsReturned: 218 (218) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 86 (86) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 3s270ms - ScannerThreadsSysTime: 142.974ms - ScannerThreadsUserTime: 3s357ms - ScannerThreadsVoluntaryContextSwitches: 402 (402) - TotalRawHdfsReadTime(*): 35s398ms - TotalReadThroughput: 6.07 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29aa (host=impala-s3-scale-18.vpc.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.06 GB MemoryUsage(2s000ms): 104.14 MB, 132.88 MB, 106.76 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 8.21 MB, 10.18 MB, 8.06 MB, 8.06 MB ThreadUsage(2s000ms): 18, 23, 12, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 3.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 198.83 MB (208484976) - PerHostPeakMemUsage: 198.83 MB (208484976) - PrepareTime: 214.995ms - RowsProduced: 1 (1) - TotalCpuTime: 5m4s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.999ms - TotalStorageWaitTime: 4m59s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 544.989ms, non-child: 544.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 81.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 247.995ms - PrepareTime: 214.995ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m48s, non-child: 240.995ms, % non-child: 0.22%) ExecOption: Codegen Enabled - BuildTime: 21.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m48s, non-child: 1m48s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.06 GB Hdfs Read Thread Concurrency Bucket: 0:94.91% 1:0.463% 2:0% 3:0.463% 4:4.167% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 59.14 MB, 336.37 MB, 565.15 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.25 MB, 652.28 MB, 658.50 MB, 658.50 MB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 2.81 - BytesRead: 664.59 MB (696868560) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 85 (85) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 198.79 MB (208448112) - PerReadThreadRawHdfsThroughput: 12.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 90.97M (90965828) - RowsReturned: 233 (233) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 188 (188) - ScannerThreadsTotalWallClockTime: 5m4s - MaterializeTupleTime(*): 3s776ms - ScannerThreadsSysTime: 173.963ms - ScannerThreadsUserTime: 3s845ms - ScannerThreadsVoluntaryContextSwitches: 520 (520) - TotalRawHdfsReadTime(*): 51s250ms - TotalReadThroughput: 6.07 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2995 (host=impala-s3-scale-27.vpc.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.49 GB MemoryUsage(2s000ms): 110.69 MB, 143.72 MB, 46.21 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB ThreadUsage(2s000ms): 24, 21, 6, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.84 - BloomFilterBytes: 0 - PeakMemoryUsage: 203.37 MB (213252024) - PerHostPeakMemUsage: 203.37 MB (213252024) - PrepareTime: 166.967ms - RowsProduced: 1 (1) - TotalCpuTime: 3m13s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 3m8s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 438.913ms, non-child: 438.913ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.957ms - PrepareTime: 165.967ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m48s, non-child: 196.961ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 27.994ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m47s, non-child: 1m47s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.49 GB Hdfs Read Thread Concurrency Bucket: 0:95.83% 1:0% 2:0.463% 3:0% 4:3.704% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 95.62 MB, 358.42 MB, 573.32 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB, 600.61 MB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 1.84 - BytesRead: 601.19 MB (630397688) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 203.34 MB (213215160) - PerReadThreadRawHdfsThroughput: 12.43 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 82.39M (82389118) - RowsReturned: 166 (166) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 102 (102) - ScannerThreadsTotalWallClockTime: 3m13s - MaterializeTupleTime(*): 3s177ms - ScannerThreadsSysTime: 136.968ms - ScannerThreadsUserTime: 3s196ms - ScannerThreadsVoluntaryContextSwitches: 512 (512) - TotalRawHdfsReadTime(*): 48s379ms - TotalReadThroughput: 5.56 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a3 (host=impala-s3-scale-4.vpc.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.40 GB MemoryUsage(2s000ms): 67.50 MB, 57.97 MB, 53.40 MB, 2.72 MB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 492.00 KB, 2.45 MB, 2.30 MB, 2.64 MB ThreadUsage(2s000ms): 9, 12, 10, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 2 - AverageThreadTokens: 4.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 106.34 MB (111509216) - PerHostPeakMemUsage: 106.34 MB (111509216) - PrepareTime: 188.000ms - RowsProduced: 1 (1) - TotalCpuTime: 5m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 5m56s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 470.001ms, non-child: 470.001ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 61.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 222.000ms - PrepareTime: 186.000ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m48s, non-child: 216.000ms, % non-child: 0.20%) ExecOption: Codegen Enabled - BuildTime: 27.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070736) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m47s, non-child: 1m47s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.40 GB Hdfs Read Thread Concurrency Bucket: 0:93.98% 1:0.9259% 2:0.463% 3:0% 4:4.63% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 43.63 MB, 232.76 MB, 432.71 MB, 554.83 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.77 MB, 556.79 MB, 562.95 MB, 577.47 MB - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 3.33 - BytesRead: 592.26 MB (621032113) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 106.31 MB (111472352) - PerReadThreadRawHdfsThroughput: 18.76 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 81.21M (81213098) - RowsReturned: 290 (290) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 87 (87) - ScannerThreadsTotalWallClockTime: 5m59s - MaterializeTupleTime(*): 2s886ms - ScannerThreadsSysTime: 140.974ms - ScannerThreadsUserTime: 2s975ms - ScannerThreadsVoluntaryContextSwitches: 394 (394) - TotalRawHdfsReadTime(*): 31s567ms - TotalReadThroughput: 5.45 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a7 (host=impala-s3-scale-19.vpc.cloudera.com:22000):(Total: 1m47s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.45 GB MemoryUsage(2s000ms): 42.38 MB, 71.22 MB, 70.44 MB, 9.79 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.30 MB, 9.23 MB, 15.74 MB ThreadUsage(2s000ms): 9, 12, 11, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 2 - AverageThreadTokens: 4.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 109.22 MB (114525968) - PerHostPeakMemUsage: 109.22 MB (114525968) - PrepareTime: 167.996ms - RowsProduced: 1 (1) - TotalCpuTime: 5m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.981us - TotalStorageWaitTime: 5m56s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 447.991ms, non-child: 447.991ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 62.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.995ms - PrepareTime: 166.996ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m47s, non-child: 190.996ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 21.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2069576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m47s, non-child: 1m47s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.45 GB Hdfs Read Thread Concurrency Bucket: 0:94.42% 1:0.9302% 2:0% 3:0.9302% 4:3.721% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 75.79 MB, 285.56 MB, 485.67 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 560.38 MB, 567.07 MB - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 3.37 - BytesRead: 596.25 MB (625217464) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 77 (77) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 109.19 MB (114489104) - PerReadThreadRawHdfsThroughput: 18.05 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 82.01M (82014618) - RowsReturned: 202 (202) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 57 (57) - ScannerThreadsTotalWallClockTime: 5m59s - MaterializeTupleTime(*): 2s847ms - ScannerThreadsSysTime: 123.977ms - ScannerThreadsUserTime: 2s924ms - ScannerThreadsVoluntaryContextSwitches: 366 (366) - TotalRawHdfsReadTime(*): 33s040ms - TotalReadThroughput: 5.47 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299c (host=impala-s3-scale-24.vpc.cloudera.com:22000):(Total: 1m47s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.83 GB MemoryUsage(2s000ms): 31.15 MB, 37.61 MB, 41.73 MB, 43.97 MB, 44.37 MB, 11.50 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB, 9.01 MB ThreadUsage(2s000ms): 4, 6, 6, 6, 6, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 79.06 MB (82905464) - PerHostPeakMemUsage: 79.06 MB (82905464) - PrepareTime: 165.002ms - RowsProduced: 1 (1) - TotalCpuTime: 2m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.997us - TotalStorageWaitTime: 2m22s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 439.006ms, non-child: 439.006ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.003ms - PrepareTime: 164.002ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m47s, non-child: 185.002ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 21.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072200) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m47s, non-child: 1m47s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.83 GB Hdfs Read Thread Concurrency Bucket: 0:90.65% 1:1.869% 2:2.336% 3:3.271% 4:1.869% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 32.15 MB, 151.72 MB, 263.38 MB, 410.37 MB, 566.16 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB, 630.91 MB - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 1.36 - BytesRead: 638.76 MB (669792963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 79.03 MB (82868600) - PerReadThreadRawHdfsThroughput: 24.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 87.58M (87581897) - RowsReturned: 224 (224) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 49 (49) - ScannerThreadsTotalWallClockTime: 2m25s - MaterializeTupleTime(*): 2s926ms - ScannerThreadsSysTime: 125.978ms - ScannerThreadsUserTime: 3s023ms - ScannerThreadsVoluntaryContextSwitches: 362 (362) - TotalRawHdfsReadTime(*): 25s583ms - TotalReadThroughput: 5.90 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a1 (host=impala-s3-scale-22.vpc.cloudera.com:22000):(Total: 1m46s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.27 GB MemoryUsage(2s000ms): 26.32 MB, 45.59 MB, 39.12 MB, 34.38 MB, 13.54 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB, 2.15 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 87.66 MB (91914544) - PerHostPeakMemUsage: 87.66 MB (91914544) - PrepareTime: 167.007ms - RowsProduced: 1 (1) - TotalCpuTime: 4m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 4m8s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 440.019ms, non-child: 440.019ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 60.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.009ms - PrepareTime: 166.007ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m46s, non-child: 191.008ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 23.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072472) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m46s, non-child: 1m46s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.27 GB Hdfs Read Thread Concurrency Bucket: 0:92.52% 1:1.869% 2:0% 3:0.9346% 4:4.673% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 49.28 MB, 204.46 MB, 356.79 MB, 536.17 MB, 665.45 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 665.60 MB, 669.14 MB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 2.37 - BytesRead: 688.07 MB (721489979) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 87 (87) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 87.62 MB (91877680) - PerReadThreadRawHdfsThroughput: 23.76 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 94.11M (94110791) - RowsReturned: 266 (266) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 51 (51) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 3s312ms - ScannerThreadsSysTime: 192.967ms - ScannerThreadsUserTime: 3s349ms - ScannerThreadsVoluntaryContextSwitches: 403 (403) - TotalRawHdfsReadTime(*): 28s958ms - TotalReadThroughput: 6.42 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299e (host=impala-s3-scale-13.vpc.cloudera.com:22000):(Total: 1m46s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.76 GB MemoryUsage(2s000ms): 39.13 MB, 77.13 MB, 53.72 MB, 23.80 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 6.67 MB ThreadUsage(2s000ms): 9, 12, 12, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.20 MB (115547856) - PerHostPeakMemUsage: 110.20 MB (115547856) - PrepareTime: 164.996ms - RowsProduced: 1 (1) - TotalCpuTime: 7m43s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 7m39s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 435.992ms, non-child: 435.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.996ms - PrepareTime: 163.997ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m46s, non-child: 189.996ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 24.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072632) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m46s, non-child: 1m46s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.76 GB Hdfs Read Thread Concurrency Bucket: 0:93.46% 1:1.402% 2:0.4673% 3:0.4673% 4:4.206% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 78.47 MB, 276.29 MB, 470.82 MB, 601.95 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 603.88 MB, 605.91 MB, 618.55 MB - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 4.34 - BytesRead: 631.52 MB (662194270) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 110.16 MB (115510992) - PerReadThreadRawHdfsThroughput: 19.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.56M (86564857) - RowsReturned: 259 (259) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 63 (63) - ScannerThreadsTotalWallClockTime: 7m43s - MaterializeTupleTime(*): 3s070ms - ScannerThreadsSysTime: 195.965ms - ScannerThreadsUserTime: 3s085ms - ScannerThreadsVoluntaryContextSwitches: 380 (380) - TotalRawHdfsReadTime(*): 31s850ms - TotalReadThroughput: 5.90 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2997 (host=impala-s3-scale-30.vpc.cloudera.com:22000):(Total: 1m46s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.69 GB MemoryUsage(2s000ms): 67.17 MB, 88.64 MB, 52.02 MB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB ThreadUsage(2s000ms): 9, 12, 9, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 129.43 MB (135713464) - PerHostPeakMemUsage: 129.43 MB (135713464) - PrepareTime: 170.000ms - RowsProduced: 1 (1) - TotalCpuTime: 4m17s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.999ms - TotalStorageWaitTime: 4m14s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 441.001ms, non-child: 441.001ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 60.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.000ms - PrepareTime: 168.000ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m46s, non-child: 194.000ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 21.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070896) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m46s, non-child: 1m46s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.69 GB Hdfs Read Thread Concurrency Bucket: 0:94.84% 1:0.4695% 2:0% 3:0% 4:4.695% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 96.58 MB, 349.22 MB, 566.64 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB, 611.18 MB - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 2.42 - BytesRead: 623.62 MB (653916231) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 129.39 MB (135676600) - PerReadThreadRawHdfsThroughput: 18.81 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 85.53M (85532196) - RowsReturned: 224 (224) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 90 (90) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 3s146ms - ScannerThreadsSysTime: 153.973ms - ScannerThreadsUserTime: 3s208ms - ScannerThreadsVoluntaryContextSwitches: 406 (406) - TotalRawHdfsReadTime(*): 33s154ms - TotalReadThroughput: 5.74 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299b (host=impala-s3-scale-28.vpc.cloudera.com:22000):(Total: 1m46s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.98 GB MemoryUsage(2s000ms): 63.87 MB, 83.63 MB, 58.03 MB, 692.94 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB ThreadUsage(2s000ms): 12, 12, 9, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 146.15 MB (153247624) - PerHostPeakMemUsage: 146.15 MB (153247624) - PrepareTime: 168.019ms - RowsProduced: 1 (1) - TotalCpuTime: 2m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 2m35s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 439.051ms, non-child: 439.051ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.025ms - PrepareTime: 167.019ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m46s, non-child: 192.022ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 24.002ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072536) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m46s, non-child: 1m46s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.98 GB Hdfs Read Thread Concurrency Bucket: 0:94.84% 1:0.4695% 2:0% 3:0.4695% 4:4.225% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 59.42 MB, 299.88 MB, 553.67 MB, 649.72 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB, 649.86 MB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 1.52 - BytesRead: 656.04 MB (687909113) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 146.11 MB (153210760) - PerReadThreadRawHdfsThroughput: 18.86 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 89.85M (89847460) - RowsReturned: 242 (242) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 150 (150) - ScannerThreadsTotalWallClockTime: 2m39s - MaterializeTupleTime(*): 3s398ms - ScannerThreadsSysTime: 155.971ms - ScannerThreadsUserTime: 3s434ms - ScannerThreadsVoluntaryContextSwitches: 417 (417) - TotalRawHdfsReadTime(*): 34s780ms - TotalReadThroughput: 6.16 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2996 (host=impala-s3-scale-5.vpc.cloudera.com:22000):(Total: 1m45s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.97 GB MemoryUsage(2s000ms): 37.28 MB, 65.36 MB, 49.86 MB, 47.41 MB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB ThreadUsage(2s000ms): 6, 8, 8, 7, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 85.65 MB (89810168) - PerHostPeakMemUsage: 85.65 MB (89810168) - PrepareTime: 166.019ms - RowsProduced: 1 (1) - TotalCpuTime: 2m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2m26s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.051ms, non-child: 436.051ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.025ms - PrepareTime: 164.019ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m45s, non-child: 190.022ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 24.002ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m45s, non-child: 1m45s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.97 GB Hdfs Read Thread Concurrency Bucket: 0:92.92% 1:0.4717% 2:0% 3:1.415% 4:5.189% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 40.75 MB, 170.41 MB, 340.26 MB, 572.78 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.13 MB, 648.16 MB - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 1.42 - BytesRead: 654.28 MB (686060623) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 85.61 MB (89773304) - PerReadThreadRawHdfsThroughput: 21.57 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 89.69M (89687594) - RowsReturned: 164 (164) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 98 (98) - ScannerThreadsTotalWallClockTime: 2m29s - MaterializeTupleTime(*): 3s228ms - ScannerThreadsSysTime: 152.974ms - ScannerThreadsUserTime: 3s266ms - ScannerThreadsVoluntaryContextSwitches: 376 (376) - TotalRawHdfsReadTime(*): 30s327ms - TotalReadThroughput: 6.12 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a4 (host=impala-s3-scale-10.vpc.cloudera.com:22000):(Total: 1m45s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.39 GB MemoryUsage(2s000ms): 72.45 MB, 67.98 MB, 50.74 MB, 5.07 MB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 340.00 KB, 2.26 MB ThreadUsage(2s000ms): 9, 12, 9, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 112.75 MB (118229464) - PerHostPeakMemUsage: 112.75 MB (118229464) - PrepareTime: 165.994ms - RowsProduced: 1 (1) - TotalCpuTime: 4m15s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.970us - TotalStorageWaitTime: 4m11s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.985ms, non-child: 436.985ms, % non-child: 100.00%) - CodegenTime: 999.968us - CompileTime: 58.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.993ms - PrepareTime: 164.994ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m45s, non-child: 198.993ms, % non-child: 0.19%) ExecOption: Codegen Enabled - BuildTime: 29.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070264) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m45s, non-child: 1m45s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.39 GB Hdfs Read Thread Concurrency Bucket: 0:94.31% 1:0.4739% 2:0.9479% 3:0% 4:4.265% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 52.07 MB, 265.92 MB, 485.37 MB, 575.87 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 577.80 MB, 579.38 MB - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 2.42 - BytesRead: 590.23 MB (618903829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 78 (78) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 112.72 MB (118192600) - PerReadThreadRawHdfsThroughput: 18.65 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 81.09M (81087152) - RowsReturned: 183 (183) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 70 (70) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 2s964ms - ScannerThreadsSysTime: 133.975ms - ScannerThreadsUserTime: 3s023ms - ScannerThreadsVoluntaryContextSwitches: 407 (407) - TotalRawHdfsReadTime(*): 31s639ms - TotalReadThroughput: 5.51 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2991 (host=impala-s3-scale-17.vpc.cloudera.com:22000):(Total: 1m45s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.40 GB MemoryUsage(2s000ms): 61.09 MB, 86.70 MB, 52.77 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB, 2.00 MB ThreadUsage(2s000ms): 12, 12, 7, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 122.21 MB (128145408) - PerHostPeakMemUsage: 122.21 MB (128145408) - PrepareTime: 165.998ms - RowsProduced: 1 (1) - TotalCpuTime: 2m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2m32s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.995ms, non-child: 434.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 57.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 211.997ms - PrepareTime: 164.998ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m45s, non-child: 185.997ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 20.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072080) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m45s, non-child: 1m45s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.40 GB Hdfs Read Thread Concurrency Bucket: 0:95.28% 1:0% 2:0% 3:0% 4:4.717% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 68.81 MB, 309.79 MB, 526.76 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB, 591.09 MB - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 1.49 - BytesRead: 591.69 MB (620431551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 79 (79) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 122.17 MB (128108544) - PerReadThreadRawHdfsThroughput: 18.23 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 81.21M (81208708) - RowsReturned: 215 (215) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 88 (88) - ScannerThreadsTotalWallClockTime: 2m35s - MaterializeTupleTime(*): 2s901ms - ScannerThreadsSysTime: 128.976ms - ScannerThreadsUserTime: 2s980ms - ScannerThreadsVoluntaryContextSwitches: 406 (406) - TotalRawHdfsReadTime(*): 32s451ms - TotalReadThroughput: 5.58 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a8 (host=impala-s3-scale-23.vpc.cloudera.com:22000):(Total: 1m45s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.41 GB MemoryUsage(2s000ms): 50.76 MB, 44.17 MB, 36.74 MB, 48.83 MB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB, 188.00 KB ThreadUsage(2s000ms): 6, 8, 8, 7, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 87.44 MB (91686672) - PerHostPeakMemUsage: 87.44 MB (91686672) - PrepareTime: 168.007ms - RowsProduced: 1 (1) - TotalCpuTime: 2m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2m26s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 440.019ms, non-child: 440.019ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 60.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.009ms - PrepareTime: 167.007ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1m45s, non-child: 188.008ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 20.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2073176) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1m44s, non-child: 1m44s, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.41 GB Hdfs Read Thread Concurrency Bucket: 0:92.38% 1:0.9524% 2:0.4762% 3:2.381% 4:3.81% File Formats: PARQUET/NONE:57 BytesRead(2s000ms): 49.01 MB, 180.05 MB, 312.41 MB, 504.57 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB, 578.26 MB - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 1.42 - BytesRead: 592.95 MB (621749009) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 87.40 MB (91649808) - PerReadThreadRawHdfsThroughput: 20.85 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 81.31M (81305283) - RowsReturned: 253 (253) - RowsReturnedRate: 2.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 74 (74) - ScannerThreadsTotalWallClockTime: 2m29s - MaterializeTupleTime(*): 2s759ms - ScannerThreadsSysTime: 141.975ms - ScannerThreadsUserTime: 2s810ms - ScannerThreadsVoluntaryContextSwitches: 363 (363) - TotalRawHdfsReadTime(*): 28s435ms - TotalReadThroughput: 5.58 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a6 (host=impala-s3-scale-26.vpc.cloudera.com:22000):(Total: 7s228ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.66 GB MemoryUsage(500.000ms): 0, 1.07 MB, 76.73 MB, 54.57 MB, 49.27 MB, 49.92 MB, 86.19 MB, 51.86 MB, 36.91 MB, 56.20 MB, 61.20 MB, 49.27 MB, 59.04 MB, 50.86 MB, 43.22 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 7.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.59 MB (99182736) - PerHostPeakMemUsage: 94.59 MB (99182736) - PrepareTime: 170.002ms - RowsProduced: 1 (1) - TotalCpuTime: 47s910ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.000ms - TotalStorageWaitTime: 44s735ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 444.005ms, non-child: 444.005ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.002ms - PrepareTime: 169.002ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 7s222ms, non-child: 188.002ms, % non-child: 2.60%) ExecOption: Codegen Enabled - BuildTime: 19.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072352) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 7s034ms, non-child: 7s034ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.66 GB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:7.143% 3:14.29% 4:78.57% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 43.20 MB, 97.19 MB, 118.91 MB, 167.96 MB, 198.24 MB, 251.27 MB, 292.25 MB, 306.20 MB, 348.49 MB, 382.94 MB, 437.80 MB, 494.02 MB, 568.94 MB - AverageHdfsReadThreadConcurrency: 4.43 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 620.55 MB (650690443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 79 (79) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 94.55 MB (99145872) - PerReadThreadRawHdfsThroughput: 20.45 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 85.26M (85262988) - RowsReturned: 90 (90) - RowsReturnedRate: 12.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 79 (79) - ScannerThreadsTotalWallClockTime: 47s910ms - MaterializeTupleTime(*): 2s964ms - ScannerThreadsSysTime: 123.977ms - ScannerThreadsUserTime: 3s051ms - ScannerThreadsVoluntaryContextSwitches: 367 (367) - TotalRawHdfsReadTime(*): 30s346ms - TotalReadThroughput: 81.28 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29ad (host=impala-s3-scale-3.vpc.cloudera.com:22000):(Total: 7s172ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.46 GB MemoryUsage(500.000ms): 796.00 KB, 66.61 MB, 37.16 MB, 40.45 MB, 51.78 MB, 76.50 MB, 42.99 MB, 66.61 MB, 75.13 MB, 29.06 MB, 50.21 MB, 61.20 MB, 50.86 MB, 50.07 MB ThreadUsage(500.000ms): 6, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 7.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 87.49 MB (91745056) - PerHostPeakMemUsage: 87.49 MB (91745056) - PrepareTime: 169.998ms - RowsProduced: 1 (1) - TotalCpuTime: 46s242ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 43s177ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 442.995ms, non-child: 442.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.997ms - PrepareTime: 167.998ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 7s169ms, non-child: 195.997ms, % non-child: 2.73%) ExecOption: Codegen Enabled - BuildTime: 23.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2073128) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 6s973ms, non-child: 6s973ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.46 GB Hdfs Read Thread Concurrency Bucket: 0:7.143% 1:7.143% 2:7.143% 3:21.43% 4:57.14% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 14.77 MB, 67.42 MB, 95.18 MB, 127.89 MB, 158.06 MB, 206.91 MB, 241.61 MB, 284.65 MB, 344.40 MB, 370.13 MB, 426.87 MB, 481.52 MB, 549.83 MB - AverageHdfsReadThreadConcurrency: 3.79 - AverageScannerThreadConcurrency: 6.79 - BytesRead: 597.85 MB (626893714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 78 (78) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 87.46 MB (91708192) - PerReadThreadRawHdfsThroughput: 20.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 82.15M (82151809) - RowsReturned: 235 (235) - RowsReturnedRate: 33.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 87 (87) - ScannerThreadsTotalWallClockTime: 46s242ms - MaterializeTupleTime(*): 2s853ms - ScannerThreadsSysTime: 135.976ms - ScannerThreadsUserTime: 2s911ms - ScannerThreadsVoluntaryContextSwitches: 358 (358) - TotalRawHdfsReadTime(*): 28s999ms - TotalReadThroughput: 78.55 MB/sec Instance 3c493c3c7086695a:3a7abec5758a299a (host=impala-s3-scale-29.vpc.cloudera.com:22000):(Total: 6s910ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.15 GB MemoryUsage(500.000ms): 0, 1.07 MB, 57.79 MB, 85.55 MB, 45.72 MB, 43.21 MB, 57.15 MB, 54.50 MB, 36.22 MB, 57.79 MB, 43.86 MB, 59.38 MB, 58.74 MB, 62.20 MB, 3.00 MB ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 2 - AverageThreadTokens: 7.13 - BloomFilterBytes: 0 - PeakMemoryUsage: 86.60 MB (90801960) - PerHostPeakMemUsage: 86.60 MB (90801960) - PrepareTime: 169.985ms - RowsProduced: 1 (1) - TotalCpuTime: 45s403ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ns - TotalStorageWaitTime: 42s503ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 440.961ms, non-child: 440.961ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 211.981ms - PrepareTime: 168.985ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 6s907ms, non-child: 192.983ms, % non-child: 2.79%) ExecOption: Codegen Enabled - BuildTime: 21.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.97 MB (3114048) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 6s714ms, non-child: 6s714ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.15 GB Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:0% 2:0% 3:14.29% 4:71.43% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 14.83 MB, 51.14 MB, 97.99 MB, 139.31 MB, 166.58 MB, 221.24 MB, 261.23 MB, 289.33 MB, 328.05 MB, 355.40 MB, 415.13 MB, 486.78 MB, 562.32 MB - AverageHdfsReadThreadConcurrency: 3.93 - AverageScannerThreadConcurrency: 6.57 - BytesRead: 563.20 MB (590554307) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 75 (75) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 86.56 MB (90765096) - PerReadThreadRawHdfsThroughput: 20.22 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.55M (77547720) - RowsReturned: 228 (228) - RowsReturnedRate: 33.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 78 (78) - ScannerThreadsTotalWallClockTime: 45s403ms - MaterializeTupleTime(*): 2s682ms - ScannerThreadsSysTime: 125.978ms - ScannerThreadsUserTime: 2s754ms - ScannerThreadsVoluntaryContextSwitches: 352 (352) - TotalRawHdfsReadTime(*): 27s853ms - TotalReadThroughput: 80.33 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2990 (host=impala-s3-scale-32.vpc.cloudera.com:22000):(Total: 6s794ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.01 GB MemoryUsage(500.000ms): 1.07 MB, 51.28 MB, 61.25 MB, 35.90 MB, 48.32 MB, 65.67 MB, 76.08 MB, 52.10 MB, 65.67 MB, 68.21 MB, 51.09 MB, 40.45 MB, 67.11 MB, 2.00 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 2 - AverageThreadTokens: 7.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 86.59 MB (90793488) - PerHostPeakMemUsage: 86.59 MB (90793488) - PrepareTime: 164.996ms - RowsProduced: 1 (1) - TotalCpuTime: 43s982ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.979us - TotalStorageWaitTime: 41s184ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 436.990ms, non-child: 436.990ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 212.995ms - PrepareTime: 163.996ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 6s788ms, non-child: 188.995ms, % non-child: 2.78%) ExecOption: Codegen Enabled - BuildTime: 23.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070648) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 6s599ms, non-child: 6s599ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.01 GB Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:0% 2:0% 3:14.29% 4:71.43% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 33.14 MB, 67.73 MB, 116.09 MB, 151.83 MB, 184.84 MB, 225.53 MB, 270.06 MB, 322.34 MB, 362.93 MB, 394.31 MB, 446.26 MB, 493.39 MB, 547.47 MB - AverageHdfsReadThreadConcurrency: 4.07 - AverageScannerThreadConcurrency: 6.50 - BytesRead: 548.07 MB (574691234) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 73 (73) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 86.55 MB (90756624) - PerReadThreadRawHdfsThroughput: 19.30 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.56M (75561295) - RowsReturned: 226 (226) - RowsReturnedRate: 34.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 75 (75) - ScannerThreadsTotalWallClockTime: 43s982ms - MaterializeTupleTime(*): 2s596ms - ScannerThreadsSysTime: 119.978ms - ScannerThreadsUserTime: 2s667ms - ScannerThreadsVoluntaryContextSwitches: 365 (365) - TotalRawHdfsReadTime(*): 28s390ms - TotalReadThroughput: 78.21 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a5 (host=impala-s3-scale-15.vpc.cloudera.com:22000):(Total: 5s870ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.04 GB MemoryUsage(500.000ms): 28.00 KB, 80.42 MB, 102.94 MB, 70.61 MB, 75.38 MB, 89.01 MB, 109.89 MB, 101.24 MB, 94.24 MB, 78.20 MB, 70.56 MB, 26.49 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 9, 3 - AverageThreadTokens: 10.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 119.10 MB (124889512) - PerHostPeakMemUsage: 119.10 MB (124889512) - PrepareTime: 168.017ms - RowsProduced: 1 (1) - TotalCpuTime: 54s489ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 50s816ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 440.045ms, non-child: 440.045ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 214.022ms - PrepareTime: 166.017ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s867ms, non-child: 193.020ms, % non-child: 3.29%) ExecOption: Codegen Enabled - BuildTime: 25.002ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.97 MB (3113728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s674ms, non-child: 5s674ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.04 GB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:9.091% 3:0% 4:90.91% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 1000.00 KB, 69.95 MB, 151.07 MB, 184.96 MB, 271.42 MB, 317.16 MB, 383.99 MB, 453.41 MB, 528.75 MB, 598.00 MB, 633.61 MB - AverageHdfsReadThreadConcurrency: 6.45 - AverageScannerThreadConcurrency: 9.91 - BytesRead: 661.74 MB (693882552) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 119.07 MB (124852648) - PerReadThreadRawHdfsThroughput: 18.24 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 90.67M (90670015) - RowsReturned: 327 (327) - RowsReturnedRate: 57.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 147 (147) - ScannerThreadsTotalWallClockTime: 54s489ms - MaterializeTupleTime(*): 3s407ms - ScannerThreadsSysTime: 196.964ms - ScannerThreadsUserTime: 3s450ms - ScannerThreadsVoluntaryContextSwitches: 407 (407) - TotalRawHdfsReadTime(*): 36s285ms - TotalReadThroughput: 105.60 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2993 (host=impala-s3-scale-7.vpc.cloudera.com:22000):(Total: 5s768ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.84 GB MemoryUsage(500.000ms): 0, 1.67 MB, 126.74 MB, 121.24 MB, 69.03 MB, 82.01 MB, 92.65 MB, 114.13 MB, 94.24 MB, 64.86 MB, 77.02 MB, 45.90 MB, 10.00 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 6, 2 - AverageThreadTokens: 9.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 138.17 MB (144880112) - PerHostPeakMemUsage: 138.17 MB (144880112) - PrepareTime: 164.990ms - RowsProduced: 1 (1) - TotalCpuTime: 53s347ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 49s797ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 438.975ms, non-child: 438.975ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 214.988ms - PrepareTime: 163.990ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s764ms, non-child: 200.988ms, % non-child: 3.49%) ExecOption: Codegen Enabled - BuildTime: 32.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2070936) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s563ms, non-child: 5s563ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.84 GB Hdfs Read Thread Concurrency Bucket: 0:16.67% 1:0% 2:0% 3:0% 4:83.33% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 61.27 MB, 123.59 MB, 177.75 MB, 240.89 MB, 304.68 MB, 375.38 MB, 430.19 MB, 517.52 MB, 561.96 MB, 602.17 MB, 640.09 MB - AverageHdfsReadThreadConcurrency: 5.83 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 640.09 MB (671186205) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 138.13 MB (144843248) - PerReadThreadRawHdfsThroughput: 17.80 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 87.69M (87688926) - RowsReturned: 198 (198) - RowsReturnedRate: 35.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 136 (136) - ScannerThreadsTotalWallClockTime: 53s347ms - MaterializeTupleTime(*): 3s290ms - ScannerThreadsSysTime: 165.968ms - ScannerThreadsUserTime: 3s321ms - ScannerThreadsVoluntaryContextSwitches: 414 (414) - TotalRawHdfsReadTime(*): 35s960ms - TotalReadThroughput: 106.68 MB/sec Instance 3c493c3c7086695a:3a7abec5758a2998 (host=impala-s3-scale-1.vpc.cloudera.com:22000):(Total: 5s754ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.83 GB MemoryUsage(500.000ms): 0, 1.67 MB, 90.30 MB, 121.10 MB, 95.26 MB, 97.22 MB, 69.72 MB, 99.66 MB, 60.20 MB, 85.42 MB, 85.27 MB, 46.50 MB, 2.00 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 11, 6, 2 - AverageThreadTokens: 9.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 129.52 MB (135806768) - PerHostPeakMemUsage: 129.52 MB (135806768) - PrepareTime: 174.005ms - RowsProduced: 1 (1) - TotalCpuTime: 54s828ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 51s444ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 445.013ms, non-child: 445.013ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 59.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 213.006ms - PrepareTime: 172.005ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s750ms, non-child: 199.005ms, % non-child: 3.46%) ExecOption: Codegen Enabled - BuildTime: 24.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2072112) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s551ms, non-child: 5s551ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.83 GB Hdfs Read Thread Concurrency Bucket: 0:8.333% 1:8.333% 2:8.333% 3:0% 4:75% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 33.73 MB, 110.68 MB, 173.93 MB, 258.27 MB, 332.10 MB, 386.10 MB, 447.35 MB, 495.06 MB, 549.31 MB, 608.43 MB, 638.04 MB - AverageHdfsReadThreadConcurrency: 5.92 - AverageScannerThreadConcurrency: 9.58 - BytesRead: 638.66 MB (669687979) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 129.48 MB (135769904) - PerReadThreadRawHdfsThroughput: 17.80 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 87.57M (87570247) - RowsReturned: 286 (286) - RowsReturnedRate: 51.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 139 (139) - ScannerThreadsTotalWallClockTime: 54s828ms - MaterializeTupleTime(*): 3s140ms - ScannerThreadsSysTime: 148.973ms - ScannerThreadsUserTime: 3s215ms - ScannerThreadsVoluntaryContextSwitches: 404 (404) - TotalRawHdfsReadTime(*): 35s881ms - TotalReadThroughput: 106.34 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29ae (host=impala-s3-scale-14.vpc.cloudera.com:22000):(Total: 5s630ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/6.26 GB MemoryUsage(500.000ms): 0, 81.32 MB, 156.45 MB, 163.86 MB, 128.61 MB, 179.82 MB, 180.35 MB, 157.74 MB, 159.46 MB, 149.50 MB, 103.48 MB, 35.90 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 23, 20, 10, 5 - AverageThreadTokens: 18.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 199.99 MB (209706936) - PerHostPeakMemUsage: 199.99 MB (209706936) - PrepareTime: 165.993ms - RowsProduced: 1 (1) - TotalCpuTime: 1m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1m41s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 434.982ms, non-child: 434.982ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 57.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 211.991ms - PrepareTime: 164.993ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s627ms, non-child: 188.992ms, % non-child: 3.36%) ExecOption: Codegen Enabled - BuildTime: 18.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2071856) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s438ms, non-child: 5s438ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/6.26 GB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:18.18% 4:81.82% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 1.66 MB, 48.84 MB, 152.42 MB, 238.70 MB, 284.41 MB, 340.84 MB, 389.22 MB, 467.91 MB, 514.92 MB, 577.56 MB, 654.60 MB - AverageHdfsReadThreadConcurrency: 10.64 - AverageScannerThreadConcurrency: 19.55 - BytesRead: 685.98 MB (719302431) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 85 (85) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 199.96 MB (209670072) - PerReadThreadRawHdfsThroughput: 11.77 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 93.98M (93981427) - RowsReturned: 279 (279) - RowsReturnedRate: 51.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 103 (103) - ScannerThreadsTotalWallClockTime: 1m45s - MaterializeTupleTime(*): 3s520ms - ScannerThreadsSysTime: 158.964ms - ScannerThreadsUserTime: 3s577ms - ScannerThreadsVoluntaryContextSwitches: 447 (447) - TotalRawHdfsReadTime(*): 58s263ms - TotalReadThroughput: 119.00 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29a0 (host=impala-s3-scale-21.vpc.cloudera.com:22000):(Total: 5s391ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.81 GB MemoryUsage(500.000ms): 0, 65.57 MB, 148.58 MB, 123.04 MB, 140.00 MB, 139.71 MB, 150.99 MB, 140.77 MB, 143.61 MB, 158.40 MB, 45.89 MB, 10.01 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 19, 15, 12, 6, 2 - AverageThreadTokens: 16.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 170.77 MB (179065968) - PerHostPeakMemUsage: 170.77 MB (179065968) - PrepareTime: 172.994ms - RowsProduced: 1 (1) - TotalCpuTime: 1m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.965us - TotalStorageWaitTime: 1m28s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 447.984ms, non-child: 447.984ms, % non-child: 100.00%) - CodegenTime: 1.999ms - CompileTime: 58.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.992ms - PrepareTime: 171.994ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s388ms, non-child: 198.993ms, % non-child: 3.69%) ExecOption: Codegen Enabled - BuildTime: 23.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.98 MB (2074448) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 5s189ms, non-child: 5s189ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.81 GB Hdfs Read Thread Concurrency Bucket: 0:9.091% 1:0% 2:0% 3:9.091% 4:81.82% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 1.46 MB, 54.87 MB, 154.52 MB, 236.85 MB, 313.36 MB, 350.88 MB, 416.57 MB, 457.05 MB, 532.77 MB, 604.96 MB, 636.15 MB - AverageHdfsReadThreadConcurrency: 8.82 - AverageScannerThreadConcurrency: 17.00 - BytesRead: 636.15 MB (667056063) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 170.74 MB (179029104) - PerReadThreadRawHdfsThroughput: 13.06 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 87.38M (87382361) - RowsReturned: 201 (201) - RowsReturnedRate: 38.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 133 (133) - ScannerThreadsTotalWallClockTime: 1m33s - MaterializeTupleTime(*): 3s228ms - ScannerThreadsSysTime: 138.968ms - ScannerThreadsUserTime: 3s314ms - ScannerThreadsVoluntaryContextSwitches: 469 (469) - TotalRawHdfsReadTime(*): 48s722ms - TotalReadThroughput: 115.58 MB/sec Instance 3c493c3c7086695a:3a7abec5758a29af (host=impala-s3-scale-6.vpc.cloudera.com:22000):(Total: 5s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:57/5.62 GB MemoryUsage(500.000ms): 28.00 KB, 97.07 MB, 166.44 MB, 149.84 MB, 120.01 MB, 116.43 MB, 134.52 MB, 204.17 MB, 173.52 MB, 97.92 MB, 29.91 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 22, 17, 9, 5 - AverageThreadTokens: 18.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.17 MB (222475768) - PerHostPeakMemUsage: 212.17 MB (222475768) - PrepareTime: 175.004ms - RowsProduced: 1 (1) - TotalCpuTime: 1m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1m29s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 450.011ms, non-child: 450.011ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2524652) - NumFunctions: 247 (247) - NumInstructions: 2.44K (2440) - OptimizationTime: 216.005ms - PrepareTime: 174.004ms DataStreamSender (dst_id=2): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 5s158ms, non-child: 206.005ms, % non-child: 3.99%) ExecOption: Codegen Enabled - BuildTime: 27.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.97 MB (2069272) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s952ms, non-child: 4s952ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 57 Hdfs split stats (:<# splits>/): -1:57/5.62 GB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:10% 3:0% 4:90% File Formats: PARQUET/NONE:57 BytesRead(500.000ms): 0, 1.86 MB, 58.75 MB, 195.53 MB, 255.29 MB, 297.00 MB, 350.15 MB, 417.57 MB, 469.95 MB, 536.92 MB, 599.67 MB - AverageHdfsReadThreadConcurrency: 10.60 - AverageScannerThreadConcurrency: 18.70 - BytesRead: 615.83 MB (645740810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 212.13 MB (222438904) - PerReadThreadRawHdfsThroughput: 11.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 84.44M (84440397) - RowsReturned: 194 (194) - RowsReturnedRate: 39.00 /sec - ScanRangesComplete: 57 (57) - ScannerThreadsInvoluntaryContextSwitches: 118 (118) - ScannerThreadsTotalWallClockTime: 1m34s - MaterializeTupleTime(*): 3s143ms - ScannerThreadsSysTime: 160.963ms - ScannerThreadsUserTime: 3s180ms - ScannerThreadsVoluntaryContextSwitches: 441 (441) - TotalRawHdfsReadTime(*): 52s068ms - TotalReadThroughput: 109.03 MB/sec