Query (id=774459bfeec8097d:eb8117dc37ccd4b3): Summary: Session ID: 8546b1f7db7ae19a:63c8f642eb4bf5af Session Type: BEESWAX Start Time: 2016-05-02 23:56:11.975422000 End Time: 2016-05-02 23:56:17.687508000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build c4425e89c34007007eac71a525a692b3978600dc) User: root Connected User: root Delegated User: Network Address: ::ffff:172.28.196.197:38402 Default Db: tpch_300_parquet_s3 Sql Statement: select sum(l_extendedprice * l_discount) as revenue from lineitem where l_shipdate >= '1994-01-01' and l_shipdate < '1995-01-01' and l_discount between 0.05 and 0.07 and l_quantity < 24 Coordinator: impala-s3-scale-2.vpc.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=362.00MB VCores=1 03:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * l_discount) | hosts=32 per-host-mem=unavailable | tuple-ids=1 row-size=16B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] | hosts=32 per-host-mem=unavailable | tuple-ids=1 row-size=16B cardinality=1 | 01:AGGREGATE | output: sum(l_extendedprice * l_discount) | hosts=32 per-host-mem=10.00MB | tuple-ids=1 row-size=16B cardinality=1 | 00:SCAN HDFS [tpch_300_parquet_s3.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate >= '1994-01-01', l_shipdate < '1995-01-01', l_discount >= 0.05, l_discount <= 0.07, l_quantity < 24 table stats: 1799989091 rows total column stats: all hosts=32 per-host-mem=352.00MB tuple-ids=0 row-size=50B cardinality=179998909 ---------------- Estimated Per-Host Mem: 379584512 Estimated Per-Host VCores: 1 Request Pool: root.root Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------ 03:AGGREGATE 1 150.002ms 150.002ms 1 1 140.00 KB -1.00 B FINALIZE 02:EXCHANGE 1 0.000ns 0.000ns 32 1 0 -1.00 B UNPARTITIONED 01:AGGREGATE 32 190.717ms 215.002ms 32 1 1.34 MB 10.00 MB 00:SCAN HDFS 32 4s396ms 4s885ms 34.26M 180.00M 386.26 MB 352.00 MB tpch_300_parquet_s3.lineitem Planner Timeline: 15.296ms - Analysis finished: 5.730ms (5.730ms) - Equivalence classes computed: 5.993ms (263.067us) - Single node plan created: 10.563ms (4.570ms) - Runtime filters computed: 10.582ms (19.417us) - Distributed plan created: 11.908ms (1.325ms) - Lineage info computed: 12.824ms (916.054us) - Planning finished: 15.296ms (2.472ms) Query Timeline: 5s719ms - Start execution: 0.000ns (0.000ns) - Planning finished: 24.000ms (24.000ms) - Submit for admission: 25.000ms (1.000ms) - Completed admission: 26.000ms (1.000ms) - Ready to start 32 remote fragments: 177.003ms (151.002ms) - All 32 remote fragments started: 182.003ms (5.000ms) - Rows available: 5s622ms (5s440ms) - First row fetched: 5s709ms (87.001ms) - Unregister query: 5s712ms (3.000ms) ImpalaServer: - ClientFetchWaitTimer: 88.001ms - RowMaterializationTimer: 0.000ns Execution Profile 774459bfeec8097d:eb8117dc37ccd4b3:(Total: 5s598ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ---------------------------------------------------------------------------------------------- Fragment start latencies: Count: 32, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 5ms Per Node Peak Memory Usage: impala-s3-scale-33.vpc.cloudera.com:22000(366.47 MB) impala-s3-scale-6.vpc.cloudera.com:22000(380.27 MB) impala-s3-scale-15.vpc.cloudera.com:22000(341.51 MB) impala-s3-scale-10.vpc.cloudera.com:22000(382.01 MB) impala-s3-scale-18.vpc.cloudera.com:22000(359.56 MB) impala-s3-scale-12.vpc.cloudera.com:22000(342.86 MB) impala-s3-scale-25.vpc.cloudera.com:22000(323.51 MB) impala-s3-scale-30.vpc.cloudera.com:22000(373.48 MB) impala-s3-scale-21.vpc.cloudera.com:22000(329.81 MB) impala-s3-scale-4.vpc.cloudera.com:22000(342.21 MB) impala-s3-scale-23.vpc.cloudera.com:22000(355.81 MB) impala-s3-scale-26.vpc.cloudera.com:22000(331.73 MB) impala-s3-scale-19.vpc.cloudera.com:22000(338.87 MB) impala-s3-scale-22.vpc.cloudera.com:22000(351.34 MB) impala-s3-scale-13.vpc.cloudera.com:22000(325.82 MB) impala-s3-scale-16.vpc.cloudera.com:22000(334.53 MB) impala-s3-scale-8.vpc.cloudera.com:22000(326.44 MB) impala-s3-scale-29.vpc.cloudera.com:22000(331.78 MB) impala-s3-scale-5.vpc.cloudera.com:22000(360.11 MB) impala-s3-scale-1.vpc.cloudera.com:22000(355.56 MB) impala-s3-scale-31.vpc.cloudera.com:22000(320.18 MB) impala-s3-scale-27.vpc.cloudera.com:22000(318.23 MB) impala-s3-scale-20.vpc.cloudera.com:22000(315.73 MB) impala-s3-scale-17.vpc.cloudera.com:22000(320.37 MB) impala-s3-scale-7.vpc.cloudera.com:22000(333.59 MB) impala-s3-scale-24.vpc.cloudera.com:22000(331.19 MB) impala-s3-scale-9.vpc.cloudera.com:22000(336.44 MB) impala-s3-scale-28.vpc.cloudera.com:22000(330.22 MB) impala-s3-scale-32.vpc.cloudera.com:22000(336.96 MB) impala-s3-scale-3.vpc.cloudera.com:22000(339.69 MB) impala-s3-scale-14.vpc.cloudera.com:22000(386.29 MB) impala-s3-scale-2.vpc.cloudera.com:22000(351.30 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 5s300ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 24.01 KB, 48.01 KB, 140.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 148.02 KB (151568) - PerHostPeakMemUsage: 0 - PrepareTime: 150.002ms - RowsProduced: 1 (1) - TotalCpuTime: 533.009ms - TotalNetworkReceiveTime: 5s150ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 439.007ms, non-child: 439.007ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 246 (246) - NumInstructions: 2.43K (2430) - OptimizationTime: 231.003ms - PrepareTime: 149.002ms AGGREGATION_NODE (id=3):(Total: 5s300ms, non-child: 150.002ms, % non-child: 2.83%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 140.00 KB (143360) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=2):(Total: 5s150ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 30.00 B, 210.00 B, 900.00 B - BytesReceived: 960.00 B (960) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s895ms - PeakMemoryUsage: 0 - RowsReturned: 32 (32) - RowsReturnedRate: 6.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 4s589ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1.74 GB, max: 2.23 GB, avg: 2.01 GB, stddev: 127.44 MB completion times: min:4s190ms max:5s442ms mean: 4s921ms stddev:236.387ms execution rates: min:388.39 MB/sec max:458.30 MB/sec mean:418.39 MB/sec stddev:14.77 MB/sec num instances: 32 - AverageThreadTokens: 7.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 342.93 MB (359591091) - PerHostPeakMemUsage: 342.93 MB (359591475) - PrepareTime: 152.623ms - RowsProduced: 1 (1) - TotalCpuTime: 31s694ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 656.246us - TotalStorageWaitTime: 14s491ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.902ms, non-child: 481.902ms, % non-child: 100.00%) - CodegenTime: 312.497us - CompileTime: 67.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 263.997ms - PrepareTime: 149.998ms DataStreamSender (dst_id=2):(Total: 31.249us, non-child: 31.249us, % non-child: 100.00%) - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 937.00 B/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 31.249us - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s587ms, non-child: 190.717ms, % non-child: 4.16%) - BuildTime: 38.874ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.33 MB (1391409) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s396ms, non-child: 4s396ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 6.04 - AverageScannerThreadConcurrency: 7.14 - BytesRead: 429.94 MB (450825415) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 954.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 342.91 MB (359565155) - PerReadThreadRawHdfsThroughput: 15.98 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 56.25M (56249659) - RowsReturned: 1.07M (1070550) - RowsReturnedRate: 243.53 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.71K (2713) - ScannerThreadsTotalWallClockTime: 31s694ms - MaterializeTupleTime(*): 16s158ms - ScannerThreadsSysTime: 94.137ms - ScannerThreadsUserTime: 14s451ms - ScannerThreadsVoluntaryContextSwitches: 144 (144) - TotalRawHdfsReadTime(*): 27s127ms - TotalReadThroughput: 89.76 MB/sec Fragment F00: Instance 774459bfeec8097d:eb8117dc37ccd4ca (host=impala-s3-scale-30.vpc.cloudera.com:22000):(Total: 5s103ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 17.33 KB, 29.64 MB, 170.75 MB, 287.14 MB, 338.84 MB, 351.89 MB, 347.48 MB, 326.18 MB, 263.53 MB, 98.34 MB, 19.37 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 9, 4, 2 - AverageThreadTokens: 7.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 373.48 MB (391627024) - PerHostPeakMemUsage: 373.48 MB (391627024) - PrepareTime: 162.995ms - RowsProduced: 1 (1) - TotalCpuTime: 37s955ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.974us - TotalStorageWaitTime: 18s799ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 497.986ms, non-child: 497.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 268.992ms - PrepareTime: 158.995ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 5s099ms, non-child: 213.994ms, % non-child: 4.20%) ExecOption: Codegen Enabled - BuildTime: 48.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s885ms, non-child: 4s885ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:20% 1:10% 2:10% 3:0% 4:60% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 100.00 KB, 47.98 MB, 143.82 MB, 217.76 MB, 272.94 MB, 330.87 MB, 404.57 MB, 462.91 MB, 476.09 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 6.70 - AverageScannerThreadConcurrency: 7.50 - BytesRead: 476.09 MB (499215434) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s045ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 373.46 MB (391601088) - PerReadThreadRawHdfsThroughput: 13.94 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290609) - RowsReturned: 1.19M (1185896) - RowsReturnedRate: 242.72 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 2.73K (2727) - ScannerThreadsTotalWallClockTime: 37s955ms - MaterializeTupleTime(*): 18s012ms - ScannerThreadsSysTime: 106.979ms - ScannerThreadsUserTime: 16s540ms - ScannerThreadsVoluntaryContextSwitches: 124 (124) - TotalRawHdfsReadTime(*): 34s160ms - TotalReadThroughput: 86.56 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4d4 (host=impala-s3-scale-33.vpc.cloudera.com:22000):(Total: 5s062ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 0, 1.64 MB, 97.64 MB, 237.89 MB, 322.14 MB, 333.64 MB, 353.56 MB, 350.13 MB, 330.61 MB, 212.43 MB, 82.84 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 10, 7, 4 - AverageThreadTokens: 8.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 366.47 MB (384276808) - PerHostPeakMemUsage: 366.47 MB (384276808) - PrepareTime: 148.992ms - RowsProduced: 1 (1) - TotalCpuTime: 39s332ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16s992ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.976ms, non-child: 472.976ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 259.987ms - PrepareTime: 146.992ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 5s062ms, non-child: 186.990ms, % non-child: 3.69%) ExecOption: Codegen Enabled - BuildTime: 38.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401856) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s875ms, non-child: 4s875ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:20% 1:10% 2:0% 3:0% 4:70% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 3.90 MB, 96.64 MB, 182.72 MB, 237.90 MB, 306.87 MB, 385.98 MB, 431.15 MB, 473.50 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 7.00 - AverageScannerThreadConcurrency: 8.10 - BytesRead: 476.09 MB (499217242) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s189ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 366.45 MB (384250872) - PerReadThreadRawHdfsThroughput: 14.66 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290181) - RowsReturned: 1.19M (1185228) - RowsReturnedRate: 243.09 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 4.53K (4527) - ScannerThreadsTotalWallClockTime: 39s332ms - MaterializeTupleTime(*): 21s037ms - ScannerThreadsSysTime: 136.975ms - ScannerThreadsUserTime: 16s761ms - ScannerThreadsVoluntaryContextSwitches: 109 (109) - TotalRawHdfsReadTime(*): 32s476ms - TotalReadThroughput: 95.22 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4d0 (host=impala-s3-scale-14.vpc.cloudera.com:22000):(Total: 4s878ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 17.33 KB, 69.64 MB, 199.85 MB, 292.26 MB, 355.76 MB, 360.31 MB, 370.07 MB, 347.02 MB, 271.37 MB, 63.94 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 9, 4 - AverageThreadTokens: 8.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 386.29 MB (405053616) - PerHostPeakMemUsage: 386.29 MB (405053616) - PrepareTime: 150.997ms - RowsProduced: 1 (1) - TotalCpuTime: 38s366ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 18s920ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.990ms, non-child: 480.990ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 264.995ms - PrepareTime: 147.997ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s877ms, non-child: 208.996ms, % non-child: 4.28%) ExecOption: Codegen Enabled - BuildTime: 57.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.27 MB (1336112) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s668ms, non-child: 4s668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:0% 2:11.11% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 300.00 KB, 70.69 MB, 142.44 MB, 235.97 MB, 280.94 MB, 340.80 MB, 412.56 MB, 462.91 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 6.89 - AverageScannerThreadConcurrency: 8.22 - BytesRead: 476.09 MB (499212439) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s075ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 386.26 MB (405027680) - PerReadThreadRawHdfsThroughput: 14.42 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290635) - RowsReturned: 1.18M (1184146) - RowsReturnedRate: 253.62 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 3.50K (3497) - ScannerThreadsTotalWallClockTime: 38s366ms - MaterializeTupleTime(*): 18s280ms - ScannerThreadsSysTime: 45.989ms - ScannerThreadsUserTime: 15s830ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsReadTime(*): 33s018ms - TotalReadThroughput: 95.20 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4ce (host=impala-s3-scale-10.vpc.cloudera.com:22000):(Total: 4s872ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 0, 1.64 MB, 85.64 MB, 222.14 MB, 319.90 MB, 342.83 MB, 352.45 MB, 370.51 MB, 318.69 MB, 196.31 MB, 55.15 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 10, 7, 3 - AverageThreadTokens: 8.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 382.01 MB (400570584) - PerHostPeakMemUsage: 382.01 MB (400570584) - PrepareTime: 151.996ms - RowsProduced: 1 (1) - TotalCpuTime: 38s166ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 19s535ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 483.987ms, non-child: 483.987ms, % non-child: 100.00%) - CodegenTime: 999.973us - CompileTime: 67.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 265.993ms - PrepareTime: 149.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s871ms, non-child: 197.994ms, % non-child: 4.06%) ExecOption: Codegen Enabled - BuildTime: 41.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401640) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s673ms, non-child: 4s673ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:20% 1:10% 2:0% 3:10% 4:60% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 3.71 MB, 87.26 MB, 169.21 MB, 239.01 MB, 298.87 MB, 348.80 MB, 420.56 MB, 473.50 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 6.40 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 476.09 MB (499211643) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 921.975ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 381.99 MB (400544648) - PerReadThreadRawHdfsThroughput: 14.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290457) - RowsReturned: 1.18M (1184222) - RowsReturnedRate: 253.37 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 2.15K (2145) - ScannerThreadsTotalWallClockTime: 38s166ms - MaterializeTupleTime(*): 17s612ms - ScannerThreadsSysTime: 29.991ms - ScannerThreadsUserTime: 15s900ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsReadTime(*): 32s194ms - TotalReadThroughput: 95.22 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4d3 (host=impala-s3-scale-6.vpc.cloudera.com:22000):(Total: 4s798ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.17 GB MemoryUsage(500.000ms): 17.33 KB, 57.64 MB, 196.89 MB, 291.70 MB, 334.85 MB, 355.46 MB, 344.55 MB, 328.24 MB, 212.12 MB, 66.31 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 7, 4 - AverageThreadTokens: 8.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 380.27 MB (398737632) - PerHostPeakMemUsage: 380.27 MB (398737632) - PrepareTime: 151.997ms - RowsProduced: 1 (1) - TotalCpuTime: 37s378ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16s883ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.992ms, non-child: 477.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 261.995ms - PrepareTime: 149.997ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s797ms, non-child: 194.996ms, % non-child: 4.06%) ExecOption: Codegen Enabled - BuildTime: 45.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401640) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s602ms, non-child: 4s602ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.17 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 200.00 KB, 63.99 MB, 153.73 MB, 223.24 MB, 280.36 MB, 330.52 MB, 410.28 MB, 463.21 MB, 463.21 MB - AverageHdfsReadThreadConcurrency: 6.44 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 463.21 MB (485714600) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s146ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 380.24 MB (398711696) - PerReadThreadRawHdfsThroughput: 14.95 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 60.60M (60600332) - RowsReturned: 1.15M (1153105) - RowsReturnedRate: 250.51 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 3.29K (3289) - ScannerThreadsTotalWallClockTime: 37s378ms - MaterializeTupleTime(*): 19s229ms - ScannerThreadsSysTime: 109.979ms - ScannerThreadsUserTime: 16s062ms - ScannerThreadsVoluntaryContextSwitches: 135 (135) - TotalRawHdfsReadTime(*): 30s978ms - TotalReadThroughput: 92.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c7 (host=impala-s3-scale-23.vpc.cloudera.com:22000):(Total: 4s777ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 17.33 KB, 77.64 MB, 230.87 MB, 315.81 MB, 340.35 MB, 347.13 MB, 327.32 MB, 315.36 MB, 220.15 MB, 66.40 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 9, 9, 8, 4 - AverageThreadTokens: 8.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 355.81 MB (373096408) - PerHostPeakMemUsage: 355.81 MB (373096408) - PrepareTime: 148.996ms - RowsProduced: 1 (1) - TotalCpuTime: 36s698ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.973us - TotalStorageWaitTime: 17s107ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 476.987ms, non-child: 476.987ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 262.993ms - PrepareTime: 144.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s775ms, non-child: 196.994ms, % non-child: 4.12%) ExecOption: Codegen Enabled - BuildTime: 48.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401904) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s578ms, non-child: 4s578ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:11.11% 1:11.11% 2:0% 3:0% 4:77.78% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 400.00 KB, 99.94 MB, 171.97 MB, 235.97 MB, 293.46 MB, 359.39 MB, 423.15 MB, 465.50 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 6.56 - AverageScannerThreadConcurrency: 7.89 - BytesRead: 476.09 MB (499214570) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s074ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 355.79 MB (373070472) - PerReadThreadRawHdfsThroughput: 15.06 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290663) - RowsReturned: 1.19M (1185674) - RowsReturnedRate: 258.94 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 2.15K (2155) - ScannerThreadsTotalWallClockTime: 36s698ms - MaterializeTupleTime(*): 18s416ms - ScannerThreadsSysTime: 238.958ms - ScannerThreadsUserTime: 16s621ms - ScannerThreadsVoluntaryContextSwitches: 153 (153) - TotalRawHdfsReadTime(*): 31s607ms - TotalReadThroughput: 95.22 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4b5 (host=impala-s3-scale-32.vpc.cloudera.com:22000):(Total: 4s767ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 57.46 MB, 189.81 MB, 300.78 MB, 316.73 MB, 315.38 MB, 287.01 MB, 243.76 MB, 90.46 MB, 27.56 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 8, 8, 4, 2 - AverageThreadTokens: 6.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 336.96 MB (353329744) - PerHostPeakMemUsage: 336.96 MB (353329744) - PrepareTime: 154.003ms - RowsProduced: 1 (1) - TotalCpuTime: 29s973ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 14s547ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 485.010ms, non-child: 485.010ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 266.005ms - PrepareTime: 152.003ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s764ms, non-child: 168.003ms, % non-child: 3.53%) ExecOption: Codegen Enabled - BuildTime: 14.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.27 MB (1336120) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s596ms, non-child: 4s596ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:11.11% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 200.00 KB, 67.46 MB, 169.37 MB, 215.45 MB, 283.15 MB, 354.91 MB, 402.02 MB, 423.20 MB, 423.20 MB - AverageHdfsReadThreadConcurrency: 5.89 - AverageScannerThreadConcurrency: 6.44 - BytesRead: 423.20 MB (443752486) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 845.018ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 336.94 MB (353303808) - PerReadThreadRawHdfsThroughput: 15.06 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369491) - RowsReturned: 1.05M (1053412) - RowsReturnedRate: 229.20 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.18K (2183) - ScannerThreadsTotalWallClockTime: 29s973ms - MaterializeTupleTime(*): 14s490ms - ScannerThreadsSysTime: 106.981ms - ScannerThreadsUserTime: 13s751ms - ScannerThreadsVoluntaryContextSwitches: 94 (94) - TotalRawHdfsReadTime(*): 28s106ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c5 (host=impala-s3-scale-19.vpc.cloudera.com:22000):(Total: 4s745ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 113.46 MB, 231.15 MB, 321.53 MB, 320.80 MB, 320.23 MB, 299.48 MB, 224.24 MB, 70.90 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 7, 3 - AverageThreadTokens: 7.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 338.87 MB (355332240) - PerHostPeakMemUsage: 338.87 MB (355332240) - PrepareTime: 151.996ms - RowsProduced: 1 (1) - TotalCpuTime: 32s079ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.977us - TotalStorageWaitTime: 15s254ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.989ms, non-child: 477.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 260.994ms - PrepareTime: 148.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s744ms, non-child: 180.995ms, % non-child: 3.81%) ExecOption: Codegen Enabled - BuildTime: 26.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.27 MB (1336136) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s563ms, non-child: 4s563ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 13.84 MB, 100.12 MB, 192.55 MB, 242.76 MB, 305.21 MB, 380.84 MB, 412.60 MB, 423.18 MB - AverageHdfsReadThreadConcurrency: 7.33 - AverageScannerThreadConcurrency: 7.11 - BytesRead: 423.18 MB (443740418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 891.979ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 338.85 MB (355306304) - PerReadThreadRawHdfsThroughput: 14.53 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369376) - RowsReturned: 1.05M (1052928) - RowsReturnedRate: 230.71 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1791) - ScannerThreadsTotalWallClockTime: 32s079ms - MaterializeTupleTime(*): 15s844ms - ScannerThreadsSysTime: 63.986ms - ScannerThreadsUserTime: 14s680ms - ScannerThreadsVoluntaryContextSwitches: 108 (108) - TotalRawHdfsReadTime(*): 29s122ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4bc (host=impala-s3-scale-5.vpc.cloudera.com:22000):(Total: 4s743ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 125.46 MB, 216.77 MB, 313.40 MB, 333.43 MB, 344.12 MB, 330.48 MB, 251.37 MB, 43.40 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 7.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 360.11 MB (377599968) - PerHostPeakMemUsage: 360.11 MB (377599968) - PrepareTime: 153.996ms - RowsProduced: 1 (1) - TotalCpuTime: 31s798ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.978us - TotalStorageWaitTime: 13s450ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 491.989ms, non-child: 491.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 69.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 269.994ms - PrepareTime: 150.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s741ms, non-child: 197.995ms, % non-child: 4.18%) ExecOption: Codegen Enabled - BuildTime: 46.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s543ms, non-child: 4s543ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 12.28 MB, 83.48 MB, 183.17 MB, 246.35 MB, 323.15 MB, 388.84 MB, 420.60 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.33 - AverageScannerThreadConcurrency: 7.22 - BytesRead: 423.19 MB (443750268) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s113ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 360.08 MB (377574032) - PerReadThreadRawHdfsThroughput: 15.14 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369392) - RowsReturned: 1.05M (1053952) - RowsReturnedRate: 231.95 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.59K (3587) - ScannerThreadsTotalWallClockTime: 31s798ms - MaterializeTupleTime(*): 17s097ms - ScannerThreadsSysTime: 125.976ms - ScannerThreadsUserTime: 14s518ms - ScannerThreadsVoluntaryContextSwitches: 245 (245) - TotalRawHdfsReadTime(*): 27s947ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c3 (host=impala-s3-scale-1.vpc.cloudera.com:22000):(Total: 4s716ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 113.46 MB, 193.73 MB, 308.26 MB, 346.61 MB, 334.38 MB, 347.01 MB, 251.03 MB, 35.15 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 7.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 355.56 MB (372834168) - PerHostPeakMemUsage: 355.56 MB (372834168) - PrepareTime: 153.996ms - RowsProduced: 1 (1) - TotalCpuTime: 32s336ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 13s650ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 479.989ms, non-child: 479.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 260.994ms - PrepareTime: 150.996ms DataStreamSender (dst_id=2):(Total: 999.979us, non-child: 999.979us, % non-child: 100.00%) - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 29.30 KB/sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 999.979us - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s715ms, non-child: 205.995ms, % non-child: 4.37%) ExecOption: Codegen Enabled - BuildTime: 51.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401472) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s509ms, non-child: 4s509ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 11.90 MB, 65.91 MB, 181.80 MB, 273.66 MB, 322.49 MB, 394.25 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.22 - AverageScannerThreadConcurrency: 7.22 - BytesRead: 423.19 MB (443748941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s019ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 355.54 MB (372808232) - PerReadThreadRawHdfsThroughput: 15.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369269) - RowsReturned: 1.05M (1053554) - RowsReturnedRate: 233.61 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.29K (3293) - ScannerThreadsTotalWallClockTime: 32s336ms - MaterializeTupleTime(*): 17s561ms - ScannerThreadsSysTime: 65.987ms - ScannerThreadsUserTime: 14s576ms - ScannerThreadsVoluntaryContextSwitches: 105 (105) - TotalRawHdfsReadTime(*): 26s564ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4d2 (host=impala-s3-scale-3.vpc.cloudera.com:22000):(Total: 4s670ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.96 GB MemoryUsage(500.000ms): 17.33 KB, 77.46 MB, 182.77 MB, 299.03 MB, 312.99 MB, 324.00 MB, 306.51 MB, 244.12 MB, 82.42 MB, 19.56 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 4, 2 - AverageThreadTokens: 6.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 339.69 MB (356187832) - PerHostPeakMemUsage: 339.69 MB (356187832) - PrepareTime: 153.005ms - RowsProduced: 1 (1) - TotalCpuTime: 30s341ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 12s140ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 482.017ms, non-child: 482.017ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 265.009ms - PrepareTime: 150.005ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s668ms, non-child: 193.006ms, % non-child: 4.13%) ExecOption: Codegen Enabled - BuildTime: 42.001ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401664) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s475ms, non-child: 4s475ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.96 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:22.22% 2:0% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 300.00 KB, 50.47 MB, 173.80 MB, 237.26 MB, 305.78 MB, 368.87 MB, 416.63 MB, 419.22 MB, 419.22 MB - AverageHdfsReadThreadConcurrency: 5.44 - AverageScannerThreadConcurrency: 6.56 - BytesRead: 419.22 MB (439582527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s047ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 339.66 MB (356161896) - PerReadThreadRawHdfsThroughput: 17.89 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 54.85M (54847962) - RowsReturned: 1.04M (1043444) - RowsReturnedRate: 233.16 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.30K (3299) - ScannerThreadsTotalWallClockTime: 30s341ms - MaterializeTupleTime(*): 17s016ms - ScannerThreadsSysTime: 118.979ms - ScannerThreadsUserTime: 14s722ms - ScannerThreadsVoluntaryContextSwitches: 310 (310) - TotalRawHdfsReadTime(*): 23s426ms - TotalReadThroughput: 83.84 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c8 (host=impala-s3-scale-4.vpc.cloudera.com:22000):(Total: 4s644ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/2.23 GB MemoryUsage(500.000ms): 17.33 KB, 1.64 MB, 135.56 MB, 259.83 MB, 333.46 MB, 327.90 MB, 330.08 MB, 287.13 MB, 212.83 MB, 98.37 MB ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 9, 6, 4 - AverageThreadTokens: 8.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 342.21 MB (358828560) - PerHostPeakMemUsage: 342.21 MB (358828560) - PrepareTime: 150.001ms - RowsProduced: 1 (1) - TotalCpuTime: 34s972ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 16s658ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 479.005ms, non-child: 479.005ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 264.003ms - PrepareTime: 148.001ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s642ms, non-child: 215.002ms, % non-child: 4.63%) ExecOption: Codegen Enabled - BuildTime: 66.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s427ms, non-child: 4s427ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/2.23 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:0% 2:11.11% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0, 39.22 MB, 126.15 MB, 209.20 MB, 250.04 MB, 337.97 MB, 399.15 MB, 462.91 MB, 476.09 MB - AverageHdfsReadThreadConcurrency: 6.56 - AverageScannerThreadConcurrency: 7.78 - BytesRead: 476.09 MB (499214133) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s035ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 342.18 MB (358802624) - PerReadThreadRawHdfsThroughput: 14.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.29M (62290610) - RowsReturned: 1.19M (1185473) - RowsReturnedRate: 267.78 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 2.96K (2957) - ScannerThreadsTotalWallClockTime: 34s972ms - MaterializeTupleTime(*): 17s206ms - ScannerThreadsSysTime: 61.985ms - ScannerThreadsUserTime: 15s418ms - ScannerThreadsVoluntaryContextSwitches: 165 (165) - TotalRawHdfsReadTime(*): 31s888ms - TotalReadThroughput: 95.22 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c0 (host=impala-s3-scale-29.vpc.cloudera.com:22000):(Total: 4s632ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 0, 1.46 MB, 105.46 MB, 231.40 MB, 291.70 MB, 305.56 MB, 314.12 MB, 314.35 MB, 224.28 MB, 78.71 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 8, 3 - AverageThreadTokens: 7.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 331.78 MB (347900216) - PerHostPeakMemUsage: 331.78 MB (347900216) - PrepareTime: 155.001ms - RowsProduced: 1 (1) - TotalCpuTime: 30s882ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 13s234ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 486.003ms, non-child: 486.003ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 266.002ms - PrepareTime: 152.001ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s631ms, non-child: 191.001ms, % non-child: 4.12%) ExecOption: Codegen Enabled - BuildTime: 38.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s440ms, non-child: 4s440ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 700.00 KB, 95.16 MB, 170.76 MB, 246.63 MB, 309.08 MB, 372.84 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.00 - AverageScannerThreadConcurrency: 7.22 - BytesRead: 423.19 MB (443745822) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 952.007ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 331.76 MB (347874280) - PerReadThreadRawHdfsThroughput: 16.54 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369348) - RowsReturned: 1.05M (1052775) - RowsReturnedRate: 237.11 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.28K (3282) - ScannerThreadsTotalWallClockTime: 30s882ms - MaterializeTupleTime(*): 16s609ms - ScannerThreadsSysTime: 124.977ms - ScannerThreadsUserTime: 14s916ms - ScannerThreadsVoluntaryContextSwitches: 87 (87) - TotalRawHdfsReadTime(*): 25s582ms - TotalReadThroughput: 94.04 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4b8 (host=impala-s3-scale-9.vpc.cloudera.com:22000):(Total: 4s631ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 125.75 MB, 225.46 MB, 293.89 MB, 319.94 MB, 305.15 MB, 279.11 MB, 197.37 MB, 35.15 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 7, 2 - AverageThreadTokens: 7.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 336.44 MB (352781640) - PerHostPeakMemUsage: 336.44 MB (352781640) - PrepareTime: 149.996ms - RowsProduced: 1 (1) - TotalCpuTime: 30s262ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.977us - TotalStorageWaitTime: 14s392ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 474.988ms, non-child: 474.988ms, % non-child: 100.00%) - CodegenTime: 1.999ms - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 259.993ms - PrepareTime: 147.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s630ms, non-child: 178.995ms, % non-child: 3.87%) ExecOption: Codegen Enabled - BuildTime: 29.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401624) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s451ms, non-child: 4s451ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 16.97 MB, 88.26 MB, 191.73 MB, 272.56 MB, 320.56 MB, 380.84 MB, 420.60 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.56 - AverageScannerThreadConcurrency: 6.89 - BytesRead: 423.19 MB (443745125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 848.980ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 336.41 MB (352755704) - PerReadThreadRawHdfsThroughput: 15.98 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369523) - RowsReturned: 1.05M (1053611) - RowsReturnedRate: 236.66 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2014) - ScannerThreadsTotalWallClockTime: 30s262ms - MaterializeTupleTime(*): 14s947ms - ScannerThreadsSysTime: 30.990ms - ScannerThreadsUserTime: 14s344ms - ScannerThreadsVoluntaryContextSwitches: 95 (95) - TotalRawHdfsReadTime(*): 26s475ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c4 (host=impala-s3-scale-22.vpc.cloudera.com:22000):(Total: 4s616ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 0, 1.46 MB, 97.75 MB, 238.31 MB, 312.86 MB, 326.78 MB, 342.38 MB, 319.08 MB, 237.20 MB, 97.99 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 7, 4 - AverageThreadTokens: 7.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 351.34 MB (368402832) - PerHostPeakMemUsage: 351.34 MB (368402832) - PrepareTime: 149.999ms - RowsProduced: 1 (1) - TotalCpuTime: 31s199ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.998us - TotalStorageWaitTime: 14s684ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 475.998ms, non-child: 475.998ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 260.999ms - PrepareTime: 147.999ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s613ms, non-child: 176.999ms, % non-child: 3.84%) ExecOption: Codegen Enabled - BuildTime: 30.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401688) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s436ms, non-child: 4s436ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 13.36 MB, 103.16 MB, 183.45 MB, 246.63 MB, 309.08 MB, 380.84 MB, 423.20 MB, 423.20 MB - AverageHdfsReadThreadConcurrency: 5.22 - AverageScannerThreadConcurrency: 7.22 - BytesRead: 423.20 MB (443753485) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 949.997ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 351.31 MB (368376896) - PerReadThreadRawHdfsThroughput: 16.30 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369312) - RowsReturned: 1.05M (1053819) - RowsReturnedRate: 237.51 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1604) - ScannerThreadsTotalWallClockTime: 31s199ms - MaterializeTupleTime(*): 15s492ms - ScannerThreadsSysTime: 41.989ms - ScannerThreadsUserTime: 14s392ms - ScannerThreadsVoluntaryContextSwitches: 526 (526) - TotalRawHdfsReadTime(*): 25s964ms - TotalReadThroughput: 94.04 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4cb (host=impala-s3-scale-25.vpc.cloudera.com:22000):(Total: 4s614ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 29.46 MB, 187.34 MB, 287.43 MB, 310.98 MB, 311.42 MB, 284.99 MB, 235.74 MB, 63.12 MB, 27.31 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 3, 2 - AverageThreadTokens: 6.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 323.51 MB (339222176) - PerHostPeakMemUsage: 323.51 MB (339222176) - PrepareTime: 148.999ms - RowsProduced: 1 (1) - TotalCpuTime: 29s367ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.999ms - TotalStorageWaitTime: 13s829ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 471.998ms, non-child: 471.998ms, % non-child: 100.00%) - CodegenTime: 999.997us - CompileTime: 65.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 258.999ms - PrepareTime: 145.999ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s611ms, non-child: 178.999ms, % non-child: 3.88%) ExecOption: Codegen Enabled - BuildTime: 28.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401544) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s432ms, non-child: 4s432ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:11.11% 2:0% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 100.00 KB, 65.53 MB, 155.59 MB, 221.52 MB, 264.56 MB, 343.67 MB, 404.60 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.00 - AverageScannerThreadConcurrency: 6.44 - BytesRead: 423.19 MB (443741673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 875.996ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 323.48 MB (339196240) - PerReadThreadRawHdfsThroughput: 15.54 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369314) - RowsReturned: 1.05M (1052827) - RowsReturnedRate: 237.50 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.84K (3841) - ScannerThreadsTotalWallClockTime: 29s367ms - MaterializeTupleTime(*): 14s552ms - ScannerThreadsSysTime: 48.988ms - ScannerThreadsUserTime: 13s791ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsReadTime(*): 27s226ms - TotalReadThroughput: 84.57 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4bf (host=impala-s3-scale-8.vpc.cloudera.com:22000):(Total: 4s587ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 0, 1.46 MB, 105.46 MB, 239.71 MB, 307.96 MB, 321.33 MB, 315.00 MB, 295.22 MB, 208.72 MB, 70.58 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 7, 3 - AverageThreadTokens: 7.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 326.44 MB (342296072) - PerHostPeakMemUsage: 326.44 MB (342296072) - PrepareTime: 150.998ms - RowsProduced: 1 (1) - TotalCpuTime: 30s597ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.987us - TotalStorageWaitTime: 13s322ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.994ms, non-child: 477.994ms, % non-child: 100.00%) - CodegenTime: 1.999ms - CompileTime: 66.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 261.996ms - PrepareTime: 147.998ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s586ms, non-child: 189.997ms, % non-child: 4.14%) ExecOption: Codegen Enabled - BuildTime: 37.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401696) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s396ms, non-child: 4s396ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 7.12 MB, 100.41 MB, 193.66 MB, 246.63 MB, 313.22 MB, 383.66 MB, 412.60 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.56 - AverageScannerThreadConcurrency: 7.11 - BytesRead: 423.19 MB (443746792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 921.989ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 326.41 MB (342270136) - PerReadThreadRawHdfsThroughput: 16.38 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369410) - RowsReturned: 1.05M (1052997) - RowsReturnedRate: 239.48 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.01K (3010) - ScannerThreadsTotalWallClockTime: 30s597ms - MaterializeTupleTime(*): 16s242ms - ScannerThreadsSysTime: 25.992ms - ScannerThreadsUserTime: 14s576ms - ScannerThreadsVoluntaryContextSwitches: 123 (123) - TotalRawHdfsReadTime(*): 25s828ms - TotalReadThroughput: 94.04 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4cf (host=impala-s3-scale-15.vpc.cloudera.com:22000):(Total: 4s565ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 77.46 MB, 217.58 MB, 309.92 MB, 320.04 MB, 322.32 MB, 319.28 MB, 259.64 MB, 184.62 MB, 19.68 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 8, 7, 6, 2 - AverageThreadTokens: 6.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 341.51 MB (358103656) - PerHostPeakMemUsage: 341.51 MB (358103656) - PrepareTime: 147.996ms - RowsProduced: 1 (1) - TotalCpuTime: 30s562ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 14s909ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 470.989ms, non-child: 470.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 257.994ms - PrepareTime: 144.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s564ms, non-child: 160.996ms, % non-child: 3.53%) ExecOption: Codegen Enabled - BuildTime: 13.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401568) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s403ms, non-child: 4s403ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:11.11% 2:0% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 300.00 KB, 86.88 MB, 174.89 MB, 210.48 MB, 287.94 MB, 370.25 MB, 420.60 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.67 - AverageScannerThreadConcurrency: 6.56 - BytesRead: 423.19 MB (443742242) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 839.981ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 341.49 MB (358077720) - PerReadThreadRawHdfsThroughput: 16.21 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369365) - RowsReturned: 1.05M (1053305) - RowsReturnedRate: 239.18 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 1.13K (1131) - ScannerThreadsTotalWallClockTime: 30s562ms - MaterializeTupleTime(*): 14s735ms - ScannerThreadsSysTime: 33.991ms - ScannerThreadsUserTime: 14s253ms - ScannerThreadsVoluntaryContextSwitches: 94 (94) - TotalRawHdfsReadTime(*): 26s107ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4bd (host=impala-s3-scale-27.vpc.cloudera.com:22000):(Total: 4s518ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 29.46 MB, 162.27 MB, 272.13 MB, 309.60 MB, 297.23 MB, 291.33 MB, 193.02 MB, 90.03 MB, 19.49 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 6, 4, 2 - AverageThreadTokens: 6.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 318.23 MB (333689784) - PerHostPeakMemUsage: 318.23 MB (333689784) - PrepareTime: 156.995ms - RowsProduced: 1 (1) - TotalCpuTime: 28s854ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 12s937ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.986ms, non-child: 494.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 73.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 265.993ms - PrepareTime: 154.995ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s517ms, non-child: 200.994ms, % non-child: 4.45%) ExecOption: Codegen Enabled - BuildTime: 38.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401688) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s316ms, non-child: 4s316ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:11.11% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 100.00 KB, 41.53 MB, 148.13 MB, 214.35 MB, 285.08 MB, 356.84 MB, 394.01 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.22 - AverageScannerThreadConcurrency: 6.33 - BytesRead: 423.19 MB (443742480) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 884.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 318.21 MB (333663848) - PerReadThreadRawHdfsThroughput: 17.59 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369425) - RowsReturned: 1.06M (1055784) - RowsReturnedRate: 244.57 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.94K (2942) - ScannerThreadsTotalWallClockTime: 28s854ms - MaterializeTupleTime(*): 14s951ms - ScannerThreadsSysTime: 119.978ms - ScannerThreadsUserTime: 13s692ms - ScannerThreadsVoluntaryContextSwitches: 74 (74) - TotalRawHdfsReadTime(*): 24s059ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4cd (host=impala-s3-scale-18.vpc.cloudera.com:22000):(Total: 4s503ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:9/1.99 GB MemoryUsage(500.000ms): 17.33 KB, 1.64 MB, 115.77 MB, 228.38 MB, 295.22 MB, 327.30 MB, 338.12 MB, 311.17 MB, 243.65 MB, 27.37 MB ThreadUsage(500.000ms): 1, 10, 10, 9, 9, 9, 9, 9, 9, 2 - AverageThreadTokens: 7.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 359.56 MB (377026864) - PerHostPeakMemUsage: 359.56 MB (377026864) - PrepareTime: 148.998ms - RowsProduced: 1 (1) - TotalCpuTime: 32s645ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.999ms - TotalStorageWaitTime: 15s072ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 476.994ms, non-child: 476.994ms, % non-child: 100.00%) - CodegenTime: 1.999ms - CompileTime: 67.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 261.997ms - PrepareTime: 145.998ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s500ms, non-child: 191.997ms, % non-child: 4.27%) ExecOption: Codegen Enabled - BuildTime: 42.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401608) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s308ms, non-child: 4s308ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 9 Hdfs split stats (:<# splits>/): -1:9/1.99 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0, 9.16 MB, 90.17 MB, 170.46 MB, 253.21 MB, 316.11 MB, 395.88 MB, 424.82 MB, 424.82 MB - AverageHdfsReadThreadConcurrency: 6.11 - AverageScannerThreadConcurrency: 7.44 - BytesRead: 424.82 MB (445451288) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s064ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 359.54 MB (377000928) - PerReadThreadRawHdfsThroughput: 15.74 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.56M (55558243) - RowsReturned: 1.06M (1056576) - RowsReturnedRate: 245.20 K/sec - ScanRangesComplete: 9 (9) - ScannerThreadsInvoluntaryContextSwitches: 3.77K (3772) - ScannerThreadsTotalWallClockTime: 32s645ms - MaterializeTupleTime(*): 16s437ms - ScannerThreadsSysTime: 57.988ms - ScannerThreadsUserTime: 14s089ms - ScannerThreadsVoluntaryContextSwitches: 98 (98) - TotalRawHdfsReadTime(*): 26s987ms - TotalReadThroughput: 84.96 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c2 (host=impala-s3-scale-16.vpc.cloudera.com:22000):(Total: 4s489ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 0, 1.46 MB, 93.46 MB, 218.40 MB, 325.16 MB, 316.56 MB, 305.78 MB, 274.85 MB, 212.34 MB, 62.93 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 7, 3 - AverageThreadTokens: 7.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 334.53 MB (350776864) - PerHostPeakMemUsage: 334.53 MB (350776864) - PrepareTime: 150.000ms - RowsProduced: 1 (1) - TotalCpuTime: 29s519ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 13s137ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.002ms, non-child: 480.002ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 266.001ms - PrepareTime: 147.000ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s486ms, non-child: 208.001ms, % non-child: 4.64%) ExecOption: Codegen Enabled - BuildTime: 62.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401624) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s278ms, non-child: 4s278ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 3.71 MB, 87.06 MB, 208.55 MB, 255.00 MB, 309.73 MB, 380.84 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.33 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 423.19 MB (443745652) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 932.004ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 334.50 MB (350750928) - PerReadThreadRawHdfsThroughput: 16.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369491) - RowsReturned: 1.06M (1056128) - RowsReturnedRate: 246.87 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.11K (2111) - ScannerThreadsTotalWallClockTime: 29s519ms - MaterializeTupleTime(*): 15s367ms - ScannerThreadsSysTime: 46.990ms - ScannerThreadsUserTime: 13s984ms - ScannerThreadsVoluntaryContextSwitches: 293 (293) - TotalRawHdfsReadTime(*): 24s933ms - TotalReadThroughput: 93.98 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4b7 (host=impala-s3-scale-24.vpc.cloudera.com:22000):(Total: 4s483ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.92 GB MemoryUsage(500.000ms): 0, 1.46 MB, 85.46 MB, 196.09 MB, 289.94 MB, 305.18 MB, 328.94 MB, 295.20 MB, 212.40 MB, 35.52 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 7, 2 - AverageThreadTokens: 7.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 331.19 MB (347275888) - PerHostPeakMemUsage: 331.19 MB (347275888) - PrepareTime: 147.995ms - RowsProduced: 1 (1) - TotalCpuTime: 30s254ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.971us - TotalStorageWaitTime: 13s835ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 472.986ms, non-child: 472.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 260.992ms - PrepareTime: 145.995ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s479ms, non-child: 178.994ms, % non-child: 4.00%) ExecOption: Codegen Enabled - BuildTime: 34.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401904) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s300ms, non-child: 4s300ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.92 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:11.11% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 400.00 KB, 67.65 MB, 152.75 MB, 220.90 MB, 301.73 MB, 369.64 MB, 409.40 MB, 409.40 MB - AverageHdfsReadThreadConcurrency: 5.56 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 409.40 MB (429286712) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 849.975ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 331.16 MB (347249952) - PerReadThreadRawHdfsThroughput: 15.90 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 53.56M (53558590) - RowsReturned: 1.02M (1020809) - RowsReturnedRate: 237.35 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.01K (3012) - ScannerThreadsTotalWallClockTime: 30s254ms - MaterializeTupleTime(*): 15s499ms - ScannerThreadsSysTime: 171.971ms - ScannerThreadsUserTime: 13s926ms - ScannerThreadsVoluntaryContextSwitches: 95 (95) - TotalRawHdfsReadTime(*): 25s756ms - TotalReadThroughput: 90.98 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4d1 (host=impala-s3-scale-2.vpc.cloudera.com:22000):(Total: 4s479ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 150.34 MB, 261.89 MB, 317.54 MB, 329.81 MB, 335.48 MB, 307.52 MB, 231.62 MB, 19.62 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 8, 2 - AverageThreadTokens: 7.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 351.28 MB (368347408) - PerHostPeakMemUsage: 351.30 MB (368359696) - PrepareTime: 163.002ms - RowsProduced: 1 (1) - TotalCpuTime: 31s822ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 14s005ms CodeGen:(Total: 500.008ms, non-child: 500.008ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 273.004ms - PrepareTime: 161.002ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s478ms, non-child: 205.003ms, % non-child: 4.58%) ExecOption: Codegen Enabled - BuildTime: 45.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401648) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s273ms, non-child: 4s273ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:11.11% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 36.28 MB, 137.37 MB, 199.45 MB, 274.49 MB, 346.25 MB, 407.43 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.67 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 423.19 MB (443748467) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s018ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 351.26 MB (368321472) - PerReadThreadRawHdfsThroughput: 16.84 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369374) - RowsReturned: 1.05M (1053735) - RowsReturnedRate: 246.60 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.11K (2106) - ScannerThreadsTotalWallClockTime: 31s822ms - MaterializeTupleTime(*): 16s717ms - ScannerThreadsSysTime: 45.989ms - ScannerThreadsUserTime: 14s781ms - ScannerThreadsVoluntaryContextSwitches: 288 (288) - TotalRawHdfsReadTime(*): 25s125ms - TotalReadThroughput: 84.64 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c1 (host=impala-s3-scale-13.vpc.cloudera.com:22000):(Total: 4s469ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.95 GB MemoryUsage(500.000ms): 0, 1.46 MB, 121.46 MB, 248.06 MB, 289.70 MB, 303.92 MB, 313.86 MB, 274.12 MB, 153.18 MB, 55.09 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 5, 3 - AverageThreadTokens: 7.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 325.82 MB (341642544) - PerHostPeakMemUsage: 325.82 MB (341642544) - PrepareTime: 155.998ms - RowsProduced: 1 (1) - TotalCpuTime: 30s364ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ns - TotalStorageWaitTime: 13s264ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 489.995ms, non-child: 489.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 267.997ms - PrepareTime: 153.998ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s469ms, non-child: 189.998ms, % non-child: 4.25%) ExecOption: Codegen Enabled - BuildTime: 35.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401640) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s279ms, non-child: 4s279ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.95 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:11.11% 2:0% 3:11.11% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 8.43 MB, 110.26 MB, 183.68 MB, 264.51 MB, 315.10 MB, 377.69 MB, 414.86 MB, 417.45 MB - AverageHdfsReadThreadConcurrency: 5.22 - AverageScannerThreadConcurrency: 6.89 - BytesRead: 417.45 MB (437731278) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s007ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 325.79 MB (341616608) - PerReadThreadRawHdfsThroughput: 16.48 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 54.62M (54615955) - RowsReturned: 1.04M (1040513) - RowsReturnedRate: 243.11 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.24K (2236) - ScannerThreadsTotalWallClockTime: 30s364ms - MaterializeTupleTime(*): 15s995ms - ScannerThreadsSysTime: 91.984ms - ScannerThreadsUserTime: 13s938ms - ScannerThreadsVoluntaryContextSwitches: 88 (88) - TotalRawHdfsReadTime(*): 25s327ms - TotalReadThroughput: 92.66 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4ba (host=impala-s3-scale-17.vpc.cloudera.com:22000):(Total: 4s444ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 162.27 MB, 251.52 MB, 308.23 MB, 311.34 MB, 305.69 MB, 242.90 MB, 133.40 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 5 - AverageThreadTokens: 7.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 320.37 MB (335930056) - PerHostPeakMemUsage: 320.37 MB (335930056) - PrepareTime: 149.999ms - RowsProduced: 1 (1) - TotalCpuTime: 29s833ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 14s076ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.997ms, non-child: 477.997ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 262.998ms - PrepareTime: 147.999ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s442ms, non-child: 182.998ms, % non-child: 4.12%) ExecOption: Codegen Enabled - BuildTime: 30.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401560) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s259ms, non-child: 4s259ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:25% 1:0% 2:0% 3:12.5% 4:62.5% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 41.53 MB, 133.14 MB, 206.35 MB, 262.63 MB, 351.66 MB, 383.43 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.75 - AverageScannerThreadConcurrency: 7.38 - BytesRead: 423.19 MB (443745559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 850.995ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 320.34 MB (335904120) - PerReadThreadRawHdfsThroughput: 15.71 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369577) - RowsReturned: 1.06M (1055197) - RowsReturnedRate: 247.70 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.06K (2063) - ScannerThreadsTotalWallClockTime: 29s833ms - MaterializeTupleTime(*): 14s822ms - ScannerThreadsSysTime: 229.961ms - ScannerThreadsUserTime: 13s665ms - ScannerThreadsVoluntaryContextSwitches: 115 (115) - TotalRawHdfsReadTime(*): 26s933ms - TotalReadThroughput: 94.04 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4b9 (host=impala-s3-scale-7.vpc.cloudera.com:22000):(Total: 4s421ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 0, 1.46 MB, 125.46 MB, 225.46 MB, 321.95 MB, 317.06 MB, 315.11 MB, 279.98 MB, 152.81 MB, 27.62 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 6, 2 - AverageThreadTokens: 7.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 333.59 MB (349789392) - PerHostPeakMemUsage: 333.59 MB (349789392) - PrepareTime: 157.003ms - RowsProduced: 1 (1) - TotalCpuTime: 29s293ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 13s338ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 487.009ms, non-child: 487.009ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 68.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 264.005ms - PrepareTime: 154.003ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s421ms, non-child: 185.003ms, % non-child: 4.18%) ExecOption: Codegen Enabled - BuildTime: 30.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401648) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s236ms, non-child: 4s236ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:22.22% 4:44.44% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 12.28 MB, 93.13 MB, 199.17 MB, 246.35 MB, 325.08 MB, 399.43 MB, 423.19 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.89 - AverageScannerThreadConcurrency: 6.78 - BytesRead: 423.19 MB (443749399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 939.018ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 333.56 MB (349763456) - PerReadThreadRawHdfsThroughput: 16.07 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369483) - RowsReturned: 1.06M (1056091) - RowsReturnedRate: 249.31 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 4.38K (4385) - ScannerThreadsTotalWallClockTime: 29s293ms - MaterializeTupleTime(*): 14s948ms - ScannerThreadsSysTime: 172.969ms - ScannerThreadsUserTime: 13s710ms - ScannerThreadsVoluntaryContextSwitches: 92 (92) - TotalRawHdfsReadTime(*): 26s337ms - TotalReadThroughput: 94.04 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c6 (host=impala-s3-scale-26.vpc.cloudera.com:22000):(Total: 4s413ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 77.46 MB, 196.90 MB, 296.13 MB, 324.23 MB, 313.06 MB, 283.48 MB, 193.37 MB, 70.87 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 6, 3 - AverageThreadTokens: 7.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 331.73 MB (347842328) - PerHostPeakMemUsage: 331.73 MB (347842328) - PrepareTime: 157.002ms - RowsProduced: 1 (1) - TotalCpuTime: 28s291ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 12s241ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.008ms, non-child: 492.008ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 69.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 268.004ms - PrepareTime: 155.002ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s411ms, non-child: 188.003ms, % non-child: 4.26%) ExecOption: Codegen Enabled - BuildTime: 31.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401536) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s223ms, non-child: 4s223ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:25% 1:0% 2:12.5% 3:0% 4:62.5% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 300.00 KB, 67.01 MB, 162.20 MB, 228.69 MB, 280.56 MB, 354.26 MB, 402.02 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 5.75 - AverageScannerThreadConcurrency: 6.88 - BytesRead: 423.19 MB (443750938) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 849.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 331.70 MB (347816392) - PerReadThreadRawHdfsThroughput: 16.70 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369325) - RowsReturned: 1.05M (1053083) - RowsReturnedRate: 249.36 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.47K (2473) - ScannerThreadsTotalWallClockTime: 28s291ms - MaterializeTupleTime(*): 15s119ms - ScannerThreadsSysTime: 62.987ms - ScannerThreadsUserTime: 13s727ms - ScannerThreadsVoluntaryContextSwitches: 95 (95) - TotalRawHdfsReadTime(*): 25s343ms - TotalReadThroughput: 93.98 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4b6 (host=impala-s3-scale-28.vpc.cloudera.com:22000):(Total: 4s397ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.95 GB MemoryUsage(500.000ms): 17.33 KB, 1.46 MB, 121.46 MB, 247.21 MB, 302.44 MB, 321.56 MB, 325.52 MB, 282.74 MB, 121.21 MB, 19.31 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 7.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 330.22 MB (346264016) - PerHostPeakMemUsage: 330.22 MB (346264016) - PrepareTime: 150.001ms - RowsProduced: 1 (1) - TotalCpuTime: 29s881ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 13s063ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 477.006ms, non-child: 477.006ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 262.003ms - PrepareTime: 146.001ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s395ms, non-child: 190.002ms, % non-child: 4.32%) ExecOption: Codegen Enabled - BuildTime: 42.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401568) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s205ms, non-child: 4s205ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.95 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:11.11% 2:0% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 4.10 MB, 107.52 MB, 201.46 MB, 264.64 MB, 323.22 MB, 399.23 MB, 417.82 MB, 417.82 MB - AverageHdfsReadThreadConcurrency: 6.00 - AverageScannerThreadConcurrency: 6.78 - BytesRead: 417.82 MB (438118151) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 889.011ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 330.20 MB (346238080) - PerReadThreadRawHdfsThroughput: 16.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 54.66M (54664886) - RowsReturned: 1.04M (1040281) - RowsReturnedRate: 247.39 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.86K (2858) - ScannerThreadsTotalWallClockTime: 29s881ms - MaterializeTupleTime(*): 15s859ms - ScannerThreadsSysTime: 132.976ms - ScannerThreadsUserTime: 13s914ms - ScannerThreadsVoluntaryContextSwitches: 99 (99) - TotalRawHdfsReadTime(*): 25s823ms - TotalReadThroughput: 83.56 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4cc (host=impala-s3-scale-12.vpc.cloudera.com:22000):(Total: 4s362ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.98 GB MemoryUsage(500.000ms): 17.33 KB, 85.46 MB, 219.65 MB, 300.25 MB, 308.58 MB, 334.99 MB, 310.48 MB, 255.83 MB, 94.12 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 5 - AverageThreadTokens: 7.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 342.86 MB (359518920) - PerHostPeakMemUsage: 342.86 MB (359518920) - PrepareTime: 153.993ms - RowsProduced: 1 (1) - TotalCpuTime: 30s173ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 999.959us - TotalStorageWaitTime: 12s970ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 481.980ms, non-child: 481.980ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 263.989ms - PrepareTime: 150.993ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s360ms, non-child: 186.992ms, % non-child: 4.29%) ExecOption: Codegen Enabled - BuildTime: 32.998ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.27 MB (1336104) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s173ms, non-child: 4s173ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.98 GB Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:12.5% 2:12.5% 3:0% 4:62.5% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 400.00 KB, 88.26 MB, 166.62 MB, 222.35 MB, 309.08 MB, 354.26 MB, 402.02 MB, 423.19 MB - AverageHdfsReadThreadConcurrency: 6.75 - AverageScannerThreadConcurrency: 7.38 - BytesRead: 423.19 MB (443751525) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 971.960ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 342.84 MB (359492984) - PerReadThreadRawHdfsThroughput: 15.53 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 55.37M (55369513) - RowsReturned: 1.05M (1054630) - RowsReturnedRate: 252.68 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 3.07K (3071) - ScannerThreadsTotalWallClockTime: 30s173ms - MaterializeTupleTime(*): 16s156ms - ScannerThreadsSysTime: 81.984ms - ScannerThreadsUserTime: 13s738ms - ScannerThreadsVoluntaryContextSwitches: 116 (116) - TotalRawHdfsReadTime(*): 27s241ms - TotalReadThroughput: 93.96 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4c9 (host=impala-s3-scale-21.vpc.cloudera.com:22000):(Total: 4s331ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.93 GB MemoryUsage(500.000ms): 0, 1.46 MB, 97.46 MB, 207.46 MB, 290.28 MB, 314.03 MB, 308.85 MB, 273.45 MB, 195.99 MB, 27.37 MB ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 9, 8, 7, 2 - AverageThreadTokens: 7.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 329.81 MB (345826176) - PerHostPeakMemUsage: 329.81 MB (345826176) - PrepareTime: 150.995ms - RowsProduced: 1 (1) - TotalCpuTime: 29s587ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 13s832ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 479.987ms, non-child: 479.987ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 263.993ms - PrepareTime: 147.996ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s330ms, non-child: 180.995ms, % non-child: 4.18%) ExecOption: Codegen Enabled - BuildTime: 32.999ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401664) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s149ms, non-child: 4s149ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.93 GB Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:0% 2:0% 3:0% 4:66.67% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 5.46 MB, 75.47 MB, 161.94 MB, 244.70 MB, 313.21 MB, 367.07 MB, 412.00 MB, 412.00 MB - AverageHdfsReadThreadConcurrency: 5.56 - AverageScannerThreadConcurrency: 6.89 - BytesRead: 412.00 MB (432017902) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 954.974ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 329.78 MB (345800240) - PerReadThreadRawHdfsThroughput: 16.44 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 53.90M (53900627) - RowsReturned: 1.03M (1025091) - RowsReturnedRate: 247.02 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1485) - ScannerThreadsTotalWallClockTime: 29s587ms - MaterializeTupleTime(*): 14s717ms - ScannerThreadsSysTime: 86.983ms - ScannerThreadsUserTime: 13s202ms - ScannerThreadsVoluntaryContextSwitches: 121 (121) - TotalRawHdfsReadTime(*): 25s055ms - TotalReadThroughput: 91.56 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4bb (host=impala-s3-scale-31.vpc.cloudera.com:22000):(Total: 4s256ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.74 GB MemoryUsage(500.000ms): 0, 1.46 MB, 72.34 MB, 190.34 MB, 274.70 MB, 307.49 MB, 307.39 MB, 271.68 MB, 137.54 MB, 19.68 MB ThreadUsage(500.000ms): 1, 9, 9, 8, 8, 8, 8, 8, 6, 2 - AverageThreadTokens: 6.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 320.18 MB (335736360) - PerHostPeakMemUsage: 320.18 MB (335736360) - PrepareTime: 153.000ms - RowsProduced: 1 (1) - TotalCpuTime: 26s540ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 12s470ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 480.000ms, non-child: 480.000ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 262.000ms - PrepareTime: 151.000ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 4s256ms, non-child: 179.000ms, % non-child: 4.21%) ExecOption: Codegen Enabled - BuildTime: 30.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.34 MB (1401928) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s077ms, non-child: 4s077ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.74 GB Hdfs Read Thread Concurrency Bucket: 0:44.44% 1:0% 2:0% 3:0% 4:55.56% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 786.32 KB, 62.49 MB, 164.03 MB, 255.89 MB, 316.41 MB, 371.94 MB, 371.94 MB, 371.94 MB - AverageHdfsReadThreadConcurrency: 4.44 - AverageScannerThreadConcurrency: 6.33 - BytesRead: 371.94 MB (390002891) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 705.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 320.16 MB (335710424) - PerReadThreadRawHdfsThroughput: 17.76 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 48.64M (48639986) - RowsReturned: 925.05K (925053) - RowsReturnedRate: 226.90 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 2.20K (2202) - ScannerThreadsTotalWallClockTime: 26s540ms - MaterializeTupleTime(*): 13s276ms - ScannerThreadsSysTime: 128.975ms - ScannerThreadsUserTime: 12s559ms - ScannerThreadsVoluntaryContextSwitches: 90 (90) - TotalRawHdfsReadTime(*): 20s947ms - TotalReadThroughput: 82.65 MB/sec Instance 774459bfeec8097d:eb8117dc37ccd4be (host=impala-s3-scale-20.vpc.cloudera.com:22000):(Total: 3s856ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:8/1.74 GB MemoryUsage(500.000ms): 17.33 KB, 85.46 MB, 173.52 MB, 286.34 MB, 306.91 MB, 295.45 MB, 251.75 MB, 102.12 MB ThreadUsage(500.000ms): 1, 9, 9, 8, 8, 8, 8, 5 - AverageThreadTokens: 7.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 315.73 MB (331067136) - PerHostPeakMemUsage: 315.73 MB (331067136) - PrepareTime: 153.000ms - RowsProduced: 1 (1) - TotalCpuTime: 24s901ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.000ms - TotalStorageWaitTime: 11s162ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 38.39 GB (41224884224) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 485.002ms, non-child: 485.002ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 67.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.41 MB (2529296) - NumFunctions: 330 (330) - NumInstructions: 5.69K (5686) - OptimizationTime: 267.001ms - PrepareTime: 151.000ms DataStreamSender (dst_id=2): - BytesSent: 30.00 B (30) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.33 KB (5456) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=1):(Total: 3s853ms, non-child: 197.001ms, % non-child: 5.11%) ExecOption: Codegen Enabled - BuildTime: 43.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.27 MB (1336016) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s656ms, non-child: 3s656ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 8 Hdfs split stats (:<# splits>/): -1:8/1.74 GB Hdfs Read Thread Concurrency Bucket: 0:14.29% 1:14.29% 2:14.29% 3:0% 4:57.14% File Formats: PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 400.00 KB, 68.95 MB, 173.21 MB, 244.39 MB, 299.95 MB, 360.89 MB, 371.48 MB - AverageHdfsReadThreadConcurrency: 5.29 - AverageScannerThreadConcurrency: 6.86 - BytesRead: 371.48 MB (389521211) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 842.005ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 315.71 MB (331041200) - PerReadThreadRawHdfsThroughput: 19.03 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 48.58M (48579367) - RowsReturned: 924.28K (924284) - RowsReturnedRate: 252.81 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 1.78K (1779) - ScannerThreadsTotalWallClockTime: 24s901ms - MaterializeTupleTime(*): 12s815ms - ScannerThreadsSysTime: 60.988ms - ScannerThreadsUserTime: 11s857ms - ScannerThreadsVoluntaryContextSwitches: 105 (105) - TotalRawHdfsReadTime(*): 19s522ms - TotalReadThroughput: 92.87 MB/sec