Query (id=c64658e8e8aa623f:5583aa5cb5227095): Summary: Session ID: 414cb3d7f886f729:3b8c444077253ab9 Session Type: BEESWAX Start Time: 2016-05-26 21:11:19.713555000 End Time: 2016-05-26 21:11:58.410241000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.6.0-cdh5.8.0 RELEASE (build 22bae7b4ea8a217cb10f27be64efbd7fae4000ad) User: root Connected User: root Delegated User: Network Address: ::ffff:172.28.210.187:39797 Default Db: tpch_300_parquet Sql Statement: select * from lineitem_s3 where l_orderkey = 10 Coordinator: impala-s3-3-4xl-2.vpc.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=640.00MB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. tpch_300_parquet.lineitem_s3 01:EXCHANGE [UNPARTITIONED] | hosts=16 per-host-mem=unavailable | tuple-ids=0 row-size=184B cardinality=unavailable | 00:SCAN HDFS [tpch_300_parquet.lineitem_s3, RANDOM] partitions=1/1 files=272 size=63.74GB predicates: l_orderkey = 10 table stats: unavailable column stats: unavailable hosts=16 per-host-mem=640.00MB tuple-ids=0 row-size=184B cardinality=unavailable ---------------- Estimated Per-Host Mem: 671088640 Estimated Per-Host VCores: 1 Tables Missing Stats: tpch_300_parquet.lineitem_s3 Request Pool: root.root Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN HDFS 16 11s291ms 16s624ms 0 -1 5.25 GB 640.00 MB tpch_300_parquet.lineitem_s3 Planner Timeline: 8.553ms - Analysis finished: 1.428ms (1.428ms) - Equivalence classes computed: 1.669ms (241.614us) - Single node plan created: 4.184ms (2.515ms) - Runtime filters computed: 4.207ms (22.315us) - Distributed plan created: 5.710ms (1.502ms) - Lineage info computed: 6.794ms (1.084ms) - Planning finished: 8.553ms (1.759ms) Query Timeline: 38s699ms - Start execution: 0.000ns (0.000ns) - Planning finished: 13.999ms (13.999ms) - Submit for admission: 16.999ms (2.999ms) - Completed admission: 17.999ms (999.986us) - Ready to start 16 remote fragments: 17.999ms (0.000ns) - All 16 remote fragments started: 20.999ms (2.999ms) - Rows available: 38s350ms (38s329ms) - First row fetched: 38s695ms (344.995ms) - Unregister query: 38s696ms (999.988us) ImpalaServer: - ClientFetchWaitTimer: 345.995ms - RowMaterializationTimer: 0.000ns Execution Profile c64658e8e8aa623f:5583aa5cb5227095:(Total: 38s331ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 16, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: impala-s3-3-4xl-15.vpc.cloudera.com:22000(5.15 GB) impala-s3-3-4xl-13.vpc.cloudera.com:22000(2.07 GB) impala-s3-3-4xl-10.vpc.cloudera.com:22000(2.14 GB) impala-s3-3-4xl-17.vpc.cloudera.com:22000(5.25 GB) impala-s3-3-4xl-16.vpc.cloudera.com:22000(2.54 GB) impala-s3-3-4xl-12.vpc.cloudera.com:22000(3.86 GB) impala-s3-3-4xl-14.vpc.cloudera.com:22000(2.21 GB) impala-s3-3-4xl-8.vpc.cloudera.com:22000(4.38 GB) impala-s3-3-4xl-4.vpc.cloudera.com:22000(627.40 MB) impala-s3-3-4xl-9.vpc.cloudera.com:22000(1.11 GB) impala-s3-3-4xl-3.vpc.cloudera.com:22000(5.26 GB) impala-s3-3-4xl-5.vpc.cloudera.com:22000(941.00 MB) impala-s3-3-4xl-7.vpc.cloudera.com:22000(4.30 GB) impala-s3-3-4xl-11.vpc.cloudera.com:22000(4.57 GB) impala-s3-3-4xl-6.vpc.cloudera.com:22000(422.39 MB) impala-s3-3-4xl-2.vpc.cloudera.com:22000(3.41 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 38s328ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 0.000ns - RowsProduced: 0 (0) - TotalCpuTime: 348.995ms - TotalNetworkReceiveTime: 38s328ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38s328ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 38s328ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 11s177ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.95 GB, max: 4.02 GB, avg: 3.98 GB, stddev: 23.42 MB completion times: min:4s797ms max:38s330ms mean: 22s727ms stddev:12s088ms execution rates: min:105.78 MB/sec max:851.81 MB/sec mean:291.02 MB/sec stddev:238.00 MB/sec num instances: 16 - AverageThreadTokens: 22.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.01 GB (3233690985) - PerHostPeakMemUsage: 3.01 GB (3233691497) - PrepareTime: 143.435ms - RowsProduced: 0 (0) - TotalCpuTime: 9m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 5m53s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 171.934ms, non-child: 171.934ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.624ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 27.437ms - PrepareTime: 142.185ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 11s291ms, non-child: 11s291ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 9.46 - AverageScannerThreadConcurrency: 22.06 - BytesRead: 4.00 GB (4290865519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1m6s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 45 (45) - PeakMemoryUsage: 3.01 GB (3226649200) - PerReadThreadRawHdfsThroughput: 20.55 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 112.50M (112499318) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.17K (2167) - ScannerThreadsTotalWallClockTime: 9m24s - MaterializeTupleTime(*): 2m2s - ScannerThreadsSysTime: 9s496ms - ScannerThreadsUserTime: 49s663ms - ScannerThreadsVoluntaryContextSwitches: 105.27K (105269) - TotalRawHdfsReadTime(*): 3m50s - TotalReadThroughput: 179.37 MB/sec Fragment F00: Instance c64658e8e8aa623f:5583aa5cb5227099 (host=impala-s3-3-4xl-7.vpc.cloudera.com:22000):(Total: 16s537ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.95 GB MemoryUsage(1s000ms): 113.36 MB, 427.24 MB, 749.51 MB, 1.01 GB, 1.23 GB, 1.46 GB, 1.62 GB, 1.75 GB, 1.97 GB, 2.21 GB, 2.39 GB, 2.60 GB, 2.77 GB, 2.95 GB, 3.09 GB, 3.22 GB, 3.32 GB, 3.47 GB, 3.54 GB, 3.61 GB, 3.69 GB, 3.83 GB, 3.92 GB, 3.95 GB, 3.95 GB, 4.11 GB, 3.76 GB, 3.43 GB, 3.11 GB, 2.38 GB, 1.72 GB, 599.85 MB ThreadUsage(1s000ms): 48, 48, 48, 48, 48, 48, 48, 48, 44, 33, 27, 26, 25, 25, 25, 25, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 20, 17, 8 - AverageThreadTokens: 30.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.30 GB (4617768032) - PerHostPeakMemUsage: 4.30 GB (4617768032) - PrepareTime: 140.997ms - RowsProduced: 0 (0) - TotalCpuTime: 15m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 11m1s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 168.996ms, non-child: 168.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 999.980us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 26.999ms - PrepareTime: 139.997ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 16s624ms, non-child: 16s624ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.95 GB Hdfs Read Thread Concurrency Bucket: 0:15.62% 1:4.688% 2:0% 3:0% 4:79.69% File Formats: PARQUET/NONE:1664 PARQUET/SNAPPY:400 BytesRead(1s000ms): 51.10 MB, 274.16 MB, 552.97 MB, 797.43 MB, 996.64 MB, 1.17 GB, 1.37 GB, 1.59 GB, 1.78 GB, 1.98 GB, 2.19 GB, 2.38 GB, 2.58 GB, 2.78 GB, 3.02 GB, 3.24 GB, 3.44 GB, 3.69 GB, 3.91 GB, 4.15 GB, 4.39 GB, 4.66 GB, 4.89 GB, 5.14 GB, 5.36 GB, 5.61 GB, 5.74 GB, 5.74 GB, 5.75 GB, 5.75 GB, 5.75 GB, 5.75 GB - AverageHdfsReadThreadConcurrency: 10.66 - AverageScannerThreadConcurrency: 29.39 - BytesRead: 5.75 GB (6177065839) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 4.29 GB (4609313320) - PerReadThreadRawHdfsThroughput: 16.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 162.10M (162099038) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.86K (2864) - ScannerThreadsTotalWallClockTime: 15m37s - MaterializeTupleTime(*): 2m49s - ScannerThreadsSysTime: 13s095ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 141.16K (141161) - TotalRawHdfsReadTime(*): 5m47s - TotalReadThroughput: 184.09 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709f (host=impala-s3-3-4xl-8.vpc.cloudera.com:22000):(Total: 16s390ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.97 GB MemoryUsage(1s000ms): 78.97 MB, 358.97 MB, 620.48 MB, 928.16 MB, 1.16 GB, 1.38 GB, 1.59 GB, 1.84 GB, 2.05 GB, 2.24 GB, 2.47 GB, 2.71 GB, 2.87 GB, 3.03 GB, 3.19 GB, 3.33 GB, 3.42 GB, 3.53 GB, 3.60 GB, 3.69 GB, 3.78 GB, 3.97 GB, 4.07 GB, 4.09 GB, 4.15 GB, 4.18 GB, 3.78 GB, 3.42 GB, 3.04 GB, 2.44 GB, 1.61 GB, 535.70 MB ThreadUsage(1s000ms): 48, 48, 48, 48, 48, 43, 38, 34, 34, 29, 26, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 17, 7 - AverageThreadTokens: 28.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.38 GB (4699519312) - PerHostPeakMemUsage: 4.38 GB (4699519312) - PrepareTime: 143.994ms - RowsProduced: 0 (0) - TotalCpuTime: 14m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9m57s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 172.993ms, non-child: 172.993ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 26.998ms - PrepareTime: 143.994ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 16s496ms, non-child: 16s496ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.97 GB Hdfs Read Thread Concurrency Bucket: 0:20.31% 1:1.562% 2:0% 3:0% 4:78.12% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:368 BytesRead(1s000ms): 27.27 MB, 240.94 MB, 448.42 MB, 718.17 MB, 954.72 MB, 1.14 GB, 1.33 GB, 1.53 GB, 1.74 GB, 1.94 GB, 2.14 GB, 2.36 GB, 2.56 GB, 2.78 GB, 2.99 GB, 3.20 GB, 3.43 GB, 3.66 GB, 3.87 GB, 4.14 GB, 4.38 GB, 4.65 GB, 4.89 GB, 5.12 GB, 5.35 GB, 5.61 GB, 5.70 GB, 5.70 GB, 5.70 GB, 5.70 GB, 5.70 GB, 5.70 GB - AverageHdfsReadThreadConcurrency: 10.80 - AverageScannerThreadConcurrency: 27.89 - BytesRead: 5.70 GB (6122748741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1m14s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 4.37 GB (4691064632) - PerReadThreadRawHdfsThroughput: 16.91 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 160.69M (160692273) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.73K (2735) - ScannerThreadsTotalWallClockTime: 14m42s - MaterializeTupleTime(*): 3m8s - ScannerThreadsSysTime: 11s632ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 128.83K (128834) - TotalRawHdfsReadTime(*): 5m45s - TotalReadThroughput: 182.47 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a6 (host=impala-s3-3-4xl-15.vpc.cloudera.com:22000):(Total: 16s096ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.96 GB MemoryUsage(1s000ms): 80.13 MB, 346.55 MB, 633.28 MB, 947.62 MB, 1.19 GB, 1.40 GB, 1.63 GB, 1.86 GB, 2.04 GB, 2.22 GB, 2.38 GB, 2.59 GB, 2.76 GB, 2.98 GB, 3.17 GB, 3.31 GB, 3.48 GB, 3.64 GB, 3.75 GB, 3.95 GB, 4.02 GB, 4.10 GB, 4.45 GB, 4.62 GB, 4.64 GB, 4.93 GB, 5.03 GB, 4.95 GB, 4.75 GB, 4.55 GB, 4.31 GB, 4.02 GB, 3.72 GB, 3.40 GB, 3.03 GB, 2.61 GB, 1.89 GB, 789.23 MB ThreadUsage(1s000ms): 48, 48, 48, 48, 48, 48, 48, 48, 45, 38, 35, 28, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 24, 19, 9 - AverageThreadTokens: 31.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.15 GB (5528763800) - PerHostPeakMemUsage: 5.15 GB (5528763800) - PrepareTime: 142.999ms - RowsProduced: 0 (0) - TotalCpuTime: 18m56s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 10m45s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 171.999ms, non-child: 171.999ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 999.996us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 27.999ms - PrepareTime: 142.999ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 16s196ms, non-child: 16s196ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.96 GB Hdfs Read Thread Concurrency Bucket: 0:21.05% 1:3.947% 2:2.632% 3:0% 4:72.37% File Formats: PARQUET/NONE:1648 PARQUET/SNAPPY:416 BytesRead(1s000ms): 24.72 MB, 227.80 MB, 470.56 MB, 754.11 MB, 989.26 MB, 1.16 GB, 1.35 GB, 1.56 GB, 1.76 GB, 1.97 GB, 2.17 GB, 2.38 GB, 2.60 GB, 2.79 GB, 2.99 GB, 3.22 GB, 3.40 GB, 3.64 GB, 3.88 GB, 4.12 GB, 4.34 GB, 4.59 GB, 4.82 GB, 5.09 GB, 5.30 GB, 5.53 GB, 5.76 GB, 6.00 GB, 6.12 GB, 6.12 GB, 6.13 GB, 6.17 GB, 6.18 GB, 6.18 GB, 6.19 GB, 6.20 GB, 6.21 GB, 6.21 GB - AverageHdfsReadThreadConcurrency: 9.95 - AverageScannerThreadConcurrency: 30.09 - BytesRead: 6.22 GB (6678813255) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3m16s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 5.14 GB (5520317720) - PerReadThreadRawHdfsThroughput: 16.87 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 175.30M (175304406) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 5.00K (4995) - ScannerThreadsTotalWallClockTime: 18m56s - MaterializeTupleTime(*): 4m22s - ScannerThreadsSysTime: 20s883ms - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 248.28K (248277) - TotalRawHdfsReadTime(*): 6m17s - TotalReadThroughput: 167.62 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a1 (host=impala-s3-3-4xl-12.vpc.cloudera.com:22000):(Total: 15s417ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.97 GB MemoryUsage(500.000ms): 51.78 MB, 180.23 MB, 346.67 MB, 491.01 MB, 647.92 MB, 800.40 MB, 979.80 MB, 1.05 GB, 1.19 GB, 1.29 GB, 1.41 GB, 1.52 GB, 1.66 GB, 1.71 GB, 1.82 GB, 1.89 GB, 1.96 GB, 2.01 GB, 2.14 GB, 2.18 GB, 2.28 GB, 2.39 GB, 2.48 GB, 2.53 GB, 2.63 GB, 2.73 GB, 2.82 GB, 2.91 GB, 3.01 GB, 3.07 GB, 3.19 GB, 3.25 GB, 3.34 GB, 3.40 GB, 3.40 GB, 3.47 GB, 3.53 GB, 3.47 GB, 3.44 GB, 3.52 GB, 3.51 GB, 3.62 GB, 3.74 GB, 3.65 GB, 3.83 GB, 3.73 GB, 3.77 GB, 3.74 GB, 3.65 GB, 3.37 GB, 3.19 GB, 2.95 GB, 2.64 GB, 2.23 GB, 1.83 GB, 1.34 GB, 837.02 MB, 354.50 MB ThreadUsage(500.000ms): 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 35, 33, 29, 25, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 23, 22, 20, 17, 14, 10, 6 - AverageThreadTokens: 27.84 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.86 GB (4146161632) - PerHostPeakMemUsage: 3.86 GB (4146161632) - PrepareTime: 143.002ms - RowsProduced: 0 (0) - TotalCpuTime: 12m59s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9m11s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 171.003ms, non-child: 171.003ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 27.000ms - PrepareTime: 141.002ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 15s524ms, non-child: 15s524ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.97 GB Hdfs Read Thread Concurrency Bucket: 0:17.24% 1:0% 2:0% 3:0% 4:82.76% File Formats: PARQUET/NONE:1712 PARQUET/SNAPPY:352 BytesRead(500.000ms): 1.66 MB, 59.95 MB, 214.96 MB, 340.06 MB, 467.54 MB, 595.30 MB, 747.17 MB, 852.33 MB, 964.84 MB, 1.03 GB, 1.14 GB, 1.24 GB, 1.35 GB, 1.44 GB, 1.56 GB, 1.64 GB, 1.78 GB, 1.86 GB, 1.96 GB, 2.07 GB, 2.17 GB, 2.25 GB, 2.38 GB, 2.45 GB, 2.56 GB, 2.63 GB, 2.77 GB, 2.85 GB, 2.99 GB, 3.10 GB, 3.24 GB, 3.33 GB, 3.47 GB, 3.58 GB, 3.69 GB, 3.79 GB, 3.92 GB, 4.04 GB, 4.16 GB, 4.27 GB, 4.39 GB, 4.53 GB, 4.66 GB, 4.79 GB, 4.88 GB, 5.00 GB, 5.11 GB, 5.24 GB, 5.38 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB, 5.45 GB - AverageHdfsReadThreadConcurrency: 11.38 - AverageScannerThreadConcurrency: 26.84 - BytesRead: 5.45 GB (5857094431) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 44s222ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 22 (22) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 3.86 GB (4140568664) - PerReadThreadRawHdfsThroughput: 16.91 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 153.71M (153706094) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.39K (2389) - ScannerThreadsTotalWallClockTime: 12m59s - MaterializeTupleTime(*): 2m40s - ScannerThreadsSysTime: 9s823ms - ScannerThreadsUserTime: 1m7s - ScannerThreadsVoluntaryContextSwitches: 97.08K (97079) - TotalRawHdfsReadTime(*): 5m30s - TotalReadThroughput: 192.61 MB/sec Instance c64658e8e8aa623f:5583aa5cb5227098 (host=impala-s3-3-4xl-11.vpc.cloudera.com:22000):(Total: 15s139ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.96 GB MemoryUsage(1s000ms): 167.85 MB, 450.30 MB, 815.53 MB, 1.04 GB, 1.24 GB, 1.47 GB, 1.64 GB, 1.86 GB, 2.08 GB, 2.28 GB, 2.51 GB, 2.70 GB, 2.87 GB, 3.09 GB, 3.28 GB, 3.38 GB, 3.42 GB, 3.51 GB, 3.67 GB, 3.84 GB, 4.11 GB, 4.14 GB, 4.32 GB, 4.36 GB, 4.39 GB, 4.43 GB, 4.14 GB, 3.90 GB, 3.61 GB, 3.28 GB, 2.77 GB, 2.15 GB, 1.28 GB ThreadUsage(1s000ms): 48, 48, 48, 48, 42, 36, 32, 31, 28, 26, 26, 26, 26, 26, 26, 26, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 20, 14 - AverageThreadTokens: 28.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.57 GB (4908188760) - PerHostPeakMemUsage: 4.57 GB (4908188760) - PrepareTime: 142.993ms - RowsProduced: 0 (0) - TotalCpuTime: 15m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9m2s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 169.992ms, non-child: 169.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 25.998ms - PrepareTime: 140.994ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 15s240ms, non-child: 15s240ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.96 GB Hdfs Read Thread Concurrency Bucket: 0:19.4% 1:2.985% 2:1.493% 3:0% 4:76.12% File Formats: PARQUET/NONE:1664 PARQUET/SNAPPY:400 BytesRead(1s000ms): 62.34 MB, 329.41 MB, 614.12 MB, 836.15 MB, 1.02 GB, 1.21 GB, 1.44 GB, 1.63 GB, 1.83 GB, 2.04 GB, 2.24 GB, 2.47 GB, 2.65 GB, 2.85 GB, 3.08 GB, 3.31 GB, 3.55 GB, 3.76 GB, 4.01 GB, 4.25 GB, 4.52 GB, 4.76 GB, 5.01 GB, 5.21 GB, 5.46 GB, 5.68 GB, 5.71 GB, 5.71 GB, 5.74 GB, 5.75 GB, 5.75 GB, 5.76 GB, 5.76 GB - AverageHdfsReadThreadConcurrency: 9.88 - AverageScannerThreadConcurrency: 27.00 - BytesRead: 5.76 GB (6180697483) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2m24s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 4.56 GB (4899603176) - PerReadThreadRawHdfsThroughput: 17.67 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 162.19M (162193434) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 3.99K (3990) - ScannerThreadsTotalWallClockTime: 15m9s - MaterializeTupleTime(*): 3m18s - ScannerThreadsSysTime: 17s221ms - ScannerThreadsUserTime: 1m13s - ScannerThreadsVoluntaryContextSwitches: 204.07K (204070) - TotalRawHdfsReadTime(*): 5m33s - TotalReadThroughput: 175.95 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a3 (host=impala-s3-3-4xl-17.vpc.cloudera.com:22000):(Total: 15s075ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.96 GB MemoryUsage(1s000ms): 63.27 MB, 286.90 MB, 567.94 MB, 908.69 MB, 1.13 GB, 1.36 GB, 1.59 GB, 1.81 GB, 2.02 GB, 2.25 GB, 2.47 GB, 2.60 GB, 2.76 GB, 2.99 GB, 3.15 GB, 3.37 GB, 3.53 GB, 3.68 GB, 3.84 GB, 3.95 GB, 4.02 GB, 4.18 GB, 4.42 GB, 4.60 GB, 4.69 GB, 4.96 GB, 4.99 GB, 5.00 GB, 4.96 GB, 4.66 GB, 4.44 GB, 4.20 GB, 3.95 GB, 3.55 GB, 3.25 GB, 2.88 GB, 2.12 GB, 1.14 GB ThreadUsage(1s000ms): 48, 48, 48, 48, 42, 35, 29, 27, 27, 27, 27, 27, 27, 27, 27, 27, 27, 27, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 20, 13 - AverageThreadTokens: 28.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.25 GB (5637893808) - PerHostPeakMemUsage: 5.25 GB (5637893808) - PrepareTime: 141.995ms - RowsProduced: 0 (0) - TotalCpuTime: 17m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9m19s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 169.995ms, non-child: 169.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 25.999ms - PrepareTime: 141.995ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 15s166ms, non-child: 15s166ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.96 GB Hdfs Read Thread Concurrency Bucket: 0:20.78% 1:5.195% 2:2.597% 3:0% 4:71.43% File Formats: PARQUET/NONE:1632 PARQUET/SNAPPY:432 BytesRead(1s000ms): 12.06 MB, 203.16 MB, 428.78 MB, 719.49 MB, 939.70 MB, 1.11 GB, 1.31 GB, 1.53 GB, 1.73 GB, 1.92 GB, 2.13 GB, 2.33 GB, 2.51 GB, 2.72 GB, 2.92 GB, 3.16 GB, 3.38 GB, 3.59 GB, 3.83 GB, 4.05 GB, 4.29 GB, 4.51 GB, 4.75 GB, 5.01 GB, 5.28 GB, 5.50 GB, 5.74 GB, 5.96 GB, 6.16 GB, 6.17 GB, 6.18 GB, 6.22 GB, 6.23 GB, 6.23 GB, 6.24 GB, 6.25 GB, 6.25 GB, 6.25 GB - AverageHdfsReadThreadConcurrency: 9.99 - AverageScannerThreadConcurrency: 27.58 - BytesRead: 6.25 GB (6708640772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3m16s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 5.24 GB (5629439088) - PerReadThreadRawHdfsThroughput: 16.96 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 176.08M (176078819) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 5.16K (5161) - ScannerThreadsTotalWallClockTime: 17m35s - MaterializeTupleTime(*): 4m25s - ScannerThreadsSysTime: 21s673ms - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 272.57K (272572) - TotalRawHdfsReadTime(*): 6m17s - TotalReadThroughput: 166.18 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709c (host=impala-s3-3-4xl-2.vpc.cloudera.com:22000):(Total: 14s998ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.97 GB MemoryUsage(500.000ms): 40.03 MB, 188.94 MB, 325.27 MB, 527.20 MB, 702.35 MB, 845.99 MB, 980.82 MB, 1.02 GB, 1.15 GB, 1.24 GB, 1.34 GB, 1.46 GB, 1.57 GB, 1.69 GB, 1.79 GB, 1.88 GB, 1.95 GB, 2.01 GB, 2.07 GB, 2.23 GB, 2.29 GB, 2.33 GB, 2.37 GB, 2.40 GB, 2.50 GB, 2.54 GB, 2.68 GB, 2.74 GB, 2.82 GB, 2.86 GB, 2.91 GB, 2.96 GB, 2.97 GB, 3.07 GB, 3.13 GB, 3.15 GB, 3.13 GB, 3.21 GB, 3.22 GB, 3.23 GB, 3.25 GB, 3.26 GB, 3.21 GB, 3.20 GB, 3.18 GB, 3.29 GB, 3.27 GB, 3.21 GB, 3.35 GB, 3.32 GB, 2.98 GB, 2.85 GB, 3.03 GB, 2.65 GB, 2.43 GB, 1.99 GB, 1.73 GB, 1.49 GB, 1.10 GB, 948.89 MB, 648.97 MB, 433.65 MB, 284.58 MB ThreadUsage(500.000ms): 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 19, 18, 14, 13, 12, 9, 8, 6, 4, 4 - AverageThreadTokens: 21.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.41 GB (3659021072) - PerHostPeakMemUsage: 3.41 GB (3659029264) - PrepareTime: 145.998ms - RowsProduced: 0 (0) - TotalCpuTime: 10m58s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 6m59s CodeGen:(Total: 173.997ms, non-child: 173.997ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 26.999ms - PrepareTime: 143.998ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 15s106ms, non-child: 15s106ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.97 GB Hdfs Read Thread Concurrency Bucket: 0:4.762% 1:1.587% 2:4.762% 3:4.762% 4:84.13% File Formats: PARQUET/NONE:1648 PARQUET/SNAPPY:416 BytesRead(500.000ms): 1000.00 KB, 89.21 MB, 197.51 MB, 357.52 MB, 512.21 MB, 646.03 MB, 744.69 MB, 871.55 MB, 965.48 MB, 1.06 GB, 1.15 GB, 1.24 GB, 1.35 GB, 1.46 GB, 1.55 GB, 1.67 GB, 1.78 GB, 1.87 GB, 1.99 GB, 2.10 GB, 2.21 GB, 2.32 GB, 2.43 GB, 2.52 GB, 2.62 GB, 2.74 GB, 2.83 GB, 2.97 GB, 3.10 GB, 3.22 GB, 3.28 GB, 3.41 GB, 3.51 GB, 3.61 GB, 3.75 GB, 3.88 GB, 3.94 GB, 4.05 GB, 4.18 GB, 4.31 GB, 4.41 GB, 4.53 GB, 4.65 GB, 4.75 GB, 4.90 GB, 5.01 GB, 5.15 GB, 5.25 GB, 5.35 GB, 5.49 GB, 5.60 GB, 5.70 GB, 5.79 GB, 5.91 GB, 5.99 GB, 6.02 GB, 6.04 GB, 6.05 GB, 6.07 GB, 6.11 GB, 6.16 GB, 6.20 GB, 6.22 GB - AverageHdfsReadThreadConcurrency: 11.67 - AverageScannerThreadConcurrency: 20.87 - BytesRead: 6.22 GB (6681065701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51s769ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.40 GB (3650558048) - PerReadThreadRawHdfsThroughput: 17.51 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 175.37M (175366590) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.94K (2939) - ScannerThreadsTotalWallClockTime: 10m58s - MaterializeTupleTime(*): 2m56s - ScannerThreadsSysTime: 11s376ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 110.48K (110476) - TotalRawHdfsReadTime(*): 6m3s - TotalReadThroughput: 202.27 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709b (host=impala-s3-3-4xl-3.vpc.cloudera.com:22000):(Total: 14s965ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.97 GB MemoryUsage(1s000ms): 42.75 MB, 316.95 MB, 627.69 MB, 940.30 MB, 1.15 GB, 1.36 GB, 1.52 GB, 1.75 GB, 1.97 GB, 2.19 GB, 2.35 GB, 2.56 GB, 2.79 GB, 2.97 GB, 3.17 GB, 3.37 GB, 3.57 GB, 3.72 GB, 3.85 GB, 3.94 GB, 4.16 GB, 4.09 GB, 4.38 GB, 4.45 GB, 4.67 GB, 4.82 GB, 4.97 GB, 5.15 GB, 4.70 GB, 4.45 GB, 4.18 GB, 3.93 GB, 3.67 GB, 3.26 GB, 2.56 GB, 1.95 GB, 929.06 MB ThreadUsage(1s000ms): 24, 48, 48, 48, 46, 40, 34, 31, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 25, 22, 20, 11 - AverageThreadTokens: 28.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.26 GB (5650763576) - PerHostPeakMemUsage: 5.26 GB (5650763576) - PrepareTime: 143.996ms - RowsProduced: 0 (0) - TotalCpuTime: 16m55s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 8m59s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 174.996ms, non-child: 174.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 28.999ms - PrepareTime: 142.996ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 15s068ms, non-child: 15s068ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.97 GB Hdfs Read Thread Concurrency Bucket: 0:20.55% 1:5.479% 2:0% 3:0% 4:73.97% File Formats: PARQUET/NONE:1664 PARQUET/SNAPPY:400 BytesRead(1s000ms): 58.63 MB, 317.79 MB, 626.86 MB, 843.43 MB, 1.03 GB, 1.24 GB, 1.43 GB, 1.64 GB, 1.83 GB, 2.03 GB, 2.23 GB, 2.43 GB, 2.65 GB, 2.83 GB, 3.05 GB, 3.28 GB, 3.52 GB, 3.76 GB, 3.97 GB, 4.19 GB, 4.43 GB, 4.68 GB, 4.92 GB, 5.19 GB, 5.41 GB, 5.64 GB, 5.87 GB, 6.10 GB, 6.12 GB, 6.12 GB, 6.15 GB, 6.18 GB, 6.18 GB, 6.19 GB, 6.19 GB, 6.20 GB - AverageHdfsReadThreadConcurrency: 10.49 - AverageScannerThreadConcurrency: 27.71 - BytesRead: 6.20 GB (6653919520) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3m4s - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 5.25 GB (5642369488) - PerReadThreadRawHdfsThroughput: 17.00 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 174.67M (174665745) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 5.29K (5290) - ScannerThreadsTotalWallClockTime: 16m55s - MaterializeTupleTime(*): 4m22s - ScannerThreadsSysTime: 20s095ms - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 242.68K (242684) - TotalRawHdfsReadTime(*): 6m13s - TotalReadThroughput: 173.85 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a2 (host=impala-s3-3-4xl-16.vpc.cloudera.com:22000):(Total: 9s634ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/4.02 GB MemoryUsage(500.000ms): 5.59 MB, 147.98 MB, 246.52 MB, 385.02 MB, 545.85 MB, 686.79 MB, 810.58 MB, 957.28 MB, 1.09 GB, 1.19 GB, 1.24 GB, 1.36 GB, 1.46 GB, 1.52 GB, 1.61 GB, 1.65 GB, 1.73 GB, 1.87 GB, 1.93 GB, 2.02 GB, 2.05 GB, 2.14 GB, 2.17 GB, 2.13 GB, 2.19 GB, 2.24 GB, 2.20 GB, 2.45 GB, 2.22 GB, 2.09 GB, 1.86 GB, 1.63 GB, 1.26 GB, 760.75 MB, 271.57 MB ThreadUsage(500.000ms): 48, 48, 48, 48, 48, 48, 48, 48, 42, 37, 36, 24, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 12, 8, 4 - AverageThreadTokens: 23.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.54 GB (2726304328) - PerHostPeakMemUsage: 2.54 GB (2726304328) - PrepareTime: 146.997ms - RowsProduced: 0 (0) - TotalCpuTime: 6m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4m48s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 177.996ms, non-child: 177.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 29.999ms - PrepareTime: 145.997ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 9s754ms, non-child: 9s754ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/4.02 GB Hdfs Read Thread Concurrency Bucket: 0:17.14% 1:0% 2:2.857% 3:0% 4:80% File Formats: PARQUET/NONE:1824 PARQUET/SNAPPY:240 BytesRead(500.000ms): 0, 44.14 MB, 168.90 MB, 228.52 MB, 353.12 MB, 478.08 MB, 594.45 MB, 732.13 MB, 918.77 MB, 1021.41 MB, 1.10 GB, 1.22 GB, 1.29 GB, 1.42 GB, 1.55 GB, 1.62 GB, 1.70 GB, 1.83 GB, 1.94 GB, 2.06 GB, 2.18 GB, 2.31 GB, 2.44 GB, 2.54 GB, 2.67 GB, 2.80 GB, 2.89 GB, 3.02 GB, 3.16 GB, 3.26 GB, 3.28 GB, 3.28 GB, 3.28 GB, 3.28 GB, 3.28 GB - AverageHdfsReadThreadConcurrency: 10.29 - AverageScannerThreadConcurrency: 22.63 - BytesRead: 3.28 GB (3525790448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 18s222ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 15 (15) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 2.53 GB (2717849560) - PerReadThreadRawHdfsThroughput: 18.37 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 92.37M (92365398) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 855 (855) - ScannerThreadsTotalWallClockTime: 6m27s - MaterializeTupleTime(*): 1m2s - ScannerThreadsSysTime: 5s274ms - ScannerThreadsUserTime: 39s427ms - ScannerThreadsVoluntaryContextSwitches: 52.65K (52647) - TotalRawHdfsReadTime(*): 3m2s - TotalReadThroughput: 192.14 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a0 (host=impala-s3-3-4xl-14.vpc.cloudera.com:22000):(Total: 9s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/4.02 GB MemoryUsage(500.000ms): 5.59 MB, 99.19 MB, 252.46 MB, 414.34 MB, 526.93 MB, 645.50 MB, 846.21 MB, 1.01 GB, 1.07 GB, 1.18 GB, 1.29 GB, 1.44 GB, 1.54 GB, 1.67 GB, 1.73 GB, 1.83 GB, 1.91 GB, 1.86 GB, 1.95 GB, 1.96 GB, 2.01 GB, 2.11 GB, 2.20 GB, 2.14 GB, 2.06 GB, 2.11 GB, 2.07 GB, 1.90 GB, 1.69 GB, 1.27 GB, 971.64 MB, 570.30 MB ThreadUsage(500.000ms): 48, 48, 45, 40, 21, 16, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 8 - AverageThreadTokens: 17.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.21 GB (2373141504) - PerHostPeakMemUsage: 2.21 GB (2373141504) - PrepareTime: 145.003ms - RowsProduced: 0 (0) - TotalCpuTime: 4m18s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2m38s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 173.003ms, non-child: 173.003ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 27.000ms - PrepareTime: 143.003ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 9s301ms, non-child: 9s301ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/4.02 GB Hdfs Read Thread Concurrency Bucket: 0:15.62% 1:3.125% 2:0% 3:3.125% 4:78.12% File Formats: PARQUET/NONE:1872 PARQUET/SNAPPY:192 BytesRead(500.000ms): 1000.00 KB, 49.47 MB, 130.77 MB, 255.71 MB, 385.06 MB, 497.14 MB, 654.22 MB, 828.77 MB, 904.40 MB, 1012.50 MB, 1.07 GB, 1.17 GB, 1.30 GB, 1.41 GB, 1.52 GB, 1.64 GB, 1.74 GB, 1.85 GB, 1.98 GB, 2.07 GB, 2.21 GB, 2.34 GB, 2.49 GB, 2.60 GB, 2.72 GB, 2.83 GB, 2.95 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB - AverageHdfsReadThreadConcurrency: 10.22 - AverageScannerThreadConcurrency: 16.12 - BytesRead: 2.98 GB (3200781461) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 16s813ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 2.20 GB (2364416552) - PerReadThreadRawHdfsThroughput: 18.81 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 83.84M (83839709) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 960 (960) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 57s253ms - ScannerThreadsSysTime: 4s871ms - ScannerThreadsUserTime: 35s934ms - ScannerThreadsVoluntaryContextSwitches: 50.55K (50555) - TotalRawHdfsReadTime(*): 2m42s - TotalReadThroughput: 190.78 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a4 (host=impala-s3-3-4xl-10.vpc.cloudera.com:22000):(Total: 9s053ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/4.01 GB MemoryUsage(500.000ms): 5.59 MB, 177.93 MB, 296.65 MB, 474.71 MB, 575.27 MB, 742.38 MB, 882.00 MB, 1.01 GB, 1.14 GB, 1.22 GB, 1.33 GB, 1.46 GB, 1.53 GB, 1.62 GB, 1.74 GB, 1.73 GB, 1.80 GB, 1.87 GB, 1.92 GB, 1.96 GB, 2.02 GB, 2.03 GB, 2.04 GB, 2.07 GB, 2.06 GB, 2.09 GB, 2.07 GB, 1.83 GB, 1.56 GB, 1.24 GB, 831.89 MB, 175.16 MB ThreadUsage(500.000ms): 48, 48, 48, 48, 46, 42, 38, 30, 14, 14, 14, 14, 14, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 3 - AverageThreadTokens: 20.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.14 GB (2294880160) - PerHostPeakMemUsage: 2.14 GB (2294880160) - PrepareTime: 141.994ms - RowsProduced: 0 (0) - TotalCpuTime: 5m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 3m37s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 168.993ms, non-child: 168.993ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 25.999ms - PrepareTime: 139.994ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 9s177ms, non-child: 9s177ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/4.01 GB Hdfs Read Thread Concurrency Bucket: 0:15.62% 1:3.125% 2:0% 3:0% 4:81.25% File Formats: PARQUET/NONE:1856 PARQUET/SNAPPY:208 BytesRead(500.000ms): 100.00 KB, 71.62 MB, 194.61 MB, 328.95 MB, 404.37 MB, 564.26 MB, 680.69 MB, 809.96 MB, 935.64 MB, 1.01 GB, 1.12 GB, 1.26 GB, 1.33 GB, 1.43 GB, 1.55 GB, 1.65 GB, 1.77 GB, 1.88 GB, 1.98 GB, 2.08 GB, 2.24 GB, 2.35 GB, 2.50 GB, 2.62 GB, 2.71 GB, 2.86 GB, 2.96 GB, 3.01 GB, 3.01 GB, 3.01 GB, 3.01 GB, 3.01 GB - AverageHdfsReadThreadConcurrency: 10.44 - AverageScannerThreadConcurrency: 19.38 - BytesRead: 3.01 GB (3228015651) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 16s506ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 2.13 GB (2286425584) - PerReadThreadRawHdfsThroughput: 18.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 84.54M (84544938) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1013) - ScannerThreadsTotalWallClockTime: 5m11s - MaterializeTupleTime(*): 56s287ms - ScannerThreadsSysTime: 4s781ms - ScannerThreadsUserTime: 36s231ms - ScannerThreadsVoluntaryContextSwitches: 48.09K (48092) - TotalRawHdfsReadTime(*): 2m45s - TotalReadThroughput: 192.40 MB/sec Instance c64658e8e8aa623f:5583aa5cb52270a5 (host=impala-s3-3-4xl-13.vpc.cloudera.com:22000):(Total: 8s913ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/4.01 GB MemoryUsage(500.000ms): 8.63 KB, 114.34 MB, 265.35 MB, 396.60 MB, 516.78 MB, 688.74 MB, 876.97 MB, 1.01 GB, 1.14 GB, 1.18 GB, 1.28 GB, 1.30 GB, 1.39 GB, 1.45 GB, 1.50 GB, 1.61 GB, 1.75 GB, 1.85 GB, 1.85 GB, 1.92 GB, 1.93 GB, 2.00 GB, 2.01 GB, 1.98 GB, 2.01 GB, 1.98 GB, 1.99 GB, 1.74 GB, 1.54 GB, 1.24 GB, 918.35 MB, 365.56 MB, 92.39 MB ThreadUsage(500.000ms): 1, 48, 48, 48, 48, 48, 48, 48, 36, 32, 23, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 9, 4, 2 - AverageThreadTokens: 20.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.07 GB (2222281224) - PerHostPeakMemUsage: 2.07 GB (2222281224) - PrepareTime: 140.996ms - RowsProduced: 0 (0) - TotalCpuTime: 5m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4m8s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 168.996ms, non-child: 168.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 999.978us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 26.999ms - PrepareTime: 140.996ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 9s030ms, non-child: 9s030ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/4.01 GB Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:6.25% 2:0% 3:0% 4:81.25% File Formats: PARQUET/NONE:1856 PARQUET/SNAPPY:208 BytesRead(500.000ms): 0, 13.09 MB, 139.31 MB, 254.33 MB, 371.61 MB, 505.45 MB, 666.18 MB, 814.94 MB, 913.76 MB, 1.00 GB, 1.08 GB, 1.20 GB, 1.33 GB, 1.42 GB, 1.48 GB, 1.61 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.08 GB, 2.19 GB, 2.30 GB, 2.43 GB, 2.53 GB, 2.66 GB, 2.79 GB, 2.92 GB, 2.97 GB, 2.99 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.01 GB - AverageHdfsReadThreadConcurrency: 10.22 - AverageScannerThreadConcurrency: 20.47 - BytesRead: 3.01 GB (3229768831) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 17s252ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 2.06 GB (2213826528) - PerReadThreadRawHdfsThroughput: 18.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 84.59M (84589763) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 848 (848) - ScannerThreadsTotalWallClockTime: 5m41s - MaterializeTupleTime(*): 56s642ms - ScannerThreadsSysTime: 4s881ms - ScannerThreadsUserTime: 35s885ms - ScannerThreadsVoluntaryContextSwitches: 49.38K (49376) - TotalRawHdfsReadTime(*): 2m43s - TotalReadThroughput: 186.68 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709d (host=impala-s3-3-4xl-9.vpc.cloudera.com:22000):(Total: 5s033ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.99 GB MemoryUsage(500.000ms): 0, 36.22 MB, 187.36 MB, 271.96 MB, 399.53 MB, 572.70 MB, 769.77 MB, 917.61 MB, 974.20 MB, 1.01 GB, 1.07 GB, 1.06 GB, 1.07 GB, 1.04 GB, 899.67 MB, 653.24 MB, 187.15 MB ThreadUsage(500.000ms): 1, 48, 48, 48, 44, 24, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 3 - AverageThreadTokens: 16.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1186871520) - PerHostPeakMemUsage: 1.11 GB (1186871520) - PrepareTime: 142.996ms - RowsProduced: 0 (0) - TotalCpuTime: 2m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1m36s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 169.995ms, non-child: 169.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 999.976us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 26.999ms - PrepareTime: 140.996ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 5s163ms, non-child: 5s163ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.99 GB Hdfs Read Thread Concurrency Bucket: 0:12.5% 1:6.25% 2:6.25% 3:6.25% 4:68.75% File Formats: PARQUET/NONE:1952 PARQUET/SNAPPY:112 BytesRead(500.000ms): 12.05 MB, 68.77 MB, 176.80 MB, 302.30 MB, 462.03 MB, 611.74 MB, 728.07 MB, 864.81 MB, 986.84 MB, 1.10 GB, 1.24 GB, 1.35 GB, 1.46 GB, 1.49 GB, 1.52 GB, 1.52 GB - AverageHdfsReadThreadConcurrency: 8.50 - AverageScannerThreadConcurrency: 16.81 - BytesRead: 1.52 GB (1633428879) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6s033ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 1.10 GB (1179757664) - PerReadThreadRawHdfsThroughput: 22.99 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 42.60M (42603716) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 372 (372) - ScannerThreadsTotalWallClockTime: 2m16s - MaterializeTupleTime(*): 18s328ms - ScannerThreadsSysTime: 2s379ms - ScannerThreadsUserTime: 17s311ms - ScannerThreadsVoluntaryContextSwitches: 19.68K (19678) - TotalRawHdfsReadTime(*): 1m7s - TotalReadThroughput: 194.72 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709a (host=impala-s3-3-4xl-5.vpc.cloudera.com:22000):(Total: 4s267ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.99 GB MemoryUsage(500.000ms): 5.59 MB, 202.33 MB, 284.68 MB, 391.71 MB, 526.21 MB, 678.14 MB, 866.45 MB, 924.85 MB, 889.45 MB, 873.11 MB, 845.12 MB, 691.71 MB, 330.64 MB ThreadUsage(500.000ms): 48, 48, 48, 8, 7, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 15.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 941.00 MB (986710856) - PerHostPeakMemUsage: 941.00 MB (986710856) - PrepareTime: 146.997ms - RowsProduced: 0 (0) - TotalCpuTime: 1m36s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 59s919ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 177.996ms, non-child: 177.996ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 28.999ms - PrepareTime: 145.997ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 4s408ms, non-child: 4s408ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.99 GB Hdfs Read Thread Concurrency Bucket: 0:7.692% 1:0% 2:15.38% 3:0% 4:76.92% File Formats: PARQUET/NONE:1968 PARQUET/SNAPPY:96 BytesRead(500.000ms): 300.00 KB, 89.04 MB, 200.44 MB, 323.51 MB, 436.27 MB, 603.84 MB, 755.89 MB, 878.41 MB, 1.00 GB, 1.10 GB, 1.19 GB, 1.24 GB, 1.27 GB - AverageHdfsReadThreadConcurrency: 8.08 - AverageScannerThreadConcurrency: 14.77 - BytesRead: 1.27 GB (1363819442) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4s353ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 938.89 MB (984499248) - PerReadThreadRawHdfsThroughput: 26.24 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 35.51M (35512254) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 160 (160) - ScannerThreadsTotalWallClockTime: 1m36s - MaterializeTupleTime(*): 13s328ms - ScannerThreadsSysTime: 1s883ms - ScannerThreadsUserTime: 13s831ms - ScannerThreadsVoluntaryContextSwitches: 13.00K (13000) - TotalRawHdfsReadTime(*): 49s572ms - TotalReadThroughput: 200.10 MB/sec Instance c64658e8e8aa623f:5583aa5cb522709e (host=impala-s3-3-4xl-4.vpc.cloudera.com:22000):(Total: 4s126ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/4.00 GB MemoryUsage(500.000ms): 8.63 KB, 95.78 MB, 195.46 MB, 329.95 MB, 454.73 MB, 582.53 MB, 602.93 MB, 525.43 MB, 400.64 MB, 249.57 MB, 99.88 MB ThreadUsage(500.000ms): 1, 48, 48, 19, 5, 4, 4, 4, 4, 3, 2 - AverageThreadTokens: 12.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 627.40 MB (657881200) - PerHostPeakMemUsage: 627.40 MB (657881200) - PrepareTime: 143.001ms - RowsProduced: 0 (0) - TotalCpuTime: 1m20s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 48s576ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 170.002ms, non-child: 170.002ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 27.000ms - PrepareTime: 141.001ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 4s265ms, non-child: 4s265ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/4.00 GB Hdfs Read Thread Concurrency Bucket: 0:10% 1:20% 2:20% 3:0% 4:50% File Formats: PARQUET/NONE:2016 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 4.78 MB, 115.35 MB, 218.79 MB, 311.94 MB, 536.85 MB, 663.20 MB, 702.29 MB, 729.20 MB, 758.88 MB, 772.55 MB - AverageHdfsReadThreadConcurrency: 5.10 - AverageScannerThreadConcurrency: 13.10 - BytesRead: 772.55 MB (810081053) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2s149ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 624.29 MB (654620496) - PerReadThreadRawHdfsThroughput: 31.58 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 20.96M (20959429) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 59 (59) - ScannerThreadsTotalWallClockTime: 1m20s - MaterializeTupleTime(*): 6s344ms - ScannerThreadsSysTime: 1s166ms - ScannerThreadsUserTime: 7s112ms - ScannerThreadsVoluntaryContextSwitches: 3.59K (3588) - TotalRawHdfsReadTime(*): 24s462ms - TotalReadThroughput: 140.46 MB/sec Instance c64658e8e8aa623f:5583aa5cb5227097 (host=impala-s3-3-4xl-6.vpc.cloudera.com:22000):(Total: 4s008ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:129/3.99 GB MemoryUsage(500.000ms): 5.59 MB, 47.46 MB, 136.08 MB, 272.71 MB, 408.83 MB, 388.92 MB, 371.08 MB, 344.60 MB, 216.60 MB ThreadUsage(500.000ms): 48, 48, 5, 4, 3, 3, 3, 3, 3 - AverageThreadTokens: 13.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 422.39 MB (442904984) - PerHostPeakMemUsage: 422.39 MB (442904984) - PrepareTime: 140.999ms - RowsProduced: 0 (0) - TotalCpuTime: 53s017ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 27s260ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.91 GB (82583052288) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 169.999ms, non-child: 169.999ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 999.997us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2217924) - NumFunctions: 5 (5) - NumInstructions: 71 (71) - OptimizationTime: 28.999ms - PrepareTime: 138.999ms DataStreamSender (dst_id=1): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 648.00 B (648) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 4s137ms, non-child: 4s137ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 129 Hdfs split stats (:<# splits>/): -1:129/3.99 GB Hdfs Read Thread Concurrency Bucket: 0:22.22% 1:22.22% 2:11.11% 3:11.11% 4:33.33% File Formats: PARQUET/NONE:2000 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 23.63 MB, 65.96 MB, 216.11 MB, 403.02 MB, 467.02 MB, 501.94 MB, 552.54 MB, 574.22 MB - AverageHdfsReadThreadConcurrency: 3.67 - AverageScannerThreadConcurrency: 12.33 - BytesRead: 574.22 MB (602116800) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s434ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 421.29 MB (441757432) - PerReadThreadRawHdfsThroughput: 36.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.47M (15467485) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 47 (47) - ScannerThreadsTotalWallClockTime: 53s017ms - MaterializeTupleTime(*): 4s380ms - ScannerThreadsSysTime: 902.861ms - ScannerThreadsUserTime: 4s950ms - ScannerThreadsVoluntaryContextSwitches: 2.23K (2225) - TotalRawHdfsReadTime(*): 15s681ms - TotalReadThroughput: 127.61 MB/sec